Balanced Scorecard and Efficiency: Design and Empirical Validation of a Strategic Map in the University by Means of DEA

Teresa García Valderrama, Vanesa Rodríguez Cornejo, Daniel Revuelta Bordoy

Departmentof Finance and Accounting, University of Cádiz, Cádiz, Spain.

DOI: 10.4236/ajor.2013.31003                

Abstract

The principal objective of the research reported in this article is to validate a Balanced Scorecard (BSC) model and a Strategic Map for the University by studying the relationships of efficiency between its dimensions. Subsequently, the validation is completed by establishing hypotheses of efficiency relationships between the perspectives proposed, employing Data Envelopment Analysis (DEA). Empirical evidence has been obtained on the validity of the proposed BSC for a unit of academic management in the university. The first contribution of this work is the establishment of a framework of analysis of the hypothetical cause-effect relationships in the BSC in university institutions. The second contribution is to obtain the determining factors of the performance in this type of institution and, therefore, the Strategic Map. Specifically, these factors are: the participation of teaching staff in innovation activities; the number of doctorate-level staff; the academic subjects and credits in the Virtual Campus; and the scores in the surveys of student satisfaction. With respect to research, the determining factors of the performance are: the research sexennials; the funding obtained from contracts with companies; the number of research projects obtained; their financing; and the participation of teachers in these projects.

Keywords

Balanced Scorecard; Efficiency; Data Envelopment Analysis; University

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1]	A. García-Aracil and D. Palomares-Montero, “Indicadores Para la Evaluación de Las Instituciones Universitarias: Validación a Través del Método Delphi,” Revista Espanola de Documentación Científica, Vol. 35, No 1, 2012, pp. 119-144. doi:10.3989/redc.2012.1.863
[2]	W. J. Spencer and D. D. Triant, “Strengthening the Link between R & D and Corporate Strategy,” The Journal of Business Strategy, Vol. 10, No. 1, 1989, pp. 38-42. doi:10.1108/eb039281
[3]	S. Kivisaari, “Management of Innovation in the Modern Corporation: Dilemmas in the Corporate Control of R & D,” Scandinavian Journal of Management, Vol. 7, No. 3, 1991, pp. 219-228. doi:10.1016/0956-5221(91)90035-Y
[4]	Z. Liao and P. F. Greenfield, “The Synergy or Corporate R & D and Competitive Strategies: A Exploration Study in Australian High-Technology Companies,” The Journal of High Technology Management Research, Vol. 11, No. 1, 2000, pp. 93-107. doi:10.1016/S1047-8310(00)00025-0
[5]	A. W. Pearson, W. Nixon and I. C. Kerssens-Van Drongelen, “R & D as a Business—What Are the Implications for Performance Measurement?” R & D Management, Vol. 30, No. 4, 2000, pp. 355-364. doi:10.1111/1467-9310.00190
[6]	J. W. Tipping, E. Zeffren and A. Fusteld, “Assessing the Value of Your Technology,” Research Technology Management, Vol. 38, No. 5, 1989, pp. 22-31.
[7]	B. M. Werner and W. E. Souder, “Measuring R & D Performance—State of the Art,” Research Technology Management, Vol. 40, No. 2, 1997, pp. 34-43.
[8]	G. A. Neufeld, P. A. Simeoni and M. A. Taylor, “High-Performance Research Organizations,” Research Technology Management, Vol. 44, No. 6, 2001, pp. 42-52.
[9]	R. S. Kaplan and D. P. Norton, “The Balanced Scorecard for Public-Sector Organizations,” Harvard Business School Publishing, Boston, 1999.
[10]	G. Li and D. Dalton, “Balanced Scorecard for I + D,” Pharmaceutical Executive, Vol. 23, No. 10, 2003, pp. 84-90.
[11]	O. Amat and P. Soldevilla, “La Aplicación del Cuadro de Mando Integral. Un Ejemplo en la Unidad de Relaciones Internacionales de una Universidad,” Auditoría Pública, Vol. 17, No. 2, 1999, pp. 40-45.
[12]	S. M. Young, “Implementing Management Innovations Successfully: Principles for Lasting Change,” Journal of Cost Management, Vol. 11, No. 5, 1997, pp. 16-20.
[13]	A. M. Zbinden, “Introducing a Balanced Scorecard Management System in a University Anesthesiology Department,” Anesthesia & Analgesia, Vol. 95, No. 6, 2002, pp. 1731-1738. doi:10.1097/00000539-200212000-00049
[14]	S. Johnson, “EFQM and Balanced Scorecard for Improving Organizational Performance. A Research Report,” 2004. http://www.som.cranfield.ac.uk/som/cbp/pma/Balanced%20Scorecard%20and%20EFQM.pdf
[15]	J. Cullen, J. Joyce, J. Hassall and M. Broadbent, “Quality in higher education: from monitoring to management”, Quality Assurance in Education Vol. 11, No. 1, 2003;pp. 5-14. doi:10.1108/09684880310462038
[16]	H. Rohm, “Improve Public Sector Results with a Balanced Scorecard: Nine Steps to Success,” The Balanced Scorecard Institute, 2003.
[17]	J. Cáceres and M. J. González, “Hacia una Gestión Estratégica de los Departamentos Universitarios: Propuesta de un Cuadro de Mando Integral,” Auditoría Pública, Vol. 35, No. 1, 2005, pp. 55-72.
[18]	University of California San Diego, “A University Business Model Based on the Balanced Scorecard 1999, Mexico/USA University Discussion,” 2006. http://www-vcba.ucsd.edu/mexico-usa/sld026.htm
[19]	O. Amat and P. Soldevilla, “Optimización del Control de Gestión en las Universidades Públicas con el Cuadro de Mando Integral,” 2012.
[20]	Universitat Jaume I, “El Cuadre de Comandament Instituciona,” 2000. http://www.uji.es/bin/infoinst/projectes/peuji/pdf/cap3.pdf
[21]	Acuerdo de 10 de Julio de 2007, del Consejo de Gobierno, por el que se aprueba elModelos de Financiación de las Universidades Públicas de Andalucía, (2007-2011). http://departamentos.uca.es/C112/convocatorias/contratoprograma2008/documentotecnico2007
[22]	J. Johnes and J. Taylor, “Performance Indicator in Higher Education,” SRHE, Open University Press, Buckingham, 1990.
[23]	R. Nowaczyk and D. Underwood, “Possible Indicators of Research Quality for College and Universities,” Educational Policy Analysis Archives, Vol. 3, No. 20, 1995, p. 830.
[24]	J. Vidal, “Indicadores en la Universidad: Información y Decisiones,” Consejo de Universidades, Madrid, 1999.
[25]	S. Gattoufi, M. Oral and A. Reisman, “A Data Envelopment Analysis: A bibliography Update (1951-2001),” Socio-Economic Planning Sciences, Vol. 38, No. 2-3, 2004, pp. 159-229.
[26]	S. Thore and G. Rich, “Prioritizing a Portfolio of R & D Activities, Employing Data Envelopment Analysis,” In: S. Thore, Ed., Technology Commercialization: DEA and Related Analytical Methods for Evaluating the Use and Implementation of Technical Innovation, Kluwer Academic Publishers, Boston, 2002, pp. 53-74. doi:10.1007/s00122-002-0978-1
[27]	S. Thore and L. Lapao, “Prioritizing R & D Projects in the Face of Technological and Market Uncertainty: Combining Scenario Analysis and DEA,” In: S. Thore, Ed., Technology Commercialization: DEA and Related Analytical Methods for Evaluating the Use and Implementation of Technical Innovation, Kluwer Academic Publishers, Boston, 2002, pp. 87-104.
[28]	J. D. Linton and S. T. Walsh and J. Morabito, “Analysis, Ranking and Selection of R & D Projects in a Portfolio,” R & D Management, Vol. 32, No. 2, 2002, pp. 139-148. doi:10.1111/1467-9310.00246
[29]	W. D. Cook and R. H. Green, “Project Prioritization: A Resource-Constrained Data Envelopment Analysis Approach,” Socio-Economic Planning Sciences, Vol. 34, No. 2, 2000, pp. 85-99. doi:10.1016/S0038-0121(99)00020-8
[30]	T. G. Valderrama and T. Groot, “Controlling the Efficiency of University Research in the Netherlands,” In: S. Thore, Ed., Technology Commercialization: DEA and Related Analytical Methods for Evaluating the Use and Implementation of Technical Innovation, Kluwer Academic Publishers, Boston, 2002, pp. 147-182.
[31]	P. Korhonen, R. Tainio and J. Wallenius, “Value Efficiency Analysis of Academic Research,” European Journal of Operational Research, Vol. 130, No. 1, 2001, pp. 121-132. doi:10.1016/S0377-2217(00)00050-3
[32]	N. Avkiran, “Investigating Technical and Scale Efficiencies of Australian Universities through Data Envelopment Analysis,” Socio-Economic Planning Science, Vol. 35, No. 1, 2001, pp. 57-80. doi:10.1016/S0038-0121(00)00010-0
[33]	R. C. Rickards, “Setting Benchmarks and Evaluating Balanced Scorecards with Data Envelopment Analysis,” Benchmarking, Vol. 10, No. 3, 2003, pp. 226-246. doi:10.1108/14635770310477762
[34]	T. G. Valderrama, E. MuleroMendigorri and D. R. Bordoy, “Relating the Perspectives of the Balanced Scorecard for R & D by Means of DEA,” European Journal of Operational Research, Vol. 196, No. 3, 2009, pp. 1177-1189.
[35]	A. H. C. Tsang, A. Jardine and H. Kolodny, “Measuring Maintenance Performance: A Holistic Approach,” International Journal of Operations & Production Management, Vol. 19, No. 7, 1999, pp. 691-715. doi:10.1108/01443579910271674
[36]	P. Rouse, M. Putterill and D. Ryan, “Integrated Performance Measurement Design: Insights from an Application in Aircraft Maintenance,” Management Accounting Research, Vol. 13, No. 2, 2002, pp. 229-248. doi:10.1006/mare.2002.0180
[37]	R. D. Banker, H. Chang, S. N. Janakiraman and C. A. Konstans, “Balanced Scorecard Analysis of Performance Metrics,” European Journal of Operational Research, Vol. 154, No. 2, 2004, pp. 423-436. doi:10.1016/S0377-2217(03)00179-6
[38]	T. Y. Chen and L. H. Chen, “DEA Performance Evaluation Based on BSC Indicators Incorporated: The Case of Semiconductor Industry,” International Journal of Productivity and Performance Management, Vol. 56, No. 4, 2007, pp. 335-357. doi:10.1108/17410400710745333
[39]	I. Van der Weijden, D. De Gilder, P. Groenewegen and E. Klasen, “Implications of Managerial Control on Performance of Dutch Academic (Bio)medical and Health Research Groups,” Research Policy, Vol. 37, No. 7, 2008, pp. 1616-1629. doi:10.1016/j.respol.2008.06.007
[40]	H. Eilat, B. Golany and A. Shtu, “R & D Project Evaluation: An Integrated DEA and Balanced Scorecard Approach,” Omega, Vol. 35, No. 5, 2008, pp. 895-912. doi:10.1016/j.omega.2006.05.002
[41]	T. Y. Chen, C. B. Chen and S. Y. Peng, “Firm Operation Performance Analysis Using Data Envelopment Analysis and Balanced Scorecard: A Case Study of a Credit Cooperative Bank,” International Journal of Productivity and Performance Management, Vol. 57, No. 7, 2008, pp. 523-539. doi:10.1108/17410400810904010
[42]	H. Min, H. Min and S. J. Joo, “A Data Envelopment Analysis-Based Balanced Scorecard for Measuring the Comparative Efficiency of Korean Luxury Hotels 2,” International Journal of Quality and Reliability Management, Vol. 25, No. 4, 2008, pp. 349-365. doi:10.1108/02656710810865249
[43]	E. Najafi, M. B. Aryanegad, F. H. Lotfi and A. Ebnerasould, “Efficiency and Effectiveness Rating of Organization with Combined DEA and BSC,” Applied Mathematical Sciences, Vol. 3, No. 25-28, 2009, pp. 1249-1264.
[44]	C. Y. Chiang and B. Lin, “An Integration of Balanced Scorecards and Data Envelopment Analysis for Firm’s Benchmarking Management,” Total Quality Management and Business Excellence, Vol. 20, No. 11, 2009, pp. 1153-1172. doi:10.1080/14783360903248286
[45]	C. Y. Huang, H. Chen, G. H. Tzeng and K. H. Hu, “Enhancing the Performance of a SOC Design Service Firm by Using a Novel DANP Based MCDM Framework on the Balanced Scorecard,” 40th International Conference on Computers and Industrial Engineering: Soft Computing Techniques for Advanced Manufacturing and Service Systems, 2010. http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=5668419
[46]	E. Kongar, J. M. Pallis and T. M. Sobh, “Non-Parametric Approach for Evaluating the Performance of Engineering Schools,” International Journal of Engineering Education, Vol. 26, No. 5, 2010, pp. 1210-1219.
[47]	F. H. Lotfi, S. J. Sadjadi, A. Khaki and E. Najafi, “A Combined Interval Net DEA and BSC for Evaluating Organizational Efficiency,” Applied Mathematical Sciences, Vol. 4, No. 36-39, 2010, pp. 1975-1999.
[48]	F. R. Roodposhti, F. H. Lotfi and M. V. Ghasemi, “Acquiring Targets in Balanced Scorecard Method by Data Envelopment Analysis Technique and Its Application in Commercial Banks,” Applied Mathematical Sciences, Vol. 4, No. 69-72, 2010, pp. 3549-3563.
[49]	F. H. Roodposhti, F. HosseinzadehLofti and M. V. Ghasemi, “Performance Evaluation through Data Envelopment Analysis Technique and Balanced Scorecards Approach and Its Application in Bank,” Applied Mathematical Sciences, Vol. 4, No. 69-72, 2010, pp. 3537-3547.
[50]	H. Wang, L. Zheng and J. Liu, “Measuring the Performance of Information Systems Using Data Envelopment Analysis,” International Journal of Digital Content Technology and Its Applications, Vol. 4, No. 8, 2010, pp. 92-101.
[51]	G. J. Van Helden, H. Aardema, H. Ter Bogt and T. Groot, “Knowledge Creation for Practice in Public Sector Management Accounting by Consultants and Academics: Preliminary Findings and Directions for Future Research,” Management Accounting Research, Vol. 21, No. 2, 2012, pp. 83-94. doi:10.1016/j.mar.2010.02.008
[52]	H. Wang, Y. Liu, M. Zhou and S. He, “DEA-Based Measurement of Information System Performance,” Key Engineering Materials, Vol. 467-469, 2011, pp. 597-602. doi:10.4028/www.scientific.net/KEM.467-469.597
[53]	R. Ramanathan and U. Ramanathan, “A Performance Measurement Framework Combining DEA and Balanced Scorecard for the UK Health Sector,” International Journal of Operational Research, Vol. 12, No. 3, 2011, pp. 257-278. doi:10.1504/IJOR.2011.042916
[54]	C. A. F. Amado, S. P. Santos and P. M. Marques, “Integrating the Data Envelopment Analysis and the Balanced Scorecard Approaches for Enhanced Performance Assessment,” Omega, Vol. 40, No. 3, 2012, pp. 390-403. doi:10.1016/j.omega.2011.06.006
[55]	C. Fu and S. Yang, “The Combination of Dependence-Based Interval-Valued Evidential Reasoning Approach with Balanced Scorecard for Performance Assessment,” Expert Systems with Applications, Vol. 39, No. 3, 2012, pp. 3717-3730. doi:10.1016/j.eswa.2011.09.069
[56]	M. Vaez-Ghasemi, F. H. Lotfi and L. Taghizadeh, “Multi-Component Balanced Scorecard for Perspectives Efficiency Measurement,” Applied Mathematical Sciences, Vol. 6, No. 9-12, 2012, pp. 403-410.
[57]	E. M. Quiroga, P. Hernán and D. Visbal, “Evaluación Docente Mediante BSC y DEA,” Revista Educación en Ingeniería, Vol. 2, No. 70, 2006, pp. 70-86.
[58]	Y. Wu and C. Li, “Research on Performance Evaluation of Higher Education Based on the Model of BSC-DRFDEA,” IEEE 16th International Conference on Industrial Engineering and Engineering Management, Beijing, 21-23 October 2009, pp. 2030-2034.
[59]	A. Charnes, W.W. Cooper and E. Rhodes, “Measuring the Efficiency of Decision Making Units,” European Journal of Operational Research, Vol. 2, No. 6, 1978, pp. 429-444.