User Acceptance of Key Performance Indicators Management Systems in a Higher Education Institution in Malaysia: A Pilot Study (Pages:22-31)
Author :
Abstract
This article discusses the users’ acceptance of two performance management systems, namely Excel Spreadsheet System (ESS) and Key Performance Indicator Monitoring System (KPI-MS). Key Performance Indicator (KPI) is an index used in measuring an individual’s, organization’s or institution’s performance. ESS is a system provide by Malaysia Ministry of Higher Education (MoHE) and has been in used since year 2008. KPI-MS was developed later as a tool using PHP 5.2 and MySQL Community Server 5.0 databases with determination to replace ESS which has several shortcomings. The acceptance study of both management systems is in terms of its accuracy, perceived usefulness and perceived ease of use. This study was done by using a survey questionnaire. The instrument of this study was developed and modified from Davis’s Technology Acceptance Model (TAM). A total of 19 participants from two of the campuses of Universiti Sains Malaysia (USM) participated in this study. This research instrument had been validated by three experts in the related field and scored reliability at Cronbach alpha value of 0.843. A comparison study was done to evaluate the accuracy of KPI-MS while descriptive analysis was conducted to determine the mean scores of KPI-MS and ESS rated by users. The findings showed that KPI-MS computed KPI marks accurately and the users also rated KPI-MS as more useful in monitoring KPI performance of their schools or centres compared to ESS. Besides, the users also indicated KPI-MS is more user-friendly. In conclusion, KPI-MS system is prefered by the users as an effective system.
Keywords
Abstract
This article discusses the users’ acceptance of two performance management systems, namely Excel Spreadsheet System (ESS) and Key Performance Indicator Monitoring System (KPI-MS). Key Performance Indicator (KPI) is an index used in measuring an individual’s, organization’s or institution’s performance. ESS is a system provide by Malaysia Ministry of Higher Education (MoHE) and has been in used since year 2008. KPI-MS was developed later as a tool using PHP 5.2 and MySQL Community Server 5.0 databases with determination to replace ESS which has several shortcomings. The acceptance study of both management systems is in terms of its accuracy, perceived usefulness and perceived ease of use. This study was done by using a survey questionnaire. The instrument of this study was developed and modified from Davis’s Technology Acceptance Model (TAM). A total of 19 participants from two of the campuses of Universiti Sains Malaysia (USM) participated in this study. This research instrument had been validated by three experts in the related field and scored reliability at Cronbach alpha value of 0.843. A comparison study was done to evaluate the accuracy of KPI-MS while descriptive analysis was conducted to determine the mean scores of KPI-MS and ESS rated by users. The findings showed that KPI-MS computed KPI marks accurately and the users also rated KPI-MS as more useful in monitoring KPI performance of their schools or centres compared to ESS. Besides, the users also indicated KPI-MS is more user-friendly. In conclusion, KPI-MS system is prefered by the users as an effective system.
Keywords
- Ajzen, I., Fishbein, M., & Heilbroner, R. L. (1980). Understanding attitudes and predicting social behavior (3 ed.). Englewood Cliffs, NJ: Prentice-Hall.
- Chan A. P. C., & Chan, A. P. L. (2004). Key performance indicators for measuring construction success. Benchmarking: An International Journal, 11(2), 203-216.
- Dahan, H. M., Fook, C. Y., Jelas, Z. M., Sidhu, G. K., Singh, P., Omar, S. K. a., et al. (2007). Key Performance Indicators (KPIs) for governance of public universities in Malaysia Asian Centre for Research on University Learning and Teaching (ACRELeT).
- Davis, F. D. (1986). A technology acceptance model for empirically testing new end-user information systems: theory and results (Unpublished Doctorial Dissertation). Massachusetts Institute of Technology.
- Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. Management Information Systems Research Center, University of Minnesota, 13(3), 319-340.
- Davis, F. D. (1993). User accceptance of information technology: system characteristics, user perceptions, and behavioural impacts. Int. J. Man-Machine Studies, 38, 475-487.
- Liu, I.-F., Chen, M. C., Sun, Y. S., Wible, D., & Kuo, C.-H. (2010). Extending the TAM model to explore the factors that affect Intention to Use an Online Learning Community. Computers & Education, 54, 600-610.
- Muniandy, B., Ong, M. Y., Phua, K. K., & Ong, S. L. (2011a). Assessing Key Performance Indicators Monitoring System (KPI-MS) of a university using Technology Acceptance Model. International Journal of Social Science and Humanity, 1(3), 171-176.
- Muniandy, B., Ong, M. Y., Phua, K. K., & Ong, S. L. (2011b). User Acceptance of a Key Performance Indicators Monitoring System (KPI-MS) in Higher Education: An Application of the Technology Acceptance Model. Paper presented at the 2nd International Conference on Education and Management Technology, Shanghai, China.
- Park, N., Roman, R., Lee, S., & Chung, J. E. (2009). User acceptance of a digital library system in developing countries: An application of the Technology Acceptance Model. International Journal of Information Management, 29, 196–209.
- Roca, J. C., Chiu, C.-M., & Martı´nez, F. J. (2006). Understanding e-learning continuance intention: An extension of the Technology Acceptance Model. Int. J. Human-Computer Studies, 64, 683-696.
- Xiong, G., Qin, T., Wang, F., Hu, L., & Shi, Q. (2010). Design and improvement of KPI system for materials management in Power Group Enterprise. IEEE, 171-176.
- Zhou, N., Wang, H., Han, X., & Zhang, X. (2010). Constructing Performance Management Information System for Academic Staff: A Model for Research-intensive Universities. Paper presented at the International Conference on E-Business and E-Government.