Abstract
Universities evaluate the activities of academic staff annually to encourage excellence in performance and to develop training programmes to enhance their professional skills. The evaluation of academic staff activities is mainly based on the results of their scientific work, but it is important to take into account other areas of their responsibilities. Therefore, the purpose of the study was to develop a system for the comprehensive evaluation of academic staff, which would consider the outcomes of their pedagogical, methodological, scientific, and organisational work. The method employed involved the analysis of university regulatory documents that define academic staff evaluation systems. Graphs were utilised to model the structure of the relationships between the criteria of the proposed evaluation system. The evaluation system determines the indices of academic staff work efficiency both for individual types of activities an comprehensively. According to the system, the outcomes of all academics are compared with the best results achieved in the current year at the university or national level. The calculations of the comprehensive index of activity efficiency for each academic enable the formation of university, faculty, and departmental rankings of academic staff, as well as the categorisation of performance levels based on the proposed scale. It was recommended that the evaluation results be presented in academic portfolios on the university website to ensure transparency. This approach also enables stakeholders to track changes in academics’ effectiveness over time. The evaluation system will enhance personnel management in universities, thereby contributing to the achievement of strategic goals for institutional development. The proposed academic staff evaluation system can be implemented at both the university and national levels. Its implementation will further foster a competitive environment among academics at the national, university, faculty, and departmental levels
Keywords
teachers and research staff evaluation; evaluation criteria; academic efficiency; teacher ranking; academic portfolio
References
[1] Andrushchenko, V., Sergienko, V., & Voytovych, I. (2017). Educational measurements: Science and practical activity. Higher Education of Ukraine, 1, 17-24.
[2] Anyanwu, O.M. (2021). Staff personnel management and university effectiveness in Southwest, Nigeria. African Journal of Educational Management, 20(2), 93-108.
[3] Apodaca, P., & Grad, H. (2005). The dimensionality of student ratings of teaching: Integration of uni‐ and multidimensional models. Studies in Higher Education, 30(6), 723-748. doi: 10.1080/03075070500340101.
[4] Aslam, M.N. (2013). Student rating as an effective tool for teacher evaluation. Journal of the College of Physicians and Surgeons Pakistan, 23(1), 37-41.
[5] Deng, S., & Que, X. (2018). Research on the teaching assessment of students of science and engineering teachers in a university. Computer Applications in Engineering Education, 2018, 1-8. doi: 10.1002/cae.22051.
[6] Duong, T.-V.T., Do, T.-D., & Nguyen, N.-P. (2015). Exploiting faculty evaluation forms to improve teaching quality: An analytical review. In 2015 Science and information conference (SAI) (pp. 457-462). London: Institute of Electrical and Electronics Engineers. doi: 10.1109/SAI.2015.7237182.
[7] Fajčíková, A., & Fejfarová, M. (2019). Evaluation of the quality of teaching from the perspective of university students. Journal on Efficiency and Responsibility in Education and Science, 12(2), 34-40. doi: 10.7160/eriesj.2019.120201.
[8] Gallagher, H.A. (2004). Vaughn Elementary’s innovative teacher evaluation system: Are teacher evaluation scores related to growth in student achievement?. Peabody Journal of Education, 79(4), 79-107. doi: 10.1207/s15327930pje7904_5.
[9] Garner, J.K., & Kaplan, A. (2021). A complex dynamic systems approach to the design and evaluation of teacher professional development. Professional Development in Education, 47(2-3), 289-314. doi: 10.1080/19415257.2021.1879231.
[10] Gryshchenko, I.M. (2017). Efficiency evaluation of academic staff activity at higher educational institutions. Bulletin of the Kyiv National University of Technology and Design. Series: Economic Sciences, 154-168.
[11] Husain, M., & Khan, S. (2016). Students’ feedback: An effective tool in teachers’ evaluation system. International Journal of Applied and Basic Medical Research, 6(3), 178-181. doi: 10.4103/2229-516X.186969.
[12] Jedemark, M., & Londos, M. (2021). Four different assessment practices: How university teachers handle the field of tension between professional responsibility and professional accountability. Higher Education, 81, 1293-1309. doi: 10.1007/s10734-020-00612-4.
[13] Kadiyono, A.L., Sulistiobudi, R.A., Haris, I., Wahab, M.K.A., Ramdani, I., Purwanto, A., Mufid, A., Muqtada, M.R., Gufron, M., Nuryansah, M., Ficayuma, L.A., Fahlevi, M., & Sumartiningsih, S. (2020). Develop leadership style model for Indonesian teachers’ performance in Education 4.0 era. Systematic Reviews in Pharmacy, 11(9), 363-373. doi: 10.31838/srp.2020.9.52.
[14] Kornell, N., & Hausman, H. (2016). Do the best teachers get the best ratings?. Frontiers in Psychology, 25(7), article number 570. doi: 10.3389/fpsyg.2016.00570.
[15] Koutrouli, M., Karatzas, E., Paez-Espino, D., & Pavlopoulos, G.A. (2020). A guide to conquer the biological network era using graph theory. Frontiers in Bioengineering and Biotechnology, 31(8), article number 34. doi: 10.3389/fbioe.2020.00034.
[16] Law of Ukraine No. 1556-VII “On Higher Education”. (2014, July). Retrieved from https://zakon.rada.gov.ua/laws/show/1556-18#Text.
[17] Maisano, D.A., Mastrogiacomo, L., & Franceschini, F. (2023). Empirical evidence on the relationship between research and teaching in academia. Scientometrics, 128, 4475-4507. doi: 10.1007/s11192-023-04770-x.
[18] Mao, Y., Wang, F., Zhang, Y., & Chen, Q. (2024). Teaching quality evaluation model based on CNN-Framework with entropy weight method. Computer-Aided Design and Applications, 22(S1), 297-312. doi: 10.14733/cadaps.2025.S1.297-312.
[19] Moroz, S., Dombrowska, S., & Moroz, V. (2017). Rating the scientific-pedagogical staff, as a part of the system of state management of higher education quality. Bulletin of NUCPU. State Management Series, 2, 294-309. doi: 10.5281/zenodo.1038888.
[20] Morze, N., & Buinytska, O. (2017). Rating indicators system of evaluation teacher’s activities in modern universities. Scientific Journal of the M.P. Drahomanov NPU. Computer-oriented Learning Systems, 19(26), 34-44.
[21] Naumann, A., Kuger, S., Köhler, C., & Hochweber, J. (2020). Conceptual and methodological challenges in detecting the effectiveness of learning and teaching. In A.-K. Praetorius, J. Grünkorn & E. Klieme (Eds.), Empirical research on teaching quality. Basic theoretical questions and quantitative modelling (pp. 179-196). Basel: Beltz Juventa. doi: 10.25656/01:25873.
[22] Paudel, K.P. (2021). Dimensions of academic performance in the context of Nepali higher education institutions. Journal of Education and Research, 11(1), 29-48. doi: 10.51474/jer.v11i1.497.
[23] Popović, M., Savić, G., Kuzmanović, M., & Martić, M. (2020). Using data envelopment analysis and multi-criteria decision-making methods to evaluate teacher performance in higher education. Symmetry, 12(4), article number 563. doi: 10.3390/sym12040563.
[24] Rafiq, S., & Qaisar, S. (2021). Teachers perception about process of teacher evaluation: A case study of a private university of Lahore. Gomal University Journal of Research, 37(3), 350-362. doi: 10.51380/gujr-37-03-09.
[25] Ramírez-Gutiérrez, Z., Barrachina-Palanca, M., & Ripoll-Feliu, V. (2020). Efficiency in higher education. Empirical study in public universities of Colombia and Spain. Revista de Administração Pública, 54(3), 468-500. doi: 10.1590/0034-761220190232x.
[26] Resolution of the Cabinet of Ministers of Ukraine No. 1187 “On Approval of the Conditions of Licensing for Conducting Educational Activities”. (2015, December). Retrieved from https://zakon.rada.gov.ua/laws/show/1187-2015-%D0%BF#Text.
[27] Riaz, M.N. (2000). Student evaluation of university teaching quality: Analysis of a teacher’s rating scale for a sample of university students. Pakistan Journal of Psychological Research, 15(3-4), 107-117.
[28] Shah, M., & Sid Nair, C. (2012). The changing nature of teaching and unit evaluations in Australian universities. Quality Assurance in Education, 20(3), 274-288. doi: 10.1108/09684881211240321.
[29] Smagina, O., Pereyaslavska, S., & Zhykova, V. (2018). Information support system of control and management calculation of scientific, educational and methodological rating of university chair lecturers. Physical and Mathematical Education, 1(15), 311-315.
[30] Smirnova, V. (2021). Evaluation of research activities of higher education institutions academic staff as part of the system of education quality assurance. Open Educational e-Environment of Modern University, 11, 146-157. doi: 10.28925/2414-0325.2021.1113.
[31] Syngaivska, I.V. (2015). The issue of higher educational institution teacher professional successfulness assessment. Psychological Prospects, 26, 264-274.
[32] Wahyudi, W. (2022). Five components of work motivation in the achievement of lecturer performance. Scientific Journal of Reflection: Economic, Accounting, Management and Business, 5(2), 466-473. doi: 10.37481/sjr.v5i2.528.
[33] Wan, С., & Jin, F. (2021). Research and practice on the teaching performance evaluation system of university teachers. In Proceedings of the 6th international conference on education reform and modern management (ERMM 2021), Advances in Social Science, Education and Humanities Research (pp. 157-162). Amsterdam: Atlantis Press. doi: 10.2991/assehr.k.210513.037.
[34] Yan, Y., Zhu, Q., & Yang, M. (2010). Research on the value-model assessment of performance review for university teachers. In 2010 International conference on e-product e-service and e-entertainment (pp. 1-4). Henan. doi: 10.1109/ICEEE.2010.5660181.
[35] Yaroshenko, О.H. (2021). Evaluation of teachers’ activities in the context of internal quality assurance of higher education. Scientific Journal of the Mykhailo Dragomanov Ukrainian State University, 82, 186-190. doi: 10.31392/NPU-nc.series5.2021.82.38.
[36] Young, S., Rush, L., & Shaw, D. (2009). Evaluating gender bias in ratings of university instructors’ teaching effectiveness. International Journal for the Scholarship of Teaching and Learning, 3(2), article number 19. doi: 10.20429/ijsotl.2009.030219.
[37] Yu, S.O. (2016). Using students’ feedback to evaluate teachers’ effectiveness. Journal for Educators, Teachers and Trainers, 7(1), 182-192.
[38] Zhang, E., & Shi, W. (2019). Humanities-oriented teachers’ scientific research performance evaluation system in Missouri State University and its enlightenment. In Proceedings of the 4th international conference on economy, judicature, administration and humanitarian projects (JAHP 2019), advances in economics, business and management research (pp. 111-115). Amsterdam: Atlantis Press. doi: 10.2991/jahp-19.2019.26.
[39] Zhang, X., Yang, X., & Yang, J. (2021). Teaching evaluation algorithm based on grey relational analysis. Complexity, 2021, article number 5596518. doi: 10.1155/2021/5596518.