In collaboration with Payame Noor University and Iranian Electronic Learning Association

Document Type : scientific-research

Authors

1 M.sc of Training and Human Resource Development, Faculty of Psychology and Educational Sciences, Shahid Beheshti University, Tehran, Iran.

2 PhD Professor, Faculty of Education and Psychology, Shahid Beheshti University, Tehran, Iran

3 PhD Associate professor, Faculty of Education and Psychology, Shahid Beheshti University, Tehran, Iran.

10.30473/idej.2025.71798.1207

Abstract

The present research was conducted with the aim of measuring the effectiveness of face to face and virtual in-service training of elementary school teachers in Birjand city based on the Kirkpatrick model and comparing them. The current research method is a quasi-experimental pre-test-post-test type. The statistical population of this research includes all primary school teachers of Birjand city who have participated in in-service and virtual courses in the academic year 2023-2024. Using available sampling, 45 teachers participating in face-to-face courses and 45 teachers participating in virtual courses were selected. In the first level, i.e. reaction, participants' opinions were collected in two stages (the beginning of the courses and the end of the courses). The tool used at this level was a researcher-made questionnaire. The second level, i.e. learning, was conducted using a researcher-made test of 19 questions and was performed as a pre-test and post-test. In the third level, i.e. behavior, data was collected 5 months after the end of the courses using the teachers' self-evaluation form and the teachers' evaluation form by their managers. The results of the inter-subject effects test to compare the reaction level components in the post-test stage and the f value obtained for all components are significant at the alpha level of 0.05. The F value obtained in the results of covariance analysis for comparing learning scores in the post-test stage is 26.563. The value of the t statistic and the value of the significance level for comparing the scores of the behavior level show that there is no difference in the variance between the two groups of face-to-face and virtual education The findings of the research show that face-to-face and virtual in-service courses are effective in the levels of reaction, learning and behavior, and there is a significant difference between the effectiveness of face-to-face and virtual courses; So that the obtained averages show that face-to-face training can have a significant effect compared to virtual training in these three levels.

Keywords

Main Subjects

Article Title [Persian]

مقایسه اثربخشی دوره های ضمن خدمت حضوری و مجازی معلمان مقطع ابتدایی بر اساس مدل کرک پاتریک

Authors [Persian]

  • محمد خسروی طناک 1
  • کورش فتحی واجارگاه 2
  • اسماعیل جعفری 3

1 کارشناسی ارشد آموزش و بهسازی منابع انسانی، گروه علوم تربیتی، دانشکده علوم تربیتی و روانشناسی، دانشگاه شهید بهشتی، تهران، ایران

2 استاد گروه علوم تربیتی دانشکدة علوم تربیتی و روانشناسی دانشگاه شهید بهشتی تهران، ایران.

3 دانشیار گروه علوم تربیتی، دانشکده علوم تربیتی و روانشناسی، دانشگاه شهید بهشتی...

Abstract [Persian]

چکیده: پژوهش حاضر با هدف سنجش اثربخشی آموزش‌های ضمن خدمت حضوری و مجازی معلمان مقطع ابتدایی شهرستان بیرجند بر اساس الگوی کرک پاتریک و مقایسه آن ها با هم انجام شده است. روش پژوهش حاضر شبه آزمایشی از نوع پیش آزمون-پس آزمون است. جامعه آماری این پژوهش شامل کلیه معلمان مقطع ابتدایی شهرستان بیرجند است که در دوره‌های ضمن خدمت حضوری و مجازی سال تحصیلی 1401-1402 شرکت کرده اند. با استفاده از نمونه گیری دردسترس 45 نفر از معلمان شرکت‌کننده در دوره‌های حضوری و 45 نفر از معلمان شرکت‌کننده در دوره‌های مجازی انتخاب شدند. در سطح اول با استفاده از پرسش نامه محقق ساخته، نظرات شرکت کنندگان در دو مرحله (اوایل برگزاری دوره‌ها و پایان برگزاری دوره‌ها) جمع آوری شد. سطح دوم یعنی یادگیری با استفاده از آزمون محقق ساخته 19 سوالی و به‌صورت پیش آزمون و پس آزمون انجام شد. در سطح سوم یعنی رفتار، 5 ماه پس از پایان دوره ها و با استفاده از فرم خود ارزیابی معلمان و فرم ارزیابی معلمان توسط مدیرانشان داده ها جمع آوری شد. نتایج آزمون اثرات بین آزمودنی برای مقایسه مولفه‌های سطح واکنش در مرحله پس‌آزمون و مقدار f به دست آمده برای تمامی مولفه ها در در سطح آلفای 05/0 معنی دار است. مقدار F بدست آمده در نتایج آزمون تحلیل کوواریانس برای مقایسه نمرات یادگیری در مرحله پس‌آزمون برابر 563/26 است. مقدار آماره t و مقدار سطح معنی‌داری جهت مقایسه نمرات سطح رفتار ، نشان از عدم تفاوت در واریانس بین دو گروه آموزش حضوری و مجازی است. یافته‌های پژوهش نشان ‌می‌دهد که دوره‌های ضمن خدمت حضوری و مجازی در سطوح واکنش، یادگیری و رفتار اثربخش است و بین اثربخشی دوره‌های حضوری و مجازی تفاوت معناداری وجود دارد؛ به طوری که میانگین های به دست آمده نشان می‌دهد که آموزش حضوری می‌تواند تأثیر به سزایی نسبت به آموزش مجازی در این سه سطح داشته باشد.

Keywords [Persian]

  • اثربخشی
  • دوره‌های ضمن خدمت
  • مدل کرک پاتریک
  • معلمان
Abu Lehyeh, S.M., Ahmed, E., Alzghoul, M., & Diya, A. (2021). Knowledge Management and its Impact on the Organizational Learning: An Experimental Study. Ilkogretim Online - Elementary Education Online, 20(5), 5577-5588.
Adib, Y., zare, S., mahmoudi, F., & badri, R. (2022). The Process of Development of Affective Dimension of Teachers’ Participation in In-Service Training. Journal of Curriculum Studies, 16(63), 141-168.
aminbeidokhti, A., Pardakhtchi, M. H., & aliyari, S. (2022). Assessing professional qualifications of primary school teachers. Journal of Research in Educational Systems, 16(56), 34-47. [In Persian]
Arets, J. Jennings, C., & Heijnen, V. (2016). 70:20:10 Towards 100% Performance. Maastricht: Sutler Media press.
Challob, A. I. (2021). The effect of flipped learning on EFL students’ writing performance, autonomy, and motivation. Education and Information Technologies, 26(4), 3743-3769.
Copriady, J., Zulnaidi, H., & Alimin, M. (2018). In-Service Training for Chemistry Teachers' Proficiency: The Intermediary Effect of Collaboration Based on Teaching Experience. International Journal of Instruction, 11(4), 749-760.
Darvishi Chari, Ruqiya (2021). Investigating the effectiveness of in-service training and identifying the factors affecting it in elementary school teachers of Eastern Bandapi region (Master's Thesis) Amol: Amol Institute of Higher Education[In Persian].
Dehghanzadeh, A., Fishman ziyari, E., Moazami, M., & Kavousi, E. (2022). Providing a model for Evaluating the Effectiveness of Virtual in-Service Training Courses for Employees in Tejarat Bank. Sociology of Education, 8(1), 1-14. doi: 10.22034/ijes.2021.541983.1184[In Persian].
Dwikurnaningsih, Y., & Waruwu, M. (2022). Evaluation of the Effectiveness of Online Training to Improve Lecturers' Ability in E-Learning Management Using the Kirkpatrick Model. Jurnal Pendidikan Progresif, 12(2), 660-672.
Engetou, E. (2017). The impact of training and development on organizational performance.
Fathi, Vajargah, K. (2020).Evaluation of Curriculum in Training and Development.Ayyjz Publishing House. [In Persian].
Fernandes, S., Araújo, A. M., Miguel, I., & Abelha, M. (2023). Teacher professional development in higher education: the impact of pedagogical training perceived by teachers. Education Sciences, 13(3), 309.
Garg, S., Sinha, S., Kar, A. K., & Mani, M. (2021). A review of machine learning applications in human resource management. International Journal of Productivity and Performance Management.
Ghorbanizadeh, V., Roodsaz, H., Sharifzadeh, F., & Sadeghi, M. (2019). The effect of individual knowledge management on organizational performance of Tehran municipality. Journal of Urban Economics and Management, 7(26), 49-63. [In Persian].
Gu, M., Zhang, Y., Li, D., & Huo, B. (2023). The effect of highinvolvement human resource management practices on supply chain resilience and operational performance. Journal of Management Science and Engineering, 8(2), 176-190.
Gupta, A. D. (2020). Strategic human resource management: Formulating and implementing HR strategies for a competitive advantage. CRC Press.
Habibi Azar, A., Keyhan, J., & Talebi, B. (2021). A Phenomenological study of teachers’ lived experiences on the challenges of holding in-service training courses by Ministry of Education. Technology of Education Journal (TEJ), 15(4), 743-756. doi: 10.22061/tej.2021.7507.2546[In Persian].
Hakimzadeh, R., Malekipour, A., Malekipour, M., & Ghasempour, E. (2015). Investigating the Status of Virtual Courses of Educators’ In-Service Training (A Case Study: Educators of Dehloran Area). Information and Communication Technology in Educational Sciences, 5(4(20)), 35-50 [In Persian].
Hemmati, A. (2012). Evaluation of the effectiveness of in-service courses in Kouhdasht city based on Kirk Patrick model .M.Sc., Curriculum Development, Allameh Tabataba'i University, University of Educational Sciences and Psychology[In Persian].
Hendy, N. (2021). The effectiveness of technology delivered instruction in teaching Human Resource Management, The International Journal of Management Education, 19 (2), 100479.
Hojjati H, Mehralizadeh Y, Farhadirad H, Alostany S., & Aghamolaei M. (2013). Assessing the effectiveness of training outcome based on Kirkpatrick model: case study. 35(3), 35-42. [In Persian].
Iqbal, A. Sh., Shabir, A. W., & Khlil, A. (2012). an Evaluation of the Effectiveness of Teacher Preparation Programs in Khyber Pakhtunkhwa Province, Pakistan; International Journal Business and Social Research; 2(7), 124- 131
Jahani, A., Kamali, N., & Davoodi, R. (2023). Identifying the Effective Factors influencing In-Service Training of Employees at the Red Crescent Society of Zanjan Province. Quarterly Scientific Journal of Rescue and Relief, 15(1), 1-8. [In Persian].
Jala, M. (2022). Online In-Service Training for Teachers in a New Pedagogical Setting. Psych Educ, 3 (8), 701-710
Jones, C., Fraser, J., & Randall, S. (2018). The evaluation of a home-based paediatric nursing service: concept and design development using the Kirkpatrick model. Journal of Research in Nursing, 23(6), 492-501.
Junejo, M. I., Sarwar, S., & Ahmed, R. R. (2018). Impact of in-service training on performance of teachers a case of STEVTA Karachi region. International Journal of Experiential Learning & Case Studies, 2(2), 50-60.
Kachuei, M, Zeinabadi, H, Arasteh, H., & Abbassian, H. (2019). Motivation of Transfer and Transfer of In-Service Education Research Action: Testing aModel and Assessing the Status of High Schools in Tehran Provinces . Modern Educational Thoughts, Volume 14(1), 83-55. [In Persian].
Kavak, N. Yamak, H&Others. (2017). The evaluation of Primary and Secondary Teachers' Opinions About in - Service Teacher Training. Procedia - Social and Behavioral Sciences. 46. 3507 - 3511. Available Online at www. Sciencedirect. Com. Published by Elsevier Ltd.
Khan, M., & Patil, D. (2023). Effective Teaching Assessment Model: Utilizing the Kirkpatrick Evaluation Framework.
Khandan, E. (2012) Evaluating the Effectiveness of In-Service Training Courses for Elementary Sixth Elementary Teachers in Darab City, 2011-90 .M.Sc., Department of Educational Sciences, Allameh Tabataba'i University, Faculty of Educational Sciences and Psychology .
Kirkpatrick, D. L. (2009). Implementing the Four Levels: A Practical Guide for Effective Evaluation of Training Programs: Easyread Super Large 24pt Edition. ReadHowYouWant.com
Kirkpatrick, D.L.,& Kirkpatrick, J.D. (2007). Impalement the four levels a practical guide for effective evaluation of training programs. Barrett-Koehler and the BK logo are registered trademarks of Barrett-Koehler Publishers. Inc.
Kivirand, T., Leijen, Ä., & Lepp, L. (2022). Enhancing Schools’ Development Activities on Inclusive Education Through In-service Training Course for School Teams: A Case Study. Frontiers in Psychology, 13, 824620.
Körkkö, M., Kotilainen, M. R., Toljamo, S., & Turunen, T. (2022). Developing teacher in-service education through a professional development plan: modelling the process. European Journal of Teacher Education, 45(3), 320-337
Lee, J. H., & Kang, J. M. (2018). A Study on the Effects of Job Education and Training Program on task Efficiency and Job Satisfaction-Focused on job satisfaction of midsize and large businesses in Cheongju. Journal of Convergence for Information Technology, 8(2), 171-181.
Leigh, J., Lamont, M., & Cairncross, G. (2021). Event managers' leadership styles and attitudes towards resourcing volunteer training: Exploring variation and practice implications. Tourism Management Perspectives, 40, 100887
Maggi, Hamidreza. (2019). Evaluating the effectiveness of skill development courses for students of Allameh Tabatabai University in Tehran based on the Kirkpatrick model. Educational Measurement Quarterly 11(41), 183-201
Mahmoudi Hekmat, Y., AREFI, M., & FATHI VAJARGAH, K.. (2019). Evaluating the Effectiveness of the training course "Character Education of TVT Students" Based on the Kirk Patrick Model. RESEARCH IN TEACHING, 7(2 ), 115-140 [In Persian].
Mansoori, Hossein, Shaemi Barzoki, Ali, Moshref Javadi, Mohamad Hosein, & Kianpoyr, Masoud. (2019). Validation of the Organizational Empowerment Model Based on Human Resource Processes. JOURNAL OF HUMAN RESOURCE MANAGEMENT RESEARCH, 11(2 (36) ), 113-135. [In Persian].
McCarthy, J., Porada, K., & Treat, R. (2023). Educational podcast impact on student study habits and exam performance. Family Medicine, 55(1), 34-37
 Megan, L., & Patricia, C. (2017). Using the CIPP model to assess nursing education program quality and merit. Teaching and learning in nursing.
Methani, M., & Hassanzadeh, R. (2008). The Effectiveness of In-Service Training Courses on Staff Performance (Islamic Azad University, Sari Branch ( . Journal of Educational Research, 4 (16): 179-159
Mohamadi, R. KhorsandiYamchi, A. Inanlou, M (2020). Evaluating the effectiveness of in-service training courses for teachers of primary school Based on the Kirk patrick's model. School Administration, 8(3), 399-371 [In Persian].
mostahfezian, Mina  (2018). The Study effectiveness of virtual in-service training periods on job performance of physical education's teachers. Journal of Sport Management and Motor Behavior, 14(28), 183-194. doi: 10.22080/jsmb.2018.10465.2405 [In Persian].
Nastiezaie, N., & Hezare Mogadam, M. (2010). A comparative survey on effects of face to face and distanced short term training courses on staff’s psychological empowerment. Nursing And Midwifery Journal, 8(4), 0-0. [In Persian].
Nguyen, C. (2020). The impact of training and development, job satisfaction and job performance on young employee retention. Job Satisfaction and empowerment and professional development of elementary teachers according to paragraph 3 of the general policies "transformation in the basic education system". Research in educational systems, 16(59), 81-94
Nik khah, D. M., & Ghanbari, M. (2021). Exploration of a virtual in-service teacher training courses Chaharmahal va Bakhtiari Province: a mixed study. Quarterly Journal of Education Studies, 7(25), 23-48 [In Persian].
Noe, R. (2023). Employee training and development. New York, NY: McGraw Hill Education
Orangi, A., Gheltash, A., Shahamat, N., & Yosleyani, G. (2011). An Investigation into the Impact of In-service Training on the Professional Performance of Teachers of Shiraz. Journal of New Approaches in Educational Administration, 2(5), 95-114 [In Persian].
Pishghadam, R., Derakhshan, A., Jajarmi, H., Tabatabaee Farani, S., & Shayesteh, S. (2021). Examining the role of teachers’ stroking behaviors in EFL learners’ active/passive motivation and teacher success. Frontiers in Psychology, 12, 707314 [In Persian].
Rezaian, S., & Moradsaleh, N. (2021). Evaluating the effectiveness of natural resources and environmental education in schools in district one of Tehran using the Kirkpatrick model. Journal of Renewable Natural Resources Research, 1(2), 145 [In Persian].
Sadeghi, M. E., Erfanian Khanzadeh, H., & Hossein, V. (2018). Evaluation and assessment of effectiveness of specialized training courses of Iranian railways system based on Kerkpatrick’s Model. Iranian Journal of Engineering Education, 20(79), 43-62. doi: 10.22047/ijee.2019.151789.1586 [In Persian].
Safari, Maitham (2015). Evaluating the effectiveness of Fars province's physical education manpower training courses based on the Kirkpatrick model. Master's thesis, Faculty of Educational Sciences and Psychology, Allameh Tabatabai University [In Persian].
Samwel, J. O. (2018). Impact of employee training on organizational performance– case study of drilling companies in geita, shinyanga and mara regions in tanzania. International Journal of Managerial Studies and Research, 6(1), 36-41.
Sanaei S., Pourkiani M., Selajqa, S., Sayadi, S., & Sheikhi, A. (2021). Presenting a two-way human resource management model in the police force using the method of theme analysis and treasury network. Scientific Quarterly Journal of Police Management Research, 15(1), 29-51. [In Persian].
Sepahvand, R., & Bagherzadeh Khodashahri, R. (2022). Variety of Talent and Employability : The Analyzing the mediating role of Intelligent Education. Journal of Development & Evolution Mnagement, 13،35-42[In Persian].
Steinbach, R. (2013). On-the-job training preparing employees for success. Axzo
Sudarwati, N., & Naim, S. (2022). The Urgency of Education in Economic Development and Human Resources: A Theoretical Perspective. Tadbir: Jurnal Studi Manajemen Pendidikan, 6(2), 169-186.
Supriadi, O. A., & Aulia, R. (2022). Distance learning and practical class during pandemic: An evaluation. In Embracing the Future: Creative Industries for Environment and Advanced Society 5.0 in a Post-Pandemic Era (pp. 281-285). Routledge.
Toraj Derakhshan Far, Ali; Khorasani, Abaslat; Fathi Vajargah, Korosh (2013). Evaluating the effectiveness of in-service training courses for teachers in Kohkiloye and Boyer Ahmad provinces based on the first and second levels of the Kirkpatrick model. The first conference of a new look at the transformation and innovation in electronic education, Hakim Arafi International Institute of Science and Technology, Shiraz. [In Persian].
Yazdani, F. (2015). ASSESSING THE EFFECTIVENESS OF TEACHERS’IN-SERVICE VIRTUAL TRAINING SYSTEM. [In Persian].
Yazdani, H., Ghafoori, A., & Radmanesh, N. (2023). Evaluating the effectiveness of in-service training programs for teachers based on the Krickpatrick method. Research in Teacher Education(RTE), 5(4), 88-65. [In Persian].
Zavvar, T., Malekpour, A.R., & Maleki avarsin, S. (2019). Prioritizing Educational Needs of Management Skills of Principals of Tabriz City. Journal of School Administration, 7(2),236-250 [In Persian].
Zheng, H. (2017). An analysis of the relationship between effective on the job training and job satisfaction: a study of a language training school in China (Doctoral dissertation, Dublin, National College of Ireland).