International Association of Educators   |  ISSN: 1554-5210

Original article | International Journal of Progressive Education 2022, Vol. 18(4) 209-222

A Meta-Evaluation Research on Teacher Training Programs in Türkiye

Muhammed Akıncı & Erdoğan Köse

pp. 209 - 222   |  DOI: https://doi.org/10.29329/ijpe.2022.459.15   |  Manu. Number: MANU-2112-01-0001

Published online: August 01, 2022  |   Number of Views: 23  |  Number of Download: 103


Abstract

The purpose of this research is to make a meta-evaluation of the program evaluation studies on teacher training programs in Turkey. Meta-evaluation is the process of revealing the deficiencies and errors of the research as the last stage of the program evaluation process. In this context, the steps of the meta-evaluation processes were followed methodically. In the in this research, 9 program evaluation studies conducted between 2010 and 2020 about teacher training programs, using any program evaluation approach and model, were meta-evaluated. The sampling method of the research is criterion sampling.. Research data was collected using the "Program Evaluation Standards Checklist developed by the researchers. During the development of the relevant data collection tool, the Program Evaluation Standards created by the Joint Committee on Standards for Educational Evaluation (JCSEE) were benefited. The studies included in the research were examined by 6 program experts who formed the meta-evaluation team. Each expert evaluated 3 studies using the checklist. Research data was analyzed using descriptive analysis method. Research findings indicate that the examined program evaluation studies meet the program evaluation standards by 55.67%. From this point, some suggestions that are believed to contribute to future program evaluation and meta-evaluation studies on teacher training were presented.

Keywords: Meta-Evaluation, Program Evaluation, Teacher Training, Evaluation Standards, Program Standards


How to Cite this Article?

APA 6th edition
Akinci, M. & Kose, E. (2022). A Meta-Evaluation Research on Teacher Training Programs in Türkiye . International Journal of Progressive Education, 18(4), 209-222. doi: 10.29329/ijpe.2022.459.15

Harvard
Akinci, M. and Kose, E. (2022). A Meta-Evaluation Research on Teacher Training Programs in Türkiye . International Journal of Progressive Education, 18(4), pp. 209-222.

Chicago 16th edition
Akinci, Muhammed and Erdogan Kose (2022). "A Meta-Evaluation Research on Teacher Training Programs in Türkiye ". International Journal of Progressive Education 18 (4):209-222. doi:10.29329/ijpe.2022.459.15.

References
  1. Akcan, A. T., Malkoç, S., & Kızıltan, Ö. (2018). Akademisyenlere Göre Akademi ve Akademik Kültür. Abant İzzet Baysal Üniversitesi Eğitim Fakültesi Dergisi, 18(1), 569-591.  [Google Scholar]
  2. Akıncı (2021). Evaluation of the measurement and evaluation in education curriculum (PhD dissertation, Akdeniz University, Department of Educational Sciences, Antalya). Retrieved from https://tez.yok.gov.tr/UlusalTezMerkezi. [Google Scholar]
  3. Akıncı, M., & Köse, E. (2021).  Research trends of program evaluation studies conducted between 2010-2019 in Turkey. Çukurova University Faculty of Education Journal, 50(1), 77-120. [Google Scholar]
  4. Ak, M. Z., & Gülmez, A. (2006). Türkiye’nin uluslararası yayın performansının analizi. Akademik incelemeler dergisi, 1(1), 22-49. [Google Scholar]
  5. Alexakis, D. E. (2020). Meta-evaluation of water quality indices. application into groundwater resources. Water, 12(7), 1-13. [Google Scholar]
  6. Ardisson, M., Smallheer, B., Moore, G., & Christenbery, T. (2015). Meta-Evaluation: Experiences in an Accelerated Graduate Nurse Education Program. Journal of Professional Nursing, 31(6), 508-515. [Google Scholar]
  7. Astbury, B. (2016). From evaluation theory to tests of evaluation theory?. In Stockmann, R., & Meyer, W. (Ed). The Future of Evaluation (pp. 309-325). Palgrave Macmillan, London. [Google Scholar]
  8. Bullough Jr, R. V. (1992). Beginning teacher curriculum decision making, personal teaching metaphors, and teacher education. Teaching and Teacher Education, 8(3), 239-252. [Google Scholar]
  9. Chapman, L. S. (2012). Meta-evaluation of worksite health promotion economic return studies: 2012 update. American Journal of Health Promotion, 26(4), 1-12. [Google Scholar]
  10. Cooksy, L. J., & Caracelli, V. J. (2009). Meta-evaluation in Practice. Journal of multidisciplinary evaluation, 6(11), 1-15.  [Google Scholar]
  11. Demirel, Ö. (2014). Eğitimde program geliştirme kuramdan uygulamaya. (21. Edition). Ankara: Pegem Akademi Yayıncılık.  [Google Scholar]
  12. Erdoğan, İ. (2001). Sosyal bilimlerde pozitivist-ampirik akademik araştırmaların tasarım ve yöntem sorunları. Anatolia: Turizm araştırmaları dergisi, 12(2), 119-134. [Google Scholar]
  13. Finn Jr, C. E., Stevens, F. I., Stufflebeam, D. L., & Walberg, H. J. (1997). A meta-evaluation. International Journal of Educational Research, 27(2), 159-174. [Google Scholar]
  14. Fitzpatrick, J. L., Sanders, J. R., & Worthen, B. R. (2011). Program evaluation: Alternative approaches and practical guidelines. (4. Edition). New Jersey: Pearson Education Inc. [Google Scholar]
  15. Fleiss, J. L., & Cohen, J. (1973). The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educational and psychological measurement, 33(3), 613-619. [Google Scholar]
  16. Fournier, D. M. (1994). The program evaluation standards: How to assess evaluations of educational programs. Journal of Educational Measurement, 31(4), 363-367. [Google Scholar]
  17. Georghiou, L. (1995). Assessing the framework programmes: A Meta-evaluation. Evaluation, 1(2), 171-188. [Google Scholar]
  18. JCSEE. (2018). Checklist of the program evaluation standards statements. Retrieved from https://evaluationstandards.org/program.  [Google Scholar]
  19. Kılıç, Ç., & Arslan, S. (2016). Türkiye’de yayınlanan yetişkin eğitimine ilişkin makalelerin meta değerlendirmesi. Erzincan Üniversitesi Eğitim Fakültesi Dergisi, 18(2), 865-899. [Google Scholar]
  20. Kozikoğlu, I., & Senemoğlu, N. (2015). The Content Analysis of Dissertations Completed in the Field of Curriculum and Instruction (2009-2014). Education and Science, 40(182), 29-41. [Google Scholar]
  21. Kurt, A., & Erdoğan, M. (2015). Content Analysis and Trends of Curriculum Evaluation Research: 2004-2013. Education and Science, 40(178), 199-224. [Google Scholar]
  22. LaChausse, R. G., Clark, K. R., & Chapple, S. (2014). Beyond teacher training: The critical role of professional development in maintaining curriculum fidelity. Journal of Adolescent Health, 54(3), 53-58. [Google Scholar]
  23. Léveillé, S., & Chamberland, C. (2010). Toward a general model for child welfare and protection services: A meta-evaluation of international experiences regarding the adoption of the Framework for the Assessment of Children in Need and Their Families (FACNF). Children and Youth Services Review, 32(7), 929-944. [Google Scholar]
  24. Madaus, G. F., Stufflebeam, D. L., & Scriven, M. (2000). Program Evaluation: A Historical Overview. In Stufflebeam, D. L., Madaus, G. F., & Kellaghan, T. (Ed.) In Evaluation Models: Viewpoints on Educational and Human Services Evaluation (pp. 3-22). Dordrecht: Kluwer Academic Publishers. [Google Scholar]
  25. Mertens, D. M., & Wilson, A. T. (2019). Program evaluation theory and practice. (2. Edition). Guilford Publications. [Google Scholar]
  26. Nevo, D. (Ed.). (2002). School-based evaluation: An international perspective. Oxford: Elsevier Science ltd. [Google Scholar]
  27. Null, W. (2011). Curriculum: From theory to practice. Rowman & Littlefield Publisher, Inc. [Google Scholar]
  28. Odom, S. L., & Fewell, R. R. (1983). Program evaluation in early childhood special education: A meta-evaluation. Educational Evaluation and Policy Analysis, 5(4), 445-460. [Google Scholar]
  29. Ornstein, A. C., & Hunkins, F. P. (2018). Curriculum: Foundations, principles, and issues. (2. Edition). Edinburgh: Pearson Education Limited.  [Google Scholar]
  30. Ornstein, A. C., & Levine, D. U. (2008). Foundations of education. (3. Edition). New York: Houghton Mifflin Company. [Google Scholar]
  31. Ozan, C., & Köse, E. (2014). Eğitim programları ve öğretim alanındaki araştırma eğilimleri. Sakarya University Journal of Education, 4(1), 116-136. [Google Scholar]
  32. Özüdoğru, F. (2018). Analysis of curriculum evaluation studies conducted in foreign language education: 2005-2016. Journal of Language and Linguistic Studies, 14(2), 113-134.  [Google Scholar]
  33. Pediaditi, K., Doick, K. J., & Moffat, A. J. (2010). Monitoring and evaluation practice for brownfield, regeneration to greenspace initiatives: A meta-evaluation of assessment and monitoring tools. Landscape and Urban Planning, 97(1), 22-36. [Google Scholar]
  34. Scott-Little, C., Hamann, M. S., & Jurs, S. G. (2002). Evaluations of after-school programs: A meta-evaluation of methodologies and narrative synthesis of findings. American Journal of Evaluation, 23(4), 387-419. [Google Scholar]
  35. Scriven, M. (2009). Meta-evaluation revisited. Journal of multidisciplinary evaluation, 6(11), 3-8.  [Google Scholar]
  36. Scriven, M. (2011). Evaluating evaluations: A meta-evaluation checklist. Consultado em, 9, 1-7. [Google Scholar]
  37. Stockmann, R., & Meyer, W. (2016). The future of evaluation: Global trends, new challenges and shared perspectives. Palgrave Macmillan, London. [Google Scholar]
  38. Stufflebeam, D. L., & Madaus, G. F. (1983). The standards for evaluation of educational programs, projects, and materials. In Stufflebeam, D. L., Madaus, G. F., & Kellaghan, T. (Ed.) Evaluation Models: Viewpoints on Educational and Human Services Evaluation (pp. 395-404). Dordrecht: Kluwer Academic Publishers. [Google Scholar]
  39. Stufflebeam, D. L. (1999). Foundational models for 21st century program evaluation, The Evaluation Center Occasional Papers Series, Western Michigan University.  [Google Scholar]
  40. Stufflebeam, D. L. (2000). The methodology of metaevaluation. In Stufflebeam, D. L., Madaus, G. F., & Kellaghan, T. (Ed.) Evaluation Models: Viewpoints on Educational and Human Services Evaluation (pp. 457-471). Dordrecht: Kluwer Academic Publishers. [Google Scholar]
  41. Stufflebeam, D. L., & Coryn, C. L. S. (2014). Evaluation theory, models, and applications. (2. Edition). San Francisco: Josey-Bass. [Google Scholar]
  42. Toy, B. Y., & Tosunoğlu, N. G. (2007). Sosyal bilimler alanındaki araştırmalarda bilimsel araştırma süreci, istatistiksel teknikler ve süreci, istatistiksel teknikler ve yapılan hatalar yapılan hatalar. Journal of commerce, 1(1), 1-20. [Google Scholar]
  43. Usmani, M. A. W., Khatoon, M. S., Shammot, M. M., & Zamil, A. M. (2012). Meta evaluation of a teachers’ evaluation programme using CIPP model. Archives Des Sciences, 65(7), 230-252. [Google Scholar]
  44. Uşun, S. (2012). Eğitimde program değerlendirme: Süreçler yaklaşımlar ve modeller. Ankara: Anı Yayıncılık. [Google Scholar]
  45. Valcke, M., Rots, I., Verbeke, M., & Van Braak, J. (2007). ICT teacher training: Evaluation of the curriculum and training approach in Flanders. Teaching and teacher Education, 23(6), 795-808. [Google Scholar]
  46. Windsor, R. A., Boyd, N. R., & Orleans, C. T. (1998). A meta-evaluation of smoking cessation intervention research among pregnant women: improving the science and art. Health education research, 13(3), 419-438. [Google Scholar]
  47. WMU. (2020). Evaluation Checklists. Retrieved from https://wmich.edu/evaluation/checklists. [Google Scholar]
  48. Yağan, S. A. (2019). Program değerlendirme alanında yayınlanmış doktora tezlerinin meta değerlendirmesi (2015-2019). Electronic Journal of Education Sciences, 8(16), 188-208. [Google Scholar]
  49. Yasar, S., Gultekin, M., Kose, N., Girmen, P., & Anagun, S. (2005). The meta-evaluation of teacher training programs for elementary education in Turkey. In Cooper (Ed.) Teacher Education: Local and Global: Proceedings of the 33rd Annual Australian Teacher Education Association Conference (pp. 498-504). Australia: Griffith University. [Google Scholar]
  50. Yıldırım, A., & Şimşek, H. (2013). Sosyal bilimlerde nitel araştırma yöntemleri (9.Edition). Ankara: Seçkin Yayıncılık. [Google Scholar]
  51. Yüksel, İ., & Sağlam, M. (2014). Eğitimde program değerlendirme. (2. Edition). Ankara: Pegem Akademi. [Google Scholar]
  52. Yüksel, İ., & Zeynep, A. (2013). Öğrenci başarısını belirleme sınavının (ÖBBS) öğrenci değerlendirme standartları kapsamında değerlendirilmesi: Bir meta değerlendirme araştırması. Ondokuz Mayıs Üniversitesi Eğitim Fakültesi Dergisi, 32(1), 473-495. [Google Scholar]