International Association of Educators   |  ISSN: 1554-5210

Original article | International Journal of Progressive Education 2022, Vol. 18(1) 249-265

Investigation of the Effectiveness of Hybrid Learning on Academic Achievement: A Meta-Analysis Study

İbrahim Yaşar Kazu & Cemre Kurtoğlu Yalçın

pp. 249 - 265   |  DOI: https://doi.org/10.29329/ijpe.2022.426.14   |  Manu. Number: MANU-2106-30-0002

Published online: February 01, 2022  |   Number of Views: 1089  |  Number of Download: 516


Abstract

Hybrid learning based on the integration of traditional face to face and online teaching- learning paradigms has become popular with the improvement of technology. This popularity creates a need for making a reinterpretation of the findings of recent empirical studies conducted on the effectiveness of hybrid learning. Thus, it is aimed to present the overall effect of hybrid learning on students’ academic achievements by analyzing 45 research findings obtained from 44 quantitative studies published between 2010 and 2020.  Relevant studies were identified from the databases of scholarly publications. The sample was examined using the Comprehensive Meta-Analysis (CMA) program. Publication type, education level, discipline, and duration of the intervention were determined as moderator variables. The results show that the effect of hybrid learning on students’ achievement is statistically higher (d = 1.032) in the random-effects model. A heterogeneous distribution was obtained from the sample Further subgroup analyzes using Analog ANOVA revealed that only the discipline variable is statistically significant. It was concluded that the discipline of biology has the highest effect size and the discipline of science has high effect size respectively. Furthermore, the impacts of these findings were discussed and relevant suggestions were given for future researches.

Keywords: Academic Achievement, Effect Size, Hybrid Learning, Meta-Analysis


How to Cite this Article?

APA 6th edition
Kazu, I.Y. & Yalcin, C.K. (2022). Investigation of the Effectiveness of Hybrid Learning on Academic Achievement: A Meta-Analysis Study . International Journal of Progressive Education, 18(1), 249-265. doi: 10.29329/ijpe.2022.426.14

Harvard
Kazu, I. and Yalcin, C. (2022). Investigation of the Effectiveness of Hybrid Learning on Academic Achievement: A Meta-Analysis Study . International Journal of Progressive Education, 18(1), pp. 249-265.

Chicago 16th edition
Kazu, Ibrahim Yasar and Cemre Kurtoglu Yalcin (2022). "Investigation of the Effectiveness of Hybrid Learning on Academic Achievement: A Meta-Analysis Study ". International Journal of Progressive Education 18 (1):249-265. doi:10.29329/ijpe.2022.426.14.

References
  1. Abdelraheem, A. Y. & Ahmed, A. M. (2015). Effects of activity based blended learning strategy on prospective of teachers' achievement and motivation. Journal on School Educational Technology, 11(1), 10-19.  [Google Scholar]
  2. Akgündüz, D. & Akınoğlu, O. (2017). The impact of blended learning and social media-supported learning on the academic success and motivation of the students in science education. Education and Science, 42(191), 69-90. https://doi.org/10.15390/EB.2017.6444  [Google Scholar] [Crossref] 
  3. Akkuş, M. (2014). Blended learning method for teaching differential equations. [Unpublished Ph.D. Dissertation, The Graduate School of Natural and Applied Science of Selçuk University The Degree of Doctor of Philosophy in Mathematics, Konya].  [Google Scholar]
  4. Aksoğan, M. (2011). The effects of blended learning on student’s academic success and persistence in learning. [Unpublished Master thesis, The University of Fırat the Institute of Social Science the Department of Computer Education and Instructional Technology, Elazığ]. [Google Scholar]
  5. Al-Otaibi, W. H. (2017). The effectiveness of blackboard-based blended teaching in the development of academic achievement, study skills, and self-confidence among students of Princess Nourah bint Abdulrahman University. International Education Studies, 10(11), 100-115. https://doi.org/10.5539/ies.v10n11p100   [Google Scholar] [Crossref] 
  6. Al-Qatawneh, S. & Eltahir, M. E. & Alsalhi, N. R. (2020). The effect of blended learning on the achievement of HDE students in the methods of teaching Arabic language course and their attitudes towards its use at Ajman University: A case study. Education and Information Technologies, 25, 2101–2127. http://dx.doi.org/10.1007/s10639-019-10046-w [Google Scholar]
  7. Alrouji, O. O. (2020). The effectiveness of blended learning in enhancing Saudi students’ competence in paragraph writing. English Language Teaching, 13(9), 72-82. https://doi.org/10.5539/elt.v13n9p72 [Google Scholar] [Crossref] 
  8. Arano-Ocuaman, J. A. (2010). Differences in student knowledge and perception of learning experiences among non-traditional students in blended and face-to-face classroom delivery. [Unpublished Ph.D. Dissertation, University of Missouri – St. Louis Graduate School]. [Google Scholar]
  9. Author & XXX (2014). “Deleted for Peer Review” [Google Scholar]
  10. Awadh, A.Y. & Higgins, S. E. (2012). Effects of traditional, blended, and e-learning on students’ achievement in higher education. Journal of Computer Assisted Learning, 29, 220–234. https://doi.org/10.1111/j.1365-2729.2012. 00490.x  [Google Scholar] [Crossref] 
  11. Balaman, F. & Tüysüz, C. (2011). Researching the effect of blended learning model on the science and technology course success, attitudes, and motivations of 7th class students. The Western Anatolia Journal of Educational Sciences, 2(4), 75-90.  [Google Scholar]
  12. Batdı, V. (2014). The effect of blended learning environments on students’ academic achievement: a meta-analysis study. Journal of Institute of Social Sciences, 5(1), 287-302. [Google Scholar]
  13. Bazelais, P. & Doleck, T. (2018). Blended learning and traditional learning: A comparative study of college mechanics courses. Educ Inf Technol, 23, 2889–2900.   https://doi.org/10.1007/s10639-018-9748-9  [Google Scholar] [Crossref] 
  14. Bernard, R. M., Abrami, P. C., Borokhovski, E., Wade, C. A., Tamim, R. M., Surkes, M. A., & Bethel, E. C. (2009). A meta-analysis of three types of interaction treatments in distance education. Review of Educational Research, 79(3), 1243– 1289. https://doi.org/10.3102/0034654309333844  [Google Scholar] [Crossref] 
  15. Bernard, R. M., Borokhovski, E., Schmid, R. F., Tamim, R. M. & Abrami, P. C. (2014). A meta-analysis of blended learning and technology use in higher education: from the general to the applied. J Comput High Educ, 26, 87–122. https://doi.org/10.1007/s12528-013-9077-3  [Google Scholar] [Crossref] 
  16. Bidarra, J. & Russman, E. (2017). Towards a pedagogical model for science education: Bridging educational contexts through a blended learning approach. Open Learning, 32(1), 6-20. [Google Scholar]
  17. Bozkurt, Ö. F. (2014).  Influence of blended learning facilities on academic success and self-efficacy perception of students in private language schools. [Unpublished Master thesis, Gazi University Graduate School of Educational Sciences, Ankara].  [Google Scholar]
  18. Bragg, L. A., Walsh C. & Heyeres, M. (2021). Successful design and delivery of online professional development for teachers: A systematic review of the literature. Computers & Education, 166, 1-23. https://doi.org/10.1016/j.compedu.2021.104158 [Google Scholar] [Crossref] 
  19. Can, E. (2020). Coronavirus (Covid-19) pandemic of the assess to the effects on open and distance education applications in Turkey. AUAd, 6(2), 11-53. [Google Scholar]
  20. Çetinkaya, M. (2017). Effect of personalized blended learning environments arranged on the basis of modeling to achievement in science education. Ordu University Journal of Social Science Research, 7(2), 287-296.  [Google Scholar]
  21. Ceylan, V. K., & Elitok Kesici, A. (2017). Effect of blended learning to academic achievement. Journal of Human Sciences, 14(1), 308-320. https://doi.org/10.14687/jhs.v14i1.4141  [Google Scholar] [Crossref] 
  22. Chang, C. Y., Lee, D.C. Tang, K. Y. & Hwang, G. J. (2021). Effect sizes and research directions of peer assessments: From an integrated perspective of meta-analysis and co-citation network. Computers & Education, 164 (2021), 1-15. https://doi.org/10.1016/j.compedu.2020.104123  [Google Scholar] [Crossref] 
  23. Çiftçi, B. & Dönmez, C. (2015). Blended learning method course attitudes towards academic success and effect. Turkish Studies - International periodical for the languages, Literature and History of Turkish or Turkic, 10(15), 235-254. http://dx.doi.org/10.7827/TurkishStudies.8814  [Google Scholar]
  24. Çiftçi, B. (2020).  The effect of blended learning on academic achievement and attitudes at social studies courses. Open Journal for Educational Research, 4(2), 143-150. https://doi.org/10.32591/coas.ojer.0402.05143c  [Google Scholar] [Crossref] 
  25. Çırak Kurt, S., Yıldırım, İ., & Cücük, E. (2018). The effects of blended learning on student achievement: A meta-analysis study. Hacettepe University Journal of Education, 33(3), 776-802. https://doi.org/10.16986/HUJE.2017034685  [Google Scholar] [Crossref] 
  26. Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Hilsdale. NJ: Lawrence Earlbaum Associates, 2. [Google Scholar]
  27. Cohen, L., Manion, L., & Morrison, K. (2007). Research methods in education (6th ed.). Canada: Routledge. [Google Scholar]
  28. Cumming, G. (2012). Understanding the new statistics: Effect sizes, confidence intervals, and meta-analysis. New York: Routledge. [Google Scholar]
  29. De Luca, G., Van Kerckhove, K., Coletti, P., Poletto, C., Bossuyt, N., Hens, N., et al. (2018). The impact of regular school closure on seasonal influenza epidemics: a data-driven spatial transmission model for Belgium. BMC infectious diseases, 18(1), 29.  https://doi.org/10.1186/s12879-017-2934-3  [Google Scholar] [Crossref] 
  30. Demirer, V. & Şahin, İ. (2013). Effect of blended learning environment on transfer of learning: an experimental study. Journal of Computer Assisted Learning, 29, 518-529. https://doi.org/10.1111/jcal.12009  [Google Scholar] [Crossref] 
  31. Deveci Topal, A. & Ocak, M. A. (2014). The effect of the anatomy course prepared by the blended learning environment on students’ academic achievement. Educational Technology Theory and Practice, 4(1), 48-62.  [Google Scholar]
  32. Dikmen, M. & Tuncer, M. (2018). A meta-analysis of effects of computer assisted education on students’ academic achievement: a-10-year review of achievement effect. Turkish Journal of Computer and Mathematics Education, 9(1), 97-121. https://doi.org/10.16949/turkbilmat.334733  [Google Scholar] [Crossref] 
  33. Dinçer, S. (2014). Applied meta-analysis in educational sciences. Pegem publishing. [Google Scholar]
  34. Dursun, C. (2018). Examining the effect of social media supported blended learning method on students’ mathematics achievements and self-efficacy perceptions. [Unpublished Master thesis, Marmara University, Department of Mathematics Education, İstanbul].  [Google Scholar]
  35. Fazal, M. & Bryant, M. (2019). Blended learning in middle school math: the question of effectiveness. Journal of Online Learning Research, 5(1), 49-64.  [Google Scholar]
  36. Field, A. P. (2001). Meta-analysis of correlation coefficients: A Monte Carlo comparison of fixed-and random-effects methods. Psychological Methods, 6, 161-180. [Google Scholar]
  37. Güneş, S. (2018). Asynchronous distance learning and blended learning in terms of learner autonomy, motivation, and academic success in teaching English. [Unpublished Ph.D. Dissertation, Hacettepe University, Department of Foreign Languages Education Program of English Language Teaching, Ankara].  [Google Scholar]
  38. Gürdoğan, M. & Bağ, H. (2019). The effect of blended learning environments on academic achievement, motivation, and students’ opinion. Akdeniz University Journal of Education Faculty, 2(1), 36-61.  [Google Scholar]
  39. Higgins, J. P, Thompson, S. G, Deeks, J. J., & Altman, D. G. (2003). Measuring inconsistency in meta-analysis. British Medical Journal, 2, 557-560. [Google Scholar]
  40. Huang, C., Wang, Y., Li, X., Ren, L., Zhao, J., Hu, Y. & Cao, B. (2020) Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China. Lancet, 395, 497–506. https://doi.org/10.1016/S0140-6736(20)30183-5  [Google Scholar] [Crossref] 
  41. Hwang, R. H., Lin, H. T., Sun, J. C. Y. & Wu, J. J. (2020).  Improving learning achievement in science education for elementary school students via blended learning.  International Journal of Online Pedagogy and Course Design (IJOPCD), 9(2). https://doi.org/10.4018/IJOPCD.2019040104  [Google Scholar] [Crossref] 
  42. İnal, M. & Korkmaz, Ö. (2019). The effect of web based blended learning on students’ academic achievement and attitudes towards English course. Education and Information Technologies, 24, 2603–2619. https://doi.org/10.1007/s10639-019-09890-7   [Google Scholar] [Crossref] 
  43. Ioannou, M., & Ioannou, A. (2020). Technology-enhanced embodied learning: designing and evaluating a new classroom experience. Educational Technology & Society, 23 (3), 81–94. [Google Scholar]
  44. İşigüzel, B. (2014). The blended learning environment on the foreign language learning process: A balance for motivation and achievement. Turkish Online Journal of Distance Education-TOJDE, 15(3), 108-121.  [Google Scholar]
  45. Kadirhan, M. & Korkmaz, Ö. (2020). The effects of learning blended with EBA content on students' academic achievement and attitudes toward science course. Trakya Journal of Education, 10(1), 64-75. https://doi.org/10.24315/tred.529721  [Google Scholar] [Crossref] 
  46. Kahyaoğlu, Y. (2014). The investigation of the effect of inquiry and blended learning environments on computer course. [Unpublished Master thesis, Dokuz Eylül University, Department of Computer Education and Instructional Technologies, İzmir].  [Google Scholar]
  47. Kök, A. (2018). The Effectiveness of blended learning: A meta-analysis study. [Unpublished Master thesis, Necmettin Erbakan University, Department of Computer Education and Instructional Technology, Konya]. [Google Scholar]
  48. Korucu, A.T. & Kabak, K. (2020). Hybrid learning practices and effects in Turkey: A meta-analysis study. Journal of Information and Communication Technologies, 2(2), 88-112. Retrieved from https://dergipark.org.tr/tr/pub/bited/issue/58421/803227  [Google Scholar]
  49. Li, Z., Tsai, M. H., Tao, J. & Lorentz, C. (2014). Switching to blended learning: The impact on students’ academic performance. Journal of Nursing Education and Practice, 4(3), 245-251.  https://doi.org/10.5430/jnep.v4n3p245  [Google Scholar] [Crossref] 
  50. Lin, Y. W., Tseng, C. L. & Chiang, P. J. (2017). The effect of blended learning in mathematics course.  EURASIA Journal of Mathematics Science and Technology, 13(3), 741-770. https://doi.org/10.12973/eurasia.2017.00641a  [Google Scholar] [Crossref] 
  51. Mahmud, M. M. (2018). Technology and language – what works and what does not: a meta-analysis of blended learning research. The Journal of Asia Tefl, 15(2), 365-382. http://dx.doi.org/10.18823/asiatefl.2018.15.2.7.365  [Google Scholar]
  52. Means, B., Murphy, R. & Baki, M. (2013). The effectiveness of online and blended learning: a meta-analysis of the empirical literature. Teachers College Record, 115, 1-47. Retrieved from http://www.tcrecord.org/Content.asp? ContentId=16882   [Google Scholar]
  53. Meriçelli, M. & Uluyol, Ç. (2016). The effect of web supported and mobile supported blended learning environment on students’ academic achievement and motivation. International Periodical for the Languages, Literature and History of Turkish or Turkic, 11(9), 879-904. http://dx.doi.org/10.7827/TurkishStudies.9781  [Google Scholar]
  54. Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis: An expanded Sourcebook. (2nd ed). Thousand Oaks, California: Sage. [Google Scholar]
  55. Mutlu Bilgin, M. (2020). The effect of cloud-based blended learning environment on the achievement, persistency, and cognitive load of students in vocational high schools. [Unpublished Master’s thesis, Ankara University, Department of Computer Education and Instructional Technologies, Ankara].  [Google Scholar]
  56. Nair, T. S. & Bindu, R. L. (2016). Effect of blended learning strategy on achievement in biology and social and environmental attitude of students at secondary level. Journal on School Educational Technology, 11(4), 38-52.  [Google Scholar]
  57. Obiedat, R., Nasir Eddeen, L., Harfoushi, O., Koury, A., AL-Hamarsheh, M. & AlAssaf, N. (2014). Effect of blended-learning on academic achievement of students in the University of Jordan. iJET, 9(2), 37-44. http://dx.doi.org/10.3991/ijet.v9i2.3220  [Google Scholar]
  58. Öner, G., Yıldırım, İ. & Bars, M. (2014). The effect of blended learning on students’ achievement for the topic of quadratic equation in mathematics education. Journal of Computer and Educational Research, 2(4), 152- 165.  [Google Scholar]
  59. Özerbaş, M. A. & Benli, N. (2015). The effect of blended learning on students’ academic achievement and their attitudes. GEFAD / GUJGEF, 35(1), 87-108.  [Google Scholar]
  60. Pesen, A. & Oral, B. (2014). The effect of blended learning approach on academic success and motivation of teacher candidates. Electronic Journal of Social Sciences, 15(58), 800-821. https://doi.org/10.17755/esosder.85356  [Google Scholar] [Crossref] 
  61. Pesen, A. (2014). The effect of blended learning environment on academic success, studying habits, and motivation of teacher candidates. [Unpublished Ph.D. Dissertation, Dicle University, Department of Educational Sciences Curriculum and Instruction, Diyarbakır]. [Google Scholar]
  62. Petitti, D.B. (2001). Approaches to heterogeneity in meta-analysis. Statistics in medicine, 20 (23), 3625-3633. https://doi.org/10.1002/sim.1091  [Google Scholar] [Crossref] 
  63. Roomy, M. A. & Althewini, A. (2019). The impact of blended learning on medical students’ reading performance in a Saudi University. ALLS, 10(4), 95-104. http://dx.doi.org/10.7575/aiac.alls.v.10n.4p.95  [Google Scholar]
  64. Sarıtepeci, M. & Çakır, H. (2015). The effect of blended learning environments on student's academic achievement and student engagement: a study on social studies course. Education and Science, 40(177), 203-216. https://doi.org/10.15390/EB.2015.2592  [Google Scholar] [Crossref] 
  65. Seage, S.J., & Türegün, M. (2020). The effects of blended learning on STEM achievement of elementary school students. International Journal of Research in Education and Science (IJRES), 6(1), 133-140. [Google Scholar]
  66. Şimşek, K. & İpek, J. (2019). Effects of computer Algebra systems on academic success in blended learning environments. Necatibey Faculty of Education Electronic Journal of Science and Mathematics Education, 13(2), 651-679. https://doi.org/10.17522/balikesirnef.519352   [Google Scholar] [Crossref] 
  67. Sitzmann, T., Kraiger, K., Stewart, D., & Wisher, R. (2006). The comparative effectiveness of web-based and classroom instruction: A meta-analysis. Personnel Psychology, 59(3), 623–664. [Google Scholar]
  68. Stockwell, B. R., Stockwell, M. S. Cennamo, M. & Jiang, E. (2015). Blended learning improves science education. Cell, 162, 933-936. http://dx.doi.org/10.1016/j.cell.2015.08.009  [Google Scholar]
  69. Türk, M. (2012). The effect of blended learning environment on 2-year vocational school students' engagement and academic achievement. [Unpublished Master thesis, Gazi University, Department of Computer Education and Instructional Technologies, Ankara].  [Google Scholar]
  70. Umar, Ç, & Ayvaz Reis, Z. (2017). The effects of differentiated curriculum with blended learning method on gifted students’ critical thinking abilities. Journal of Research in Informal Environments (JRINEN), 2(1), 34-58.  [Google Scholar]
  71. Ünsal, H. (2012). The effect of blended learning on motivation and success. The Journal of Turkish Educational Sciences, 10(1), 1-27.  [Google Scholar]
  72. Vernadakis, N., Giannousi, M., Derri, V., Michalopoulos, M. & Kioumourtzoglou, E. (2012). The impact of blended and traditional instruction in students’ performance. Procedia Technology, 1, 439 – 443. https://doi.org/10.1016/j.protcy.2012.02.098  [Google Scholar] [Crossref] 
  73. Vo, H. M., Zhua, C. & Diep, A. N. (2017). The effect of blended learning on student performance at course-level in higher education: A meta-analysis. Studies in Educational Evaluation, 53, 17–28. http://dx.doi.org/10.1016/j.stueduc.2017.01.002 0191-491  [Google Scholar]
  74. WHO. (2020). WHO coronavirus disease (covıd-19) dashboard. Retrieved from https://covid19.who.int/ on September 8, 2020. [Google Scholar]
  75. Yalçın, B. (2020). Investigation of the learning levels of 7th grade students in a blended learning environment (İzmir province -Karşiyaka district Eren Şahin Eronat Secondary School example). [Unpublished Master thesis, Manisa Celal Bayar University Institute of Natural and Applied Sciences, Department of Science Education, Manisa].  [Google Scholar]
  76. Yapıcı, İ. Ü. & Akbayın, H. (2012). The effect of blended learning model on high school students’ biology achievement and on their attitudes towards the internet. TOJET: The Turkish Online Journal of Educational Technology, 11(2), 228-237.  [Google Scholar]
  77. Yıldız, B. (2011). The effect of blended learning on social studies academic success of 7th grade students. [Unpublished Master thesis, Celal Bayar University, Department of Social Sciences, Manisa].  [Google Scholar]
  78. Yıldız, T. T. (2016). Inspecting the effect of blended learning on the academic success and motivation at coach training. [Unpublished Ph.D. Dissertation, Gazi University Graduate School of Educational Sciences, Ankara].  [Google Scholar]
  79. Zhao, Y., Lei, J., Yan, B., Lai, C., & Tan, H. S. (2005). What makes the difference? A practical analysis of research on the effectiveness of distance education. Teachers College Record, 107(8), 1836–1884. https://doi.org/10.1111/j.1467-9620. 2005.00544.x  [Google Scholar] [Crossref] 
  80. Zheng, L., Bhagat, K. K., Zhen, Y., & Zhang, X. (2020). The Effectiveness of the flipped classroom on students’ learning achievement and learning motivation: A meta-analysis. Educational Technology & Society, 23 (1), 1–15. [Google Scholar]