International Association of Educators   |  ISSN: 2834-7919   |  e-ISSN: 1554-5210

Original article | International Journal of Progressive Education 2023, Vol. 19(4) 1-17

Development of Portfolio Related Scales for Early Childhood Teachers: A Validity and Reliability Study

Nur Alacam, Refika Olgan & Yeşim Çapa-Aydın

pp. 1 - 17   |  DOI: https://doi.org/10.29329/ijpe.2023.579.1   |  Manu. Number: MANU-2304-05-0003.R1

Published online: August 01, 2023  |   Number of Views: 182  |  Number of Download: 226


Abstract

Portfolio is one of the common forms of pedagogical documentation around the world. However, there is no suitable instrument to measure teachers’ portfolio practices in early childhood education. In this study, it was aimed to develop scales on portfolio practices and its possible predictors based upon extended Theory of Planned Behavior (TPB). Initially, content validity was ensured with expert opinions and cognitive interviews with early childhood teachers. After that pilot data were collected from 371 early childhood teachers and exploratory factor analysis (EFA) was conducted to explore the factor structure of the scales. Then, main study data were gathered from 605 early childhood teachers, and confirmatory factor analysis (CFA) was conducted to confirm the factor structure of the scales. Internal consistency coefficients were also calculated for the reliability analysis in both pilot study and main study data. As a result, findings confirmed the validity and reliability of the scales.

Keywords: Early Childhood Education, Portfolio Assessment, Scale Development, Theory of Planned Behavior


How to Cite this Article?

APA 6th edition
Alacam, N., Olgan, R. & Capa-Aydin, Y. (2023). Development of Portfolio Related Scales for Early Childhood Teachers: A Validity and Reliability Study . International Journal of Progressive Education, 19(4), 1-17. doi: 10.29329/ijpe.2023.579.1

Harvard
Alacam, N., Olgan, R. and Capa-Aydin, Y. (2023). Development of Portfolio Related Scales for Early Childhood Teachers: A Validity and Reliability Study . International Journal of Progressive Education, 19(4), pp. 1-17.

Chicago 16th edition
Alacam, Nur, Refika Olgan and Yesim Capa-Aydin (2023). "Development of Portfolio Related Scales for Early Childhood Teachers: A Validity and Reliability Study ". International Journal of Progressive Education 19 (4):1-17. doi:10.29329/ijpe.2023.579.1.

References
  1. Ajzen, I. (1991). The theory of planned behavior. Organizational behavior and human decision processes, 50(2), 179-211. [Google Scholar]
  2. Ajzen, A. (1996). The social psychology of decision making. In E.T. Higgins, & A.W. Kruglanski (Eds.), Social psychology: Handbook of Basic Principles (pp.297-325). New York, NY: The Guilford Press.  [Google Scholar]
  3. Ajzen, I. (2002). Perceived behavioral control, self-efficacy, locus of control, and the Theory of Planned Behavior. Journal of Applied Social Psychology, 32(4), 665-683. [Google Scholar]
  4. Ajzen, I. (2005). Attitudes, personality, and behavior (2nd edition). Maidenhead: Open University Press.  [Google Scholar]
  5. Author (2016). Details removed for peer review process.  [Google Scholar]
  6. Author (2022). Details removed for peer review process.  [Google Scholar]
  7. Appl, D. J., Leavitt, J. E., & Ryan, M. A. (2014). Parent-child portfolios: ‘‘Look—this book is all about us!’’. Early Childhood Education Journal, 42(3), 191–202. doi:10.1007/s10643-013- 0598-1 [Google Scholar] [Crossref] 
  8. Armitage, C. J., & Conner, M. (2001). Efficacy of the theory of planned behavior: A meta-analytic review. British Journal of Social Psychology, 40(4), 471-499. [Google Scholar]
  9. Bamberg, S., Hunecke, M., & Blobaum, A. (2007). Social context, personal norms, and the use of public transportation: Two field studies. Journal of Environmental Psychology, 27, 190–203. doi: 10.1016/j.jenvp.2007.04.001 [Google Scholar] [Crossref] 
  10. Bandura, A. (1977). Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, 84(2), 191–215.  [Google Scholar]
  11. Bandura, A. (1997). Self-efficacy: The exercise of control. New York, NY: W. H. Freeman & Company. [Google Scholar]
  12. Banta, T.W. (Ed.). (2003). Portfolio assessment: Uses, cases, scoring, and impact. San Francisco, CA: Assessment Update Collections.  [Google Scholar]
  13. Barnes, N., Fives, H., & Dacey, C.M. (2017). U.S. teachers' conceptions of the purposes of assessment. Teaching and Teacher Education, 65, 107-116. http://dx.doi.org/10.1016/j.tate.2017.02.017 [Google Scholar]
  14. Becher, I., Rigaud, V.M., & Epstein, A. (2022). Getting to know young children: Alternative assessments in early childhood education. Early Childhood Education Journal. https://doi.org/10.1007/s10643-022-01353-y [Google Scholar] [Crossref] 
  15. Bozionelos, G., & Bennett, P. (1999). The Theory of Planned Behavior as predictor of exercise: The moderating influence of beliefs and personality variables. Journal of Health Psychology, 4(4), 517-529. [Google Scholar]
  16. Brown, G. T. L. (2004). Teachers' conceptions of assessment: Implications for policy and professional development. Assessment in Education: Principles, Policy & Practice, 11(3), 301-318. [Google Scholar]
  17. Brown, T.A. (2006). Confirmatory factor analysis for applied research. New York, NY: The Guilford Press.   [Google Scholar]
  18. Brown, G. T. L., Hui, S. K. F., Yu, F. W. M., & Kennedy, K. J. (2011). Teachers' conceptions of assessment in Chinese contexts: A tripartite model of accountability, improvement, and irrelevance. International Journal of Educational Research, 50(5/6), 307-320. [Google Scholar]
  19. Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136-162). Newbury Park, CA: Sage. [Google Scholar]
  20. Butler, S.M., & McMunn, N.D. (2006). A teacher’ guide to classroom assessment. Understanding and using classroom assessment to improve student learning. San Francisco, CA: Jossey-Bass. [Google Scholar]
  21. Butts, M.M (1997). A survey of elementary school teachers’ attitude toward student portfolio assessment (Unpublished Doctoral Dissertation). The University of Mississippi, MS, U.S. [Google Scholar]
  22. Collins, D. (2003). Pretesting survey instruments: An overview of cognitive methods. Quality of Life Research 12, 229–238. [Google Scholar]
  23. Conner, M. & Armitage, C. J. (1998) Extending the theory of planned behavior: A review and avenues for further research. Journal of Applied Social Psychology, 28, 1429-1464. [Google Scholar]
  24. Couchenour, D., & Chrisman, J.K. (2000). The Sage Encyclopedia of Contemporary Early Childhood Education. Sage Publications. ProQuest E-book Central, http://ebookcentral.proquest.com/lib/wisc/detail.action?docID=4625105. [Google Scholar]
  25. Doran, R., & Larsen, S. (2016). The relative importance of social and personal norms in explaining intentions to choose eco-friendly travel options. International Journal of Tourism Research, 18, 159–166. [Google Scholar]
  26. Drennan, J. (2003). Cognitive interviewing: verbal data in the design and pretesting of questionnaires. Journal of Advanced Nursing, 42(1), 57-63.  [Google Scholar]
  27. Dunn, R., Hattie, J., & Bowles, T. (2018). Using the Theory of Planned Behavior to explore teachers’ intentions to engage in ongoing teacher professional learning. Studies in Educational Evaluation, 59, 288–294. https://doi.org/10.1016/j.stueduc.2018.10.001 [Google Scholar] [Crossref] 
  28. Fabrigar, L.R., & Wegener, D.T. (2012). Exploratory factor analysis. Understanding statistics.  Oxford University Press. [Google Scholar]
  29. Fiore, L.B. (2012). Assessment of young children: A collaborative approach. New York, NY: Routledge. [Google Scholar]
  30. Fishbein, M., & Ajzen, I. (2010). Predicting and changing behavior. The reasoned action approach. New York, NT: Psychology Press. [Google Scholar]
  31. Gollwitzer, P.M., & Bargh, J.A. (1996). The psychology of action: Linking cognition and motivation to behavior. New York: The Guilford Press.  [Google Scholar]
  32. Gronlund, G., & Engel. B. (2001). Focused portfolios: A complete assessment for the young child. St. Paul, MN: Readleaf Press. [Google Scholar]
  33. Guo, Y., Dynia, J., Pelatti, C., & Justice, L. (2014). Self-efficacy of early childhood special education teachers. Teacher and Teacher Education, 39, 12-21. doi: 10.1016/j.tate.2013.11.005 [Google Scholar] [Crossref] 
  34. Hair, J.F., Black, W.C., Babin, B.J., & Anderson, R.E. (2010). Multivariate data analysis: A global perspective (7th ed.). Upper Saddle River, New Jersey: Pearson Education.  [Google Scholar]
  35. Harland, P., Staats, H., & Wilke, H.A.M. (1999). Explaining proenvironmental intention and behavior by personal norms and the Theory of Planned Behavior. Journal of Applied Social Psychology, 29(12), 2505-2528. https://doi.org/10.1111/j.1559-1816.1999.tb00123.x [Google Scholar] [Crossref] 
  36. Harris, M.B., & Curran, C.M. (1998). Knowledge, attitudes, and concerns about portfolio assessment: An exploratory study. Teacher Education and Special Education, 21(2), 83-94. [Google Scholar]
  37. Hou, Y., & Hsieh, M.F. (2019). Helping parents reexamine children’s emergent writing performance through parent–teacher portfolio sharing conferences. Australasian Journal of Early Childhood, 44(4), 378-391. doi: 10.1177/1836939119870924 [Google Scholar] [Crossref] 
  38. Kim, Y., & Yazdian, L.S. (2014). Portfolio assessment and quality teaching. Theory into Practice, 53(3), 220-227. doi: 10.1080/00405841.2014.916965 [Google Scholar] [Crossref] 
  39. Kingore, B. (2008). Developing portfolio for authentic assessment, PreK-3: Guiding potential in young learners. Thousand Oaks, CA: Corwin Press.  [Google Scholar]
  40. Kiser, W.K. (2008). The NAEYC classroom portfolio process: Examining the relationship between demographic characteristics and external factors that support teacher motivation (Unpublished Master’s thesis). University of North Carolina at Chapel Hill, U.S. [Google Scholar]
  41. Knabe, A.P. (2012). Applying Ajzen's theory of planned behavior to a study of online course adoption in public relations education (Doctoral dissertation). Retrieved from Dissertations. [Google Scholar]
  42. Knauf, H. (2015). Styles of documentation in German early childhood education. Early Years, 35(3), 232-248. doi: 10.1080/09575146.2015.1011066 [Google Scholar] [Crossref] 
  43. Knauf, H. (2017a). Making an impression: Portfolios as instruments of impression management for teachers in early childhood education and care centers. Early Childhood Educ J, 45(4), 481–491. [Google Scholar]
  44. Knauf, H. (2017b). Documentation as a tool for participation in German early childhood education and care. European Early Childhood Education Research Journal, 25(1), 19-35. doi: 10.1080/1350293X.2015.1102403 [Google Scholar] [Crossref] 
  45. Krnjaja, Z., & Pavlović- Breneselović, D. (2016). Preschool teachers’ perspectives on the purpose of a child portfolio in the preschool curriculum: The case of Serbia. Journal of Contemporary Educational Studies, 67(133), 148-167.  [Google Scholar]
  46. Lee, J., Cerreto, F.A., & Lee, J. (2010). Theory of Planned Behavior and teachers’ decisions regarding use of educational technology. Educational Technology & Society, 13(1), 152–164. [Google Scholar]
  47. Litchfield, B.C., & Dempsey, J.V. (2015). Authentic assessment of knowledge, skills, and attitudes. New Directions for Teaching and Learning, 142, 65-80.doi: 10.1002/tl.20130  [Google Scholar] [Crossref] 
  48. MacFarlane, F., & Woolfson, L.M. (2013). Teacher attitudes and behavior toward the inclusion of children with social, emotional and behavioral difficulties in mainstream schools: An application of the theory of planned behavior. Teaching and Teacher Education, 29,46-52. https://doi.org/10.1016/j.tate.2012.08.006  [Google Scholar] [Crossref] 
  49. Martin, J.J., & Kulinna, P.H. (2004). Self-efficacy theory and the theory of planned behavior: Teaching physically active physical education classes. Research Quarterly for Exercise and Sport, 75(3), 288-297. doi: 10.1080/02701367.2004.10609161 [Google Scholar] [Crossref] 
  50. McAfee, O., Leong, D.J., & Bodrova, E. (2016). Assessing and guiding young children’s development and learning (6th ed.). Boston: Pearson. [Google Scholar]
  51. McCoach, D.B., Gable, R.K., & Madura, J.P. (2013). Instrument development in the affective domain. School and Corporate Applications (3rd ed.). New York: Springer. [Google Scholar]
  52. Menand, V., Clément, M.E., & April, J. (2021). Early childhood educator’s intention to provide support in the context of parental violence: The contribution of the theory of planned behavior. Journal of Early Childhood Teacher Education, 42(2), 162-181, doi:10.1080/10901027.2021.1918295 [Google Scholar] [Crossref] 
  53. Netemeyer, R.G., Bearden, W.O., & Sharma, S. (2003). Scaling procedures. Issues and applications. Thousand Oaks, CA: Sage Publications.  [Google Scholar]
  54. Patterson, R.R. (2000). College and pre-college teachers’ beliefs, intentions, and behaviors regarding the implementation of microbiology activities presented in a professional development workshop: An application of the theory of planned behavior (Unpublished Doctoral Dissertation). Duquesne University, Pittsburgh, PA, U.S. [Google Scholar]
  55. Pekis, A., & Gourgiotou, E. (2017). Parental perceptions about children’s authentic assessment and the work sampling system’s implementation. International Journal of Assessment Tools in Education, 4(2), 182-210. doi: 10.21449/ijate.318250 [Google Scholar] [Crossref] 
  56. Pickens, A. (2018). Pre-kindergarten and kindergarten teachers' perceptions of the student growth portfolio model in Tennessee (Doctoral Dissertation). Retrieved from Electronic Theses and Dissertations.  [Google Scholar]
  57. Piker, R.A., & Jewkes, A.M. (2013). Assessing young children’s learning. In D.R. Reutzel (Eds.), Handbook of research-based practice in early education (pp.250-271). New York, NY: Guilford Press.  [Google Scholar]
  58. Roos, D., & Hahn, R. (2019). Understanding collaborative consumption: An extension of the Theory of Planned Behavior with value-based personal norms. Journal of Business Ethics, 158(3). doi: 10.1007/s10551-017-3675-3 [Google Scholar] [Crossref] 
  59. Schaaf, M.F., Stokking, K.M., & Verloop, N. (2008). Teacher beliefs and teacher behavior in portfolio assessment. Teaching and Teacher Education, 24(7), 1691–1704. https://doi.org/10.1016/j.tate.2008.02.021 [Google Scholar] [Crossref] 
  60. Shores, E.F., & Grace (1998). The portfolio book: A step by step guide for teachers. Beltswille, Maryland: Gryphon House.  [Google Scholar]
  61. Sonnier, C.A. (1999). Elementary general educators' beliefs, attitudes, and practices of portfolio assessment (Unpublished Doctoral Dissertation). The University of Alabama, Tuscaloosa, AL, U.S. [Google Scholar]
  62. Stiggins, R. (2005). Using student-involved classroom assessment to close achievement gaps (4th ed.). Columbus, OH: Merrill Prentice Hall.  [Google Scholar]
  63. Tangdhanakanond, K., & Archwamety, T. (2019). Teachers’ misconceptions and current performance in implementing student portfolio assessment in elementary schools in Thailand. International Journal of Psychology: Biopsychosocial Approach, 23, 39-62. https://doi.org/10.7220/2345-024X.23.2 [Google Scholar] [Crossref] 
  64. Teo, T., Zhou, M., & Noyes, J. (2016). Teachers and technology: Development of an extended theory of planned behavior. Educational Technology Research and Development, 64, 1033–1052. doi: 10.1007/s11423-016-9446-5 [Google Scholar] [Crossref] 
  65. Thompson, B. (2004). Exploratory and confirmatory factor analysis. Understanding concepts and applications. Washington, DC: American Psychological Association. [Google Scholar]
  66. Tsigilis, N. (2006). Applicability of the planned behavior theory to attitudes of students in early childhood education toward teaching culturally diverse classes: The role of self-identity. Psychological Reports, 100, 1123- 1128. https://doi.org/10.2466/pr0.100.4.1123-1128 [Google Scholar] [Crossref] 
  67. Tsigilis, N., Tsioumis, K., & Gregoriadis, A. (2006). Prospective early childhood educators’ attitudes toward teaching multicultural classes: A planned behavior theory perspective. Journal of Early Childhood Teacher Education, 27, 265–273. doi: 10.1080/10901020600843624 [Google Scholar] [Crossref] 
  68. Wortham, S., & Hardin, B.J. (2016). Assessment in early childhood education (7th ed.). USA: Pearson.  [Google Scholar]
  69. Yan, Z. (2014). Predicting teachers' intentions to implement school-based assessment using the Theory of Planned Behavior. Educational Research and Evaluation, 20(2), 83-97. doi: 10.1080/13803611.2013.877394 [Google Scholar] [Crossref] 
  70. Yan, Z., & Cheng, E.C.K. (2015). Primary teachers' attitudes, intentions and practices regarding formative assessment. Teaching and Teacher Education, 45, 128-136. http://dx.doi.org/10.1016/j.tate.2014.10.002 [Google Scholar]
  71. Yan, Z., & Sin, K. (2014). Inclusive education: Teachers' intentions and behavior analyzed from the viewpoint of the Theory of Planned Behavior. International Journal of Inclusive Education, 18(1), 72-85. doi: 10.1080/13603116.2012.757811 [Google Scholar] [Crossref]