Examining Turkish Students' Views on the Reading Literacy Tasks of PISA 2018 in Terms of Different Variables

Author :  

Year-Number: 2021-Volume 13, Issue 1
Yayımlanma Tarihi: 2020-11-28 13:39:42.0
Language : English
Konu :
Number of pages: 125-140
Mendeley EndNote Alıntı Yap

Abstract

Keywords

Abstract

The study investigates possible factors affecting Turkish students' perception of task difficulty in the Program for International Student Assessment (PISA) 2018. The research data consist of the survey responses of the students who participated in the PISA 2018. The participants include 6679 15-year-old Turkish students. The dependent variable of this study is the students' views of the reading task difficulty in the PISA 2018. Independent variables are divided into two as student-level and school-level variables. The student-level variables include strategy use, reading format preference, time spent reading, perceived difficulty, and frequency of being online. The school-related variable is schools’ digital capacity. Since the PISA sample has a nested structure, the data were analyzed using hierarchical linear modeling (HLM). The analysis showed that the differences among schools predicted approximately 9.8% of the variation in students' perception of the difficulty of reading literacy tasks in PISA while the rest of the percentage was due to the differences among students. In the regression model, student-level and school-level variables as groups appeared to predict the dependent variable significantly. In the final interactive regression model, the interactions of student and school-level variables were examined, and the interaction appeared not to be a significant predictor of the dependent variable. Based on the HLM analysis, it can be argued that PISA tasks are perceived as easier in cases where schools' digital capacity increases, students opt for strategy use, the use of electronic media in reading increases, the difficulty in reading and comprehension decreases, the time spent reading increases, and the frequency of being online increases.

Keywords

Kaynakça

  • Akyol, H. (2011). Türkçe öğretim yöntemleri (Yeni programa uygun) (4 ed.). Ankara: Pegem Akademi Yayıncılık.
  • Aydin, A., Erdağ, C., & Taş, N. (2011). A Comparative Evaluation of Pisa 2003-2006 Results in Reading Literacy Skills: An Example of Top-Five OECD Countries and Turkey. Kuram ve Uygulamada Egitim Bilimleri, 11, 665-673.
  • Biancarosa, G., & Snow, C. (2006). Reading Next: A Vision for Action and Research in Middle and High School Literacy (Second ed.). Washington, DC: Alliance for Excellent Education, Carnegie Corporation.
  • Bozkurt, B. Ü. (2016). Türkiye’de Okuma Eğitiminin Karnesi: PISA Ölçeğinden Çıkarımlar. Abant İzzet Baysal Üniversitesi Eğitim Fakültesi Dergisi, 16(4), 1673-1686.
  • Brozo, W. G., Shiel, G., & Topping, K. (2007). Engagement in Reading: Lessons Learned From Three PISA Countries. Journal of Adolescent & Adult Literacy, 51(4), 304-315. doi:10.1598/jaal.51.4.2
  • Brozo, W. G., Sulkunen, S., Shiel, G., Garbe, C., Pandian, A., & Valtin, R. (2014). Reading, Gender, and Engagement: Lessons From Five PISA Countries. Journal of Adolescent & Adult Literacy, 57(7), 584-593. doi:10.1002/jaal.291
  • Bulut, O., & Cutumisu, M. (2018). When technology does not add up: ICT use negatively predicts mathematics and science achievement for Finnish and Turkish students in PISA 2012. Journal of Educational Multimedia and Hypermedia, 27(1), 25-42.
  • Cheema, J. R. (2018). Adolescents' enjoyment of reading as a predictor of reading achievement: new evidence from a cross-country survey. 41(S1), S149-S162. doi:10.1111/1467-9817.12257
  • Cheon, H. J., & Ma, J. H. (2014). The effects of reading purpose on reading comprehension and perceived difficulty. English Teaching, 69(2), 51-69. doi:10.15858/ENGTEA.69.2.201406.51
  • Clinton, V. (2019). Reading from paper compared to screens: A systematic review and meta-analysis. Journal of Research in Reading, 42(2), 288-325. doi:10.1111/1467-9817.12269
  • Cope, B., & Kalantzis, M. (2000). Multiliteracies: literacy learning and the design of social futures. London: Routledge.
  • Çeçen, M. A., & Alver, M. (2011). Türkçe öğretmeni adaylarının üstbilişsel okuma stratejilerini kullanma düzeyleri (Giresun Üniversitesi örneği). Karadeniz Sosyal Bilimler Dergisi, 3(5), 39-56.
  • Delgado, P., Vargas, C., Ackerman, R., & Salmerón, L. (2018). Don't throw away your printed books: A meta- analysis on the effects of reading media on reading comprehension. Educational Research Review, 25, 23-38. doi:https://doi.org/10.1016/j.edurev.2018.09.003
  • Duran, E., & Alevli, O. (2014). Öğrenci görüşleri: Dijital metin mi basılı metin mi? International Journal of Language Academy,, 2(2), 110-126.
  • Fulcher, G. (1997). Text difficulty and accessibility: Reading formulae and expert judgement. System, 25(4), 497-513. doi:10.1016/S0346-251X(97)00048-1
  • Fulmer, S. M., D'Mello, S. K., Strain, A., & Graesser, A. C. (2015). Interest-based text preference moderates the effect of text difficulty on engagement and learning. Contemporary Educational Psychology, 41, 98-110. doi:10.1016/j.cedpsych.2014.12.005
  • Fulmer, S. M., & Frijters, J. C. (2011). Motivation During an Excessively Challenging Reading Task: The Buffering Role of Relative Topic Interest. The Journal of Experimental Education, 79(2), 185-208. doi:10.1080/00220973.2010.481503
  • Fulmer, S. M., & Tulis, M. (2013). Changes in interest and affect during a difficult reading task: Relationships with perceived difficulty and reading fluency. Learning and Instruction, 27, 11-20. doi:10.1016/j.learninstruc.2013.02.001
  • Gallucci, M. (2019). GAMLj: General analyses for linear models [jamovi module]. Retrieved from https://gamlj.github.io/
  • Gil-Flores, J., Torres-Gordillo, J.-J., & Perera-Rodriguez, V.-H. (2012). The role of online reader experience in explaining students’ performance in digital reading. Computers & Education, 59(2), 653-660.
  • Goldhammer, F., Naumann, J., Stelter, A., Tóth, K., Rölke, H., & Klieme, E. (2014). The time on task effect in reading and problem solving is moderated by task difficulty and skill: Insights from a computer-based large-scale assessment. Journal of Educational Psychology, 106(3), 608-626. doi:10.1037/a0034716
  • Gubbels, J., Swart, N. M., & Groen, M. A. (2020). Everything in moderation: ICT and reading performance of Dutch 15-year-olds. Large-scale Assessments in Education, 8(1), 1. doi:10.1186/s40536-020-0079-0
  • Guthrie, J. T., Klauda, S. L., & Ho, A. N. (2013). Modeling the Relationships Among Reading Instruction, Motivation, Engagement, and Achievement for Adolescents. Reading research quarterly, 48(1), 9-26. doi:10.1002/rrq.035
  • Güngör, A. (2005). Altıncı yedinci ve sekizinci sınıf öğrencilerinin okuduğunu anlama stratejilerini kullanma düzeyleri. Hacettepe Üniversitesi Eğitim Fakültesi Dergisi, 28(28), 101-108.
  • Harju-Luukkainen, H., Vettenranta, J., Ouakrim-Soivio, N., & Bernelius, V. (2016). Differences between students’ PISA reading literacy scores and grading for mother tongue and literature at school: A geostatistical analysis of the Finnish PISA 2009 data. Education Inquiry, 7(4). doi:10.3402/edui.v7.29413
  • Hou, J., Rashid, J., & Lee, K. M. (2017). Cognitive map or medium materiality? Reading on paper and screen. Computers in Human Behavior, 67(C), 84–94. doi:10.1016/j.chb.2016.10.014
  • IBM Corp. (2013). IBM SPSS Statistics for Windows (Version 22.0). Armonk, NY: IBM Corp.
  • Kankaraš, M., & Moors, G. (2014). Analysis of Cross-Cultural Comparability of PISA 2009 Scores. 45(3), 381- 399. doi:10.1177/0022022113511297
  • Kauchak, D., Leroy, G., & Hogue, A. (2017). Measuring text difficulty using parse-tree frequency. Journal of the Association for Information Science and Technology, 68(9), 2088-2100. doi:10.1002/asi.23855
  • Keskin, H. K. (2014). A Path Analysis of Metacognitive Strategies in Reading, Self-Efficacy and Task Value. International J. Soc. Sci. & Education, 4(4), 798-808.
  • Keskin, H. K., & Çetinkaya, F. Ç. (2017). Preferred Format in Reading the Course Materials: Digital or Paper? Research in Reading & Writing Instruction, 5(2), 75-87.
  • Klauda, S. L., & Guthrie, J. T. (2015). Comparing relations of motivation, engagement, and achievement among struggling and advanced adolescent readers. Reading and Writing, 28(2), 239-269. doi:10.1007/s11145014-9523-2
  • Kong, Y., Seo, Y. S., & Zhai, L. (2018). Comparison of reading performance on screen and on paper: A meta- analysis. Computers & Education, 123, 138-149. doi:https://doi.org/10.1016/j.compedu.2018.05.005
  • Lee, Y.-H., & Wu, J.-Y. (2012). The effect of individual differences in the inner and outer states of ICT on engagement in online reading activities and PISA 2009 reading literacy: Exploring the relationship between the old and new reading literacy. Learning and Individual Differences, 22(3), 336-342. doi:10.1016/j.lindif.2012.01.007
  • Leino, K. (2014). The relationship between ICT use and reading literacy Focus on 15-year-old Finnish students in PISA studies. In. Retrieved from https://jyx.jyu.fi/bitstream/handle/123456789/44930/978-951-39-58282.pdf?sequence=1&isAllowed=y
  • Leroy, G., Helmreich, S., & Cowie, J. R. (2010). The influence of text characteristics on perceived and actual difficulty of health information. International Journal of Medical Informatics, 79(6), 438-449. doi:10.1016/j.ijmedinf.2010.02.002
  • Liu, Y., Doucette, W. R., & Farris, K. B. (2007). Perceived difficulty and self-efficacy in the factor structure of perceived behavioral control to seek drug information from physicians and pharmacists. Research in Social and Administrative Pharmacy, 3(2), 145-159. doi:10.1016/j.sapharm.2006.07.002
  • Mak, S.-k., Cheung, K.-c., Soh, K., Sit, P.-s., & Ieong, M.-k. (2017). An examination of student- and across-level mediation mechanisms accounting for gender differences in reading performance: a multilevel analysis of reading engagement. Educational Psychology, 37(10), 1206-1221. doi:10.1080/01443410.2016.1242712
  • McQueen, J., & Mendelovits, J. (2003). PISA reading: cultural equivalence in a cross-cultural study. Language Testing, 20(2), 208-224. doi:10.1191/0265532203lt253oa
  • MEB. (2019). PISA 2018 Türkiye ön raporu. Retrieved from http://www.meb.gov.tr/meb_iys_dosyalar/2019_12/03105347_PISA_2018_Turkiye_On_Raporu.pdf
  • Mizrachi, D., Boustany, J., Kurbanoğlu, S., Doğan, G., Todorova, T., & Vilar, P. (20016). The Academic Reading Format International Study (ARFIS): Investigating Students Around the World. In S. Kurbanoğlu, J. Boustany, S. Špiranec, E. Grassian, D. Mizrachi, L. Roy, & Ç. T. (Eds.), Information Literacy: Key to an Inclusive Society ECIL 2016 (pp. 215-227): Springer.
  • Mozuraite, V. (2015). Change of the reading paradigm in the age of e-book. Libellarium: journal for the research of writing, books, and cultural heritage institutions, 7. doi:10.15291/libellarium.v7i1.199
  • Neff, L. (2015). The Relationship Between Reading Enjoyment, Gender, Socioeconomic Status, and Reading Outcomes in PISA 2009. (54 Doctor of Education), George Fox University, Retrieved from https://digitalcommons.georgefox.edu/edd/54
  • OECD. (2014). PISA 2012 Results: What Students Know and Can Do (Revised ed. Vol. I). Paris: Student Performance in Mathematics, Reading and Science, PISA, OECD Publishing.
  • OECD. (2019a). PISA 2018 Assessment and Analytical Framework. Paris: PISA, OECD Publishing.
  • OECD. (2019b). PISA 2018 Results (Volume I): What Students Know and Can Do. Paris: PISA, OECD Publishing.
  • OECD. (2020). PISA 2018 Database. Retrieved 10.05.2020, from OECD https://www.oecd.org/pisa/data/2018database/
  • Oxford, R., Cho, Y., Leung, S., & Kim, H.-J. (2004). Effect of the presence and difficulty of task on strategy use: An exploratory study %J International Review of Applied Linguistics in Language Teaching. 42(1), 147. doi:https://doi.org/10.1515/iral.2004.001
  • Özer Özkan, Y., & Doğan, B. (2013). İlköğretim 8. Sınıf Öğrencilerinin Okuma Becerilerinin Kestirilmesinde Etkili Olan Değişkenlerin Belirlenmesi. International Journal of Social Science, 6(4), 667-680.
  • Petko, D., Cantieni, A., & Prasse, D. (2016). Perceived Quality of Educational Technology Matters: A Secondary Analysis of Students' ICT Use, ICT-Related Attitudes, and PISA 2012 Test Scores. Journal of Educational Computing Research, 54(8), 1070-1091. doi:10.1177/0735633116649373
  • Pfost, M., Dörfler, T., & Artelt, C. (2013). Students' extracurricular reading behavior and the development of vocabulary and reading comprehension. Learning and Individual Differences, 26, 89-102. doi:10.1016/j.lindif.2013.04.008
  • Puteh, M., Zin, Z. M., & Ismail, I. (2016). Reading performance of Malaysian students across gender in PISA 2012. 3L: Language, Linguistics, Literature, 22(2), 109-121. doi:10.17576/3L-2016-2202-08
  • R Core Team. (2018). R: A Language and environment for statistical computing [Computer software]. Retrieved from https://cran.r-project.org/
  • Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models : applications and data analysis methods (Second ed.). Thousand Oaks: Sage Publications.
  • Rosenzweig, E. Q., & Wigfield, A. (2017). What if reading is easy but unimportant? How students’ patterns of affirming and undermining motivation for reading information texts predict different reading outcomes. Contemporary Educational Psychology, 48, 133-148. doi:10.1016/j.cedpsych.2016.09.002
  • Rutherford, L., Singleton, A., Derr, L. A., & Merga, M. K. (2018). Do digital devices enhance teenagers’ recreational reading engagement? Issues for library policy from a recent study in two Australian states. Public Library Quarterly, 37(3), 318-340. doi:10.1080/01616846.2018.1511214
  • Säälik, Ü., Nissinen, K., & Malin, A. (2015). Learning strategies explaining differences in reading proficiency. Findings of Nordic and Baltic countries in PISA 2009. Learning and Individual Differences, 42, 36-43.
  • Shiel, G., & Eivers, E. (2009). International comparisons of reading literacy: what can they tell us? Cambridge Journal of Education, 39(3), 345-360. doi:10.1080/03057640903103736
  • Siegenthaler, E., Wurtz, P., Bergamin, P., & Groner, R. (2011). Comparing reading processes on e-ink displays and print. Displays, 32(5), 268-273. doi:10.1016/j.displa.2011.05.005
  • Soemer, A., & Schiefele, U. (2019). Text difficulty, topic interest, and mind wandering during reading. Learning and Instruction, 61, 12-22. doi:10.1016/j.learninstruc.2018.12.006
  • Spaull, N. (2019). Who makes it into PISA? Understanding the impact of PISA sample eligibility using Turkey as a case study (PISA 2003–PISA 2012). Assessment in Education: Principles, Policy & Practice, 26(4), 397421. doi:10.1080/0969594X.2018.1504742
  • Spaull, N., & Taylor, S. (2015). Access to What? Creating a Composite Measure of Educational Quantity and Educational Quality for 11 African Countries. Comparative Education Review, 59(1), 133-165. doi:10.1086/679295
  • Spencer, C. (2006). Research on Learners' Preferences for Reading from a Printed Text or from a Computer Screen. Journal of Distance Education, 21(1), 33-50.
  • Steffens, K. (2014). ICT Use and Achievement in Three European Countries: What Does PISA Tell Us? European Educational Research Journal, 13(5), 553-562. doi:10.2304/eerj.2014.13.5.553
  • Stokmans, M. J. W. (1999). Reading attitude and its effect on leisure time reading. Poetics, 26(4), 245-261. doi:10.1016/S0304-422X(99)00005-4
  • Sullivan, K., McConney, A., & Perry, L. B. (2018). A Comparison of Rural Educational Disadvantage in Australia, Canada, and New Zealand Using OECD’s PISA. SAGE Open, 8(4), 1-12. doi:10.1177/2158244018805791
  • Tan, C. Y. (2020). Comparing Cultural Capital Across Groups and Countries. In Family Cultural Capital and Student Achievement: Theoretical Insights from PISA (pp. 47-55). Singapore: Springer Singapore.
  • Tavsancıl, E., Yıldırım, O., & Bilican Demir, S. (2019). Direct and Indirect Effects of Learning Strategies and Reading Enjoyment on PISA 2009 Reading Performance. Eurasian Journal of Educational Research, 82, 169-189.
  • The jamovi project. (2019). Jamovi (Version 1.1) [Computer Software]. Retrieved from https://www.jamovi.org
  • Torgesen, J. K., Houston, D. D., Rissman, L. M., Decker, S. M., Roberts, G., Vaughn, S., . . . Lesaux, N. (2007). Academic literacy instruction for adolescents: A guidance document from the Center on Instruction. Portsmouth, NH: RMC Research Corporation, Center on Instruction.
  • Torppa, M., Eklund, K., Sulkunen, S., Niemi, P., & Ahonen, T. (2018). Why do boys and girls perform differently on PISA Reading in Finland? The effects of reading fluency, achievement behaviour, leisure reading and homework activity. Journal of Research in Reading, 41(1), 122-139. doi:10.1111/1467
  • Tsvetkova, M. I. (2016). The shadows of reading: Reasons for the bad results of Bulgarians in PISA studies. European Journal of Contemporary Education, 17(3), 368-377. doi:10.13187/ejced.2016.17.368
  • Tveit, Å. K., & Mangen, A. (2014). A joker in the class: Teenage readers' attitudes and preferences to reading on different devices. Library & Information Science Research, 36(3-4), 179-184. doi:10.1016/j.lisr.2014.08.001
  • Ürün Karahan, B., & Taşdan, M. (2016). 5. ve 6. Sınıf Öğrencilerinin Okumaya Karşı Tutum Ve Motivasyonlarının Okuduğunu Anlama Becerileri İle İlişkisi. Uluslararası Türkçe Edebiyat Kültür Eğitim (Teke) Dergisi, 5(2), 949-969.
  • Vázquez-Cano, E., Gómez-Galán, J., Infante-Moro, A., & López-Meneses, E. (2020). Incidence of a Non- Sustainability Use of Technology on Student“ Reading Performance in Pisa. Sustainability, 12(2), 749. doi:10.3390/su12020749
  • Woltman, H., Feldstain, A., MacKay, J. C., & Rocchi, M. (2012). An introduction to hierarchical linear modeling. Tutorials in Quantitative Methods for Psychology, 8(1), 52-69.
  • Zammit, K. (2011). Charting a pathway : embedding ICT and new literacies into the curriculum. In C. M. L. Ho, K. T. Anderson, & A. P. Leong (Eds.), Transforming Literacies and Language: Multimodality and Literacy in the New Media Age. New York: Continuum.
  • Zasacka, Z., & Bulkowski, K. (2017). Reading engagement and school achievement of lower secondary school students. Edukacja, 2(141), 78–99. doi:10.24131/3724.170205
  • Zehner, F., Goldhammer, F., & Sälzer, C. (2018). Automatically analyzing text responses for exploring gender- specific cognitions in PISA reading. Large-scale Assessments in Education, 6(1), 7. doi:10.1186/s40536018-0060-3
MAKALE İSTATİSTİKLERİ

                                                                                                                                                                                                        

                                                                                                                                                                                                        

                                                                                                                                                                                                        
                                                                                                                                                                                                        
                                                                                                                                                                                                        

                                                                                                                                                                                                        

                                                                                                                                                                                                        



                                                                                                                                                                                                        

                                                                                                                                                                                                        
 
                                                                                                                                                                                                        
                      
                                                                                                                                                                                                        

                                                                                                                                                                                                        

                                                                                                                                                                                                        
LINKS

                                                                                                                                                                                                        
    
                                                                                                                                                                                                        
  • 
                                                                                                                                                                                                        
    
                                                                                                                                                                                                        
    

                                                                                                                                                                                                        
     Last issue
    
                                                                                                                                                                                                        
    
                                                                                                                                                                                                        
    • 
                                                                                                                                                                                                        
  • 
                                                                                                                                                                                                        
    
                                                                                                                                                                                                        
    
                                                                                                                                                                                                        
         Previous issues
    
                                                                                                                                                                                                        
    
                                                                                                                                                                                                        
    • 
                                                                                                                                                                                                        
  • 
                                                                                                                                                                                                        
    
                                                                                                                                                                                                        
    
                                                                                                                                                                                                        
    Article Statistics
    
                                                                                                                                                                                                        
    
                                                                                                                                                                                                        
    • 

                                                                                                                                                                                                        
                                                                                                                                                                                                        




                                                                                                                                                                                                        


                                                                                                                                                                                                        

                                                                                                                                                                                                        



                                                                                                                                                                                                        

                                                                                                                                                                                                        

                                                                                                                                                                                                        
Share