Turkish Eighth Graders’ Mathematics Performance on TIMSS 2007 and 2011 with the Lens of National High School Placement Tests
Author :
Abstract
Keywords
Abstract
The purpose of this study is to interpret the gains in Turkish eighth graders’ TIMSS mathematics performance between 2007 and 2011 in terms of the two national assessments conducted to place eighth graders into high schools in Turkey, namely OKS 2007 and SBS 2011. Content analysis technique was employed by three experts to analyze mathematics items in these national assessments. Items in the national assessments were categorized into the content domains (numbers, algebra, data & chance, and geometry) and cognitive domains (knowing, applying, and reasoning), which were described in the TIMSS 2011 assessment framework. As a result, it was found that the percentage of number content items decreased from 24% in OKS 2007 to 15% in SBS 2011 while the geometry content items increased from 36% in OKS 2007 to 50% in SBS 2011. On the other hand, there was an increase in the percentage of items in the knowing domain (32% in OKS 2007 to 50% in SBS 2011) and a decrease in the percentage of items in the other two cognitive domains. In terms of students’ mathematics performance, no significant differences were observed among the given years in numbers content scores of Turkish eighth graders while their scores in the other content domains improved, especially in geometry, as well as the improvement in their knowing cognitive scores between TIMSS 2007 and 2011. As a result, in terms of the content domains, this study determined that changes in the focus of the Turkish assessments in relation to TIMSS is likely a reason for the increase in geometry in comparison to number performance, with all respect to the other factors affecting student achievement. It also raises concerns regarding the distribution of the cognitive domains in the national assessments, considering the inconsistency of the distributions with students’ performances in the specific domains.
Keywords
- Basturk, S. (2011). Negative reflections of preparation process to the university entrance exam on students’ mathematics learning. Hacettepe Üniversitesi Eğitim Fakültesi Dergisi, 40(40), 69-79.
- Belfield, C. R., & Crosta, P. M. (2012). Predicting success in college: The importance of placement tests and high school transcripts. (Working Paper No. 42). New York, NY: Columbia University Community College Research Center
- Biber, A. Ç., Tuna, A, Uysal, R., & Kabuklu, Ü. N. (2018). Liselere Geçiş Sınavının Örnek Matematik Sorularına Dair Destekleme ve Yetiştirme Kursu Matematik Öğretmenlerinin Görüşleri [Supporting and Training Course Teachers’ Opinions on Sample Mathematics Questions of the High School Entrance Exam]. Asya Öğretim Dergisi, 6(2), 63-80.
- Elo, S., & Kyngas, H. (2008). The qualitative content analysis process. Journal of advanced nursing, 62(1), 107- 115.
- Erden, B. (2020). Türkçe, Matematik ve Fen Bilimleri Dersi Beceri Temelli Sorularına İlişkin Öğretmen Görüşleri [Teachers' Views Related to Skill-Based Questions in Turkish, Mathematics and Science Lessons]. Academia Eğitim Araştırmaları Dergisi, 5(2), 81-103.
- Güner, N., Sezer, R., & İspir, O. A. (2013). İlköğretim ikinci kademe öğretmenlerinin TIMSS hakkındaki görüşleri [Elementary school teachers’ opinion about TIMSS]. Pamukkale Üniversitesi Eğitim Fakültesi Dergisi, 33(1), 11-29.
- İncikabı, L. (2012). After the reform in Turkey: A content analysis of SBS and TIMSS assessment in terms of mathematics content, cognitive domains, and item types. Education as Change, 16(2), 301-312.
- Kamens, D. H., & McNeely, C. L. (2010). Globalization and the growth of international educational testing and national assessment. Comparative Education Review, 54(1), 5-25.
- Karabacak, K. (2013). The influence of secondary education entrance examinations practiced in Turkey (The Placement Test, SBS) on the students’ social life. Procedia-Social and Behavioral Sciences, 106, 2866-2878.
- Kellaghan, T., & Greaney, V. (2001). Using assessment to improve the quality of education. Paris: UNESCO, International Institute for Educational Planning.
- Krippendorff, K. (2004). Content analysis: An introduction to its methodology (2nd ed.). Thousand Oaks, CA: Sage Publications.
- Martin, M. O., Mullis, I. V., & Foy, P. (2008). TIMSS 2007 international mathematics report. Findings from IEA's Trends in International Mathematics and Science Study at the fourth and eighth grades. Chestnut Hill, Mass.: IEA, TIMSS &PIRLS.
- Ministry of National Education. (2007a). 2007 OKS degerlendirmesi. [OKS 2007 assessment evaluation] [Online]. Retrieved on February 22nd, 2016 from:
- Ministry of National Education. (2007b). 64 soruda ortaöğretime gec ̧iş sistemi. [The transition to secondary education system at 64 questions] [Online]. Retrieved on November 9th, 2008 from: http://oges.meb.gov.tr/docs/64_soru.pdf.
- Ministry of National Education. (2007c). OKS 2007 sınav soruları [OKS 2007 assessment items] [Online]. Retrieved on November 27th, 2014 from:
- Ministry of National Education. (2011a). Ortaöğretim kurumlarına geçiş sistemi, seviye belirleme sınavı e- başvuru kılavuzu [Transition system to secondary education, secondary education placement test eapplication guideline]. [Online]. Retrieved on September 25, 2015 from: http://yegitek.meb.gov.tr/Sinavlar/Klavuz/2011/2011_SBS.pdf.
- Ministry of National Education. (2011b). Ozel okullar [Private Schools]. [Online]. Retrieved on February 22nd, 2016 from:
- http://mebk12.meb.gov.tr/meb_iys_dosyalar/21/15/967807/dosyalar/2013_03/20090107_ogess41nxpowerlite.p ptx.
- Ministry of National Education. (2011c). SBS 2011 sınav soruları [SBS 2011 assessment items]. [Online].
- Ministry of National Education. (2011d). SBS sisteminin tanıtılması [Introducing the SBS system]. [Online].
- http://mebk12.meb.gov.tr/meb_iys_dosyalar/12/01/742616/dosyalar/2013_02/20020446 2013sevyebelrlemesınavısstemnntanıtılması.pptx.
- Mullis, I. V., Martin, M. O., Foy, P., & Arora, A. (2012). TIMSS 2011 International results in mathematics. International Association for the Evaluation of Educational Achievement. Herengracht 487, Amsterdam, 1017 BT, The Netherlands.
- Mullis, I. V., Martin, M. O., Ruddock, G. J., O'Sullivan, C. Y., & Preuschoff, C. (2009). TIMSS 2011 assessment frameworks. International Association for the Evaluation of Educational Achievement. Herengracht 487,
- NCES. (2015). National Center for Education Statistics, Trends in International Mathematics and Science Study International Data Explorer [online software]. Available from https://nces.ed.gov/timss/idetimss/
- Neidorf, T. S., Binkley, M., Gattis, K., & Nohara, D. (2006). Comparing mathematics content in the National Assessment of Educational Progress (NAEP), Trends in International Mathematics and Science Study (TIMSS), and Program for International Student Assessment (PISA) 2003 assessments. Technical report. NCES 2006-029. National Center for Education Statistics.
- OECD. (2006). Education at a Glance 2006: OECD Indicators. Paris: OECD Publishing.
- Pektas, M. (2012). Grade 8 biology content in TIMSS and SBS: A comparison study. Energy Education Science and Technology Part B: Social and Educational Studies, Special Issue: 1088-1093
- Postlethwaite, T. N. (2005). What do international assessment studies tell us about the quality of school systems. Background paper for EFA global monitoring report. Smith, G., Wood, L., Coupland, M., Stephenson, B., Crawford, K., & Ball, G. (1996). Constructing mathematical examinations to assess a range of knowledge and skills. International Journal of Mathematical Education in Science and Technology, 27(1), 65-77.
- Ritchie, J., & Spencer, L. (1994). Qualitative data analysis for applied policy research. In, Bryman A, Burgess RG (Eds.) Analyzing Qualitative Data (pp. 173-194). Abindgon: Routledge.
- Sarıer, Y. (2010). Ortaöğretime giriş sınavları (OKS-SBS) ve PISA sonuçları ışığında eğitimde fırsat eşitliğinin değerlendirilmesi [An evaluation of equal opportunities in education in the light of high school entrance exams (OKS-SBS) and PISA results]. Ahi Evran Üniversitesi Eğitim Fakültesi Dergisi, 11(3), 107-129.
- Smith, G., Wood, L., Coupland, M., Stephenson, B., Crawford, K., & Ball, G. (1996). Constructing mathematical examinations to assess a range of knowledge and skills. International Journal of Mathematical Education in Science and Technology, 27(1), 65-77.
- Uğurel, I., Moralı, H. S., & Kesgin, Ş. (2012). A comparative analysis on the mathematics questions in OKS, SBS and TIMSS under the lens of MATH taxonomy. Gaziantep University-Journal of Social Sciences, 11(2), 423-444.
