The Rasch Model Analysis for Understanding Mathematics Proficiency—A Case Study: Senior High School Sardinian Students

Carlo Andrea Pensavalle, Giuliana Solinas

Department of Biomedical Sciences, Laboratory of Epidemiology and Biostatistics, University of Sassari, Sassari, Italy.
Department of Science for Nature and Environmental Resources, University of Sassari, Sassari, Italy.

DOI: 10.4236/ce.2013.412109                

Abstract

Many students enrolled in Italian Universities don’t have regular careers in their first level of university education mainly because of the obstacles encountered in their studies. As far as Mathematics proficiency assessment there are national and international important systematic studies which give evidence for positive relationships between achievement and varied classroom settings and provide a larger context for better understanding regional performance, extending and enriching the local picture. This paper presents some preliminary results aiming to evaluate specific Mathematics abilities in Senior High School Sardinian Students approaching university studies. For this purpose the Rasch model was applied. The information obtained by the application of this measurement approach provides clear indication for further analysis to ascertain the causes that influence Mathematics proficiency. The Rasch model was performed on 888 students coming from 28 High Schools located in the central-northern part of the Sardinia region using a questionnaire to evaluate the level of ability in procedural fluency and a second questionnaire to evaluate strategic competence. The study provides more evidence in favor of Rasch Model as an appropriate way for teachers and researchers to obtain richer interpretations on the relationship between students’ proficiency and test items. Based on Infit and Outfit MNSQ, all items are within acceptable range between 0.7 - 1.3. In light of preliminary results there is a need for local schools and universities to become attuned to the full extent of the Mathematics problem as it affects Senior High School Sardinian Students.

Keywords

Rasch Analysis Model; Mathematics Proficiency; Procedural Fluency; Strategic Competence

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1]	Adams, R. (2002). Scaling PISA cognitive data. In R. Adams, & M. Wu (Eds.), PISA 2000 technical report (pp. 99-108). Paris: OECD.
[2]	Adams, R., Wu, M., & Wilson, M. (2012). ACER ConQuest 3.1. Melbourne: ACER.
[3]	Bock, R. D., & Lieberman, M. (1970). Fitting a response model for dichotomously scored items. Psychometrika, 35, 179-187. http://dx.doi.org/10.1007/BF02291262
[4]	Bond, T. G., & Fox, C. M. (2007). Applying the rasch model: Fundamental measurement in the human sciences. Mahwah, New Jersey: Lawrence Erlbaum Associates.
[5]	Boone, W. J., & Scantlebury, K. (2006). The role of Rasch analysis when conducting science education research utilizing multiplechoice tests. Science Education, 90, 253-269. http://dx.doi.org/10.1002/sce.20106
[6]	Brentari, E., & Golia, S. (2007). Unidimensionality in the Rasch model: how to detect and interpret. Statistica, 67, 253-261.
[7]	Chiandotto, B., & Giusti, C. (2005). L’abbandono degli studi universitari. In C. Crocetta (Ed.), Modelli statistici per l’analisi della transizione università-lavoro (pp. 1-22). Padova.
[8]	Cingano, F., & Cipollone, P. (2007). University drop-out: The case of Italy. Temi di discussione del Servizio Studi, 626. Roma: Banca d’Italia.
[9]	Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297-334. http://dx.doi.org/10.1007/BF02310555
[10]	Delvecchio, F., & D’Ovidio, F. (2002). Alcuni fattori di rischio per l’abbandono degli studi universitari. In L. C. Sardi, & F. Delvecchio (Eds.), Indicatori e metodi per l’analisi dei percorsi universitari e postuniversitari (pp. 101-124). Padova: Cleup.
[11]	Dunne, T., Long, C., Craig, T., & Venter, E. (2012). Meeting the requirements of both classroom-based and systematic assessment of mathematics proficiency: The potential of Rasch measurement theory. Pythagoras, 33, 16 p. http://dx.doi.org/10.4102/pythagoras.v33i3.19
[12]	Fisher, G. (1995). Derivations of the Rasch model. In G. H. Fisher, & I. W. Molenaar (Eds.), Rasch models: Foundations recent developments and applications (pp. 15-38). Berlin: Springer-Verlag. http://dx.doi.org/10.1007/978-1-4612-4230-7_2
[13]	Hawkes, T., & Savage, M. (2000). Measuring the mathematics problem. London: Engineering Council.
[14]	Kilpatrick, J., Swafford, J., & Findell, B. (2001). Adding it up: Helping how children learn Mathematics. Washington DC: National Academic Press.
[15]	MIUR/CNVSU (2011). Undicesimo rapporto sullo stato del sistema universtiario. http://www.cnvsu.it
[16]	Mossi, P., Venuleo, C., Tondo, P., & Salvatore, S. (2012). The measurement of students’ performance. The use of an extended Rasch model for the analysis of predictors of high educational performance. EJASA, 5, 393-399.
[17]	Mouw, J. T., & Khanna, R. K. (1983). Prediction of academic success: A review of the literature and some recommendations. College Student Journal, 27, 328-336.
[18]	PISA (2009). Results: What students know and can do. Student performance in reading, mathematics and science (Volume I). http://dx.doi.org/10.1787/9789264091450-en
[19]	Rasch, G. (1960). Probabilistic models for some intelligence and attainments tests. Copenhagen: Danish Institute for Educational Research.
[20]	Rohde, T. E., & Thompson, L. A. (2007). Predicting academic achievement with cognitive ability. Intelligence, 35, 83-92. http://dx.doi.org/10.1016/j.intell.2006.05.004
[21]	Samuelsson, J. (2010). The impact of teaching approaches on students’ mathematical proficiency in Sweden. International Electronic Journal of Mathematics Education, 5, 61-78.
[22]	Solinas, G., Masia, M.D., Maida, G., & Muresu, E. (2012). What really affects student satisfaction? An assessment of quality through a university-wide student survey. Creative Education, 3, 37-40. http://dx.doi.org/10.4236/ce.2012.31006
[23]	Teddlie, C., & Reynolds, D. (2000). International handbook of school effectiveness. London: Falmer.
[24]	Wright, B. D., & Masters, G. N. (1982). Rating scale analysis: Rasch measurement. Chicago: Mesa Press.