RESEARCH PAPER
Rasch Analysis for Disposition Levels of Computational Thinking Instrument Among Secondary School Students
 
More details
Hide details
1
Faculty of Education, Universiti Kebangsaan Malaysia, Bangi Selangor, MALAYSIA
 
 
Publication date: 2022-02-23
 
 
EURASIA J. Math., Sci Tech. Ed 2022;18(3):em2088
 
KEYWORDS
ABSTRACT
Computational thinking is a strategy of thinking to tackle complex problems. There is a paucity of conceptualization and instruments that cogitate on computational thinking disposition and attitudes. This study reacts to these constraints by establishing an instrument to test computational thinking related dispositions and attitudes. The computational thinking disposition Instrument is an indicator of student’s disposition towards computational thinking in daily life. The objective of this study is to investigate the psychometric features using Rasch model. Data of 535 form four computer science students in Malaysia were obtained. Instrument consists of 55 core measures in three domains: cognitive, affective and conative. The Rasch analysis indicated good psychometric features of the instrument. In these three domains no items showed disordered thresholds and the reliability was good. As a result, the Rasch analysis provides basis for cautious optimism permitting more detailed and finer level investigation of the instrument.
 
REFERENCES (79)
1.
Abdullah, N., Zakaria, E., & Halim, L. (2012). The effect of a thinking strategy approach through visual representation on achievement and conceptual understanding in solving mathematical word problems. Asian Social Science, 8(16), 30-37. https://doi.org/10.5539/ass.v8....
 
2.
Andrich, D., & Styles, I. (2004). Final report on the psychometric analysis of the early development instrument (EDI) using the Rasch model: A technical paper commissioned for the development of the Australian early development instrument (AEDI). http://ww2.rch.org.au/emplibra....
 
3.
Ariffin, S. R. (2008). Inovasi dalam pengukuran dan penilaian [Inovation in measurement and evaluation]. UKM Press.
 
4.
Aziz, A. A., Masodi, M. S., & Zaharim, A. (2015). Rasch measurement model basis: Scale development and measurement structure. UKM Press.
 
5.
Baghaei, P. (2008). Local dependency and Rasch measures. Rasch Measurement Transactions, 21(3), 1105-1106.
 
6.
Balsamo, M., Giampaglia, G., & Saggino, A. (2014). Building a new Rasch-based self-report inventory of depression. Neuropsychiatric Disease and Treatment, 10, 153-165. https://doi.org/10.2147/ndt.s5....
 
7.
Barr, D., Harrison, J., & Conery, L. (2011). Computational thinking: A digital age skill for everyone. Learning and Leading with Technology, 38(6), 20-23.
 
8.
Barr, V., & Stephenson, C. (2011). Bringing computational thinking to K-12: What is involved and what is the role of the computer science education community. ACM Inroads, 2(1), 48-54. https://doi.org/10.1145/192988....
 
9.
Belanger, C., Christenson, H., & Lopac, K. (2018). Confidence and common challenges: The effects of teaching computational thinking to students ages 10-16 [Masters’s thesis, St. Catherine University]. St. Catherine University Repository.
 
10.
Beyer, B. K. (1988). Developing a thinking skills programme. Allyn and Bacon Inc.
 
11.
Beyer, B. K. (1995). Critical thinking. Phi Delta Kappa Educational Foundations.
 
12.
Bocconi, S., Chioccariello, A., Dettori, G., Ferrari, A., Engelhardt, K., Kampylis, P., & Punie, Y. (2016). Developing computational thinking in compulsory education. Implications for policy and practice. EUR-Scientific and Technical Research Reports. https://doi.org/10.2791/792158.
 
13.
Bond, T. G., & Fox, C. M. (2007). Applying the Rasch model: Fundamental measurement in the human sciences (2nd ed.). Routledge.
 
14.
Bond, T. G., & Fox, C. M. (2015). Applying the Rasch model: Fundamental measurement in the human sciences (3rd ed.). Routledge.
 
15.
Brennan, K., & Resnick, M. (2012, April). New frameworks for studying and assessing the development of computational thinking [Paper presentation]. Annual Meeting of the American Educational Research Association (AERA), Vancouver, BC, Canada. http://scratched.gse.harvard.e....
 
16.
Chongo, S., Osman, K., & Nayan, N. A. (2020). Level of computational thinking level of computational thinking skills among secondary science student: Variation across gender and mathematics achievement skills among secondary science student. Science Education International, 31(2), 159-163. https://doi.org/10.33828/sei.v....
 
17.
College Board. (2014). Advanced placement computer science principles: Curriculum framework. http://securemedia.collegeboar....
 
18.
Computer Science Teachers Association. (2017). CSTA K-12 Computer Science Standards. http://www.csteachers.org/stan....
 
19.
Conrad, K. M., Conrad, K. J., Passetti, L. L., Funk, R. R., & Dennis, M. L. (2015). Validation of the full and short-form self-help involvement scale against the Rasch measurement model. Evaluation Review, 39(4), 395-427. https://doi.org/10.1177/019384....
 
20.
Creswell, J. W. (2012). Educational research: Planning, conducting, and evaluating quantitative and qualitative research. Pearson.
 
21.
Creswell, J. W., & Creswell, J. D. (2018). Research design: Qualitative, quantitative, and mixed methods approaches. SAGE.
 
22.
Denning, P. J. (2009). The profession of IT beyond computational thinking. Communications of the ACM, 52(6), 28-30. https://doi.org/10.1145/151604....
 
23.
DeVon, H. A., Block, M. E., Moyle-Wright, P., Ernst, D. M., Hayden, S. J., Lazzara, D. J., Savoy, S. M., & Kostas-Polston, E. (2007). A psychometric toolbox for testing validity and reliability. Journal of Nursing Scholarship, 39(2), 155-164. https://doi.org/10.1111/j.1547....
 
24.
Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Lawrence Erlbaum Associates. https://doi.org/10.1037/10519-....
 
25.
Facione, N. C., Facione, P. A., & Sanchez, C. A. (1994). Critical thinking disposition as a measure of competent clinical judgment: The development of the California critical thinking disposition inventory. Journal of Nursing Education, 33(8), 345-350. https://doi.org/10.3928/0148-4....
 
26.
Facione, P. A. (2000). The disposition toward critical thinking: Its character, measurement, and relationship to critical thinking skill. Informal Logic, 20(1), 61-84. https://doi.org/10.22329/il.v2....
 
27.
Fisher, J. W. P. (2006). Survey design recommendations. Rasch Measurements Transactions, 20(3), 1072-1074.
 
28.
Fisher, J. W. P. (2007). Rating scale instrument quality criteria. Rasch Measurement Transactions, 21(1), 1095.
 
29.
Fisher, W. (1992). Reliability, separation, strata statistics. Rasch Measurement Transactions, 6(3), 238.
 
30.
Fox, C. M., & Jones, J. A. (1998). Uses of Rasch modeling in counseling psychology research. Journal of Counseling Psychology, 45(1), 30-45. https://doi.org/10.1037/0022-0....
 
31.
Gay, L. R., & Mills, G. E. (2018). Educational research: Competencies for analysis and applications. Merrill Prentice Hall.
 
32.
Grover, S., & Pea, R. (2013). Computational thinking in K-12. Educational Researcher, 42(1), 38-43. https://doi.org/10.3102/001318....
 
33.
Hair, J. F., Celsi, M. W., Oritinau, D. J., & Bush, R. P. (2017). Essentials of marketing research. McGraw Hill.
 
34.
Haseski, H. I., Ilic, U., & Tugtekin, U. (2018). Defining a new 21st century skill-computational thinking: Concepts and trends. International Education Studies, 11(4), 29. https://doi.org/10.5539/ies.v1....
 
35.
Hilgard, E. R. (1980). The trilogy of mind: Cognition, affection, and conation. Journal of the History of the Behavioral Sciences, 16(2), 107-117. https://doi.org/10.1002/1520-6...<107::AID-JHBS2300160202>3.0.CO;2-Y.
 
36.
Hill, C., & Koekemoer, E. (2013). The development of the MACE work-family enrichment instrument. SA Journal of Industrial Psychology, 39, 1-16. https://doi.org/10.4102/sajip.....
 
37.
Jong, M. S. -Y., Geng, J., Chai, C. S., & Lin, P. Y. (2020). Development and predictive validity of the computational thinking disposition questionnaire. Sustainability, 12(11), 4459. https://doi.org/10.3390/su1211....
 
38.
Kim, B., Kim, T., & Kim, J. (2013). Paper-and-pencil programming strategy toward computational thinking for non-majors: design your solution. Journal of Educational Computing Research, 49(4), 437-459. https://doi.org/10.2190/ec.49.....
 
39.
Lai, J. S., & Eton, D. T. (2002). Clinically meaningful gaps. Rasch Measurement Transactions, 15(4), 850.
 
40.
Linacre, J. M. (1994). Sample size and item calibration (or person measure) stability. Rasch Measurement Transactions, 7(4), 328.
 
41.
Linacre, J. M. (2002). What do infit and outfit, mean-square and standardized mean? Rasch Measurement Transactions, 16(2), 878.
 
42.
Linacre, J. M. (2003). Winsteps computer program version 3.48. Chicago. http://www.winsteps.com/a/wins....
 
43.
Linacre, J. M. (2005). Winstep Rasch measurement computer program. MESA Press.
 
44.
Linacre, J. M. (2007). A user’s guide to WINSTEPS Rasch-model computer program. MESA Press.
 
45.
Linacre, J. M. (2010). When to stop removing items and persons in Rasch misfit analysis? Rasch Measurement Transactions, 23(4), 1241.
 
46.
Linacre, J. M. (2012). A user’s guide to WINSTEPS: Rasch model computer programs. MESA Press.
 
47.
Linacre, J. M. (2017). Winsteps Rasch measurement computer program user’s guide. Winsteps.com.
 
48.
Marret, M. J., & Choo, W. Y. (2017). Factors associated with online victimization among Malaysian adolescents who use social networking sites: A cross-sectional study. BMJ Open, 7(6), e014959. https://doi.org/10.1136/bmjope....
 
49.
Masek, A., & Nasaruddin, N. (2016). Students’ perception and readiness on school-based assessment. Mediterranean Journal of Social Sciences, 7(6), 189. https://doi.org/10.5901/mjss.2....
 
50.
Matore, M. E. E. M, Zainal, M. A., Noh, M. F. M., Khairani, A. Z., Rahman, N. A., & Idris, H. (2020). Pengujian psikometrik item kecerdasan menghadapi cabaran untuk pelajar lelaki kejuruteraan mekanikal menggunakan model pengukuran Rasch [Psychometric properties of an adversity quotient items for mechanical engineering male students using Rasch measurement model]. Malaysia Education Journal, 45(1), 87-100. https://doi.org/10.17576/jpen-....
 
51.
Miller, L. A., & Lovler, R. L. (2019). Foundations of psychological testing: A practical approach. SAGE.
 
52.
National Research Council. (2011). Report of a workshop on the pedagogical aspects of computational thinking. National Academies Press.
 
53.
Norris, S. P., & Ennis, R. H. (1989). Evaluating critical thinking. Midwest Publications.
 
54.
Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory. McGraw Hill.
 
55.
Olabe, J. C., Basogain, X., Olabe, M. Á., Maíz, I., & Castaño, C. (2014). Solving math and science problem in the real world with a computational mind. New Approaches in Education Research, 3(2), 75-82. https://doi.org/10.7821/naer.3....
 
56.
Othman, N., Salleh, S., Hussein, H., & Wahid, H. A. (2014). Assessing construct validity and reliability of competitiveness scale using Rasch model approach. In WEI International Academic Conference Proceedings (pp. 113-120). Indonesia.
 
57.
Pallant, J. (2001). SPSS survival manual. Open University Press.
 
58.
Pallant, J. F., & Tennant, A. (2007). An introduction to the Rasch measurement model: An example using the hospital anxiety and depression scale (HADS). British Journal of Clinical Psychology, 46(1), 1-18. https://doi.org/10.1348/014466....
 
59.
Perera, C. J., Sumintono, B., Jiang, N. (2018). The psychometric validation of the principal practices questionnaire based on item response theory. Educational Leadership, 2(1), 21-38. https://doi.org/10.22452/iojel....
 
60.
Qiu, R. G. (2009). Computational thinking of service systems: dynamics and adaptiveness modeling. Service Science, 1(1), 42-55. https://doi.org/10.1287/serv.1....
 
61.
Salihuddin, M. S., Hasnah, M., Zaleha, A., Norasykin, M. Z., Baharuddin, A., & Mageswaran, S. (2016). Enhancing student’s higher order thinking skills (HOTS) through the Socratic method approach with technology. In 1St ICRIL-International Conference on Innovation in Science and Technology. Technology University of Malaysia.
 
62.
Sands, P., Yadav, A., Good, J. (2018). Computational thinking in K-12: In-service teacher perceptions of computational thinking. In M. S. Khine (ed.), Computational Thinking in the STEM Disciplines (pp. 151-164). Springer. http://dx.doi.org/10.1007/978-....
 
63.
Schiffman, L. G., Lazar, L., & Håvard, K. (2012). Consumer behavior: A European outlook. Pearson.
 
64.
Sekaran, U. (2003). Research methods for business: A skill-building approach. John Wiley & Sons.
 
65.
Settle, A., Franke, B., Hansen, R., Spaltro, F., Jurisson, C., Rennert-May, C., & Wildeman, B. (2012). Infusing computational thinking into the middle and high-school curriculum. In Proceedings of the 17th ACM Annual Conference on Innovation and Technology in Computer Science Education - ITiCSE ‘12 (pp. 22-27). Association for Computing Machinery. https://doi.org/10.1145/232529....
 
66.
Shute, V. J., Sun, C., & Asbell-Clarke, J. (2017). Demystifying computational thinking. Educational Research Review, 22, 142-158. https://doi.org/10.1016/j.edur....
 
67.
Sondakh, D. E., Osman, K., & Zainudin, S. (2020a). A proposal for holistic assessment of computational thinking for undergraduate: Content validity. (2020). European Journal of Educational Research, 9(1), 33-50. https://doi.org/10.12973/eu-je....
 
68.
Sondakh, D. E., Osman, K., & Zainudin, S. (2020b). A pilot study of an instrument to assess undergraduates’ computational thinking proficiency. International Journal of Advanced Computer Science and Applications, 11(11), 263-273. https://doi.org/10.14569/ijacs....
 
69.
Sumintono, B., & Widhiarso, W. (2014). Aplikasi model Rasch untuk penelitian ilmu-ilmu sosial [Rasch model application for social disciplines]. Trim Komunikata Publishing House.
 
70.
Sysło, M. M., & Kwiatkowska, A. B. (2015). Introducing a new computer science curriculum for all school levels in Poland. In A. Brodnik, & J. Vahrenhold (Eds.), ISEEP (pp. 141-154). Springer. https://doi.org/10.1007/978-3-....
 
71.
Tang, K. Y., Chou, T. L., & Tsai, C. C. (2019). A content analysis of computational thinking research: An international publication trends and research typology. The Asia-Pacific Education Researcher, 29(1), 9-19. https://doi.org/10.1007/s40299....
 
72.
Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach’s alpha. International Journal of Medical Education, 2, 53-55. https://doi.org/10.5116/ijme.4....
 
73.
Weese, J. L. (2016). Mixed methods for the assessment and incorporation of computational thinking in K-12 and higher education. In Proceedings of the 2016 ACM Conference on International Computing Education Research-ICER ‘16 (pp. 279-280). Association for Computing Machinery. https://doi.org/10.1145/296031....
 
74.
Wing, J. M. (2006). Computational thinking. Communications of the ACM, 49(3), 33-35. https://doi.org/10.1145/111817....
 
75.
Wing, J. M. (2008). Computational thinking and thinking about computing. Philosophical Transactions of the Royal Society: A Mathematical, Physical and Engineering Sciences, 366(1881), 3717-3725. https://doi.org/10.1098/rsta.2....
 
76.
Wright, B. D., & Master, G. N. (1982). Rating scale analysis. Cesa Press.
 
77.
Wright, B. D., & Mok, M. M. (2004). An overview of the family of Rasch measurement models. In E. V. Smith, & R. M. Smith (Eds.), Introduction to Rasch measurement: Theory, models, and applications. JAM Press.
 
78.
Wu, M., & Adams, R. (2007). Applying the Rasch model to psycho-social measurement: A practical approach. Educational Measurement Solutions.
 
79.
Yadav, A., Mayfield, C., Zhou, N., Hambrusch, S., & Korb, J. T. (2014). Computational thinking in elementary and secondary teacher education. ACM Transactions on Computing Education, 14(1), 1-16. https://doi.org/10.1145/257687....
 
eISSN:1305-8223
ISSN:1305-8215
Journals System - logo
Scroll to top