Exploring the potential of artificial intelligence tools in educational measurement and assessment
More details
Hide details
Department of Educational Foundations, University of Calabar, Calabar, Cross River State, NIGERIA
Ultimate Research Network, Calabar, Cross River State, NIGERIA
Department of Public Administration, University of Calabar, Calabar, Cross River State, NIGERIA
Online publication date: 2023-06-21
Publication date: 2023-08-01
EURASIA J. Math., Sci Tech. Ed 2023;19(8):em2307
Artificial intelligence (AI) is transforming various industries, and education is no exception. Rapid advancements in AI technology have become essential for educators and educational assessment professionals to enhance teaching and learning experiences. AI-powered educational assessment tools provide numerous benefits, including improving the accuracy and efficiency of assessments, generating personalized feedback for students, and enabling teachers to adapt their teaching strategies to meet the unique needs of each student. Therefore, AI has the potential to revolutionize the way education is delivered and assessed, ultimately leading to better educational outcomes for students. This paper explores the various applications of AI tools in educational measurement and assessment. Specifically, it discusses the integration of large language AI models in classroom assessment, in specific areas such as test purpose determination and specification, developing, test blueprint, test item generation/development, preparation of test instructions, item assembly/selection, test administration, test scoring, interpretation of test results, test analysis/appraisal, and reporting. It analyses the role of teachers in AI-based assessment and the challenges of using AI-powered tools in educational assessment. Finally, the paper presents strategies to address these challenges and enhance the effectiveness of AI in educational assessment. In conclusion, using AI in educational assessment has benefits and limitations. As such, educators, policymakers, and stakeholders must work together to develop strategies that maximize the benefits of AI in educational assessment while mitigating the associated risks. The application of AI in educational assessment can ultimately transform education, improve learning outcomes, and equip students with the skills needed to succeed in the 21st century.
Adiguzel, T., Kaya, M. H., & Cansu, F. K. (2023). Revolutionizing education with AI: Exploring the transformative potential of ChatGPT. Contemporary Educational Technology, 15(3), ep429.
Bassey, B. A., Ubi, I. O., Anagbogu, G. E., & Owan, V. J. (2020). Permutation of UTME multiple-choice test items on performance in use of English and mathematics among prospective higher education students. The Journal of Social Sciences Research, 6(4), 483-493.
Chatterjee, J., & Dethlefs, N. (2023). This new conversational AI model can be your friend, philosopher, and guide ... and even your worst enemy. Patterns, 4(1), 100676.
Cukurova, M., & Luckin, R. (2018). Measuring the impact of emerging technologies in education: A pragmatic approach. Springer.
Delgado, H. O. K., de Azevedo Fay, A., Sebastiany, M. J., & Silva, A. D. C. (2020). Artificial intelligence adaptive learning tools. BELT-Brazilian English Language Teaching Journal, 11(2), e38749-e38749.
Dergaa, I., Chamari, K., Zmijewski, P., & Saad, H. B. (2023). From human writing to artificial intelligence generated text: Examining the prospects and potential threats of ChatGPT in academic writing. Biology of Sport, 40(2), 615-622.
Dillenbourg, P. (2016). The evolution of research on digital education. International Journal of Artificial Intelligence in Education, 26(2), 544-560.
Elliott, D., & Soifer, E. (2022). AI technologies, privacy, and security. Frontiers in Artificial Intelligence, 5, 826737.
Halaweh, M. (2023). ChatGPT in education: Strategies for responsible implementation. Contemporary Educational Technology, 15(2), ep421.
Hawes, D., & Arya, A. (2023). Technology solutions to reduce anxiety and increase cognitive availability in students. IEEE Transactions on Learning Technologies, 16(2), 278-291.
Holmes, W., Bialik, M., & Fadel, C. (2019). Artificial intelligence in education: Promises and implications for teaching and learning. Center for Curriculum Redesign.
Hou, J., Li, Z., & Liu, G. (2022). Macro education approach to improve learning interest under the background of artificial intelligence. Wireless Communications and Mobile Computing, 2022, 4295887.
Hrastinski, S., Olofsson, A. D., Arkenback, C., Ekström, S., Ericsson, E., Fransson, G., Jaldemark, J., Ryberg, T., Öberg, L.-M., Fuentes, A., Gustafsson, U., Humble, N., Mozelius, P., Sundgren, M., & Utterberg, M. (2019). Critical imaginaries and reflections on artificial intelligence and robots in post-digital K-12 education. Post-Digital Science and Education, 1(2), 427-445.
Hu, Y., & Min, H. K. (2023). The dark side of artificial intelligence in service: The “watching-eye” effect and privacy concerns. International Journal of Hospitality Management, 110, 103437.
Huang, A. Y., Lu, O. H., & Yang, S. J. (2023a). Effects of artificial intelligence-enabled personalized recommendations on learners’ learning engagement, motivation, and outcomes in a flipped classroom. Computers & Education, 194, 104684.
Huang, S.-P. (2018). Effects of using artificial intelligence teaching system for environmental education on environmental knowledge and attitude. EURASIA Journal of Mathematics, Science and Technology Education, 14(7), 3277-3284.
Huang, X., Zou, D., Cheng, G., Chen, X., & Xie, H. (2023b). Trends, research issues and applications of artificial intelligence in language education. Educational Technology & Society, 26(1), 112-131.
Ingraham, J., Garg, V., Barzilay, R., & Jaakkola, T. (2019). Generative models for graph-based protein design. In H. Wallach, H. Larochelle, A. Beygelzimer, F. Alché-Buc, E. Fox, & R. Garnett (Eds.), Advances in neural information processing systems. Curran Associates, Inc.
Javaid, M., Haleem, A., Singh, R. P., Khan, S., & Khan, I. H. (2023). Unlocking the opportunities through ChatGPT Tool towards ameliorating the education system. BenchCouncil Transactions on Benchmarks, Standards and Evaluations, 3(2), 100115.
Joshua, M. T. (2012). Fundamentals of tests and measurement in education. University of Calabar Press.
Karsenti, T. (2019). Artificial intelligence in education: The urgent need to prepare teachers for tomorrow’s schools. Formation et Profession [Education and Profession], 27(1), 112-116.
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Pfeffer, J., Poquet, O., Sailer, M., Schmidt, A., Seidel, T., … Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 102274.
Khan, I., Ahmad, A. R., Jabeur, N., & Mahdi, M. N. (2021). An artificial intelligence approach to monitor student performance and devise preventive measures. Smart Learning Environments, 8(1), 1-18.
King, M. R., & ChatGPT. (2023). A conversation on artificial intelligence, chatbots, and plagiarism in higher education. Cellular and Molecular Bioengineering, 16(1), 1-2.
Kumar, N. S. (2019). Implementation of artificial intelligence in imparting education and evaluating student performance. Journal of Artificial Intelligence, 1(01), 1-9.
Lin, P. Y., Chai, C. S., Jong, M. S. Y., Dai, Y., Guo, Y., & Qin, J. (2021). Modelling the structural relationship among primary students’ motivation to learn artificial intelligence. Computers and Education: Artificial Intelligence, 2, 100006.
Luckin, R., & Cukurova, M. (2019). Designing educational technologies in the age of AI: A learning sciences-driven approach. British Journal of Educational Technology, 50(6), 2824-2838.
Luo, Y., Han, X., & Zhang, C. (2022). Prediction of learning outcomes with a machine learning algorithm based on online learning behavior data in blended courses. Asia Pacific Education Review.
Mena-Guacas, A. F., Urueña Rodríguez, J. A., Santana Trujillo, D. M., Gómez-Galán, J., & López-Meneses, E. (2023). Collaborative learning and skill development for educational growth of artificial intelligence: A systematic review. Contemporary Educational Technology, 15(3), ep428.
Mohamed, M. Z. B., Hidayat, R., Suhaizi, N. N. B., Sabri, N. B. M., Mahmud, M. K. H. B., & Baharuddin, S. N. B. (2022). Artificial intelligence in mathematics education: A systematic literature review. International Electronic Journal of Mathematics Education, 17(3), em0694.
Naqvi, A. (2020). Artificial intelligence for audit, forensic accounting, and valuation: A strategic perspective. John Wiley & Sons.
Nasution, N. E. A. (2023). Using artificial intelligence to create biology multiple choice questions for higher education. Agricultural and Environmental Education, 2(1), em002.
Nazaretsky, T., Ariely, M., Cukurova, M., & Alexandron, G. (2022). Teachers’ trust in AI‐powered educational technology and a professional development program to improve it. British Journal of Educational Technology, 53(4), 914-931.
Nazari, N., Shabbir, M. S., & Setiawan, R. (2021). Application of artificial intelligence powered digital writing assistant in higher education: Randomized controlled trial. Heliyon, 7(5), e07014.
Owan, V. J. (2020). Computer-administered testing practice in higher education in an era of severe acute respiratory syndrome-related diseases outbreaks. In V. C. Emeribe, L. U. Akah, O. A. Dada, D. A. Alawa, & B. A. Akuegwu (Eds.), Multidisciplinary issues in health, human kinetics and general education practices (pp. 429-442). University of Calabar Press.
Owan, V. J., Duruamaku-dim, J. U., & Eneje, S. (2019). Mode of test administration, birth variables, and students’ academic achievement in mathematics in Obubra Local Government Area of Cross River State, Nigeria. Prestige Journal of Counselling Psychology, 2(2), 60-77.
Owan, V. J., Owan, M. V., & Ogabor, J. O. (2023). Sitting arrangement and malpractice behaviors among higher education test-takers: On educational assessment in Nigeria. Journal of Applied Learning & Teaching, 6(1), 1-15.
Papapicco, C. (2020). Google mini: Italian example of artificial pro-sociality. Online Journal of Communication and Media Technologies, 10(3), e202015.
Ren, X. (2020). Artificial intelligence and depression: How AI powered chatbots in virtual reality games may reduce anxiety and depression levels. Journal of Artificial Intelligence Practice, 3(1), 48-58.
Rudolph, J., Tan, S., & Tan, S. (2023). ChatGPT: Bullshit spewer or the end of traditional assessments in higher education? Journal of Applied Learning and Teaching, 6(1), 1-22.
Saura, J. R., Ribeiro-Soriano, D., & Palacios-Marqués, D. (2022). Assessing behavioral data science privacy issues in government artificial intelligence deployment. Government Information Quarterly, 39(4), 101679.
Seufert, S., Guggemos, J., & Sailer, M. (2021). Technology-related knowledge, skills, and attitudes of pre-and in-service teachers: The current situation and emerging trends. Computers in Human Behavior, 115, 106552.
Suh, W., & Ahn, S. (2022). Development and validation of a scale measuring student attitudes toward artificial intelligence. Sage Open, 12(2), 21582440221100463.
Tovani-Palone, M. R. (2023). Some challenges and limitations of using ChatGPT in medicine. Electronic Journal of General Medicine, 20(5), em503.
Vasconcelos, M. A. R., & dos Santos, R. P. (2023). Enhancing STEM learning with ChatGPT and Bing Chat as objects to think with: A case study. EURASIA Journal of Mathematics, Science and Technology Education, 19(7), em2296.
Wardat, Y., Tashtoush, M. A., AlAli, R., & Jarrah, A. M. (2023). ChatGPT: A revolutionary tool for teaching and learning mathematics. EURASIA Journal of Mathematics, Science and Technology Education, 19(7), em2286.
Xia, Q., Chiu, T. K. F, Lee, M., Temitayo I., Dai, Y., & Chai, C. S. (2022). A self-determination theory design approach for inclusive and diverse artificial intelligence (AI) K-12 education. Computers & Education, 189, 104582.
Journals System - logo
Scroll to top