Intelligent tutoring system: New criteria and evaluation to measure students’ degree of mastery


  • Siti Khatijah Nor Abdul Rahim School of Computing Sciences, College of Computing, Informatics and Mathematics, Universiti Teknologi MARA (UiTM), Shah Alam, Selangor, Malaysia.
  • Amir Hamzah Jaafar E-Content (M) Sdn. Bhd, 63000 Cyberjaya, Selangor, Malaysia.
  • Geetha Baskaran Procurement Services, University of Sydney, Forest Lodge, NSW 2037, Australia.



intelligent tutoring system, mastery level, pre-processing, evaluation criteria, evaluation function


Intelligent Tutoring Systems (ITSs) are computer software designed to simulate or imitate a human tutor’s behavior and guidance. ITSs can be seen as personalized tutoring systems that arouse students’ learning enthusiasm. One of the important features of ITS is the capability to interpret complex student’s responses and to estimate the student’s degree of mastery, and as a result, it manages to adjust the behaviour of the tutoring accordingly. Mastery learning requires that the tutoring system have a mechanism to evaluate the student’s degree of mastery in a particular knowledge. Motivated by this, and realizing that ITS still needs to improve its capability in helping students attain knowledge according to their degree of mastery of the underlying knowledge of a particular topic, this study has proposed new criteria and approaches to measure the student’s degree of mastery through data pre-processing. The pre-processing was done on some data files to obtain more meaningful data to achieve the aim. From the results obtained, it was shown that student’s degree of mastery was able to be measured through the proposed approach. This can benefit the ITS to be a personalized tutor according to the student’s capability.


Download data is not yet available.


Ahuja, N. J., Dutt, S., Choudhary, S. L., & Kumar, M. (2022). Intelligent tutoring system in education for disabled learners using human–computer interaction and augmented reality. International Journal of Human–Computer Interaction, 1-13.

Aleven, V., Sewall, J., Popescu, O., Xhakaj, F., Chand, D., Baker, R., Wang, Y., Siemens, G., Rosé, C., & Gasevic, D. (2015). The beginning of a beautiful friendship? Intelligent tutoring systems and MOOCs. In C. Conati, N. Heffernan, A. Mitrovic, & M. Verdejo. (Eds.), Lecture notes in computer science: Vol. 9112. Artificial intelligence in education. AIED 2015. (pp. 525-528). Springer.

Anderson, J. R., Boyle, C. F., & Reiser, B. J. (1985). Intelligent tutoring systems. Science, 228(4698), 456-462.

Benedikt, O., Módos, I., & Hanzálek, Z. (2020). Power of pre-processing: Production scheduling with variable energy pricing and power-saving states. Constraints, 25, 300-318.

Bhagat, K. K., Rodrigo, M. T., & Chang, C. Y. (2018). Current status, challenges, and opportunities of the intelligent tutoring systems (ITS) in developing countries in Asia. In K. J. Kennedy & J. C. K. Lee (Eds.), Routledge international handbook of schools and schooling in Asia (pp. 382-395). Taylor & Francis.

Bloom, B. S. (1968). Learning for Mastery. Instruction and curriculum. Regional Education Laboratory for the Carolinas and Virginia (ED053419). ERIC.

Chango, W., Cerezo, R., Sanchez-Santillan, M., Azevedo, R., & Romero, C. (2021). Improving prediction of students’ performance in intelligent tutoring systems using attribute selection and ensembles of different multimodal data sources. Journal of Computing in Higher Education, 33, 614-634.

Chanthiran, M., Ibrahim, A. B., Abdul Rahman, M. H., & Mariappan, P. (2022). Artificial intelligence in education: A systematic mapping study using Scopus and Web of Science. Journal of ICT in Education, 9(2), 61–70.

Cuéllar-Rojas, O. A., Hincapié-Montoya, M., Contero, M., & Güemes-Castorena, D. (2022, December). Bibliometric analysis and systematic literature review of the intelligent tutoring systems. Frontiers in Education, 7, Article 1047853.

Deane, S., Avdelidis, N. P., Ibarra-Castanedo, C., Zhang, H., Yazdani Nezhad, H., Williamson, A. A., Mackley, T., Maldague, X., Tsourdos, A, & Nooralishahi, P. (2020). Comparison of cooled and uncooled IR sensors by means of signal-to-noise ratio for NDT diagnostics of aerospace grade composites. Sensors, 20(12), Article 3381.

Fang, Y., Lippert, A., Cai, Z., Chen, S., Frijters, J. C., Greenberg, D., & Graesser, A. C. (2022). Patterns of adults with low literacy skills interacting with an intelligent tutoring system. International Journal of Artificial Intelligence in Education, 32, 297-322.

Ferster, B. (2022). Intelligent tutoring systems. Routledge.

Huang, X., Zou, D., Cheng, G., Chen, X., & Xie, H. (2023). Trends, research issues and applications of artificial intelligence in language education. Educational Technology and Society, 26(1), 112-131.

Huang, Y., Brusilovsky, P., Guerra, J., Koedinger, K., & Schunn, C. (2023). Supporting skill integration in an intelligent tutoring system for code tracing. Journal of Computer Assisted Learning, 39(2), 477-500.

Karpouzis, K. (2023). Explainable AI for intelligent tutoring systems. OSF Preprints.

Khazanchi, R., Di Mitri, D., & Drachsler, H. (2022). Impact of intelligent tutoring systems on mathematics achievement of underachieving students. In E. Langran (Ed.), Proceedings of society for information technology & teacher education international conference (pp. 1524-1534).

Koedinger, K., & Tanner, M. (2013, July 9). 7 Things you should know about intelligent tutoring systems. EDUCAUSE Publications.

Kochmar, E., Vu, D. D., Belfer, R., Gupta, V., Serban, I. V., & Pineau, J. (2022). Automated data-driven generation of personalized pedagogical interventions in intelligent tutoring systems. International Journal of Artificial Intelligence in Education, 32(2), 323-349.

Kulik, J. A., & Fletcher, J. D. (2016). Effectiveness of intelligent tutoring systems: A meta-analytic review. Review of Educational Research, 86(1), 42-78.

Kurni, M., Mohammed, M. S., & Srinivasa, K. G. (2023). A beginner's guide to introduce artificial intelligence in teaching and learning. Springer.

Lin, C. C., Huang, A. Y., & Lu, O. H. (2023). Artificial intelligence in intelligent tutoring systems toward sustainable education: A systematic review. Smart Learning Environments, 10, Article 41,

Ma, W., Adesope, O. O., Nesbit, J. C., & Liu, Q. (2014). Intelligent tutoring systems and learning outcomes: A meta-analysis. Journal of Educational Psychology, 106(4), 901-918.

Mahdi, A. O., Alhabbash, M. I., & Naser, S. S. A. (2016). An intelligent tutoring system for teaching advanced topics in information security. World Wide Journal of Multidisciplinary Research and Development, 2(12), 1-19.

Nwana, H. S. (1990). Intelligent tutoring systems: An overview. Artificial Intelligence Review, 4, 251-277.

Nye, B. D. (2015). Intelligent tutoring systems by and for the developing world: A review of trends and approaches for educational technology in a global context. International Journal of Artificial Intelligence in Education, 25, 177-203.

Psotka, J., Massey, L. D., & Mutter, S. A. (Eds.). (1988). Intelligent tutoring systems: Lessons learned. Psychology Press.

Saidong, L., Guohua, T., Yaowen, X., & Yu, S. (2013). The research and implementation of a personalized intelligent tutoring system. Proceedings of the 2nd International Conference On Computer Science And Electronics Engineering, China, 1302-1304.

Šarić-Grgić, I., Grubišić, A., Šerić, L., & Robinson, T. J. (2023). Student clustering based on learning behavior data in the intelligent tutoring system. International Journal of Distance Education Technologies, 18(2), 73-89,

Sudin, I. A. A., Rahmatullah, B., Abdullah, M. F. W., Tamrin, K. F., Khairudin, M., & Yahya, S. R. (2022). A systematic literature review study on university students’ exposure to 3D printing as preparation for industry. Journal of ICT in Education, 9(1), 48–60.

VanLehn, K. (2006). The behavior of tutoring systems. International Journal Of Artificial Intelligence In Education, 16(3), 227-265.

Vimal, K. R., Sowmya, V., & Soman, K. P. (2020). Effect of data pre-processing on brain tumor classification using Capsulenet. In V. Gunjan, V. Garcia Diaz, M. Cardona, V. Solanki, & K. Sunitha (Eds.), ICICCT 2019 – System reliability, quality control, safety, maintenance and management (pp. 110-119). Springer.

Wang, H., Tlili, A., Huang, R., Cai, Z., Li, M., Cheng, Z., ... & Fei, C. (2023). Examining the applications of intelligent tutoring systems in real educational contexts: A systematic literature review from the social experiment perspective. Education and Information Technologies, 28, 9113-9148.

Wasilewska, A., & Menasalvas, E. (2023). A granular model for data mining. In T. Y. Lin, C. J. Liau, & J. Kacprzyk. (Eds.), Encyclopedia of complexity and systems science series: Granular, fuzzy, and soft computing (pp. 251-264). Springer.

Yaratan, H. (2003). Intelligent tutoring system: A tool for testing the research curiosities of artificial intelligence researchers. Turkish Online Journal of Educational Technology, 2(3), 41-47.

Yilmaz, R., Yurdugül, H., Yilmaz, F. G. K., Şahi̇n, M., Sulak, S., Aydin, F., Tepgeç, M., Müftüoğlu, C. T., & Oral, O. O. O. (2022). Smart MOOC integrated with intelligent tutoring: A system architecture and framework model proposal. Computers and Education: Artificial Intelligence, 3, Article 100092.

Zhang, L., Pan, M., Yu, S., Chen, L., & Zhang, J. (2023). Evaluation of a student-centered online one-to-one tutoring system. Interactive Learning Environments, 31(7), 4251-4269.




How to Cite

Abdul Rahim, S. K. N., Jaafar, A. H., & Baskaran, G. (2023). Intelligent tutoring system: New criteria and evaluation to measure students’ degree of mastery. Journal of ICT in Education, 10(2), 113–131.