Online Formative Assessment in Higher STEM Education; A Systematic Literature Review

  • Mangai Solomon Mahanan Department of Educational Science, Mathematics and Creative Multimedia, Faculty of Social Science and Humanities, Universiti Teknologi Malaysia, MALAYSIA
  • Corrienna Abdul Talib Department of Educational Science, Mathematics and Creative Multimedia, Faculty of Social Science and Humanities, Universiti Teknologi Malaysia, MALAYSIA
  • Nor Hasniza Ibrahim Department of Educational Science, Mathematics and Creative Multimedia, Faculty of Social Science and Humanities, Universiti Teknologi Malaysia, MALAYSIA
Keywords: Formative assessment, STEM education, Online formative assessment, Higher education

Abstract

Online formative assessment in higher education Science Technology Engineering and Mathematics (STEM) is gaining attention in recent years based on the increasing use of online learning. This study, aimed at critically reviewing studies on online formative assessment in Higher education STEM between 2011 to 2020. The study adopted a qualitative research design to analyze studies based on specific themes. 1402 articles were systematically searched through Scopus, web of science, and google scholar databases. However, only 12 studies were included in this study after satisfying the inclusion criteria. All data analyses were done using the Endnote X9 reference manager. The findings reveal that, evidence about online tools used, theories used in the learning and assessment process, the domain of learning outcome assessed, assessment of practical skills, and form of assessment used have been implicitly described. However, the online formative assessments have shown great potential of yielding immediate feedback. Therefore, future studies can engage in a more extensive study on areas such as online assessment tools for assessing practical skills and strategies that can enhance the effectiveness of online formative assessment which encompasses all domains of learning outcome within STEM higher education.

Downloads

Download data is not yet available.

References

Adedoyin, O. B., & Soykan, E. (2020). Covid-19 pandemic and online learning: the challenges and opportunities. Interactive Learning Environments, 1–13. https://doi.org/10.1080/10494820.2020.1813180

Adnan, M. (2020). Online learning amid the COVID-19 pandemic: Students perspectives. Journal of Pedagogical Research, 1(2), 45–51. https://doi.org/10.33902/jpsp.2020261309

Allo, M. D. G. (2020). Is the online learning good in the midst of Covid-19 Pandemic ? The case of EFL learners. Jurnal Sinestesia, 10(1), 1–10.

Anwari, I., Yamada, S., Unno, M., Saito, T., Suwarma, I. R., Mutakinati, L., & Kumano, Y. (2015). Implementation of authentic learning and assessment through STEM education approach to improve students’ metacognitive skills. K-12 STEM Education, 1(3), 123–136. http://www.k12stemeducation.in.th/journal/article/view/23/24

Baleni, Z. G. (2015). Online formative assessment in higher education : Its pros and cons. Electronic Journal of e-Learning, 13(4), 228–236.

Black, P., & Wiliam, D. (2009). Developing the theory of formative assessment. Educational Assessment Evaluation and Accountability, 21(September 2008), 5–31. https://doi.org/10.1007/s11092-008-9068-5

Boekaerts, M., Maes, S., & Karoly, P. (2005). Self-Regulation Across Domains of Applied Psychology : Is there an Emerging Consensus? Applied Psychology: An International Review, 54(2), 149–154.

Cabrera, I., & Villalon, J. (2013). An adaptive interface for computer-assisted rubrics in an E-marking tool using nearest neighbor. Proceedings - 2013 IEEE 13th International Conference on Advanced Learning Technologies, ICALT 2013, 72–76. https://doi.org/10.1109/ICALT.2013.27

Challis, D. (2005). Committing to quality learning through adaptive online assessment. Assessment and Evaluation in Higher Education, 30(5), 519–527. https://doi.org/10.1080/02602930500187030

Chang, S. C., Hsu, T. C., & Jong, M. S. Y. (2020). Integration of the peer assessment approach with a virtual reality design system for learning earth science. Computers and Education, 146(November 2019), 103758. https://doi.org/10.1016/j.compedu.2019.103758

Clutterbuck, P., Rowlands, T., & Seamons, O. (2015). Investigating student behavior in adopting online formative assessment feedback. International Journal of Social, Economics and Management Engineering, 9(1), 328–335.

Cohen, D., & Sasson, I. (2016). Online quizzes in a virtual learning environment as a tool for formative assessment. Journal of Technology and Science Education, 6(3), 188–208.

Davis, D., Chen, G., Hauff, C., & Houben, G. J. (2018). Activating learning at scale: A review of innovations in online learning strategies. Computers and Education, 125(June), 327–344. https://doi.org/10.1016/j.compedu.2018.05.019

Deepika, N. (2020). The impact of online learning during COVID-19: students’ and teachers’ perspective. The International Journal of Indian Psychology, 8(2), 784–793. https://doi.org/10.25215/0802.094

Dhawan, S. (2020). Online Learning: A Panacea in the Time of COVID-19 Crisis. Journal of Educational Technology Systems, 49(1), 5–22. https://doi.org/10.1177/0047239520934018

Divall, M. V., Alston, G. L., Bird, E., Buring, S. M., Kelley, K. A., Murphy, N. L., Schlesselman, L. S., Stowe, C. D., & Szilagyi, J. E. (2014). A faculty toolkit for formative assessment in pharmacy education. American Journal of Pharmaceutical Education, 78(9). https://doi.org/10.5688/ajpe789160

Elmahdi, Ismail; Al-Hattami, Abdulghani; Fawzi, H. (2018). Using technology for formative assessment to improve students’ learning. TOJET: The Turkish Online Journal of Educational Technology, 17(2), 182–188. https://eric.ed.gov/?id=EJ1176157

Elzainy, A., El Sadik, A., & Al Abdulmonem, W. (2020). Experience of e-learning and online assessment during the COVID-19 pandemic at the College of Medicine, Qassim University. Journal of Taibah University Medical Sciences, 15(6), 456–462. https://doi.org/10.1016/j.jtumed.2020.09.005

Fuad, A., & Rahim, A. (2020). Guidelines for Online Assessment in Emergency Remote Teaching during the COVID-19 Pandemic. Education in Medicine Journal, 12(2), 59–68. https://doi.org/10.21315/eimj2020.12.2.6

Galvan, J. L., & Galvan, M. C. (2017). Writing literature reviews: A guide for students of the social and behavioral sciences. New York: Routledge

Gao, X., Li, P., Shen, J., & Sun, H. (2020). Reviewing assessment of student learning in interdisciplinary STEM education. International Journal of STEM Education, 7(1). https://doi.org/10.1186/s40594-020-00225-4

Ghaicha, A. (2016). Theoretical Framework for Educational Assessment : A Synoptic Review. Journal of Education and Practice, 7(24), 212–231.

Gikandi, J. W., Morrow, D., & Davis, N. E. (2011). Online formative assessment in higher education: A review of the literature. Computers and Education, 57(4), 2333–2351. https://doi.org/10.1016/j.compedu.2011.06.004

Gonzalez, H. B., & Kuenzi, J. (2012). What Is STEM Education and Why Is It Important? Congressional Research Service, August, 1–15. https://www.ccc.edu/departments/Documents/STEM_labor.pdf

Gotwals, A. W., Philhower, J., Cisterna, D., & Bennett, S. (2015). Using video to examine formative assessment practices as measures of expertise for mathematics and science teachers. International Journal of Science and Mathematics Education, 13(2), 405–423. https://doi.org/10.1007/s10763-015-9623-8

Greene, J. A., Azevedo, R., & Greene, J. A. (2007). Review of Educational New Perspectives and Directions. Review of Educational Research, 77(3), 334-372. https://doi.org/10.3102/003465430303953

Hansen, G., & Ringdal, R. (2018). Studies in educational evaluation formative assessment as a future step in maintaining the mastery-approach and performance-avoidance goal stability. Studies in Educational Evaluation, 56(November 2017), 59–70. https://doi.org/10.1016/j.stueduc.2017.11.005

Harizah, Z., Kusairi, S., & Latifah, E. (2020). Student’s critical thinking skills in interactive demonstration learning with web based formative assessment. Journal of Physics: Conference Series, 1567(4). https://doi.org/10.1088/1742-6596/1567/4/042038

Haug, B. S., & Ødegaard, M. (2015). Formative assessment and teachers’ sensitivity to student responses. International Journal of Science Education, 37(4), 629–654. https://doi.org/10.1080/09500693.2014.1003262

Hooshyar, D., Ahmad, R. B., Yousefi, M., Fathi, M., Abdollahi, A., Horng, S.-J., & Lim, H. (2016). A solution-based intelligent tutoring system integrated with an online game-based formative assessment: development and evaluation. Educational Technology Research and Development, 64(4), 787–808. https://doi.org/10.1007/s11423-016-9433-x

Jeong, J. S., González-Gómez, D., & Prieto, F. Y. (2020). Sustainable and flipped stem education: Formative assessment online interface for observing pre-service teachers’ performance and motivation. Education Sciences, 10(10). https://doi.org/10.3390/educsci10100283

Kamioka, H. (2019). Preferred reporting items for systematic review and meta-analysis protocols (prisma-p) 2015 statement. Japanese Pharmacology and Therapeutics, 47(8), 1177–1185.

Kerr, S., Muller, D., Mckinon, W., & Inerney, P. M. (2016). An online formative assessment tool to prepare students for summative assessment in physiology. 8(1), 72–76. https://doi.org/10.7196/AJHPE.2016.v8i1.581

Kibble, J. (2007). Use of unsupervised online quizzes as formative assessment in a medical physiology course : effects of incentives on student participation and performance. Advance Physiology Education, 6, 253–260. https://doi.org/10.1152/advan.00027.2007.

Kusairi, S., Noviandari, L., Parno, & Pratiwi, H. Y. (2019). Analysis of students’ understanding of motion in straight line concepts: Modeling Instruction with formative E-Assessment. International Journal of Instruction, 12(4), 353–364. https://doi.org/10.29333/iji.2019.12423a

Lestari, T. P., & Sumarti, S. S. (2018). STEM-Based Project Based Learning Model to Increase Science Process and Creative Thinking Skills of 5th Grade. Journal of Primary Education, 7(1), 18–24.

Lin, C. Y., & Wang, T. H. (2017). Implementation of personalized e-assessment for remedial teaching in an e-learning environment. Eurasia Journal of Mathematics, Science and Technology Education, 13(4), 1045–1058. https://doi.org/10.12973/eurasia.2017.00657a

Lu, X., Zheng, D., & Liu, L. (2018). Data driven analysis on the effect of online judge system. Proceedings - 2017 IEEE International Conference on Internet of Things, IEEE Green Computing and Communications, IEEE Cyber, Physical and Social Computing, IEEE Smart Data, IThings-GreenCom-CPSCom-SmartData 2017, 2018-Janua, 573–577. https://doi.org/10.1109/iThings-GreenCom-CPSCom-SmartData.2017.90

McDonald, C. (2016). STEM Education: A Review of the Contribution of the Disciplines of Science, Technology, Engineering and Mathematics. Science Education International, 27(4), 530–569.

Moharreri, K., Ha, M., & Nehm, R. H. (2014). EvoGrader : an online formative assessment tool for automatically evaluating written evolutionary explanations. Evolution: Education and Outreach, 7(15), 1-14.

Moher D, A, L., J, T., & DG, A. (2009). Preferred Reporting Items for Systematic Reviews and MetaAnalyses. PLoS Medicine, 6, 1–2. https://doi.org/10.1371/journal.pmed1000097

Nikolic, S., Stirling, D., & Ros, M. (2018). Formative assessment to develop oral communication competency using YouTube: self- and peer assessment in engineering. European Journal of Engineering Education, 43(4), 538–551. https://doi.org/10.1080/03043797.2017.1298569

Paiva, R. C., Ferreira, M. S., & Frade, M. M. (2017). Intelligent tutorial system based on personalized system of instruction to teach or remind mathematical concepts. Journal of Computer Assisted Learning, 33(4), 370–381. https://doi.org/10.1111/jcal.12186

Panadero, E., & Brown, G. T. L. (2017). Teachers’ reasons for using peer assessment: positive experience predicts use. European Journal of Psychology of Education, 32(1), 133–156. https://doi.org/10.1007/s10212-015-0282-5

Robert, M. C., & Scott, W. S. (2013). Stem project-based learning (M. C. Robert, M. M. Capraro, & R. M. James (eds.)). Boston: Sense Publishers

Sangwin, C.J., & Köcher, N. (2016). Automation of mathematics examinations. Computers and Education, 94, 215–227. https://doi.org/10.1016/j.compedu.2015.11.014

Sangwin, Christopher J., & Köcher, N. (2016). Automation of mathematics examinations. Computers and Education, 94, 215–227. https://doi.org/10.1016/j.compedu.2015.11.014

Schleicher, A. (2020). The impact of COVID-19 on education: Insights from education at a glance 2020. OECD Journal: Economic Studies, 1–31. https://www.oecd.org/education/the-impact-of-covid-19-on-education-insights-education-at-a-glance-2020.pdf

Singh, V. K., Kumari, P., Singh, A., & Thapa, J. (2011). An automated course feedback system using opinion mining. Proceedings of the 2011 World Congress on Information and Communication Technologies, WICT 2011, 72–76. https://doi.org/10.1109/WICT.2011.6141220

Sridharan, B., & Boud, D. (2019). The effects of peer judgements on teamwork and self-assessment ability in collaborative group work. Assessment and Evaluation in Higher Education, 44(6), 894–909. https://doi.org/10.1080/02602938.2018.1545898

Taber, K. S. (2013). Revisiting the chemistry triplet: Drawing upon the nature of chemical knowledge and the psychology of learning to inform chemistry education. Chemistry Education Research and Practice, 14(2), 156–168. https://doi.org/10.1039/c3rp00012e

Tsai, F., Tsai, C., & Lin, K. (2015). Computers & Education The evaluation of different gaming modes and feedback types on game-based formative assessment in an online learning environment. Computers & Education, 81, 259–269. https://doi.org/10.1016/j.compedu.2014.10.013

Uribe, S. N., & Vaughan, M. (2017). Facilitating student learning in distance education: a case study on the development and implementation of a multifaceted feedback system. Distance Education, 38(3), 288–301. https://doi.org/10.1080/01587919.2017.1369005

Ventista, O. M. (2018). Self-assessment in massive open online courses. E-Learning and Digital Media, 15(4), 165–175. https://doi.org/10.1177/2042753018784950

Walker, P., Rhys Gwynllyw, D., & Henderson, K. L. (2015). Diagnosing student errors in e-Assessment questions. Teaching Mathematics and Its Applications, 34(3), 160–170. https://doi.org/10.1093/teamat/hrv010

Wang, D., & Han, H. (2020). Applying learning analytics dashboards based on process-oriented feedback to improve students’ learning effectiveness. Journal of Computer Assisted Learning, February, 1–13. https://doi.org/10.1111/jcal.12502

White, D. W. (2014). What is STEM education and why is it important. Florida Association of Teacher Educators Journal, 1(14), 1-9.

Wu, X. V., Chan, Y. S., Tan, K. H. S., & Wang, W. (2018). A systematic review of online learning programs for nurse preceptors. Nurse Education Today, 60(April 2017), 11–22. https://doi.org/10.1016/j.nedt.2017.09.010

Yuliana, I., Kusairi, S., Taufiq, A., Priyadi, R., & Rosyidah, N. D. (2020). The analysis of students’ problem-solving ability in the 5E learning cycle with formative e-assessment. AIP Conference Proceedings, 2215(April). https://doi.org/10.1063/5.0000751

Published
2021-06-05
How to Cite
Mahanan, M. S., Abdul Talib, C., & Ibrahim, N. H. (2021). Online Formative Assessment in Higher STEM Education; A Systematic Literature Review. Asian Journal of Assessment in Teaching and Learning, 11(1), 47-62. https://doi.org/10.37134/ajatel.vol11.1.5.2021