Validation of technical and vocational teachers’ competency evaluation instrument using the rasch model
DOI:
https://doi.org/10.37134/jpsmm.vol9.1.3.2019Keywords:
competency, Rasch Model, vocational, teacher, evaluationAbstract
This pilot study was conducted with the aim to validate the instrument used in evaluating the competency of teachers in the field of technical and vocational education. This instrument consists of 45 items and is administered to 53 teachers from a selected vocational college. The Rasch Model with the help of the Winstep Version 3.72.3 software has been used in this study for the purpose of checking the functionality of the item and the validity of the instrument. An analysis has been made based on the suitability of items in measuring the construct, item and person reliability and separation index, polarity and residual correlation value. The Rasch analysis showed that the item reliability was valued at 0.92 while the person reliability valued at 0.96 with their item MNSQ between overfit (<0.6) and misfit (>1.4). Based on the findings, there are three items that were dropped because of failing to meet the inspection criteria. The finalized instrument consists of 42 items, in which it is suitable for evaluating the four constructs in the competency evauation of technical and vocational teachers in vocational colleges.
Downloads
References
Bond, T., & Fox, C. (2015). Applying the rasch model fundamental measurement in the human Sciences. New York: Routledge.
Fisher, W. (2007). Rating scale instrument quality criteria . Rasch Measurement Transaction 21(1), 1095.
Ghazali, D., & Sufean, H. (2018). Metodologi penyelidikan dalam pendidikan. Kuala Lumpur: Penerbit Universiti Malaya.
Hashimah, M., Mohd Isa, H., & Shahlan, S. (2018). Kesahan dan kebolehpercayaan instrumen indeks pemupukan kreativiti dalam pengajaran guru dengan elemen islam (I-CFTI) berdasarkan pendekatan model rasch. Jurnal Pendidikan Malaysia, 77-88.
Hasnah, I., & Jamaludin, B. (2017). Kompetensi guru bahasa melayu dalam menerapkan kemahiran berfikir aras tinggi dalam pengajaran dan pembelajaran. Jurnal Pendidikan Bahasa Melayu, 56-65.
Hishamuddin , A., Siti Eshah , M., & Mohd Razimi, H. (2018). Detecting item bias in an anatomy & physiology test for nursing students using item response theory. International Journal of Academic Research in Progressive Education and Development, 97–109.
Hishamuddin , A., Siti Eshah, M., Mohd Razimi , H., Siti Rahaimah , A., & Ismail Yusuf , P. (2019). Measuring the academic success of students with ASICS using polytomous item response theory. International Journal of Advanced and Applied Sciences, 123-129.
Lily Hanefarezan, A., Maimun Aqsha, L., Ashinida, A., & Mus'ab, S. (2018). Kesahan dan kebolehpercayaan instrumen strategi pembelajaran kolokasi bahasa arab : Analisis menggunakan model rasch. Jurnal Pendidikan Malaysia, 131-140.
Linacre, J. (1994). Sample size and item calibration stability. Rasch Measurement Transactions, 7:4 p.328
Linacre, J. (2002). Optimizing rating scale category effectiveness. Journal of Applied Measurement, 3(1), 85–106
Linacre, J. (2019). A user's guide to winstep® ministep Rasch-Model Computer Program.
Noraini, I. (2013). Penyelidikan dalam pendidikan. Selangor: McGraw-Hill Education (Malaysia) Sdn. Bhd.
Unit Pelaksanaan dan Prestasi Pendidikan. (2018). Laporan tahunan 2017 : Pelan pembangunan pendidikan malaysia 2013-2025. Putrajaya: Kementerian Pendidikan Malaysia.
Wright, B., & Stone, M. (1979). Best Test Design. MESA Press Chicago.
