The Importance of Using Checklist in Measuring the Comprehensiveness of English Teaching Materials: A Systematic Literature Review
DOI:
https://doi.org/10.37134/ajatel.vol13.2.6.2023Keywords:
comprehensiveness, material analysis, checklist method, English as a Second LanguageAbstract
The aim of this paper was to provide evidence pertaining to the practice of using checklists in analysing the comprehensiveness level of the English teaching materials prepared to be used during the teaching and learning process. A systematic literature review (SLR) of empirical studies exploring the practices of using checklists in analysing the English teaching materials was performed. A total of 12 papers were included in the SLR. It was discovered that the use of a checklist in analysing teaching materials could highlight the differences in teachers’ perceptions; promote convenient methods to keep record; identify the strengths and weaknesses of the materials; encourage systematic method of analysis; offer flexibility for current changes; lead to adaptation of the existing materials. It is also suggested in the future, bigger-scale research should be conducted and repeating analysis using the similar checklist could be done in order to improve the accuracy in obtaining the data.
Downloads
References
Ahmadi, A., & Derakhshan, A. (2016). EFL teachers' perceptions towards textbook evaluation. Theory and Practice in Language Studies, 6(2), 260-267.
Ahour, T., Towhidiyan, B., & Saeidi, M. (2014). The Evaluation of" English Textbook 2" Taught in Iranian High Schools from Teachers' Perspectives. English Language Teaching, 7(3), 150-158.
Almatard, A. (2019). Developing an Evaluation Checklist for Identity in ESOL Textbooks. Doctoral dissertation, Arizona State University.
Almeida, L. S., Prieto, M. D., Ferreira, A. I., Bermejo, M. R., Ferrando, M., & Ferrándiz, C. (2010). Intelligence assessment: Gardner multiple intelligence theory as an alternative. Learning and Individual Differences, 20(3), 225-230.
Alshehri, A. (2016). Textbook evaluation: teachers’ perspectives on cutting edge. International Journal of English Language Education, 4(2), 91-106.
Altan, M. Z. (1995). Culture in EFL contexts: Classroom and coursebooks. MET, 4(2), 58–60.
Ansary, H., & Babaii, E. (2002). Universal characteristics of EFL/ESL textbooks: A step towards systematic textbook evaluation. The Internet TESL Journal, 8(2), 1-9.
Bahumaid, S. (2008). TEFL materials evaluation: A teacher's perspective. Poznań Studies in Contemporary Linguistics, 44(4), 423-432.
Bajrami, L., & Ismaili, M. (2016). The role of video materials in EFL classrooms. Procedia-Social and Behavioral Sciences, 232, 502-506.
Barton, L., & Tomlinson, S. (Eds.). (2012). Special Education and Social Interests (RLE Edu M). New York: Routledge.
Basri, M., & Patak, A. A. (2015, October). Exploring Indonesian students' perception on Mendeley Reference Management Software in academic writing. In 2015 2nd international conference on information technology, computer, and electrical engineering (ICITACEE) (pp. 8-13). IEEE.
Berardo, S. A. (2006). The use of authentic materials in the teaching of reading. The reading matrix, 6(2). 60-69.
Block, D. (1991). Some thoughts on DIY materials design. ELT Journal, 45(3), 211–217.
Bradley, R., Danielson, L., & Hallahan, D. P. (Eds.). (2002). Identification of learning disabilities: Research to practice. New York: Routledge.
Brown, H.D. (2007). Teaching by Principles: An Interactive Approach to Language Pedagogy. New York: Pearson Education.
Cenoz, J., & Gorter, D. (2017). Minority languages and sustainable translanguaging: Threat or opportunity?. Journal of Multilingual and Multicultural Development, 38(10), 901-912.
Charmaz, K. (2000). Grounded theory: Objectivist and constructivist methods. Handbook of qualitative research, 2, 509-535.
Creswell, J. W. (2002). Educational research: Planning, conducting, and evaluating quantitative (p. 676). Upper Saddle River, NJ: Prentice Hall.
Creswell, J.W. (2003). Research design: Qualitative, quantitative, and mixed methods approaches (2nd ed.) Thousand Oaks, CA: Sage.
Curzon, L. B. (2003). Teaching in further education: An outline of principles and practice. New York: Continuum.
Darling-Hammond, L. (2006). Constructing 21st-century teacher education. Journal of teacher education, 57(3), 300-314.
Dawson, K., & Ferdig, R. E. (2006). Commentary: Expanding notions of acceptable research evidence in educational technology: A response to Schrum et al. Contemporary Issues in Technology and Teacher Education, 6(1), 133-142.
Demetrion, G. (1997). Student goals and public outcomes: The contribution of adult literacy education to the public good. Adult basic education, 7(3), 145-164.
Demir, Y., & Ertas, A. (2014). A suggested eclectic checklist for ELT coursebook evaluation. Reading, 14(2), 243-252.
Donalek, J. G. (2005). The interview in qualitative research. Urologic Nursing, 25(2), 124-125.
Ellis, R. (1986). Activities and procedures for teacher training. ELT journal, 40(2), 91-99.
Fadilahwati Abdul Rahman, Fattawi Mokhtar & Ronaldi Saleh Umar (2010). Usability Testing on Interactive Multimedia Learning Object for Dyslexic Children: Proceeding of 5th International Conference on e-Learning, 12-13 July 2010. Universiti Sains Malaysia, Penang, Malaysia.
Fong, C. E. (2018). Dari Pendidikan Khas ke Pendidikan Pemulihan: Dua Program Masalah Pembelajaran. Analitika: Jurnal Magister Psikologi UMA, 10(1), 46-53.
Foo, B., & Richards, C. (2004). English in Malaysia. RELC journal, 35(2), 229-240.
García, S. B., & Tyler, B. J. (2010). Meeting the needs of English language learners with learning disabilities in the general curriculum. Theory into practice, 49(2), 113-120.
Graham, S., & Harris, K. R. (1994). Implications of constructivism for teaching writing to students with special needs. The Journal of Special Education, 28(3), 275-289.
Graves, K. (2000). Designing language courses: A guide for teachers. Boston, MA: Heinle & Heinle.
Gredler, M. E. (2012). Understanding Vygotsky for the classroom: Is it too late?. Educational Psychology Review, 24(1), 113-131.
Gregoire, J., & Hambleton, R. K. (2009). Advances in test adaptation research: A special issue. International Journal of Testing, 9(2), 75-77.
Griffin, J. D. (2004). Growing up in foster care: A qualitative study of the relational worlds of foster youth. USA: The University of Texas at Austin.
Harmer, J. (2001). Coursebooks. A human, cultural and linguistic disaster? MET, 8(4), 5–10.
Harmer, J. (2008). How to teach English. ELT journal, 62(3), 313-316.
Hebert, M., Simpson, A., & Graham, S. (2013). Comparing effects of different writing activities on reading comprehension: A meta-analysis. Reading and Writing, 26(1), 111-138.
Hedge, T. (2000). Teaching and learning in the language classroom. Oxford: Oxford University Press.
Hillyard, S. (2018). Resourcing the Under-resourced English Language Classroom in State Primary Special Education Schools in Buenos Aires, Argentina. In International Perspectives on Teaching English in Difficult Circumstances (pp. 175-195). Palgrave Macmillan, London.
Hosie, P., & Schibeci, R. (2005). Checklist and context‐bound evaluations of online learning in higher education. British Journal of Educational Technology, 36(5), 881-895.
Howard, J., & Major, J. (2004). Guidelines for designing effective English language teaching materials. The TESOLANZ Journal, 12(10), 50-58.
Huda, M. (2017). The use of authentic materials in teaching English: Indonesia teachers’ perspective in EFL classes. PEOPLE: international Journal of social sciences, 3(2), 1907-1927.
Ismail, H., Hamzah, R., Yunus, A. S. M., Nawawi, H., Abu, R., & Ali, W. Z. W. (2007). Teachers' Belief Towards the Principles Underlying the National Philosophy of Education in Malaysia. international Journal of Learning, 13(9), 777-780.
Jusuf, H. (2018). The models of checklist method in evaluating ELT textbooks. Al-Lisan: Jurnal Bahasa (e-Journal), 3(2), 17-35.
Kauffman, J. M., Hallahan, D. P., Pullen, P. C., & Badar, J. (2018). Special education: What it is and why we need it. New York: Routledge.
Keeley, J., Smith, D., & Buskist, W. (2006). The Teacher Behaviors Checklist: Factor analysis of its utility for evaluating teaching. Teaching of Psychology, 33(2), 84-91.
Klingner, J. K., Urbach, J., Golos, D., Brownell, M., & Menon, S. (2010). Teaching reading in the 21st century: A glimpse at how special education teachers promote reading comprehension. Learning Disability Quarterly, 33(2), 59-74.
Kolb, A. Y., & Kolb, D. A. (2009). Experiential learning theory: A dynamic, holistic approach to management learning, education and development. The SAGE handbook of management learning, education and development, 7(2), 42-68.
Kozulin, A. (2004). Vygotsky's theory in the classroom: Introduction. European Journal of Psychology of Education, 19(2), 3-7.
Lawrence, J. E., & Tar, U. A. (2018). Factors that influence teachers’ adoption and integration of ICT in teaching/learning process. Educational Media International, 55(1), 79-105.
Lay WL, Hui ML (2014) The Evolution of Special Education in Malaysia. British Journal of Special Education 41 (1), 42-58.
Leung, L. (2015). Validity, reliability, and generalizability in qualitative research. Journal of family medicine and primary care, 4(3), 324.
Liu, J. (2016). Adaptation of authentic materials in English listening comprehension classes. Theory and Practice in Language Studies, 6(9), 1774-1779.
LittleJohn, A. 2011. The analysis of language teaching materials: Inside the Trojan Horse. In Materials Development in Language Teaching (2nd Edition). United Kingdom: Cambridge University Press.
Litz, D. R. (2005). Textbook evaluation and ELT management: A South Korean case study. Asian EFL journal, 48(1), 1-53.
Marand, E. S. (2011). Adoption, adaptation, and development of language instructional units. European Journal of Social Sciences, 22(4), 550-555.
Madsen, H. S., & Bowen, J. D. (1978). Adaptation in Language Teaching. New York: Newbury House Publishers.
Mengist, W., Soromessa, T., & Legese, G. (2020). Method for conducting systematic literature review and meta-analysis for environmental science research. MethodsX, 7, 100777.
McDonough, J., & Shaw, C. (2012). Materials and Methods in ELT. New Jersey: John Wiley & Sons.
McDonough, J., Shaw, C. and Masuhara, H. (2013), Materials and Methods in ELT; A Teacher’s Guide (3rd ed.). New York: Wiley.
McGrath, I. (2002). Materials evaluation and design for language teaching. Edinburgh: Edinburgh University Press.
Makin, L., Jones-Diaz, C., & McLachlan, C. (Eds.). (2007). Literacies in childhood: Changing views, challenging practice. United Kingdom: Elsevier Australia.
Maley, A. (2011) Squaring the circle – reconciling materials as constraint with materials as empowerment. In: Tomlinson, B. (ed). Materials Development in Language Teaching. (2nd ed) Cambridge: Cambridge University Press.
Merriam, S. B. (2004). The role of cognitive development in Mezirow’s transformational learning theory. Adult education quarterly, 55(1), 60-68.
Mukundan, J., & Roslim, N. (2009). Textbook representation of prepositions. English language teaching, 2(4), 13-24.
Mukundan, J. (2006). Are there new ways of evaluating ELT coursebooks? Readings on ELT Material II. Petaling Jaya: Pearson Malaysia,
Mukundan, J., Hajimohammadi, R., & Nimehchisalem, V. (2011). Developing an English language textbook evaluation checklist. Contemporary Issues in Education Research (CIER), 4(6), 21-28.
Musa, S. H. (2021). Something Important For Special Education In Malaysia. Turkish Journal of Computer and Mathematics Education (TURCOMAT), 12(11), 5211-5216.
Nasir, M. N. A., & Efendi, A. N. A. E. (2016). Special education for children with disabilities in Malaysia: Progress and obstacles. Malaysian Journal of Society and Space, 12(10), 78-87.
Noble, H., & Smith, J. (2015). Issues of validity and reliability in qualitative research. Evidence-based nursing, 18(2), 34-35.
Nordlof, J. (2014). Vygotsky, scaffolding, and the role of theory in writing center work. The Writing Center Journal, 34(1), 45-64.
Norizan Abdul Ghani, Zahidah Anisah Mohamad & Che Wan Takwa Che Wan Abu Bakar (2013).Teachers’ Challenges in Educating Special Children in Special Classes of Three Selected Primary Schools, Kuala Terengganu, Terengganu, Malaysia. Advances in Natural and Applied Sciences, 7(3),284-291.
O'Connor, R. E., Sanchez, V., Beach, K. D., & Bocian, K. M. (2017). Special education teachers integrating reading with eighth grade US history content. Learning Disabilities Research & Practice, 32(2), 99-111.
Okazaki, T. (2005). Critical consciousness and critical language teaching. University of Hawai'I Second Langauge Studies Paper 23 (2), 174-202.
Okoli, C. (2015). A guide to conducting a standalone systematic literature review. Communications of the Association for Information Systems, 37(43), 879 - 910.
O'Neill, R. (1982). Why use textbooks?. ELT Journal, 36(2), 104-111.
Ortega, L. (2009).Understanding Second Language Acquisition. London: Hodder Education.
Pettit, S. K. (2011). Teachers' beliefs about English language learners in the mainstream classroom: A review of the literature. International Multilingual Research Journal, 5(2), 123-147.
Podromou, L. (2002). The great ELT textbook debate. MET, 11(4), 25–33.
Popenoe, R., Langius-Eklöf, A., Stenwall, E., & Jervaeus, A. (2021). A practical guide to data analysis in general literature reviews. Nordic journal of nursing research, 41(4), 175-186.
Potter, M. L., & Wamre, H. M. (1990). Curriculum-based measurement and developmental reading models: Opportunities for cross-validation. Exceptional Children, 57(1), 16-25.
Rashidi, N. & Safari, F. (2011). A model for EFL materials development within the framework of critical pedagogy (CP). English Language Teaching, 4(2), 250-259.
Refnita, L. (2012). The Effectiveness of an Integrated Assessment to Improve the Students ‘English Grammar Ability. Lingua Didaktika: Jurnal Bahasa dan Pembelajaran Bahasa, 6(1), 45-50.
Richards, J. C. (2008). Teaching listening and speaking. Cambridge, England: Cambridge University press.
Richards, J. & Rodgers, J. (2001). Approaches and methods in language teaching. Cambridge, England: Cambridge University Press.
Rixon, S. (1986). Developing listening skills. Macmilla: London.
Roberts, P., & Priest, H. (2006). Reliability and validity in research. Nursing standard, 20(44), 41-46.
Rosengren, K. S., Brem, S. K., Evans, E. M., & Sinatra, G. M. (Eds.). (2012). Evolution challenges: Integrating research and practice in teaching and learning about evolution. Oxford University Press.
Rost, M., Laurie, F., & Helen, S. (2017). Contemporary Topics: 21st century skills for academic success. England: Pearson Education.
Şahin, S. (2020). Developing a checklist for English language teaching course book analysis. International Journal of Education and Research, 8(1), 107-120.
Sarem, S. N., Hamidi, H., & Mahmoudie, R. (2013). A critical look at textbook evaluation: A case study of evaluating an ESP course-book: English for international tourism. International Research Journal of Applied and Basic Sciences, 4(2), 372-380.
Sastry, M. K., & Mohammed, C. (2013, July). The summary-comparison matrix: A tool for writing the literature review. In IEEE International Professonal Communication 2013 Conference (pp. 1-5). IEEE.
Sikorova, Z. (2005). The textbook selection in primary and secondary schools. Caught in the web or lost in the textbook, 11(2), 341-348.
Skierso, A. (1991). Textbook selection and evaluation. In M. Celce-Murcia (Ed.), Teaching English as a second or foreign language (pp. 432-453). Boston, MA: Heinle & Heinle Publishers.
Strauss, A., & Corbin, J. (1998). Basics of qualitative research: Techniques and procedures for developing grounded theory (2nd ed.) Thousand Oaks, CA: Sage
Swanson, H. L., Harris, K. R., & Graham, S. (Eds.). (2013). Handbook of learning disabilities. United Kingdom: Guilford press.
Taiwo, F. O. (2013). An Examination of the Problems in Selecting Materials for Classrooms in Nigeria. International Journal of Educational Research and Technology, 4 (3), 15-21.
Taylor, K. S., Mahtani, K. R., & Aronson, J. K. (2021). Summarising good practice guidelines for data extraction for systematic reviews and meta-analysis. BMJ Evidence-Based Medicine, 26(3), 88-90.
Thalmann, S. (2014). Adaptation criteria for the personalised delivery of learning materials: A multi-stage empirical investigation. Australasian Journal of Educational Technology, 30(1). 45-60.
Thornbury, S., & Meddings, L. (2001). Coursebooks: The roaring in the chimney. MET, 8(4), 11–13.
Thornbury, S., & Meddings, L. (2002). Using a coursebook the Dogme way. MET, 11(1), 36–40
Thyer, B. A. (2012). Quasi-experimental research designs. United Kingdom: Oxford University Press.
Tomlinson, B. (2012). Materials development for language learning and teaching. Language teaching, 45(2), 143-179.
Troia, G. A. (2006). Writing instruction for students with learning disabilities. Handbook of writing research, 23(2), 324-336.
Umar, R. S., Rahman, F. A., Mokhtar, F., & Alias, N. A. (2011). Menggunakan Animasi di dalam Instruksi Khas untuk Kanak-Kanak Disleksia. Jurnal Teknologi Pendidikan Malaysia, 1(2), 27-38.
Underwood, P. R. (2012). Teacher beliefs and intentions regarding the instruction of English grammar under national curriculum reforms: A Theory of Planned Behaviour perspective. Teaching and Teacher education, 28(6), 911-925.
Usman, A., & Khan, A. W. (2018). Software outsourcing quality challenges model systematic literature review (SLR) protocol. University of Sindh Journal of Information and Communication Technology, 2(4), 196-201.
Wondimtegegn, F. Y. (2020). Authentic ELT Material Adaptation: Drawbacks, Prevalence and Solutions: The case of Wolkite University community school, Wolkite, Ethiopia. International Journal of Scientific Research and Management (IJSRM), 8(1), 597-606.
Yilmaz, K. (2011). The cognitive perspective on learning: Its theoretical underpinnings and implications for classroom practices. The Clearing House: A Journal of Educational Strategies, Issues and Ideas, 84(5), 204-212.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Muhammad Azwan Basaruddin, Hema Rosheny Mustafa
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
