Relational Validity in Practice: A Decade of Research on Alternative Assessment in English Language Teaching Higher Education (2014–2024)
DOI:
https://doi.org/10.37134/ajatel.vol15.2.7.2025Keywords:
Alternative Assessment, Bibliometric Analysis, Relational Validity, English Language Teaching, Higher EducationAbstract
The past decade has witnessed a marked shift in English Language Teaching (ELT) assessment within higher education from standardised testing toward formative and learner-centred approaches. This study maps and reinterprets this evolution through a bibliometric and AI-assisted thematic analysis of 516 peer-reviewed journal articles published between 2014 and 2024. Using Dimensions.ai as the data source, co-word mapping and Latent Dirichlet Allocation (LDA) modelling identified five thematic clusters representing teacher assessment literacy, learner-centred experimentation, systemic reform, inclusivity, and sociocultural feedback dynamics. Although publication output increased exponentially after 2019, conceptual integration between sociocultural learning theory and validation frameworks remains limited. To address this gap, the study introduces relational validity as a synthesising framework that aligns evidential reasoning with dialogic, ethical, and pedagogical dimensions of assessment. This construct reframes validity as coherence among evidence, interpretation, and educational consequence, extending traditional psychometric concerns toward a more contextually grounded, human-centred paradigm. By combining structural bibliometric analysis with interpretive theorisation, this study offers both an overview of alternative assessment research and a conceptual roadmap for advancing fairness, reliability, and transformative practice in ELT higher education.
Downloads
References
Altinay, F., Alpturk, K., Berigel, M., Ayaz, A., Dagli, G., & Altinay, Z. (2024). Evolution of online assessment in higher education: A bibliometric analysis. Pakistan Journal of Life and Social Sciences, 22(1), 6772–6786. https://doi.org/10.57239/PJLSS-2024-22.1.00494
American Educational Research Association. (2011). Code of ethics. https://www.aera.net/About-AERA/AERA-Rules-Policies/Professional-Ethics
Andrade, H., & Brookhart, S. M. (2016). The role of classroom assessment in supporting self-regulated learning. In D. Laveault & L. Allal (Eds.), Assessment for learning: Meeting the challenge of implementation (Vol. 4, pp. 293–309). Springer. https://doi.org/10.1007/978-3-319-39211-0_17
Black, P., & Wiliam, D. (1998). Assessment and classroom learning. Assessment in Education: principles, policy & practice, 5(1), 7-74. https://doi.org/10.1080/0969595980050102
Black, P., & Wiliam, D. (2010). Inside the black box: Raising standards through classroom assessment. Phi Delta Kappan, 92(1), 81–90. https://doi.org/10.1177/003172171009200119
Boud, D., & Falchikov, N. (2006). Aligning assessment with long‐term learning. Assessment & evaluation in higher education, 31(4), 399-413. https://doi.org/10.1080/02602930600679050
Brown, J. D., & Hudson, T. (1998). The alternatives in language assessment. TESOL Quarterly, 32(4), 653–675. https://www.jstor.org/stable/3587999
Carless, D. (2015). Excellence in university assessment: Learning from award-winning practice. Routledge. https://doi.org/10.4324/9781315740621
Carless, D., & Boud, D. (2018). The development of student feedback literacy: Enabling uptake of feedback. Assessment & Evaluation in Higher Education, 43(8), 1315–1325. https://doi.org/10.1080/02602938.2018.1463354
Cheng, L., & Fox, J. (2017). Assessment in the language classroom: Teachers supporting student learning. Bloomsbury Publishing.
Cowie, B., & Bell, B. (1999). A model of formative assessment in science education. Assessment in Education: Principles, Policy & Practice, 6(1), 101-116. https://doi.org/10.1080/09695949993026
Davison, C., & Leung, C. (2009). Current issues in English language teacher-based assessment. TESOL Quarterly, 43(3), 393–415. https://doi.org/10.1002/j.1545-7249.2009.tb00242.x
Earl, L. M. (2012). Assessment as learning: Using classroom assessment to maximize student learning. Corwin Press.
Fulcher, G. (2015). Re-examining language testing: A philosophical and social inquiry. Routledge.
Fulcher, G., & Davidson, F. (2007). Language testing and assessment. Routledge.
Gipps, C. (1994). Developments in Educational Assessment: what makes a good test? Assessment in Education: Principles, Policy & Practice, 1(3), 283-292. https://doi.org/10.1080/0969594940010304
Hattie, J., & Timperley, H. (2007). The power of feedback. Review of educational research, 77(1), 81-112. https://doi.org/10.3102/003465430298487
Hook, D. W., Porter, S. J., & Herzog, C. (2018). Dimensions: Building context for search and evaluation. Frontiers in Research Metrics and Analytics, 3(23), 1-11. https://doi.org/10.3389/frma.2018.00023
Kane, M. (2013). The argument-based approach to validation. School Psychology Review, 42(4), 448–457.
Kunnan, A. J. (2017). Evaluating language assessments. Routledge. https://doi.org/10.4324/9780203803554
Lantolf, J. P., & Poehner, M. E. (2011). Dynamic assessment in the classroom: Vygotskian praxis for second language development. Language Teaching Research, 15(1), 11–33. https://doi.org/10.1177/1362168810383328
Lin, Y., & Yu, Z. (2023). A bibliometric analysis of peer assessment in online language courses. Languages, 8(1), 47. https://doi.org/10.3390/languages8010047
Lynch, B. K. (2001). Rethinking assessment from a critical perspective. Language Testing, 18(4), 351–372. https://doi.org/10.1177/026553220101800403
Messick, S. (1989). Validity. In R. Linn (Eds.), Educational measurement (pp. 13–103). Macmillan Publishing Co, Inc; American Council on Education.
Messick, S. (1996). Validity in performance assessments. In G. W. Phillips (Eds.), Technical issues in large-scale performance assessment. Washington DC: National Center for Education Statistics.
Palm, T. (2008). Performance assessment and authentic assessment: A conceptual analysis of the literature. Practical Assessment, Research, and Evaluation, 13(1), 4. https://doi.org/10.7275/0qpc-ws45
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., et al. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ, 372(71), 1-9. https://doi.org/10.1136/bmj.n71
Panadero, E., Brown, G. T., & Strijbos, JW. (2016). The future of student self-assessment: A review of known unknowns and potential directions. Educational Psychology Review, 28(4), 803–830. https://doi.org/10.1007/s10648-015-9350-2
Phakiti, A., & Isaacs, T. (2021). Classroom assessment and validity: Psychometric and edumetric approaches. European Journal of Applied Linguistics and TEFL, 10(1), 3–24.
Phongsirikul, M. (2018). Traditional and alternative assessments in ELT: Students’ and teachers’ perceptions. rEFLections, 25(1), 61–84. https://doi.org/10.61508/refl.v25i1.136267
Rea-Dickins, P. (2004). Understanding teachers as agents of assessment. Language Testing, 21(3), 249–258. https://doi.org/10.1191/0265532204lt283ed
Scarino, A. (2013). Language assessment literacy as self-awareness: Understanding the role of interpretation in assessment and in teacher learning. Language Testing, 30(3), 309–327.
https://doi.org/10.1177/0265532213480128
Shepard, L. A. (2000). The role of assessment in a learning culture. Educational Researcher, 29(7), 4–14.
https://doi.org/10.3102/0013189X029007004
Shepard, L. A. (2019). Classroom assessment to support teaching and learning. The ANNALS of the American Academy of Political and Social Science, 683(1), 183–200. https://doi.org/10.1177/0002716219843818
Shohamy, E. (2020). The power of tests: A critical perspective on the uses of language tests. Routledge.
Taylor, L., & Banerjee, J. (2023). Language assessment accommodations: Issues and challenges for the future. Language Testing, 40(4), 1000–1006. https://doi.org/10.1177/02655322231186222
Van Eck, N. J., & Waltman, L. (2010). Software survey: VOSviewer, a computer program for bibliometric mapping. Scientometrics, 84, 523–538. https://doi.org/10.1007/s11192-009-0146-3
Visser, M., Van Eck, N. J., & Waltman, L. (2021). Large-scale comparison of bibliographic data sources: Scopus, Web of Science, Dimensions, Crossref, and Microsoft Academic. Quantitative Science Studies, 2(1), 20–41. https://doi.org/10.1162/qss_a_00112
Vygotsky, L. S. (1978). Mind in society: Development of higher psychological processes. M. Cole, V. Jolm-Steiner, S. Scribner, & E. Souberman, (Eds.). Harvard University Press. https://doi.org/10.2307/j.ctvjf9vz4
Wiliam, D. (2011). What is assessment for learning? Studies in Educational Evaluation, 37(1), 3-14. https://doi.org/10.1016/j.stueduc.2011.03.001
Zhang, X. (2025). Trends in language assessment and testing: A bibliometric study. Studies in Second Language Learning and Teaching, 15(1), 171–198. https://doi.org/10.14746/ssllt.25141
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Arathai Din Eak, Li Hsien Ooi, Saw Fen Tan
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
