Augmented Reality Integrated Sensory Books for Contextual Vocabulary Learning in Deaf and Hard-of-Hearing (DHH) Children: A Systematic Literature Review (2021–2026)

Authors

  • Jin Xin Art & Design Department,Faculty of Art, Sustainability and Creative Industry, Universiti Pendidikan Sultan Idris, 35900, Tanjong Malim, Perak, Malaysia Author
  • Nur Syuhada binti Mat Sin Art & Design Department,Faculty of Art, Sustainability and Creative Industry, UPSI, Tanjong Malim, Perak, Malaysia Author
  • Vestly Kong Liang Soon Special Educaition Department,Faculty of Human Development, Universiti Pendidikan Sultan Idris, 35900, Tanjong Malim, Perak, Malaysia Author

DOI:

https://doi.org/10.37134/jadcm.vol1.1.1.2026

Keywords:

augmented reality, sensory (multi-sensory) books, deaf and hard of hearing, vocabulary learning, inclusive interaction design, systematic literature review

Abstract

Children who are deaf or hard of hearing (DHH) frequently have enduring obstacles in early vocabulary development, which may limit subsequent reading and classroom engagement. Augmented reality (AR) has progressively been integrated with multimodal books to deliver contextualized, multi-sensory vocabulary learning; yet, the evidence remains disjointed across special education, educational technology, and design/HCI domains.

This systematic literature review synthesized empirical data published from 2021 to 2026 about AR-integrated sensory-book methodologies for vocabulary acquisition in DHH youngsters. Investigations were performed across four databases (ACM Digital Library, Scopus, Web of Science Core Collection, and SpringerLink) and were supplemented by backward and forward snowballing techniques. Study selection adhered to PRISMA 2020 protocols, and methodological quality was evaluated using the Mixed Methods Appraisal Tool (MMAT, 2018). Seventy-one eligible studies were incorporated into the final synthesis from a total of 862 database entries and supplementary snowballing records (January 2026 update). The findings were synthesized narratively in relation to three study questions: (RQ1) The integration of AR inside sensory-book contexts, (RQ2) the design-feature clusters linked to vocabulary-related outcomes, and (RQ3) the identified advantages and limitations. The research indicates that AR-sensory book therapies are typically structured to enhance attention, engagement, and contextual word-meaning mapping; nevertheless, there is significant variability in intervention designs, outcome measures, and reporting quality. The review provides a design-focused taxonomy and evidence-based recommendations to facilitate more reproducible, classroom-appropriate AR-sensory book designs for vocabulary acquisition in DHH learners.

Downloads

Download data is not yet available.

Author Biography

  • Jin Xin, Art & Design Department,Faculty of Art, Sustainability and Creative Industry, Universiti Pendidikan Sultan Idris, 35900, Tanjong Malim, Perak, Malaysia

    Visual Communication Design Department,Faculty of Art & Design, Bengbu University,233000, Anhui, China

References

Chang, C.-T., Chao, W.-H., Yang, C.-Y., & Semwaiko, G. S. (2025). Evaluating the Impact of Augmented Reality on Learning Outcomes in K-12 Special Education: A Systematic Review. European Journal of Educational Research, 14(4), 1167~1182. https://doi.org/10.12973/eu-jer.14.4.1167

Chuang, C., & Jamiat, N. (2023). A systematic review on the effectiveness of children’s interactive reading applications for promoting their emergent literacy in the multimedia context. Contemporary Educational Technology, 15(2), ep412. https://doi.org/10.30935/cedtech/12941

Edgar Marçal. (2024). Augmented reality in education for people who are deaf or hard of hearing: A systematic literature review | Universal Access in the Information Society. https://link.springer.com/article/10.1007/s10209-023-00994-z

González-Cuenca, A., González-Jerez, M., Linero, M. J., & Lavigne, R. (2024). Differences in the type of vocabulary understood by deaf and hearing students: Results to guide interventions. Journal of Communication Disorders, 111, 106458. https://doi.org/10.1016/j.jcomdis.2024.106458

Hettiarachchi, S., Ranaweera, M., & Disanayake, H. M. L. N. (2021). The Effectiveness of Using Multi-Sensory Children’s Stories on Vocabulary Development in Young Deaf and Hard-of-Hearing Children. Deafness & Education International, 23(2), 145~168. https://doi.org/10.1080/14643154.2020.1808275

Hong, Q. N., Fàbregues, S., Bartlett, G., Boardman, F., Cargo, M., Dagenais, P., Gagnon, M.-P., Griffiths, F., Nicolau, B., O’Cathain, A., Rousseau, M.-C., Vedel, I., & Pluye, P. (2020). The Mixed Methods Appraisal Tool (MMAT) version 2018 for information professionals and researchers. Education for Information, 34(4), 285~291. https://doi.org/10.3233/EFI-180221

Lunny, C., Reid, E. K., Neelakant, T., Chen, A., Zhang, J. H., Shinger, G., Stevens, A., Tasnim, S., Sadeghipouya, S., Adams, S., Zheng, Y. W., Lin, L., Yang, P. H., Dosanjh, M., Ngsee, P., Ellis, U., Shea, B. J., & Wright, J. M. (2022). A new taxonomy was developed for overlap across 《overviews of systematic reviews》: A meta-research study of research waste. Research Synthesis Methods, 13(3), 315~329. https://doi.org/10.1002/jrsm.1542

Samaradivakara, Y., Pathirage, A., Ushan, T., Sasikumar, P., Karunanayaka, K., Keppitiyagama, C., & Nanayakkara, S. (2025). Tailored Real-time AR Captioning Interface for Enhancing Learning Experience of Deaf and Hard-of-Hearing (DHH) Students (No. arXiv:2501.02233). arXiv. https://doi.org/10.48550/arXiv.2501.02233

Schorr, I., Plecher, D. A., Eichhorn, C., & Klinker, G. (2024). Foreign language learning using augmented reality environments: A systematic review. Frontiers in Virtual Reality, 5. https://doi.org/10.3389/frvir.2024.1288824

Solichah, N., & Fardana, N. (2024). Exploring multisensory programs as early literacy interventions: A scoping review. International Journal of Evaluation and Research in Education (IJERE), 13, 3411. https://doi.org/10.11591/ijere.v13i5.28991

Windson Viana. (2023). (PDF) Augmented reality in education for people who are deaf or hard of hearing: A systematic literature review. https://www.researchgate.net/publication/370286486_Augmented_reality_in_education_for_people_who_are_deaf_or_hard_of_hearing_a_systematic_literature_review?utm_source=chatgpt.com

Downloads

Published

2026-01-19

How to Cite

Jin Xin, Mat Sin, N. S., & Kong, V. L. S. (2026). Augmented Reality Integrated Sensory Books for Contextual Vocabulary Learning in Deaf and Hard-of-Hearing (DHH) Children: A Systematic Literature Review (2021–2026). Journal of Art, Design and Creative Media, 1(1), 1-17. https://doi.org/10.37134/jadcm.vol1.1.1.2026