Reka bentuk ekspresi wajah dan tahap realistik Talking-Head dan kesannya terhadap emosi pelajar

  • Muhammad Ihsan Rokeman Fakulti Seni, Komputeran dan Industri Kreatif, Universiti Pendidikan Sultan Idris, Tanjong Malim, Perak, Malaysia
  • Ahmad Zamzuri Mohamad Ali Fakulti Seni, Komputeran dan Industri Kreatif, Universiti Pendidikan Sultan Idris, Tanjong Malim, Perak, Malaysia
Keywords: Animasi, emosi, ekspresi wajah, talking-head, realistik

Abstract

Animasi talking-head merupakan pendekatan yang boleh digunakan sebagai perwakilan guru atau agen pedagogi dalam medium pembelajaran digital. Namun, animasi talking-head berpotensi mengakibatkan ketidakselesaan sekiranya reka bentuk karakter talking-head yang tidak betul digunakan. Oleh itu, artikel ini akan membincangkan serta mencadangkan suatu kerangka konseptual bagi panduan untuk kajian-kajian berkaitan permasalahan ini. Kerangka konseptual ini dibina berdasarkan teori, prinsip dan tinjauan literatur yang dilakukan. Artikel ini juga menggariskan cadangan kajian lanjutan untuk mengukuhkan lagi kerangka konseptual yang dibina.

This The talking-head animation is an instructional approach that can be utilized to represent teachers or pedagogical agents in the digital learning medium. However, talking-head animation can potentially become a source of distraction in learning due to insufficient design of the talking-head characters. Therefore, this article will discuss and suggest a conceptual framework as a guidance for studies related to such problems. This conceptual framework is constructed based on the theories, principles and relevant literature reviews. This article also outlines future research suggestions to further strengthen the conceptual framework that has been developed.

Keywords: Animation, emotion, face expression, talking-head, realistic

Downloads

Download data is not yet available.

Author Biography

Muhammad Ihsan Rokeman, Fakulti Seni, Komputeran dan Industri Kreatif, Universiti Pendidikan Sultan Idris, Tanjong Malim, Perak, Malaysia

Jabatan Matematik, Sains dan Komputer, Politeknik Sultan Azlan Shah, Tanjong Malim, Perak. Malaysia

References

Ahmad Zamzuri, M. A. (2018). Multimedia dan perisian pendidikan panduan praktikal reka bentuk dan penyelidikan. Tanjong Malim, Perak: Penerbit Universiti Pendidikan Sultan Idris.

Ahmed, W., van der Werf, G., Kuyper, H., & Minnaert, A. (2013). Emotions, self-regulated learning, and achievement in mathematics: A growth curve analysis. Journal of Educational Psychology, 105(1), 150–161. https://doi.org/10.1037/a0030160

Bakker, I., van der Voordt, T., Vink, P., & de Boon, J. (2014). Pleasure, arousal, dominance: Mehrabian and russell revisited. Current Psychology, 33(3), 405–421. https://doi.org/10.1007/s12144-014-9219-4

Barrett, L. F., Quigley, K. S., Bliss-Moreau, E., & Aronson, K. R. (2004). Interoceptive sensitivity and self-reports of emotional. Journal of Personality and Social Psychology, 87(5), 684–697. https://doi.org/10.1038/jid.2014.371

Baylor, A. L. (2011). The design of motivational agents and avatars. Educational Technology Research And Development, 59(2), 291–300. https://doi.org/10.1007/s11423-011-9196-3

Brom, C., Stárková, T., & D’Mello, S. K. (2018). How effective is emotional design? A meta-analysis on facial anthropomorphisms and pleasant colors during multimedia learning. Educational Research Review, 25, 100–119. https://doi.org/10.1016/j.edurev.2018.09.004

Buff, A., Reusser, K., Rakoczy, K., & Pauli, C. (2011). Activating positive affective experiences in the classroom: “ Nice to have” or something more? Learning and Instruction, 21(3), 452–466. https://doi.org/10.1016/j.learninstruc.2010.07.008

Bynion, T. M., & Feldner, M. T. (2017). Self-Assessment Manikin. In V. Zeigler-Hill & T. K. Shackelford (Eds.), Encyclopedia of Personality and Individual Differences (pp. 1–3). https://doi.org/10.1007/978-3-319-28099-8_77-1

Cheetham, M., Wu, L., Pauli, P., & Jancke, L. (2015). Arousal, valence, and the uncanny valley: Psychophysiological and self-report findings. Frontiers in Psychology, 6, 1–15. https://doi.org/10.3389/fpsyg.2015.00981

Dey, P., Maddock, S., & Nicolson, R. (2010). Evaluation of a viseme-driven talking head. In J. Collomosse & I. Grimstead (Eds.), EG UK Theory and Practice of Computer Graphics (pp. 139–142). https://doi.org/10.2312/LocalChapterEvents/TPCG/TPCG10/139-142

Domagk, S. (2010). Do pedagogical agents facilitate learner motivation and learning outcomes? Journal of Media Psychology, 22(2), 82–95. https://doi.org/10.1027/1864-1105/a000011

Frenzel, A. C., Pekrun, R., & Goetz, T. (2007). Perceived learning environment and students’ emotional experiences: A multilevel analysis of mathematics classrooms. Learning and Instruction, 17(5), 478–493. https://doi.org/10.1016/j.learninstruc.2007.09.001

Ganotice, F. A., Datu, J. A. D., & King, R. B. (2016). Which emotional profiles exhibit the best learning outcomes? A person-centered analysis of students academic emotions. School Psychology International, 37(5), 498–518. https://doi.org/10.1177/0143034316660147

Gläser-Zikuda, M., Stuchlíková, I., & Janík, T. (2013). Emotional aspects of learning and teaching: Reviewing the field-discussing the issues. Orbis Scholae, 7(2), 7–22. https://doi.org/10.14712/23363177.2015.18

Goetz, T., Keller, M. M., Lüdtke, O., Nett, U. E., & Lipnevich, A. A. (2019). The dynamics of real-time classroom emotions: Appraisals mediate the relation between students’ perceptions of teaching and their emotions. Journal of Educational Psychology, 1(999), 1–18. https://doi.org/10.1037/edu0000415

Gulz, A., & Haake, M. (2006). Design of animated pedagogical agents — A look at their look. International Journal of Human-Computer Studies, 64(4), 322–339. https://doi.org/10.1016/j.ijhcs.2005.08.006

Jia, J., Wu, Z., Zhang, S., Meng, H. M., & Cai, L. (2014). Head and facial gestures synthesis using PAD model for an expressive talking avatar. Multimedia Tools and Applications, 73(1), 439–461. https://doi.org/10.1007/s11042-013-1604-8

Kim, Y., & Baylor, A. L. (2016). Research-based design of pedagogical agent roles: A review, progress, and recommendations. International Journal of Artificial Intelligence in Education, 26(1), 160–169. https://doi.org/10.1007/s40593-015-0055-y

Kim, Y., Thayne, J., & Wei, Q. (2017). An embodied agent helps anxious students in mathematics learning. Educational Technology Research and Development, 65(1), 219–235. https://doi.org/10.1007/s11423-016-9476-z

Krämer, N., Kopp, S., Becker-Asano, C., & Sommer, N. (2013). Smile and the world will smile with you - The effects of a virtual agent’s smile on users’ evaluation and behavior. International Journal of Human Computer Studies, 71(3), 335–349. https://doi.org/10.1016/j.ijhcs.2012.09.006

Ku, J., Jang, H. J., Kim, K. U., Kim, J. H., Park, S. H., Lee, J. H., … Sun I. Kim. (2005). Experimental results of affective valence and arousal to avatar’s facial expressions. CyberPsychology & Behavior, 8(5), 493–503. https://doi.org/http://doi.org/10.1089/cpb.2005.8.493

Kunz, S. (2015). The problem of realism in animated characters – has the uncanny valley been crossed? International Conference in Illustration & Animation, 74–86. Braga, Portugal: IPCA.

Kuppens, P. (2008). Individual differences in the relationship between pleasure and arousal. Journal of Research in Personality, 42(4), 1053–1059. https://doi.org/10.1016/j.jrp.2007.10.007

Kuppens, P., Tuerlinckx, F., Yik, M., Koval, P., Coosemans, J., Zeng, K. J., & Russell, J. A. (2017). The relation between valence and arousal in subjective experience varies with personality and culture. Journal of Personality, 85(4), 530–542. https://doi.org/10.1111/jopy.12258

Lawson, A. P., Mayer, R. E., Adamo-Villani, N., Benes, B., Lei, X., & Cheng, J. (2021). Recognizing the emotional state of human and virtual instructors. Computers in Human Behavior, 114(May 2020), 106554. https://doi.org/10.1016/j.chb.2020.106554

Lay, S., Brace, N., Pike, G., & Pollick, F. (2016). Circling around the uncanny valley: Design principles for research into the relation between human likeness and eeriness. I-Perception, 7(6), 1–11. https://doi.org/10.1177/2041669516681309

Linnenbrink-Garcia, L., Patall, E. A., & Pekrun, R. (2016). Adaptive motivation and emotion in education: Research and principles for instructional design. Policy Insights from the Behavioral and Brain Sciences, 3(2), 228–236. https://doi.org/10.1177/2372732216644450

Lisetti, C., & Hudlicka, E. (2015). Why and how to build emotion-based agent architectures. In Rafael Calvo, S. D’Mello, J. Gratch, & A. Kappas (Eds.), The Oxford Handbook of Affective Computing (pp. 94–109). https://doi.org/10.1093/oxfordhb/9780199942237.013.019

MacDorman, K. F., Green, R. D., Ho, C. C., & Koch, C. T. (2009). Too real for comfort? Uncanny responses to computer generated faces. Computers in Human Behavior, 25(3), 695–710. https://doi.org/10.1016/j.chb.2008.12.026

Marieke, R., Elliot, A. J., & De Dreu, C. K. W. (2014). Why is avoidance motivation problematic, and what can be done about it? Current Directions in Psychological Science, 23(2), 133–138. https://doi.org/https://doi.org/10.1177/0963721414524224

Mathur, M. B., & Reichling, D. B. (2016). Navigating a social world with robot partners: A quantitative cartography of the Uncanny Valley. Cognition, 146, 22–32. https://doi.org/10.1016/j.cognition.2015.09.008

Mori, M. (1970). The uncanny valley. Energy, 7(4), 33–35.

Mori, M. (2012). The uncanny valley (K. F. MacDorman & N. Kageki, Trans.). IEEE Robotics and Automation Magazine, 19(2), 98–100. https://doi.org/http://dx.doi.org/10.1109/MRA. 2012.2192811

Muhammad Ihsan, R., Ahmad Zamzuri, M. A., & Mohd Khairulnizam, R. (2020). Talking-head, realism level and emotions in learning: A conceptual framework. International Journal of Information and Education Technology, 10(8), 585–589. https://doi.org/10.18178/ijiet.2020.10.8.1428

Norlida, D., & Ahmad Zamzuri, M. A. (2019). Kerangka konseptual reka bentuk emoji untuk poster kesedaran dalam bentuk media bercetak. KUPAS SENI: Jurnal Seni Dan Pendidikan Seni, 7, 12–21. Retrieved from https://ejournal.upsi.edu.my/index.php/JSPS/article/view/2689

Parthasarathy, S., & Busso, C. (2017). Jointly predicting arousal, valence and dominance with multi-task learning. International Speech Communication, 1103–1107. https://doi.org/10.21437/Interspeech.2017-1494

Patel, H., & MacDorman, K. F. (2015). Sending an avatar to do a human’s job: Compliance with authority persists despite the uncanny valley. Presence: Teleoperators & Virtual Environments, 24(1), 1–23. https://doi.org/10.1162/PRES

Pekrun, R. (2006). The control-value theory of achievement emotions: Assumptions, corollaries, and implications for educational research and practice. Educational Psychology Review, 18(4), 315–341. https://doi.org/10.1007/s10648-006-9029-9

Pekrun, R., Frenzel, A. C., Goetz, T., & Perry, R. P. (2007). The control-value theory of achievement emotions. In P. A. Schutz & R. Pekrun (Eds.), Emotion in Education (pp. 13–36). https://doi.org/10.1016/B978-012372545-5/50003-4

Peng, X., Chen, H., Wang, L., & Wang, H. (2018). Evaluating a 3-D virtual talking head on pronunciation learning. International Journal of Human Computer Studies, 109, 26–40. https://doi.org/10.1016/j.ijhcs.2017.08.001

Ruhland, K., Prasad, M., & Mcdonnell, R. (2017). Data-driven approach to synthesizing facial animation using motion capture. IEEE Computer Graphics and Applications, 37(4), 30–41. https://doi.org/10.1109/MCG.2017.3271467

Saidatul Maizura, S., Farah, M. Z., Nabila, A. N. K., Noorizdayantie, S., Zuraidah, A. R., Omar, M., … Wong, S. L. (2010). The pedagogical agent in online learning : Effects of the degree of realism on achievement in terms of gender. Contemporary Educational Technology, 1(2), 175–185. Retrieved from http://dergipark.gov.tr/download/article-file/252129

Schindler, S., Zell, E., Botsch, M., & Kissler, J. (2017). Differential effects of face-realism and emotion on event-related brain potentials and their implications for the uncanny valley theory. Scientific Reports, 7, 1–13. https://doi.org/10.1038/srep45003

Schwind, V., Leicht, K., Jäger, S., Wolf, K., & Henze, N. (2018). Is there an uncanny valley of virtual animals? A quantitative and qualitative investigation. International Journal of Human Computer Studies, 111, 49–61. https://doi.org/10.1016/j.ijhcs.2017.11.003

Shao, K., Pekrun, R., & Nicholson, L. J. (2019). Emotions in classroom language learning: What can we learn from achievement emotion research? System, 86, 1–11. https://doi.org/10.1016/j.system.2019.102121

Stef, A., Perera, K., Shum, H. P. H., & Ho, E. S. L. (2019). Synthesizing expressive facial and speech animation by text-to-IPA translation with emotion control. International Conference on Software, Knowledge Information, Industrial Management and Applications IEEE, 70–78. https://doi.org/10.1109/SKIMA.2018.8631536

Storbeck, J., & Clore, G. L. (2008). Affective arousal as information: How affective arousal influences judgments, learning, and memory. Social and Personality Psychology Compass, 2(5), 1824–1843. https://doi.org/10.1111/j.1751-9004.2008.00138.x.Affective

Tinwell, A. (2014). The uncanny valley in games and animation. Broken Sound Parkway NW: CRC Press.

Tinwell, A., Abdel Nabi, D., & Chalton, J. . (2013). Perception of psychopathy and the uncanny valley in virtual characters. Computers in Human Behavior, 29(4), 1617–1625. https://doi.org/http://dx.doi.org/10.1016/j.chb.2013.01.008

Tze, W. L., Nor Azan, M. Z., & Noraidah, S. (2017). Exploring the affective, motivational and cognitive effects of pedagogical agent enthusiasm in a multimedia learning environment. Human-Centric Computing and Information Sciences, 7(9), 1–21. https://doi.org/10.1186/s13673-017-0089-2

Tze, W. L., Nor Azan, M. Z., Noraidah, S., & Su, M. T. (2016). The effects of a pedagogical agent’s smiling expression on the learner’s emotions and motivation in a virtual learning environment. International Review of Research in Open and Distributed Learning, 17(5), 248–266. https://doi.org/http://dx.doi.org/10.19173/irrodl.v17i5.2350

Vesker, M., Bahn, D., Degé, F., Kauschke, C., & Schwarzer, G. (2018). Perceiving arousal and valence in facial expressions: Differences between children and adults. European Journal of Developmental Psychology, 15(4), 411–425. https://doi.org/10.1080/17405629.2017.1287073

Published
2021-04-28
How to Cite
Rokeman, M. I., & Mohamad Ali, A. Z. (2021). Reka bentuk ekspresi wajah dan tahap realistik Talking-Head dan kesannya terhadap emosi pelajar. Jurnal Pendidikan Bitara UPSI, 14, 1-10. https://doi.org/10.37134/bitara.vol14.sp.1.2021