Playing Gamelan Bonang in the Air: User Requirements for Designing a Digital Musical Instrument for the Malay Bonang
DOI:
https://doi.org/10.37134/mjm.vol11.1.5.2022Keywords:
Digital Musical Instruments, Human Computer Interaction, Malay gamelan, music interaction, user requirements, virtual bonangAbstract
In recent years, computer technologies have been impactful in the design and development of Digital Musical Instruments (DMIs). As music interaction became prominent in the Human-Computer Interaction (HCI) field, emphasis on user requirement upon the design of musical interfaces has also grown since the last decade. Although designing new DMIs is becoming very popular, it is often determined by the designers and often not reflective of users’ needs. In this study, we explored user requirements for the design of a virtual musical instrument of the Malay bonang, an instrument found in the Malay gamelan ensemble. The requirements were elicited from a group of gamelan experts to establish the bonang playing techniques to be mapped to the virtual instrument which we called Air Bonang. Findings revealed that in designing the Air Bonang that is natural and expressive, the fundamental playing techniques of the bonang should be integrated into the system using mid-air interaction. In addition, exploratory techniques might also be integrated into the Air Bonang to leverage musical expression. The outcome of the study proposes design criteria that encompass three aspects of a natural Air Bonang, namely, embodiment, expressiveness, and feedback.
Downloads
References
Anshori, F. (2014). Aplikasi "AR-Gamelan" sebagai media pembelajaran mengenal Gamelan Jawa berbasis augmented reality pada perangkat mobile Android (Studi Kasus : MI Ma ’ arif Nu 1 Pageraji ). Jurnal Skripsi.
Aryadana, I. P. S., Wiranatha, A. A. K. A. C., & Dharmadi, I. P. A. (2019). Aplikasi virtual reality gamelan gong kebyar tradisional Bali berbasis Android. Jurnal Ilmiah Merpati (Menara Penelitian Akademika Teknologi Informasi), 7(2), 162. https://doi.org/10.24843/jim.2019.v07.i02.p08
Bowen, N. (2013). Mobile phones, group improvisation, and music: Trends in digital socialized music-making [CIty University of New York]. In City University of New York. https://doi.org/10.1017/CBO9781107415324.004
Brown, D., Nash, C., & Mitchell, T. (2018). Understanding user-defined mapping design in mid-air musical performance. 5th International Conference on Movement and Computing. https://doi.org/10.1145/3212721.3212810
Brown, D., Nash, C., & Mitchell, T. J. (2020). Was that me?: Exploring the effects of error in gestural digital musical instruments. ACM International Conference Proceeding Series, 168–174. https://doi.org/10.1145/3411109.3411137
Cohé, A., & Hachet, M. (2012). Beyond the mouse: Understanding user gestures for manipulating 3D objects from touchscreen inputs. Computers and Graphics (Pergamon), 36(8), 1119–1131. https://doi.org/10.1016/j.cag.2012.09.004
Corbin, J. & Strauss A. (2014). Basics of qualitative research: Techniques and procedures for developing grounded theory. In Sage Publications (3rd Edition).
Coss, R. G. (2018). Descriptions of expert jazz educators’ experiences teaching improvisation. International Journal of Music Education, 36(4), 521–532. https://doi.org/10.1177/0255761418771093
Diatmika, I. W. I., Darmawiguna, I. G. M., & Sunarya, I. M. G. (2015). Pengembangan aplikasi instrumen gamelan semar pegulingan Android. Kumpulan Artikel Mahasiswa Pendidikan Teknik Informatika (KARMAPATI), 4(5). https://doi.org/10.23887/janapati.v4i2.9775
Dwipayana, K., Wirawan, I. M. A., & Sindu, I. G. P. (2019). Go-Byar based on virtual reality for the learning media of gamelan. 25(2), 229–236. https://doi.org/10.21831/jptk.v25i2.26182
Emerson, G., & Egermann, H. (2020). Exploring the motivations for building new Digital Musical Instruments. In Musicae Scientiae (Vol. 24, Issue 3). https://doi.org/10.1177/1029864918802983
Fogliano, F. (2020). NEMI: New ergonomic musical instrument A bridge between the Human-Centred Design and Digital Musical Instrument. UNICAMP - Università di Campinas - Brasile (BRASILE).
Françoise, J., & Bevilacqua, F. (2018). Motion-sound mapping through interaction: An approach to user-centered design of auditory feedback using machine learning. ACM Transactions on Interactive Intelligent Systems, 8(2). https://doi.org/10.1145/3211826
Hamdan, S., Musib, A. F., Musoddiq, I. A., & Sawawi, M. (2020). Timbre spectrum of gamelan instruments from four Malay Gamelan ensembles. Pertanika Journal of Science and Technology, 28(2), 459–476.
Han, J., & Gold, N. E. (2014). Lessons learned in exploring the Leap-Motion(TM) sensor for gesture-based instrument design. New Interfaces For Musical Expression, 371–374.
Hansberger, J. T., Peng, C., Mathis, S. L., Areyur Shanthakumar, V., Meacham, S. C., Cao, L., & Blakely, V. R. (2017). Dispelling the gorilla arm syndrome: The viability of prolonged gesture interactions. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 10280, Issue August). https://doi.org/10.1007/978-3-319-57987-0_41
Hassan, W., Rosli, D., Ariffin, A., Ahmad, F., & Jamin, J. (2020). The application of bonang gamelan music based on mobile application. International Journal of Recent Technology and Engineering, 8(6), 1077–1082. https://doi.org/10.35940/ijrte.f7554.038620
Hincapié-Ramos, J. D., Guo, X., Moghadasian, P., & Irani, P. (2014). Consumed endurance: A metric to quantify arm fatigue of mid-air interactions. Conference on Human Factors in Computing Systems - Proceedings, 1063–1072. https://doi.org/10.1145/2556288.2557130
Hwang, I., Son, H., & Kim, J. R. (2017). AirPiano: Enhancing music playing experience in virtual reality with mid-air haptic feedback. 2017 IEEE World Haptics Conference, WHC 2017, 213–218. https://doi.org/10.1109/WHC.2017.7989903
Koutsabasis, P., & Vogiatzidakis, P. (2019). Empirical research in mid-air interaction: A systematic review. International Journal of Human-Computer Interaction, 35(18), 1747–1768. https://doi.org/10.1080/10447318.2019.1572352
Lam, M. (2020). The physicality of music production: Investigating the roles of mindful practice and kinesthetic learning. Music Educators Journal, 106(3), 23–28. https://doi.org/10.1177/0027432119895553
Lazar, J., Feng, J. H., & Hochheiser, H. (2017). Research ,methods in Human-Computer interaction (Second). Elsevier Inc.
Leng, H. Y., Norowi, N. M., & Jantan, A. H. (2018). Designing an expressive virtual kompang on mobile device with Tri-Axial accelerometer. International Journal of Engneering and Techology, 7(4.31), 414–419.
Leng, H. Y., Norowi, N. M., & Jantan, A. H. (2017). A user-defined gesture set for music interaction in immersive virtual environment. ACM International Conference Proceeding Series, Part F1293(2), 44–51. https://doi.org/10.1145/3077343.3077348
León, L. R. P., Galindo, J. A. R., & Prado, P. L. Z. (2015). Human factors in musicians: Design proposals. Procedia Manufacturing, 3(Ahfe), 6124–6132. https://doi.org/10.1016/j.promfg.2015.07.765
McPherson, A., Morreale, F., & Harrison, J. (2019). Musical instruments for novices: Comparing NIME, HCI and Crowdfunding Approaches. In Springer Series on Cultural Computing, 179–212. Springer. https://doi.org/10.1007/978-3-319-92069-6_12
Mohd Shah, S., & Poheng, J. J. (2021). The changing landscape of the Malay gamelan and its implications on music education in Malaysia. Environment-Behaviour Proceedings Journal, 6(SI5), 137–141. https://doi.org/10.21834/ebpj.v6isi5.2939
Morreale, F., Mcpherson, A. P., & Wanderley, M. M. (2018). NIME Identity from the performer’s perspective.
Naber, A. L. H. (2016). Designing a digital gamelan. ICMC 2016 - 42nd International Computer Music Conference, Proceedings, 191–194.
Palinkas, L. A., Horwitz, S. M., Green, C. A., Wisdom, J. P., Duan, N., Hoagwood, K., Angeles, L., & Northwest, K. P. (2015). Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Administration and Policy in Mental Health and Mental Health Services Research, 42(5), 233–244. https://doi.org/10.1007/s10488-013-0528-y
Permana, F., Tolle, H., Utaminingrum, F., & Dermawi, R. (2019). Development of Augmented Reality (AR) based gamelan simulation with leap motion control. International Journal of Interactive Mobile Technologies, 12, 120–135. https://doi.org/10.3991/ijim.v13i12.9270
Rakkolainen, I., Freeman, E., Sand, A., Raisamo, R., & Brewster, S. (2020). A survey of mid-air ultrasound haptics and its applications. IEEE Transactions on Haptics, 1–1. https://doi.org/10.1109/toh.2020.3018754
Revana, I., Mohammad, Z., & Damastuti, F. A. (2020). Saron hit precision in virtual world. Seminar Nasional Terapan Riset Inovatif (SENTRINOV) Ke-6, 6(1), 990–997.
Saffian, K. (2014). Pitch analysis of keyed instruments in the Malay gamelan ensemble. International Music and Performing Arts Conference 2014 (IMPAC2014).
Saffian, K. A., & Norowi, N. M. (2021). Gestural interaction of gamelan mobile application : A preliminary study. Asian CHI Symposium 2021.
Shah, S. M. (2013). Contextualizing the transmission of Malaysian traditional music. Procedia - Social and Behavioral Sciences, 93, 1000–1004. https://doi.org/10.1016/j.sbspro.2013.09.318
Tanaka, A. (2010). Mapping out instruments, affordances, and mobiles. Proceedings of the International Conference on New Interfaces for Musical Expression (NIME), Nime, 15–18. http://www.nime.org/proceedings/2010/nime2010_088.pdf
Wobbrock, J. O., Morris, M. R., & Wilson, A. D. (2009). User-defined gestures for surface computing. Conference on Human Factors in Computing Systems - Proceedings, 1083–1092. https://doi.org/10.1145/1518701.1518866
Zappi, V., & McPherson, A. P. (2014). Dimensionality and appropriation in Digital Musical Instrument design. NIME ’14 Proceedings of the 2014 Conference on New Interfaces for Musical Expression, 455–460. http://www.nime.org/proceedings/2014/nime2014_409.pdf
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2022 Khatriza Ahmad Saffian, Noris Mohd Norowi
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
