{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T15:36:49Z","timestamp":1781105809672,"version":"3.54.1"},"reference-count":21,"publisher":"IGI Global Scientific Publishing","issue":"4","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2013,10,1]]},"abstract":"<p>Music conducting is the art of directing musical ensembles with hand gestures to personalize and diversify a piece of music. Although the ability to successfully perform a musical piece demands intense training and coordination for the conductor and the orchestra, preparing a practice session is expensive and time-consuming. Hence, there is a genuine need for alternatives capable of providing adequate training for conductors at all skill levels. The potential use of virtual and augmented reality technology holds particular promise. The goal of this research is to examine the mechanics of music conducting and to develop a system capable of closely simulating the experience of conducting a piece of music. After extensive discussions with professional and nonprofessional conductors, in addition to wide-ranging research regarding music conducting materials, several key features of conducting were identified. A set of lightweight algorithms exploring these features was developed to enable tempo control, volume adjustment, and instrument emphasis, which are core components of conducting. Such a system would be a helpful training tool for students, an experiential tool allowing professional conductors and composers to shape music at a low cost, or an entertainment tool for nonprofessional music lovers. In this paper, we propose a real-time interactive conducting system using Microsoft Kinect. The proposed system overcomes the limitation of Kinect's design, which is generally designed for large body movements. In this system, delicate conducting signals can be correctly recognized without referencing any prior knowledge. Evaluation of the algorithms in real-world scenarios reveals promising results. The system was evaluated by conductors of all skill levels and provided a high level of accuracy and a low latency. Users of the final system expressed satisfaction with the virtual experience.<\/p>","DOI":"10.4018\/ijmdem.2013100103","type":"journal-article","created":{"date-parts":[[2014,3,11]],"date-time":"2014-03-11T14:25:59Z","timestamp":1394547959000},"page":"35-57","source":"Crossref","is-referenced-by-count":0,"title":["Music Control in an Interactive Conducting System Using Kinect"],"prefix":"10.4018","volume":"4","author":[{"given":"Yi-Shin","family":"Chen","sequence":"first","affiliation":[{"name":"Institute of Information Systems and Applications, National Tsing Hua University, Hsinchu, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Leng-Wee","family":"Toh","sequence":"additional","affiliation":[{"name":"Department of Computer Science, National Tsing Hua University, Hsinchu, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yi-Lan","family":"Liu","sequence":"additional","affiliation":[{"name":"Institute of Information Systems and Applications, National Tsing Hua University, Hsinchu, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"2432","reference":[{"key":"ijmdem.2013100103-0","doi-asserted-by":"crossref","unstructured":"Argueta, C., Ko, C., & Chen, Y. (2009). Interacting with a music conducting system. In J. A. Jacko (Ed.), Proceedings of the 13th International Conference on Human-Computer Interaction. Part II: Novel Interaction Methods and Techniques (pp. 654-663). Berlin, Heidelberg, Germany: Springer-Verlag.","DOI":"10.1007\/978-3-642-02577-8_72"},{"key":"ijmdem.2013100103-1","doi-asserted-by":"publisher","DOI":"10.1007\/s00530-003-0119-y"},{"key":"ijmdem.2013100103-2","unstructured":"Chafe, C., Wilson, S., Leistikow, R., Chisholm, D., & Scavone, G. (2000). A simplified approach to high quality music and sound over IP. In D. Rocchesso (Ed.), Proceedings of the COST-G6 Conference on Digital Audio Effects (pp. 159-164). Verona, Italy: Dipartmento Scientifico e Tecnologico, Universit\u00e0 di Verona."},{"key":"ijmdem.2013100103-3","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-20520-0_26"},{"key":"ijmdem.2013100103-4","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/5657.001.0001","author":"K. A.Ericsson","year":"1993","journal-title":"Protocol analysis: Verbal reports as data"},{"key":"ijmdem.2013100103-5","unstructured":"Ilmonen, T., & Takala, T. (1999). Conductor following with artificial neural networks. In Proceedings of the International Computer Music Conference (pp. 367-370)."},{"key":"ijmdem.2013100103-6","unstructured":"Kolesnik, P., & Wanderley, M. (2004). Recognition, analysis and performance with expressive conducting gestures. In C. Leider (Ed.), Proceedings of the International Computer Music Conference (pp. 572-575). Coral Gables, FL: School of Music, University of Miami Frost."},{"key":"ijmdem.2013100103-7","unstructured":"Lee, E., Gr\u00fcll, I., Kiel, H., & Borchers, J. (2006a). Conga: A framework for adaptive conducting gesture analysis. In Proceedings of the Conference on New Interfaces for Musical Expression (pp. 260-265)."},{"key":"ijmdem.2013100103-8","doi-asserted-by":"crossref","unstructured":"Lee, E., Kiel, H., Dedenbach, S., Gr\u00fcll, I., Karrer, T., Wolf, M., & Borchers, J. (2006b). iSymphony: An adaptive interactive orchestral conducting system for digital audio and video streams. In G. Olson (Ed.), Proceedings of the CHI EA '06 Extended Abstracts on Human Factors in Computing Systems (pp. 259-262). New York, NY: Association for Computing Machinery.","DOI":"10.1145\/1125451.1125507"},{"key":"ijmdem.2013100103-9","doi-asserted-by":"crossref","unstructured":"Lee, E., Wolf, M., & Borchers, J. (2005). Improving orchestral conducting systems in public spaces: Examining the temporal characteristics and conceptual models of conducting gestures. In G. C. van der Veer & C. Gale (Eds.), SIGCHI Conference on Human Factors in Computing Systems (pp. 731-740). New York, USA: Association for Computing Machinery.","DOI":"10.1145\/1054972.1055073"},{"key":"ijmdem.2013100103-10","doi-asserted-by":"publisher","DOI":"10.1109\/2.84835"},{"key":"ijmdem.2013100103-11","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-24598-8_49"},{"key":"ijmdem.2013100103-12","unstructured":"Nakra, T. M. (1999). Inside the conductor\u2019s jacket: Analysis, interpretation and musical synthesis of expressive gesture. (Doctoral dissertation). Retrieved from https:\/\/2.zoppoz.workers.dev:443\/http\/web.media.mit.edu\/"},{"key":"ijmdem.2013100103-13","unstructured":"Nakra, T. M., Ivanov, Y., Smaragdis, P., & Ault, C. (2009). The UBS virtual maestro: An interactive conducting system. In N. Zahler & R. Dannenberg (Eds.), Proceedings of the 2009 Conference on New Interfaces for Musical Expression (pp. 250-255). Pittsburgh, PA: School of Music, Carnegie Mellon University."},{"key":"ijmdem.2013100103-14","unstructured":"Renaud, A., Car\u00f4t, A., & Rebelo, P. (2007). Networked music performance: State of the art. In J. Merimaa & T. Lokki (Eds), Proceedings of the AES 30th International Conference (pp. 16). Saariselk\u00e4, Finland: Audio Engineering Society."},{"key":"ijmdem.2013100103-15","author":"M.Rudolf","year":"1994","journal-title":"The grammar of conducting: A comprehensive guide to baton technique and interpretation"},{"key":"ijmdem.2013100103-16","unstructured":"Segen, J., Gluckman, J., & Kumar, S. (2000). Visual interface for conducting virtual orchestra. In A. K. Jain, S. Venkatesh, & B. C. Lovell (Eds.), Proceedings of 15th International Conference on Pattern Recognition (Vol. 1, pp. 276-279). Barcelona, Spain: Computer Society, IEEE."},{"key":"ijmdem.2013100103-17","unstructured":"Toh, L., Chao, W., & Chen, Y. (2013). An interactive conducting system using Kinect. In A. Basu, N. Ling, & S. Panchanathan (Eds.), Proceedings of the 2009 Conference on Multimedia and Expo (ICME), 2013 IEEE International Conference (pp. 1-6). San Jose, CA: Computer Society, IEEE."},{"issue":"4","key":"ijmdem.2013100103-18","first-page":"127","article-title":"A multi-modal conducting simulator.","volume":"10","author":"S.Usa","year":"1998","journal-title":"Journal of Japan Society for Fuzzy Theory and Systems"},{"key":"ijmdem.2013100103-19","doi-asserted-by":"crossref","unstructured":"Wong, E. L., Yuen, W. Y., & Choy, C. S. (2008). Designing Wii controller: A powerful musical instrument in an interactive music performance system. In G. Kotsis, D. Taniar, E. Pardede, & I. Khalil (Eds.), Proceedings of the 6th International Conference on Advances in Mobile Computing and Multimedia (pp. 82-87). New York, NY: Association for Computing Machinery.","DOI":"10.1145\/1497185.1497205"},{"key":"ijmdem.2013100103-20","doi-asserted-by":"publisher","DOI":"10.1145\/1352012.1352018"}],"container-title":["International Journal of Multimedia Data Engineering and Management"],"original-title":[],"language":"ng","link":[{"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/www.igi-global.com\/viewtitle.aspx?TitleId=103010","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,1]],"date-time":"2025-05-01T21:30:58Z","timestamp":1746135058000},"score":1,"resource":{"primary":{"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/services.igi-global.com\/resolvedoi\/resolve.aspx?doi=10.4018\/ijmdem.2013100103"}},"subtitle":[""],"short-title":[],"issued":{"date-parts":[[2013,10,1]]},"references-count":21,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2013,10]]}},"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.4018\/ijmdem.2013100103","relation":{},"ISSN":["1947-8534","1947-8542"],"issn-type":[{"value":"1947-8534","type":"print"},{"value":"1947-8542","type":"electronic"}],"subject":[],"published":{"date-parts":[[2013,10,1]]}}}