Virtual Piano Dynamics Enhancement with Electromyography
Pianos are musical instruments that are not easily accessible and portable, which can cause limitations in learning the instrument. Although various technologies have shown promising results in resolving this issue, an optimal solution that can overcome the physical limitation yet provide reality an...
| Main Authors: | , |
|---|---|
| Format: | Conference or Workshop Item |
| Published: |
2021
|
| Subjects: | |
| Online Access: | http://eprints.sunway.edu.my/2155/ |
| _version_ | 1848802211969105920 |
|---|---|
| author | Fen, Cherlynn Chew Hui Lim, Woan Ning * |
| author_facet | Fen, Cherlynn Chew Hui Lim, Woan Ning * |
| author_sort | Fen, Cherlynn Chew Hui |
| building | SU Institutional Repository |
| collection | Online Access |
| description | Pianos are musical instruments that are not easily accessible and portable, which can cause limitations in learning the instrument. Although various technologies have shown promising results in resolving this issue, an optimal solution that can overcome the physical limitation yet provide reality and immersive playing experience has yet to be achieved. This research proposed a lightweight and portable virtual piano solution for beginner-level piano playing, enhanced with biofeedback and tactile sensation to overcome the limitation of lacking in dynamics in most of the virtual piano application. The player’s hands are detected and tracked for playing movements as they interact with the 3D graphical interface by using the Leap Motion Controller (LMC). The MyoWare muscle sensors are used to detect the electromyography (EMG) readings to enable the dynamic variation while playing. User testing was carried out on two groups of participants: experienced and novice players respectively. Quantitative and qualitative data have been collected for accuracy, usability, workload, and realism analysis. Results of the study show that this approach has the potential to be used as a beginner’s instrument for simple pieces or warm-up practices. The results also indicate that with the addition of tactile sensation by using an acrylic panel and incorporating dynamics with the EMG signals into the solution has led to a better immersive user experience. This study provides an alternative option and worthwhile insight for future development of virtual piano applications. |
| first_indexed | 2025-11-14T21:19:45Z |
| format | Conference or Workshop Item |
| id | sunway-2155 |
| institution | Sunway University |
| institution_category | Local University |
| last_indexed | 2025-11-14T21:19:45Z |
| publishDate | 2021 |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | sunway-21552023-03-20T05:50:29Z http://eprints.sunway.edu.my/2155/ Virtual Piano Dynamics Enhancement with Electromyography Fen, Cherlynn Chew Hui Lim, Woan Ning * QA75 Electronic computers. Computer science TJ Mechanical engineering and machinery Pianos are musical instruments that are not easily accessible and portable, which can cause limitations in learning the instrument. Although various technologies have shown promising results in resolving this issue, an optimal solution that can overcome the physical limitation yet provide reality and immersive playing experience has yet to be achieved. This research proposed a lightweight and portable virtual piano solution for beginner-level piano playing, enhanced with biofeedback and tactile sensation to overcome the limitation of lacking in dynamics in most of the virtual piano application. The player’s hands are detected and tracked for playing movements as they interact with the 3D graphical interface by using the Leap Motion Controller (LMC). The MyoWare muscle sensors are used to detect the electromyography (EMG) readings to enable the dynamic variation while playing. User testing was carried out on two groups of participants: experienced and novice players respectively. Quantitative and qualitative data have been collected for accuracy, usability, workload, and realism analysis. Results of the study show that this approach has the potential to be used as a beginner’s instrument for simple pieces or warm-up practices. The results also indicate that with the addition of tactile sensation by using an acrylic panel and incorporating dynamics with the EMG signals into the solution has led to a better immersive user experience. This study provides an alternative option and worthwhile insight for future development of virtual piano applications. 2021-11-18 Conference or Workshop Item PeerReviewed Fen, Cherlynn Chew Hui and Lim, Woan Ning * (2021) Virtual Piano Dynamics Enhancement with Electromyography. In: 2021 Innovations in Intelligent Systems and Applications Conference (ASYU), 6-8 October 2021, Elazig, Turkey. https://ieeexplore.ieee.org/document/9598948 |
| spellingShingle | QA75 Electronic computers. Computer science TJ Mechanical engineering and machinery Fen, Cherlynn Chew Hui Lim, Woan Ning * Virtual Piano Dynamics Enhancement with Electromyography |
| title | Virtual Piano Dynamics Enhancement with Electromyography |
| title_full | Virtual Piano Dynamics Enhancement with Electromyography |
| title_fullStr | Virtual Piano Dynamics Enhancement with Electromyography |
| title_full_unstemmed | Virtual Piano Dynamics Enhancement with Electromyography |
| title_short | Virtual Piano Dynamics Enhancement with Electromyography |
| title_sort | virtual piano dynamics enhancement with electromyography |
| topic | QA75 Electronic computers. Computer science TJ Mechanical engineering and machinery |
| url | http://eprints.sunway.edu.my/2155/ http://eprints.sunway.edu.my/2155/ |