TY - GEN
T1 - PianoWatch
T2 - 20th Annual IEEE International Conference on Sensing, Communication, and Networking, SECON 2023
AU - Guo, Kaiwen
AU - Zhou, Hao
AU - Jing, Siyu
AU - Du, Haohua
AU - Luo, Puhan
AU - Hou, Jiahui
AU - Li, Xiang Yang
N1 - Publisher Copyright:
© 2023 IEEE.
PY - 2023
Y1 - 2023
N2 - Existing intelligent piano learning systems mainly assist the player by camera, which generally only consider the fingering that can only reflect the performance problem from a limited perspective. Thus, we propose PianoWatch, a multi-dimensional assistance system based on wrist wearable devices. PianoWatch extracts more accurate patterns by analyzing data from microphone, camera, accelerometers and gyroscopes. Then it gives corresponding playing advices, in addition to pitch, including fingering, depth and even mood, through an evaluation model. We implement the prototype of PianoWatch and evaluate it by 20 volunteers. Extensive experiments show it can achieve 93% F1-Score on the playing pattern extraction, and more than 95% of users would like to try it to assist their piano learning.
AB - Existing intelligent piano learning systems mainly assist the player by camera, which generally only consider the fingering that can only reflect the performance problem from a limited perspective. Thus, we propose PianoWatch, a multi-dimensional assistance system based on wrist wearable devices. PianoWatch extracts more accurate patterns by analyzing data from microphone, camera, accelerometers and gyroscopes. Then it gives corresponding playing advices, in addition to pitch, including fingering, depth and even mood, through an evaluation model. We implement the prototype of PianoWatch and evaluate it by 20 volunteers. Extensive experiments show it can achieve 93% F1-Score on the playing pattern extraction, and more than 95% of users would like to try it to assist their piano learning.
UR - https://www.scopus.com/pages/publications/85177450997
U2 - 10.1109/SECON58729.2023.10287516
DO - 10.1109/SECON58729.2023.10287516
M3 - 会议稿件
AN - SCOPUS:85177450997
T3 - Annual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks workshops
SP - 222
EP - 230
BT - 2023 20th Annual IEEE International Conference on Sensing, Communication, and Networking, SECON 2023
PB - IEEE Computer Society
Y2 - 11 September 2023 through 14 September 2023
ER -