An intelligent virtual piano tutor

Abstract

Aiming to instruct the novice in good playing of musical instruments, tutors need to teach the students how to practice certain fingering for certain notes sequence, which typically is the most difficult skill for a beginner to learn. In this paper, we illustrate a virtual piano tutoring system. The system takes a MIDI event sequence as input and displays the suggested result by a 3D virtual pianist, demonstrating the automatically generated "good" fingering for the learner to imitate.Most previous fingering solving algorithms have drawbacks. First, all them solve the fingering piece by piece off-line. Second, the goodness evaluation function is hard to model. Third, no polyphonic algorithm is ever presented. This paper describes a new framework which remedies the first two drawbacks and is of potnetial to solve polyphonic sequence using a novel fingering generation mechanism SFG(Slicing Fingering Generation). Our system gets the fingering solving in real-time, and provides an ergonomics-based pose evaluation.