Interactive dancing game with real-time recognition of continuous dance moves from 3D human motion capture

Abstract

We have implemented an interactive dancing game using optical 3D motion capture technology. We propose a Progressive Block Matching algorithm to recognize the dance moves performed by the player in real-time. This makes a virtual partner be able to recognize and respond to the player's movement without a noticeable delay. The completion progress of a move is tracked progressively and the virtual partner's move is rendered in synchronization with the player's current action. Our interactive dancing game contains moves with various difficulty levels that suits for both novices and skillful players. Through animating the virtual partner in response to the player's movements, the player gets immersed into the virtual environment. A user test is performed to have a subjective evaluation of our game and the feedbacks from the subjects are positive.