Cyberphysical System With Virtual Reality for Intelligent Motion Recognition and Training

Abstract

In this paper, we propose to build a comprehensive cyberphysical system (CPS) with virtual reality (VR) and intelligent sensors for motion recognition and training. We use both wearable wireless sensors (such as electrocardiogram, motion sensors) and nonintrusive wireless sensors (such as gait sensors) to monitor the motion training status. We first provide our CPS architecture. Then we focus on motion training from three perspectives: 1) VR-first we introduce how we can use motion capture camera to trace the motions; 2) gait recognition-we have invented low-cost small wireless pyroelectric sensor, which can recognize different gaits through Bayesian pattern learning. It can automatically measure gait training effects; and 3) gesture recognition-to quickly tell what motions the subject is doing, we propose a low-cost, low-complexity motion recognition system with 3-axis accelerometers. We will provide hardware and software design. Our experimental results validate the efficiency and accuracy of our CPS design.