2011 · 24 citations · 7 references
ComputingVisualization3D ModelingInteractive MediaSensor FusionGesture RecognitionGesture-based InteractionMotion CaptureMultimodal InteractionSensor IntegrationSensor-based InteractionComputer Vision InterfacesExpressive Control InterfacesGesture RecognizersHuman-computer Music InteractionMotion Capture For MusicSensor-based Gesture RecognitionSensor-based Musical ControlSound-to-motion Mapping
This paper describes a study into the realisation of a new method for capturing 3D sound control data. It expands on our established practice with the radiodrum 3D input device by incorporating a computer vision platform that we have developed using the Xbox Kinect motion sensing input device. It also extends our previous work in systemizing a low-cost, open-source 3D gesture sensor system, as a novel method for musically oriented human computer interaction. We discuss in detail the development process and the system performance in different scenarios and outline the future directions of this development.
7