2017 · 159 citations · 13 references
ComputingRobotics EngineeringCinematographyComputer VisionMachine LearningAnimationDeep LearningModeling For AnimationMotion CaptureMotion EstimationSequence LearningControl Signal GenerationHuman Motion AnalysisHuman Motion PredictionMotion GenerationMotion LearningMotion Representation LearningMotion SynthesisVariational Posterior Approximation
We propose a novel generative model of human motion that can be trained using a large motion capture dataset, and allows users to produce animations from high-level control signals. As previous architectures struggle to predict motions far into the future due to the inherent ambiguity, we argue that a user-provided control signal is desirable for animators and greatly reduces the predictive error for long sequences. Thus, we formulate a framework which explicitly introduces an encoding of control signals into a variational inference framework trained to learn the manifold of human motion. As part of this framework, we formulate a prior on the latent space, which allows us to generate high-quality motion without providing frames from an existing sequence. We further model the sequential nature of the task by combining samples from a variational approximation to the intractable posterior with the control signal through a recurrent neural network (RNN) that synthesizes the motion. We show that our system can predict the movements of the human body over long horizons more accurately than state-of-the art methods. Finally, the design of our system considers practical use cases and thus provides a competitive approach to motion synthesis.<br/>
13
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
Auto-Encoding Variational Bayes
Diederik P. Kingma, Max Welling · UvA-DARE (University of Amsterdam) · 2013 · 15.6K citations · Full text
Convergence Results for Neural Networks via Electrodynamics
arXiv (Cornell University) · 2018 · 2.9K citations · Full text
Computing, Computer Science, Physics +13