Predicting Video-frames Using Encoder-convlstm Combination

Abstract

Video generation is an active field of research. With the rise in the amount of available data and economically available processing power in the form of GPUs, deep Learning has been a go-to solution for many real life problems and similarly it is often attempted to solve the problem of video generation using deep learning. Predicting the next set of frames for a given set of frames in a video has seldom been taken up. Each video is composed of a consecutive closely related frames of images. If we consider these frames, the frame in each time-step seems to be related to the frames in the preceding time-steps. Therefore, we have both spatial and temporal data available from any set of consecutive frames in a video. Learning some sort of representation of the images that encodes the spatial data of the images (frames) can be combined with learning how these representations of a particular time-step is related with the next few time-steps is made possible, then prediction of the next few frames for a given set of frames is made possible. Our aim is to propose a simple yet effective model that can achieve this goal.