Tensor Discriminant Analysis With Multiscale Features for Action Modeling and Categorization

Abstract

This letter addresses the problem of analyzing spatio-temporal patterns for action recognition. In this letter we organize the whole training set in a single tensor, with each mode indicating one factor which influences the result of recognition, e.g., various view points. A novel method is proposed for tensor decomposition by discriminant analysis of multiscale features which represent the motion details on different scales. In addition, the nearest neighbor classifier (NNC) is employed for action classification. Experiments on the self-manufactured action database under ideal conditions showed that the proposed method was better than state-of-the-art methods under various view angles in terms of accuracy. Experiments on the commonly used KTH database also showed that the proposed method had low time complexity and was robust against changing view points.