Featureless
Bypassing feature extraction in action categorization
Silvia L. Pintea (Universiteit van Amsterdam)
Pascal Mettes (Universiteit van Amsterdam)
J.C. Van Gemert (Universiteit van Amsterdam, TU Delft - Pattern Recognition and Bioinformatics)
AWM Smeulders (Universiteit van Amsterdam)
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
This method introduces an efficient manner of learning action categories without the need of feature estimation. The approach starts from low-level values, in a similar style to the successful CNN methods. However, rather than extracting general image features, we learn to predict specific video representations from raw video data. The benefit of such an approach is that at the same computational expense it can predict 2D video representations as well as 3D ones, based on motion. The proposed model relies on discriminative Wald-boost, which we enhance to a multiclass formulation for the purpose of learning video representations. The suitability of the proposed approach as well as its time efficiency are tested on the UCF11 action recognition dataset.