ChaLearn Joint Contest on Multimedia Challenges Beyond Visual Analysis
An overview
Hugo Jair Escalante (INAOE, ChaLearn)
Victor Ponce-López (Autonomous University of Barcelona, Universitat Politecnica de Catalunya, Open University of Catalonia)
Jun Wan (Chinese Academy of Sciences)
Michael A. Riegler (Simula Research Laboratory)
Baiyu Chen (University of California)
Albert Clapés (Universitat Politecnica de Catalunya)
Sergio Escalera (Autonomous University of Barcelona, Open University of Catalonia)
Isabelle Guyon (Université Paris-Saclay, ChaLearn)
Xavier Baró (Open University of Catalonia, Autonomous University of Barcelona)
Pål Halvorsen (Simula Research Laboratory)
Henning Müller (University of Applied Sciences Western Switzerland)
Martha Larson (TU Delft - Electrical Engineering, Mathematics and Computer Science)
More Info
expand_more
Abstract
This paper provides an overview of the JointContest on Multimedia Challenges Beyond Visual Analysis.We organized an academic competition that focused on fourproblems that require e‚ective processing of multimodalinformation in order to be solved. Two tracks were devoted togesture spotting and recognition from RGB-D video, two fundamentalproblems for human computer interaction. Anothertrack was devoted to a second round of the €rst impressionschallenge of which the goal was to develop methods torecognize personality traits from short video clips. For thissecond round we adopted a novel collaborative-competitive(i.e., coopetition) setting. ‡e fourth track was dedicated tothe problem of video recommendation for improving userexperience. ‡e challenge was open for about 45 days, andreceived outstanding participation: almost 200 participantsregistered to the contest, and 20 teams sent predictions inthe €nal stage. ‡e main goals of the challenge were ful€lled:the state of the art was advanced considerably in the fourtracks, with novel solutions to the proposed problems (mostlyrelying on deep learning). However, further research is stillrequired. ‡e data of the four tracks will be available to allowresearchers to keep making progress in the four tracks