Lagrangian-Convolutional Networks for Video Classification

• Applicant: Professor Dr.-Ing. Thomas Sikora
• Subject Area: Image and Language Processing, Computer Graphics and Visualisation, Human Computer Interaction, Ubiquitous and Wearable Computing
• Term: from 2019 to 2022
• Project identifier: Deutsche Forschungsgemeinschaft (DFG) - Project number 434160640

The amount of video data has rapidly increased throughout the last decades. This development rises the demand for effective methods to analyse video data beyond a single frame image-based analysis. Specifically the detection quantification and classification of dynamic motion information is a crucial aspect for processing time-dependent video data which yet needs to be fully exploited. With this project we request funding to develop a novel system for analysis and classification of video data based on a Lagrangian methodology. With our preliminary work we highlighted the innovative potential for video processing using such methods in combination with recent machine learning approaches. With this project we like to evolve and substantiate this approach and aim to develop a novel concept for video-level description and classification: the Lagrangian- Convolutional Neural Network (LaCNN). This concept takes advantage of recent in-depth understanding of motion signatures in a video sequence and exploits the capabilities of the Lagrangian methodology and the encoded motion information more effectively. In summary this novel concept will lead to a competitive effective and more transparent video classification system in comparison to existing state of the art methods.

• DFG Programme: Research Grants