Domain-adaptive human motion and dynamics capture

• Applicant: Dr. Bastian Wandt
• Subject Area: Image and Language Processing, Computer Graphics and Visualisation, Human Computer Interaction, Ubiquitous and Wearable Computing
• Term: from 2021 to 2022
• Project identifier: Deutsche Forschungsgemeinschaft (DFG) - Project number 461209230

The goal of the project is to develop a video-based markerless human motion and dynamics capture system. In contrast to other motion capture (MoCap) systems this project focuses on motions that are hard to record in traditional MoCap studios resulting in a lack of accurate 3D data for the specific motion domain. For example these motions can be outdoor activities of humans such as rock climbing, skiing and parkour running or even motions of animals. Additionally to estimating accurate 3D reconstructions of the observed object the system should also infer physical parameters that drive the motion, for instance joint torques and external forces. These forces are not only of high interest for motion analysis but will also improve the 3D motion reconstruction from videos. Moreover, constraints based on rigid body dynamics will be extremely helpful to enable a domain adaptation to motions without available ground truth 3D recordings.

• DFG Programme: WBP Fellowship
• International Connection: Canada
• Host: Professor Dr. Helge Rhodin