Crossmodal representation facilitating robust robot behaviour (A04)

• Subject Area: Automation, Mechatronics, Control Systems, Intelligent Technical Systems, Robotics ; Image and Language Processing, Computer Graphics and Visualisation, Human Computer Interaction, Ubiquitous and Wearable Computing ; Cognitive, Systems and Behavioural Neurobiology
• Term: since 2016
• Project identifier: Deutsche Forschungsgemeinschaft (DFG) - Project number 261402652

Project A4 approaches the “dynamics of crossmodal adaption” topic from a computer science and robotics perspective, with the goal to learn crossmodal representations for robust robot behaviour. A4 proposes to build a novel crossmodal simulation platform that will provide near-realistic physical properties and integrate novel tactile sensors, deformable objects, and robot models. Both meta-learning and multi-agent collaborative techniques, which respectively focus on shared and dynamic crossmodal representation, will be studied in a challenging clothes-hanging scenario. The learned models will be tested on simulated and real humanoid platforms using transfer strategies. The developed datasets and simulation environment will result in standardized robot benchmarking scenarios.

• DFG Programme: CRC/Transregios
• Subproject of: TRR 169: Crossmodal Learning: Adaptivity, Prediction and Interaction
• International Connection: China
• Applicant Institution: Universität Hamburg
• Project Heads: Professor Dr. Yizhou Wang; Professor Dr. Jianwei Zhang; Professor Dr. Changshui Zhang