Crossmodal transfer of dexterous manipulation skills (B05)

• Subject Area: Automation, Mechatronics, Control Systems, Intelligent Technical Systems, Robotics ; Image and Language Processing, Computer Graphics and Visualisation, Human Computer Interaction, Ubiquitous and Wearable Computing
• Term: since 2016
• Project identifier: Deutsche Forschungsgemeinschaft (DFG) - Project number 261402652

The Project studies the crossmodal transfer of dexterous manipulation skills to new situations. The project will (1) describe crossmodal multi-level representations of dexterous manipulation skills, (2) develop crossmodal imitation learning methods to learn such abstractions from multimodal sensor data, (3) develop crossmodal transfer strategies that selectively reuse prior knowledge to adapt to new situations, and (4) improve dexterous manipulation skills online in dynamic environments. Overall, this project will explore novel ways to represent, learn and transfer crossmodal information for dexterous motor abilities.

• DFG Programme: CRC/Transregios
• Subproject of: TRR 169: Crossmodal Learning: Adaptivity, Prediction and Interaction
• International Connection: China
• Applicant Institution: Universität Hamburg
• Project Heads: Professor Dr. Fuchun Sun; Professor Dr. Jianwei Zhang