Multimodal Intent Communication of Autonomous Systems

• Applicant: Professor Dr. Albrecht Schmidt
• Subject Area: Image and Language Processing, Computer Graphics and Visualisation, Human Computer Interaction, Ubiquitous and Wearable Computing ; Human Factors, Ergonomics, Human-Machine Systems
• Term: since 2024
• Project identifier: Deutsche Forschungsgemeinschaft (DFG) - Project number 529719707

As a consequence of advances in artificial intelligence, sensing, and robotics, humans will increasingly encounter and cooperate with autonomous systems. This will require humans to understand and predict the intentions and future behaviors of these systems. Researchers have investigated how drivers or passengers can interact with autonomous vehicles, however there is no comprehensive model of intent communication. Also in other domains there is little understanding of how to communicate intent from intelligent systems to users. We aim at a comprehensive user-centered investigation of intent communication across different scenarios (e.g. cleaning robot and autonomous bike). With this, we aim at discovering general principles for intent communication in autonomous systems, especially with respect to modalities, content, and/or timing of information delivery. By developing a toolbox consisting of communication and evaluation methods, the project will contribute to better cooperation with autonomous systems in the future.

• DFG Programme: Research Grants
• International Connection: Austria
• Partner Organisation: Fonds zur Förderung der wissenschaftlichen Forschung (FWF)
• Cooperation Partner: Professor Dr. Florian Michahelles