Project Details
Projekt
GRK 1247: Cross-Modal Interaction in Natural and Artificial Cognitive Systems (CINACS)
Subject Area
Systems Engineering
Term
from 2006 to 2015
Project identifier
Deutsche Forschungsgemeinschaft (DFG) - Project number 968025
Natural cognitive systems profit from combining the input of their different sensory systems not only because each modality provides information about different aspects of the world, but also because the different senses can jointly encode particular aspects of events, e.g. their location or meaning. However, this comes at a cost: As each modality uses specific representations, information needs to be transferred into a code that allows the different senses to interact.
Corresponding problems arise in human communication when information about one topic is expressed using combinations of different formats such as language and graphics.
Within this International Research Training Group the principles of cross-modal interactions in natural and cognitive systems are investigated to implement them in artificial systems. Research primarily considers three sensory systems (vision, hearing and haptics) and their interactions.
Multisensory interaction in natural systems is studied using behavioural, electrophysiological and neuroimaging techniques. Different paradigms including cross-modal association learning, sensorimotor control, cross-modal illusions and multisensory language perception are used to uncover the principles of multisensory processes and multimodal representation. The aim is to understand the biological mechanisms of cross-modal processing and its role in perception and behavioural control. Furthermore, our goal is to design models, implement algorithms and architectures for more robust artificial multimodal systems, which can function like natural systems.
The Research Training Group CINACS will combine particular techniques like EEG, fMRI, TMS, simulation, use of artefacts, computer and robot experiments. This is only possible because CINACS comprises the disciplines of neuroscience, psychology, linguistics, computer science, robotics and bio-engineering. From this synergy we expect major advances in the fields of multisensory learning, attention, memory and sensorimotor control and a profound impact on future technologies like human-robot communication, sensory substitution for rehabilitation, hybrid technology to restore sensory loss, hybrid bionic systems and a better understanding of information processing in the human brain.
Corresponding problems arise in human communication when information about one topic is expressed using combinations of different formats such as language and graphics.
Within this International Research Training Group the principles of cross-modal interactions in natural and cognitive systems are investigated to implement them in artificial systems. Research primarily considers three sensory systems (vision, hearing and haptics) and their interactions.
Multisensory interaction in natural systems is studied using behavioural, electrophysiological and neuroimaging techniques. Different paradigms including cross-modal association learning, sensorimotor control, cross-modal illusions and multisensory language perception are used to uncover the principles of multisensory processes and multimodal representation. The aim is to understand the biological mechanisms of cross-modal processing and its role in perception and behavioural control. Furthermore, our goal is to design models, implement algorithms and architectures for more robust artificial multimodal systems, which can function like natural systems.
The Research Training Group CINACS will combine particular techniques like EEG, fMRI, TMS, simulation, use of artefacts, computer and robot experiments. This is only possible because CINACS comprises the disciplines of neuroscience, psychology, linguistics, computer science, robotics and bio-engineering. From this synergy we expect major advances in the fields of multisensory learning, attention, memory and sensorimotor control and a profound impact on future technologies like human-robot communication, sensory substitution for rehabilitation, hybrid technology to restore sensory loss, hybrid bionic systems and a better understanding of information processing in the human brain.
DFG Programme
International Research Training Groups
International Connection
China
Applicant Institution
Universität Hamburg
IRTG-Partner Institution
Tsinghua University
Spokesperson
Professor Dr. Jianwei Zhang
IRTG-Partner: Spokesperson
Professor Dr. Fuchun Sun
