GRK 1247:  Cross-Modal Interaction in Natural and Artificial Cognitive Systems (CINACS)

• Subject Area: Systems Engineering
• Term: from 2006 to 2015
• Project identifier: Deutsche Forschungsgemeinschaft (DFG) - Project number 968025

• Final Report Year: 2018

Final Report Abstract

The International Graduate College CINACS (Cross-modal Interaction in Natural and Artificial Cognitive Systems) has been carried out jointly by the Departments of Informatics, the University Medical Center Hamburg-Eppendorf and the department of Psychology of the Universität Hamburg, as well as by the Tsinghua University in Beijing, China since 2006. Within CINACS, we have investigated and taught the principles of cross-modal processes in natural cognitive systems as well as in artificial systems, in particular focusing on phenomena of dynamics, learning, memory and communication. These principles of cross-modal processing are central to making further progress on understanding and building new cross-modal intelligent systems. Furthermore, we have investigated and taught principles for designing and realizing multi-modal environments for human-computer and human-robot interaction. The research programme aims at understanding the biological mechanisms of cross-modal processing, its role in perception and behavioural control and the use of multi-modal representations in communication and problem solving. Additionally, our goal is to design models, implement algorithms and investigate architectures for robust artificial multi-modal systems which facilitate a smooth and efficient cooperation and communication between humans and artificial systems. CINACS combines the relevant methods, in particular behavioural techniques, cognitive and computational simulation, artefact construction, computer and robot experiments. This combination of approaches is possible because CINACS comprises the disciplines of neuroscience, bio-engineering, psychology, linguistics, computer science and robotics. For both the PhD students and the supervisors, the cultural exchange has constituted a valuable addition to the strategic importance of collaborating in extensive, international projects.

Publications

• (2006). Multimodal people tracking and trajectory prediction based on learned generalized motion patterns. In 2006 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, (pp. 541-546). IEEE
  Weser, M., Westhoff, D., Huser, M., & Zhang, J.
  
• (2006). Real-time fusion of multimodal tracking data and generalization of motion patterns for trajectory prediction. In 2006 IEEE International Conference on Information Acquisition, (pp. 786-791). IEEE
  Weser, M., Westhoff, D., Huser, M., & Zhang, J.
  
• (2007), Searching and Fitting Strategies in Active Shape Models, In The 4th International Conference on Informatics in Control, Automation and Robotics (ICINCO), Angers, France
  Zhang, J.H., Chen S.Y., Liu S., Guan Q., & Wu H.H.
  
• (2007), The moment invariant for fitting of active shape models, In The 4th IET Visual Information Engineering, London, UK
  Zhang, J.H., Chen S.Y., Liu S., & Guan Q.
  
• (2007). An Audio-Visual Speech Recognition System based on Articulatory Features. In proceedings of AVSP 2007 - 6th Int. Conf. on Audio Visual Speech, Kasteel Groenendael, Hilvarenbeek, Netherlands, Aug 28-Sep 03, 2007
  Gan, T., Menzel, W. & Yang, S.
  
• (2007). Audiovisuelle Interaktionen bei der Wahrnehmung visueller Scheinbewegungen. In Tagung experimentell arbeitender Psychologen (TSAP), Trier, German
  Bruns，P. & Getzmann, S.
  
• (2007). Effects of the cannabinoid CB1 receptor antagonist rimonabant on distinct measures of impulsive behavior in rats. Psychopharmacology (Berl), 193(1), 85-96
  Pattij, T., Janssen, M. C., Schepers, I. M., González-Cuevas, G., De Vries, T. J., & Schoffelmeer, A. N.
  
• (2007). Epirome-a novel framework to investigate high-level episodic robot memory. In proceedings of IEEE International Conference on Robotics and Biomimetics (ROBIO). (pp. 1075-1080). IEEE
  Jockel, S., Westhoff, D., & Zhang, J.
  
• (2007). Eye-tracking and testing learning materials. Tobii User Meeting, Frankfurt, Germany
  Acarturk, C.
  
• (2007). Integrating cross-modal context for PP attachment disambiguation. In Third International Conference on Natural Computation (ICNC); (Vol. 3, pp. 292-296). IEEE
  McCrae, P.
  
• (2007). Multimodal comprehension of language and graphics. In proceedings of the 14th European Conference on Eye Movements (ECEM), Potsdam, Germany
  Acarturk, C., Habel, C., Cagiltay, K., & Alacam, O.
  
• (2007). On reciprocal improvement in multimodal generation: Co-reference by text and information graphics. In Proceedings of MOG 2007: The workshop on multimodal output generation (pp. 69-80)
  Habel, C., & Acartürk, C.
  
• (2007). Proactive multimodal perception for feature based anchoring of complex objects. In proceedings of IEEE International Conference on Robotics and Biomimetics (ROBIO). (pp. 1069-1074). IEEE
  Weser, M., & Zhang, J.
  
• (2007). Three-dimenisonal monocular scene reconstruction for service-robots-an application. In VISAPP (Special Sessions) (pp. 41-46)
  Jockel, S., Baier-Löwenstein, T., & Zhang, J.
  
• (2007). Towards a system architecture for integrating crossmodal context in syntactic disambiguation. In proceedings of the 4th International Workshop on Natural Language Processing and Cognitive Science, Madeira (NLPCS 2007) (pp. 228-237)
  McCrae, P., & Menzel, W.
  
• (2008). A Normalized weighted shape context and its application in feature-based matching. Optical Engineering, 47(9), 097201
  Zhang, J.H., Chen, S., Liu, S., & Guan, Q.
  
• (2008). Audiovisual influences on the perception of visual apparent motion: Exploring the effect of a single sound. Acta Psychologica, 129(2), 273-283
  Bruns, P. & Getzmann, S.
  
• (2008). Automatic segmentation of micro-calcification based on sift in mammograms. In proceedings of International Conference onBioMedical Engineering and Informatics (BMEI),. (Vol. 2, pp. 13-17). IEEE
  Guan, Q., Zhang, J.H., Chen, S., & Todd-Pokropek, A.
  
• (2008). Design Concepts for Tactile Maps to Support Visually Impaired Persons. In Spatial Cognition, Doctoral Colloquium, Freiburg / Breisgau, Germany
  Graf, C.
  
• (2008). From Interaction between Language and Visual Representations to the Interaction between Language and Haptic Representations. In The Workshop on the Interaction of Vision and Language in Cross-Modal Comprehension (IVLCMC), Hamburg, Germany
  Graf, C.
  
• (2008). Fuzzy multisensor fusion for autonomous proactive robot perception. In proceedings of IEEE International Conference on Fuzzy Systems (FUZZ). IEEE
  Weser, M., Jockel, S., & Zhang, J.
  
• (2008). Learning from text and graphs: The role of annotations and sensory modality. In Proceedings of EARLI Special Interest Group Text and Graphics. Exploiting the Opportunities Learning with Textual, Graphical and Multimodal Representations, (pp.13-16)
  Acartürk, C., Habel, C., Cagiltay, K., & Alacam, O.
  
• (2008). Levels of error processing in Huntington's disease: a combined study using event-related potentials and voxel-based morphometry. Hum Brain Mapp, 29(2), 121-130
  Beste, C., Saft, C., Konrad, C., Andrich, J., Habbel, A., Schepers, I., Jansen, A., Pfleiderer, B., & Falkenstein, M.
  
• (2008). Modelling global phenomena with extended local constraints. In proceedings of the 5th International Workshop on Constraints and Language Processing (CSLP), (pp. 48-60), Hamburg, Germany)
  McCrae, P., Foth, K. A., & Menzel, W.
  
• (2008). Multimodal comprehension of graphics with textual annotations: The role of graphical means relating annotations and graph lines. In International Conference on Theory and Application of Diagrams (pp. 335-343). Springer, Berlin, Heidelberg
  Acarturk, C., Habel, C., & Cagiltay, K.
  
• (2008). Multimodal comprehension of language and graphics: Graphs with and without annotations. Journal of Eye Movement Research, 1(3), 1-15
  Acartürk, C., Habel, C., Cagiltay, K., & Alacam, O.
  
• (2008). Tactile capture of auditory localization is modulated by hand posture. In The 9th International Multisensory Research Forum (MRRF), Hamburg, Germany
  Bruns，P. & Röder, B.
  
• (2008). Towards an episodic memory for cognitive robots. In proceedings of 6th Cognitive Robotics workshop at 18th European Conf. on Artificial Intelligence (ECAI) (pp. 68-74)
  Jockel, S., Weser, M., Westhoff, D., & Zhang, J.
  
• (2008). Using the Tandem Approach for AF Classification in an AVSR System. In proceedings of ISNN 2008 - 5th Int. Symp. on Neural Networks, Beijing, China, Sep 24-28, 2008
  Gan, T., Menzel, W. & Zhang, J.
  
• (2008). You-are-here Maps as Navigation Aids for Visually Impaired People. In proceedings of workshop "You-Are-Here-Maps", (pp. 01-10), Freiburg / Breisgau, Germany
  Habel, C. & GrafC.
  
• Dissociable roles for the hippocampus and the amygdala in human cued versus context fear conditioning. Journal of Neuroscience, 28(36), 9030-9036
  Marschner, A, Kalisch, R, Vervliet, B, Vansteenwegen D & Büchel, C
  
• You-are-here maps for the blind: First experiments in cognitive design of non-visual spatial representations. Fachtagung der Gesellschaft für Kognitionswissenschaft KogWis, (pp. 73), Dresden, Germany
  Graf, C.
  
• (2009) Using Articulatory Feature-based ANN/HMM Approach in AVSR. In The 13th International Conference on Speech and Computer, St. Petersburg, Russia, Jun 21-25, 2009
  Gan, T. & Menzel, W.
  
• (2009). A model for the cross-modal influence of visual context upon language procesing. In Proceedings of the International Conference RANLP-2009 (pp. 230-235)
  McCrae, P.
  
• (2009). Active Detection and Correction of Shape Distortions Based on Moment Invariants for Active Shape Models. Journal of Image and Graphics, 9, 031
  Zhang, J. H., Chen, S. Y., Liu, S., & Guan, Q.
  
• (2009). Autonomous planning for mobile manipulation services based on multi-level robot skills. In proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). (pp. 1999-2004). IEEE
  Weser, M. & Zhang, J.
  
• (2009). Detection and Localization of Partial Occlusion of Object Boundaries. In 2009 IEEE International Instrumentation and Measurement Technology Conference, Singapore
  Zhang, J.H., Li, Y.F., & Chen, S.Y.
  
• (2009). Distraction of task-relevant information processing by irrelevant changes in auditory, visual, and bimodal stimulus features: A behavioural and eventrelated potential study. Psychophysiology, 46(3), 645-654
  Boll, S. & Berti, S.
  
• (2009). Do humans optimally integrate perceptual uncertainty and reward expectation? In Tagung experimentell arbeitender Psychologen (TEAP), Jena, Germany
  Maiworm, M., & Röder, B.
  
• (2009). Eye-tracking evidence for multimodal language-graphics comprehension: The role of integrated conceptual representations
  Habel, C., & Acartürk, C.
  
• (2009). HTN Robot Planning in partially observable dynamic environments, In 2010 IEEE International Conference on Robotics and Automation (ICRA), (pp. 1505-1510). IEEE
  Weser, M., Off, D., & Zhang, J.
  
• (2009). Real-time 3D environment perception: An application for small humanoid robots. In proceedings of IEEE International Conference on Robotics and Biomimetics (ROBIO). (pp. 354-359). IEEE
  Klimentjew, D., Stroh, A., Jockel, S., & Zhang, J.
  
• (2009). Reasoning for context integration into syntactic parsing. In proceedings of Intelligent Linguistic Technologies Conference (ILINTEC), Las Vegas, USA
  McCrae, P.
  
• (2009). Robot navigation and manipulation based on a predictive associative memory. In proceedings of IEEE 8th International Conference on Development and Learning (ICDL) (pp. 1-7). IEEE
  Jockel, S., Mendes, M., Zhang, J., Coimbra, A. P., & Crisóstomo, M.
  
• (2009). Sparse distributed memory for experience-based robot manipulation. In proceedings of IEEE International Conference on Robotics and Biomimetics (ROBIO). (pp. 1298-1303). IEEE
  Jockel, S., Lindner, F., & Zhang, J.
  
• (2010). A Computational Model of Vision-Language Interaction Based on Conceptual Structure. In proceedings of the 2010 Conference on Conceptual Structure, Discourse and Language, San Diego, USA
  McCrae P.
  
• (2010). An independent brain–computer interface using covert non-spatial visual selective attention. Journal of neural engineering, 7(1), 016010
  Zhang, D., Maye, A., Gao, X., Hong, B., Engel, A. K., & Gao, S.
  
• (2010). Attitudes toward younger and older adults: The German aging semantic differential. International Journal of Behavioral Development, 34(2), 147-158
  Gluth, S., Ebner, N. C., & Schmiedek, F.
  
• (2010). Audiotactile spatial ventriloquism in congenitally blind, late blind and sighted individuals. In proceedings of IMRF 2010 - the 11th International Multisensory Research Forum, Liverpool, UK, June
  Occelli V., Bruns P., Zampini M. & Röder B.
  
• (2010). Conceptual Structure as Mediator in a Computational Model for Vision-Language Interaction. In proceedings of the Biannual Conference of the German Society for Cognitive Science, Potsdam (Germany)
  McCrae P.
  
• (2010). Dissociating face processing from contextual effects in the amygdala using high resolution fMRI. In the 16th annual meeting of the organization for human brain mapping 2010, Barcelona, Spain
  Boll, S., Gamer, M. & Büchel, C.
  
• (2010). Evidence accumulation in economic decision making. In The Computations, Decisions, and Movement Workshop 2010, Castle of Rauischholzhausen, Germany
  Gluth, S. & Büchel, C.
  
• (2010). Generating Verbal Assistance for Tactile-Map Explorations1. In MOG 2010 3rd Workshop on Multimodal Output Generation (pp. 27-35)
  Lohmann, K., Kerzel, M., & Habel, C.
  
• (2010). Neural representations of expected value and reward prediction error for strategy selection learning. In The 16th Annual Meeting of the Organization for Human Brain Mapping 2010, Barcelona, Spain
  Gluth, S., Rieskamp, J. & Büchel, C.
  
• (2010). Object Affordances in the Context of Sensory Motor Contingencies. Frontiers in Computational Neuroscience, 71
  Kleesiek, J., Engel, A. K., Wermter, S., & Weber, C.
  
• (2010). RNA secondary structure prediction using a self-consistent mean field approach. Journal of computational chemistry, 31(6), 1135-1142
  Kleesiek, J., & Torda, A. E.
  
• (2010). Tactile capture of auditory localization is modulated by hand posture. Experimental psychology, 57(4), 267
  Bruns, P., & Röder, B.
  
• (2010). Tactile capture of auditory localization: an event-related potential study. European Journal of Neuroscience, 31(10), 1844-1857
  Bruns, P., & Röder, B.
  
• (2010). Tactile capture of auditory localization: An event-related potential study. In Tagung Experimentell Arbeitender Psychologinnen (TEAP), Jena, German
  Bruns，P. & Röder, B.
  
• (2010). Tactile Map Exploration Procedures: A Taxonomy. In proceedings of EuroHaptics 2010
  Habel, C. & Lohmann, K.
  
• (2010). Taktile Rekalibrierung auditiver Raumrepräsentationen. In proceedings of TeaP 2010 - Tagung experimentell arbeitender Psychologen, Saarbrücken, Germany, March
  Bruns P., Spence C. & Röder B.
  
• (2010). Verbal Assistance in Tactile-Map Explorations: A Case for Visual Representations and Reasoning. In Visual Representations and Reasoning (pp. 34-41)
  Habel, C., Kerzel, M., & Lohmann, K.
  
• (2010, August 1-6). Neural Correlates of Non-Visual Processing in Visual Cortex of the Blind. In proceedings of Gordon Research Conference on Neurobiology of Cognition, Waterville Valley, NH, USA
  Schepers, I. M. Hipp, J. F. Schneider,T. R. Röder, B. & Engel, A.K.
  
• (2011). A computational model of concept generalization in cross-modal reference. Tsinghua Science & Technology, 16(2), 113-120
  McCrae, P., Menzel, W., & Sun, M.
  
• (2011). A discrete computational model of sensorimotor contingencies for object perception and control of behavior. In 2011 IEEE International Conference on Robotics and Automation (ICRA), (pp. 3810-3815). IEEE
  Maye, A., & Engel, A. K.
  
• (2011). A Transgenic Approach to Identify Thyroxine Transporter-Expressing Structures in Brain Development. Journal of neuroendocrinology, 23(12), 1194-1203
  Lang, M. F., Salinin, S., Ridder, D. A., Kleesiek, J., Hroudova, J., Berger, S., ... & Schwaninger, M.
  
• (2011). Causal inference in graph-text constellations: Designing verbally annotated graphs. Tsinghua Science & Technology, 16(1), 7-12
  Habel, C. & Acartürk, C.
  
• (2011). Continual HTN Robot Task Planning in Open-Ended Domains: A Case Study. In Automated Action Planning for Autonomous Mobile Robots (pp. 1505-1510). San Francisco, USA
  Off, D., & Zhang, J.
  
• (2011). Cross-modal training induces changes in spatial representations early in the auditory processing pathway. Psychological science, 22(9), 1120-1126
  Bruns, P., Liebnau, R., & Röder, B.
  
• (2011). Decision Strategies in Incremental PoS Tagging. In The 18th Nordic Conference of Computational Linguistics
  Beuck, N., Köhn, A., & Menzel, W.
  
• (2011). Detection and amendment of shape distortions based on moment invariants for active shape models. IET Image Processing, 5(3), 273-285
  Chen, S. Y., Zhang, J.H., Guan, Q., & Liu, S.
  
• (2011). Fast plane detection for SLAM from noisy range images in both structured and unstructured environments. In 2011 International Conference on Mechatronics and Automation (ICMA), (pp. 1768-1773). IEEE
  Xiao, J., Zhang, J.H., Zhang, J., Zhang, H., & Hildre, H. P.
  
• (2011). Incremental parsing and the evaluation of partial dependency analyses. In Proc. DepLing 2011 - The 1st International Conference on Dependency Linguistics
  Beuck, N., Köhn, A., & Menzel, W.
  
• (2011). Integrate multi-modal cues for category-independent object detection and localization. In proceedings of 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), (pp. 801-806). IEEE
  Zhang, J.H., Xiao, J., Zhang, J., Zhang, H., & Chen, S.
  
• (2011). Integrative processing of perception and reward in an auditory localization paradigm. Experimental psychology, 58(3), 217
  Maiworm, M., König, P., & Röder, B.
  
• (2011). Intuitive Interaction: Tapping into body skills to find rich and intuitive interaction methods for Virtual Reality. In CHI 2011 Workshop on ”Embodied Interaction”, (pp. 128-131)
  Beckhaus, S., & Kleesiek, J.
  
• (2011). Linking spatial haptic perception to linguistic representations: assisting utterances for tactile-map explorations. In International Conference on Spatial Information Theory (pp. 328-349). Springer Berlin Heidelberg
  Lohmann, K., Eschenbach, C., & Habel, C.
  
• (2011). Medial prefrontal cortex activity when thinking about others depends on their age. Neurocase, 17(3), 260-269
  Ebner, N. C., Gluth, S., Johnson, M. R., Raye, C. L., Mitchell, K. J., & Johnson, M. K.
  
• (2011). Multimodal brain-computer interfaces. Tsinghua Science & Technology, 16(2), 133-139
  Maye, A., Zhang, D., Wang, Y., Gao, S., & Engel, A. K.
  
• (2011). Multimodal integration processes in plan-based service robot control. Tsinghua Science & Technology, 16(1), 1-6
  Off, D., & Jianwei, Z.
  
• (2011). Open-ended domain model for continual forward search HTN planning. In KEPS, 85
  Off, D., & Zhang, J.
  
• (2011). Processing of facial expressions and their significance for the observer in subregions of the human amygdala. Neuroimage, 56(1), 299-306
  Boll, S., Gamer, M., Kalisch, R., & Büchel, C.
  
• (2011). Reducing the spatial distance between printed and online information sources by means of mobile technology enhances learning: Using 2D barcodes. Computers & Education, 57(3), 2077-2085
  Ozcelik, E., & Acartürk, C.
  
• (2011). Reward-driven learning of sensorimotor laws and visual features. In proceedings of 2011 IEEE International Conference on Development and Learning (ICDL), 2 (pp. 1-6). IEEE
  Kleesiek, J., Engel, A. K., Weber, C., & Wermter, S.
  
• (2011). Suboptimal Auditory Dominance in Audiovisual Integration of Temporal Cues. Tsinghua Science & Technology, 16(2): 121-132
  Maiworm, M., & Röder, B.
  
• (2011). Tactile recalibration of auditory spatial representations. Experimental brain research, 209(3), 333-344
  Bruns, P., Spence, C., & Röder, B.
  
• (2011). The Use of Sketch Maps as Measures for Spatial Knowledge. In Understanding and Processing Sketch Maps–Proceedings of the COSIT 2011 Workshop (pp. 45-54)
  Lohmann, K.
  
• (2012). A haptic-audio interface for acquiring spatial knowledge about apartments. In International Conference on Haptic and Audio Interaction Design (pp. 21-30). Springer Berlin Heidelberg
  Yu, J., & Habel, C.
  
• (2012). A hierarchical model incorporating segmented regions and pixel descriptors for video background subtraction. IEEE Transactions on Industrial Informatics, 8(1), 118-127
  Chen, S., Zhang, J.H., Li, Y., & Zhang, J.
  
• (2012). A SOM-based model for multi-sensory integration in the superior colliculus. In 2012 international joint conference on Neural Networks (IJCNN), (pp. 1-8). IEEE
  Bauer, J., Weber, C., & Wermter, S.
  
• (2012). Action-driven perception for a humanoid. In International Conference on Agents and Artificial Intelligence (pp. 83-99). Springer Berlin Heidelberg
  Kleesiek, J., Badde, S., Wermter, S., & Engel, A. K.
  
• (2012). An architecture for incremental information fusion of cross-modal representations. In 2012 IEEE Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI), (pp. 498-503). IEEE
  Baumgärtner, C., Beuck, N., & Menzel, W.
  
• (2012). Audiotactile integration is reduced in congenital blindness in a spatial ventriloquism task.Neuropsychologia, 50(1), 36-43
  Occelli, V., Bruns, P., Zampini, M., & Röder, B.
  
• (2012). Biomimetic binaural sound source localisation with ego-noise cancellation. In International Conference on Artificial Neural Networks (pp. 239-246). Springer Berlin Heidelberg
  Dávila-Chacón, J., Heinrich, S., Liu, J., & Wermter, S.
  
• (2012). Constructing dynamic category hierarchies for novel visual category discovery. In proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2 (pp. 2122-2127). IEEE
  Zhang, J.H., Zhang, J., Chen, S., Hu, Y., & Guan, H.
  
• (2012). Cortical thickness is linked to executive functioning in adulthood and aging. Human brain mapping, 33(7), 1607-1620
  Burzynska, A. Z., Nagel, I. E., Preuschhof, C., Gluth, S., Bäckman, L., Li, S. C., ...& Heekeren, H. R.
  
• (2012). Deciding when to decide: time-variant sequential sampling models explain the emergence of value-based decisions in the human brain. Journal of Neuroscience, 32(31), 10686-10698
  Gluth, S., Rieskamp, J., & Büchel, C.
  
• (2012). Don’t look back in anger! Responsiveness to missed chances in successful and nonsuccessful aging. Science, 336(6081), 612-614
  Brassen, S., Gamer, M., Peters, J., Gluth, S., & Büchel, C.
  
• (2012). Extended verbal assistance facilitates knowledge acquisition of virtual tactile maps. In International Conference on Spatial Cognition (pp. 299-318). Springer Berlin Heidelberg
  Lohmann, K., & Habel, C.
  
• (2012). Eye tracking in multimodal comprehension of graphs. In Proceedings of the Workshop on Technology-Enhanced Diagrams Research (Vol. 887, pp. 11-25)
  Acartürk, C., & Habel, C.
  
• (2012). Functionally specific oscillatory activity correlates between visual and auditory cortex in the blind. Brain, 135(3), 922-934
  Schepers, I. M., Hipp, J. F., Schneider, T. R., Röder, B., & Engel, A. K.
  
• (2012). Generating situated assisting utterances to facilitate tactile-map understanding: A prototype system. In Proceedings of the Third Workshop on Speech and Language Processing for Assistive Technologies (pp. 56-65). Association for Computational Linguistics
  Lohmann, K., Eichhorn, O., & Baumann, T.
  
• (2012). Gestures in Communication through Line Graphs. In Proceedings of the Annual Meeting of the Cognitive Science Society, 34
  Acartürk, C., & Alaçam, Ö.
  
• (2012). Gonadotrope plasticity at cellular and population levels. Endocrinology, 153(10), 4729-4739
  Alim, Z., Hartshorn, C., Mai, O., Stitt, I., Clay, C., Tobet, S., & Boehm, U.
  
• (2012). Grasping semantic information with and without vision. Journal of Vision, 12(9), (pp. 1036-1036)
  Floß, C., & Franz, V. H.
  
• (2012). Hierarchical Plan-Based Control in Open-Ended Environments: Considering Knowledge Acquisition Opportunities. In International Conference on Agents and Artificial Intelligence (pp. 25-38). Springer Berlin Heidelberg
  Off, D., & Zhang, J.
  
• (2012). Integrating a Model for Visual Attention into a System for Natural Language Parsing. In Proceedings of the 9th International Workshop on Natural Language Processing and Cognitive Science-NLPCS, (pp. 24–33)
  Baumgärtner, C., & Menzel, W.
  
• (2012). Neuronal assembly models of compositionality. M. Werning, W. Hinzen, and E. Machery (eds.): The Oxford Handbook of Compositionality, 30, 616–632, Oxford University Press: Oxford
  Maye, A., & Engel, A. K.
  
• (2012). Points, lines and arrows in statistical graphs. In proceedings of International Conference on Theory and Application of Diagrams (pp. 95-101). Springer Berlin Heidelberg
  Acartürk, C.
  
• (2012). Preparatory motor signals can be used to track the emergence of value-based decisions in the human brain. In proceedings of the Annual Meeting of the Society for Neuroscience, New Orleans, USA
  Gluth, S.
  
• (2012). Referring expressions in communication through line graphs: A comparative analysis of verbal descriptions. In Workshop on Discourse Structure in Turkic Languages, ICTL
  Acartürk, C.
  
• (2012). Single-drop optimization of protein crystallization. Acta Crystallographica Section F: Structural Biology and Crystallization Communications, 68(8), 994-998
  Meyer, A., Dierks, K., Hilterhaus, D., Klupsch, T., Mühlig, P., Kleesiek, J., ... & Betzel, C.
  
• (2012). Smoke and mirrors—virtual realities for sensor fusion experiments in biomimetic robotics. In IEEE Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI), (pp. 114-119). IEEE
  Bauer, J., Dávila-Chacón, J., Strahl, E., & Wermter, S.
  
• (2012). Time scales of sensorimotor contingencies. In International Conference on Brain Inspired Cognitive Systems, 7366, 240-249. Springer Berlin Heidelberg
  Maye, A., & Engel, A. K.
  
• (2012). Touch Remapping is Automatic But Top-Down Modulated. Program No. 260.10. Neuroscience
  Badde, S., Heed, T., & Röder, B.
  
• (2012). Towards building a corpus of Turkish referring expressions. In Proc. 1st Workshop on Language Resources and Technologies for Turkic Languages (pp. 1-5)
  Acartürk, C., & Çakır, M. P.
  
• (2012). Using sensorimotor contingencies for prediction and action planning. In International Conference on Simulation of Adaptive Behavior, 7426, 106-116. Springer Berlin Heidelberg
  Maye, A., & Engel, A. K.
  
• (2012). Using sensorimotor contingencies for terrain discrimination and adaptive walking behavior in the quadruped robot puppy. In International Conference on Simulation of Adaptive Behavior, 7426, 54-64. Springer Berlin Heidelberg
  Hoffmann, M., Schmidt, N. M., Pfeifer, R., Engel, A. K., & Maye, A.
  
• (2012). Verbally assisted virtual-environment tactile maps: a prototype system. In Proceedings of the Workshop on Spatial Knowledge Acquisition with Limited Information Displays (pp. 25-30)
  Lohmann, K., Kerzel, M., & Habel, C.
  
• (2012). When emotional valence modulates audiovisual integration. Attention, Perception, & Psychophysics, 74(6): 1302-1311
  Maiworm, M., Bellantoni, M., Spence, C., & Röder, B.
  
• (2012, Jun 18-22). Integration of Semantic and Visual Information in Grasping. In proceedings of the Joint Workshop of the German Research Training Groups in Computer Science, Dagstuhl, Germany
  Floß, C. & Franz, V.
  
• Work in Progress: Annotating Gestures in Communication through Graphs. Organising Committee, (pp. 5-7)
  Alaçam, Ö., & Acartürk, C.
  
• (2013 May 27-29). Grasping based on semantic information does not obey Weber's law. In proceedings of the Joint Workshop of the German Research Training Groups in Computer Science, Dagstuhl, Germany
  Floß, C. & Franz, V.
  
• (2013) Eye voice span in agglutinative languages: A case study in Turkish. Abstracts of the 17th European Conference on Eye Movements, (pp. 340), Lund, Sweden
  Acartürk C. & Turan, S.
  
• (2013), Using Sonification and Haptics to Represent Overlapping Spatial Objects: Effects on Accuracy. In 7th International Conference on Universal Access in Human-Computer Interaction (pp. 602-611). Springer Berlin Heidelberg
  Yu, J., Lohmann, K. & Habel, C.
  
• (2013). Altered intrinsic neuronal interactions in the visual cortex of the blind. Journal of Neuroscience, 33(43), 17072-17080
  Hawellek, D. J., Schepers, I. M., Roeder, B., Engel, A. K., Siegel, M., & Hipp, J. F.
  
• (2013). Classic EEG motor potentials track the emergence of value-based decisions. Neuroimage, 79, 394-403
  Gluth, S., Rieskamp, J., & Büchel, C.
  
• (2013). Cohesion in multimodal documents: Effects of cross-referencing. Information Design Journal, 20(2), 98-110
  Acartürk, C., Taboada, M. & Habel, C.
  
• (2013). Context-dependent dynamic weighting of information from multiple sensory modalities. In 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), (pp. 2812-2818). IEEE
  Maye, A., & Engel, A. K.
  
• (2013). Deciding not to decide: computational and neural evidence for hidden behavior in sequential choice.PLoS Comput Biol, 9(10), e1003309
  Gluth, S., Rieskamp, J., & Büchel, C.
  
• (2013). Discover novel visual categories from dynamic hierarchies using multimodal attributes. IEEE Transactions on Industrial Informatics, 9(3), 1688-1696
  Zhang, J.H., Zhang, J., & Chen, S.
  
• (2013). Evaluating Supervised Semantic Parsing Methods on Application-Independent Data. In Student Sessions at the European Summer School in Logic, Language and Information (pp. 19-25). Springer Berlin Heidelberg
  Beschke, S.
  
• (2013). Extending sensorimotor contingency theory: prediction, planning, and action generation. Adaptive Behavior, 21(6), 423-436
  Maye, A., & Engel, A. K.
  
• (2013). Gesture and Language Production in Communication through Bar Graphs. In CogSci, 1714-1719
  Alaçam, Ö., Habel, C., & Acartürk, C.
  
• (2013). Investigation of haptic line-graph comprehension through co-production of gesture and language. In Tilburg Gesture Research Meeting, Tilburg
  Alaçam, Ö., Habel, C., & Acartürk, C.
  
• (2013). Laminar profile of visual response properties in ferret superior colliculus. Journal of neurophysiology, 110(6), 1333-1345
  Stitt, I., Galindo-Leon, E., Pieper, F., Engler, G., & Engel, A. K.
  
• (2013). Learning multi-sensory integration with self-organization and statistics. In Ninth international workshop on neural-symbolic learning and reasoning NeSy (Vol. 13, pp. 7-12)
  Bauer, J., & Wermter, S.
  
• (2013). Modeling body posture effects on reference frame integration. Multisensory Research, 26, 8-8
  Badde, S., Heed, T., & Roeder, B.
  
• (2013). Multiview triangulation with uncertain data. In 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO), (pp. 1414-1419). IEEE
  Zhang, L., Zhang, J.H, Chen, B., Lu, Z., Hu, Y., & Zhang, J.
  
• (2013). Neural and statistical processing of spatial cues for sound source localisation. In The 2013 International Joint Conference on Neural Networks (IJCNN), (pp. 1-8). IEEE
  Dávila-Chacón, J., Magg, S., Liu, J., & Wermter, S.
  
• (2013). Noise alters beta-band activity in superior temporal cortex during audiovisual speech processing. Neuroimage, 70, 101-112
  Schepers, I. M., Schneider, T. R., Hipp, J. F., Engel, A. K., & Senkowski, D.
  
• (2013). Predictive incremental parsing and its evaluation. In Kim Gerdes, Eva Hajičová, Leo Wanner, editors, Computational Dependency Theory, Frontiers in Artificial Intelligence and Applications
  Beuck, N., Köhn, A., & Menzel, W.
  
• (2013). Self-Organized Neural Learning of Statistical Inference from High-Dimensional Data. In IJCAI
  Bauer, J., & Wermter, S.
  
• (2013). Separate amygdala subregions signal surprise and predictiveness during associative fear learning in humans. European Journal of Neuroscience, 37(5), 758-767
  Boll, S., Gamer, M., Gluth, S., Finsterbusch, J., & Büchel, C.
  
• (2013). Spatial remapping in the audio-tactile ventriloquism effect: a TMS investigation on the role of the ventral intraparietal area. Journal of cognitive neuroscience, 25(5), 790-801
  Renzi, C., Bruns, P., Heise, K. F., Zimerman, M., Feldheim, J. F., Hummel, F. C., & Röder, B.
  
• (2013). Structural prediction in incremental dependency parsing. In International Conference on Intelligent Text Processing and Computational Linguistics (pp. 245-257). Springer Berlin Heidelberg
  Beuck, N., & Menzel, W.
  
• (2013). The Role of Visual Coherence in Graphical Passwords. Np, nd Web, 10 (pp. 1774-1779)
  Aydın, Ü. A., Acartürk, C., & Çağıltay, K.
  
• (2013). Three-dimensional point cloud plane segmentation in both structured and unstructured environments. Robotics and Autonomous Systems, 61(12), 1641-1652
  Xiao, J., Zhang, J.H,. Adler, B., Zhang, H., & Zhang, J.
  
• (2013). Touch localization under coordinate conflict. In Meeting of the German neuroscience society, Goettingen, Germany
  Badde, S., Heed, T. & Röder, B.
  
• (2013). Towards designing audio assistance for comprehending haptic graphs: a multimodal perspective. In International Conference on Universal Access in Human-Computer Interaction, (pp. 409-418). Springer Berlin Heidelberg
  Alaçam, Ö., Habel, C., & Acartürk, C.
  
• (2013). Verbally assisted comprehension of haptic linegraphs: referring expressions in a collaborative activity. In Proceedings of the CogSci 2013 workshop on production of referring expressions, Berlin
  Habel, C., Alaçam, Ö., & Acartürk, C.
  
• (2013). Verbally assisted comprehension of haptic linegraphs: referring expressions in a collaborative activity. In Proceedings of the CogSci 2013 workshop on production of referring expressions, Berlin
  Habel, C., Alaçam, Ö., & Acartürk, C.
  
• (2013). Visual Object recognition through sensorimotor contingencies, Beijing SummerSchool
  Skoruppa, S. Engel, A.K. & Maye, A.
  
• (2013). Where's the action? The pragmatic turn in cognitive science. Trends in cognitive sciences, 17(5), 202-209
  Engel, A. K., Maye, A., Kurthen, M., & König, P.
  
• (2013, June 16-20). Electrocorti-cography of visual cortex responses to multisensory speech. Annual Meeting of the Organization for Human Brain Mapping Seattle, USA
  Schepers, I. M. Sun, P. Pei, X. Baum, S.H. Yoshor, D. & Beauchamp, M. S.
  
• (2013, May 27-29). Statistical Semantic Parsing on Wide-Domain Data. In proceedings of the 7th Joint Workshop of the German Research Training Groups in Computer Science, p. 64, Schloss Dagstuhl
  Beschke, S.
  
• (2013, May 27-29). The Influence of Pre-Stimulus Oscillatory Brain States on Pain Perception. Proceedings of the 7th Joint Workshop of the German Research Training Groups in Computer Science, Dagstuhl, Germany
  Taesler, P.
  
• (2013, October 13-17). Auditory speech diminishes gamma-band responses in visual cortex to visual speech. Society for Neuroscience Meeting, New Orleans, USA
  Schepers, I. M. Sun, P. Pei, X. Baum, S.H. Yoshor, D. & Beauchamp, M. S.
  
• Micro-analysis of referring expressions in a dual eye tracking paradigm: Two case studies on voice and chat mediated interaction. In Proceedings of the CogSci 2013 Workshop on Production of Referring Expressions
  Çakır, M. P., & Acartürk, C.
  
• (2014). Because size does matter: The Hamburg dependency treebank. In ELRA 2014 - Language Resources and Evaluation Conference 2014 European Language Resources Association
  Foth, K., Köhn, A., Beuck, N., & Menzel, W.
  
• (2014). Brain potentials reveal audiovisual integration in bilinguals on arithmetic fact retrieval. In 2014 International Conference on Multisensor Fusion and Information Integration for Intelligent Systems (MFI), (pp. 1-6). IEEE
  Zhang, L., Martínez, A., & Salillas, E.
  
• (2014). Cognitive and neural mechanisms of memory-based preferential choices. In proceedings of the Meeting of the Deutsche Gesellschaft für Psychologie (German Psychological Society), Bochum, Germany
  Gluth, S., Sommer T., Rieskampa J. & Büchel C.
  
• (2014). Compounding local invariant features and global deformable geometry for medical image registration. PloS one, 9(8), e105815
  Zhang, J.H, Chen, L., Wang, X., Teng, Z., Brown, A. J., Gillard, J. H., ... & Chen, S.
  
• (2014). Deciding not to decide: cognitive modeling and EEG reveal a hidden choice process. In proceedings of the Bernoulli Workshop in Economics and Psychology, University of Basel, Switzerland
  Gluth, S.
  
• (2014). Developing a verbal assistance system for line graph comprehension. In International Conference of Design, User Experience, and Usability (pp. 373-382). Springer International Publishing
  Acartürk, C., Alaçam, Ö., & Habel, C.
  
• (2014). Development of the spatial coding of touch: ability vs. automaticity. Developmental science, 17(6), 944-945
  Röder, B., Heed, T., & Badde, S.
  
• (2014). Extending Constraint Satisfaction for better Language Processing, Chapter II.6. In: Constrains and Language. Blache, P., et al. (Editors). Cambridge Scholars Publishing
  Foth, K., McCrae, P., & Menzel, W.
  
• (2014). Hierarchical mergence approach to cell detection in phase contrast microscopy images. Computational and mathematical methods in medicine
  Chen, L., Zhang, J.H, Chen, S., Lin, Y., Yao, C., & Zhang, J.
  
• (2014). Ilastik for multi-modal brain tumor segmentation. In proceedings of MICCAI 2013 Challenge on Multimodal Brain Tumor Segmentation (BRATS)
  Kleesiek, J., Biller, A., Urban, G., Kothe, U., Bendszus, M., & Hamprecht, F.
  
• (2014). Image quality assessment based on structural saliency. In 19th International Conference on Digital Signal Processing (DSP), (pp. 492-496). IEEE
  Zhang, Z., Zhang, J.H, Wang, X., Guan, Q., & Chen, S.
  
• (2014). Improving Humanoid Robot Speech Recognition with Sound Source Localisation. In International Conference on Artificial Neural Networks (pp. 619-626). Springer International Publishing
  Dávila-Chacón, J., Twiefel, J., Liu, J., & Wermter, S.
  
• (2014). In-hand haptic perception in dexterous manipulations. Science China Information Sciences, 57(12), 1-11
  He, J., & Zhang, J.
  
• (2014). Large-scale CCG Induction from the Groningen Meaning Bank. In Proc. ACL 2014 Workshop on Semantic Parsing, (pp. 12-16)
  Beschke, S., Liu, Y., & Menzel, W.
  
• (2014). Multi-modal brain tumor segmentation using deep convolutional neural networks. In proceedings of MICCAI BraTS (Brain Tumor Segmentation) Challenge. Winning Contribution, (pp. 31-35)
  Kopiske, K. K., Urban, G., Bendszus, M., Hamprecht, F., & Kleesiek, J.
  
• (2014). Multimodal Mixed Conditional Random Field Model for Category-Independent Object Detection. In Foundations and Practical Applications of Cognitive Systems and Information Processing (pp. 629-641). Springer Berlin Heidelberg
  Zhang, J.H., Zhang, J. W., Chen, S. Y., & Hu, Y.
  
• (2014). Multimodal spatial calibration for accurately registering EEG sensor positions. Computational and mathematical methods in medicine. Comput Math Methods Med. 2014;2014:826019
  Zhang, J.H, Chen, J., Chen, S., Xiao, G., & Li, X.
  
• (2014). Multiple spatial representations determine touch localization on the fingers. Journal of Experimental Psychology: Human Perception and Performance, 40(2), 784
  Badde, S., Röder, B., & Heed, T.
  
• (2014). Neural evidence for adaptive strategy selection in value-based decision-making. Cerebral cortex, 24, 2009– 2021
  Gluth, S., Rieskamp, J., & Büchel, C.
  
• (2014). Neural Sound Source Localisation for Speech Processing Based on the Inferior Colliculus. In proceedings of the Joint Workshop of the German Research Training Groups in Computer Science
  Davila-Chacon, J.
  
• (2014). Perspective alignment during the course of verbally assisted haptic graph comprehension. In the online Proceedings of the RefNet Workshop
  Alaçam, Ö., Habel, C., & Acartürk, C.
  
• (2014). Predictors for threshold-level pain perception in pre-stimulus oscillatory brain activity. In proceedings of Organization for Human Brain Mapping annual meeting, Hamburg, Germany
  Taesler P. & Rose M.
  
• (2014). Processing load impairs coordinate integration for the localization of touch. Attention, Perception, & Psychophysics, 76(4), 1136-1150
  Badde, S., Heed, T., & Röder, B.
  
• (2014). Producing verbal descriptions for haptic line-graph explorations. In Proceedings of the 18th Workshop on the Semantics and Pragmatics of Dialogue. SemDial (pp. 205-207)
  Kerzel, M., Alaçam, Ö., Habel, C., & Acartürk, C.
  
• (2014). Push resistance in in-hand manipulation. In proceedings of IROS 2014 - IEEE International Conference on Intelligent Robots and Systems (pp. 2488-2493)
  He, J., & Zhang, J.
  
• (2014). Referring expressions in discourse about haptic line graphs. In Proceedings of the 18th Workshop on the Semantics and Pragmatics of Dialogue. SemDial (pp. 7-16)
  Alaçam, Ö., Acartürk, C., & Habel, C.
  
• (2014). Reinforcement learning signals of social influence on human decision-making. In proceedings of the Bernstein Conference of Computational Neuroscience, Göttingen, Germany
  Zhang L. & Gläscher J.
  
• (2014). Reward expectation influences audiovisual spatial integration. Attention, Perception, & Psychophysics, 76(6), 1815-1827
  Bruns, P., Maiworm, M. & Röder, B.
  
• (2014). Reward expectation influences audiovisual spatial integration. Attention, Perception, & Psychophysics, 76(6): 1815-1827
  Bruns, P., Maiworm, M., & Röder, B.
  
• (2014). Tactile acuity charts: A reliable measure of spatial acuity. PloS one, 9(2), e87384
  Bruns, P., Camargo, C. J., Campanella, H., Esteve, J., Dinse, H. & Röder, B.
  
• (2014). The IRIS Project: a liaison between industry and academia towards natural multimodal communication. In Proceedings of Iberspeech, Las Palmas de Gran Canaria, Spain, (pp. 338-347)
  Freitas, J., Candeias, S., Dias, M. S., Lleida, E., Ortega, A., Teixeira, A., lva, S. Acartürk, C., & Orvalho, V.
  
• (2014). Top-down controlled integration of tactile reference frames. In Conference of Experimental Psychologists, Giessen, Germany
  Badde, S., Heed, T. & Röder, B.
  
• (2014). Towards a systematic understanding of graphical cues in communication through statistical graphs. Journal of Visual Languages & Computing, 25(2), 76-88
  Acartürk, C.
  
• (2014). Using Cross-Modal Context for Diagnosing Language Learner Errors. In proceedings of the 8th Joint Workshop of the German Research Training Groups in Computer Science, (pp. 26), Schloss Dagstuhl
  Köhn C.
  
• (2014). Verbally Assisting Virtual-Environment Tactile Maps: A Cross-Linguistic and Cross-Cultural Study. In Foundations and Practical Applications of Cognitive Systems and Information Processing (pp. 821-831). Springer Berlin Heidelberg
  Lohmann, K., Yu, J., Kerzel, M., Wang, D., & Habel, C.
  
• (2014). Violation of Weber's law in grasping is independent of the availability of visual information. In TeaP 2014 - 56th Conference of Experimental Psychologists
  Floß-Löwenkamp,C., Gaertner,W., & Franz, V.
  
• (2014). What to do first: the initial behavior in a multi-sensory household object recognition and categorization system. In 2014 International Conference on Multisensor Fusion and Information Integration for Intelligent Systems (MFI), (pp. 1-6). IEEE
  Guan, H., He, W., & Zhang, J.
  
• (2014, Jun 15-18). Multimodal integration in grasping. In proceedings of the 8th Joint Workshop of the German Research Training Groups in Computer Science, Dagstuhl, Germany
  Floß-Löwenkamp, C. Sun, F. & Franz, V.
  
• (2014, Jun 16-18). Spatial number representation depends on both semantic and visual properties of numbers. In proceedings of the 8th Joint Workshop of the German Research Training Groups on Computer Science, Dagstuhl, Germany
  K. K. Kopiske, Sun, F., & Franz, V. H.
  
• (2014, June 15-18). Efficient Grammar Induction for Wide-coverage Semantic Parsing. In proceedings of the 8th Joint Workshop of the German Research Training Groups in Computer Science, Schloss Dagstuhl
  Beschke, S.
  
• (2014, June 15-18). Ongoing oscillatory brain activity in pain perception. Proceedings of the 8th Joint Workshop of the German Research Training Groups in Computer Science, Dagstuhl, Germany
  Taesler, P.
  
• (2014, June 8-12). Posterior superior temporal cortex differentially responds to clear and noisy audiovisual speech. Annual Meeting of the Organization for Human Brain Mapping, Hamburg
  Schepers, I. M. Yoshor, D. & Beauchamp, M. S.
  
• (2014, September 3-12). Brain-Computer-Interfaces in pain management. 9th International CINACS Summer School, Hamburg, Germany
  Taesler, P.
  
• (2015). Attention modeled as information in learning multisensory integration. Neural Networks, 65, 44-52
  Bauer, J., Magg, S., & Wermter, S.
  
• (2015). Auditory and visual interactions between the superior and inferior colliculi in the ferret. European Journal of Neuroscience, 41(10), 1311-1320
  Stitt, I., Galindo-Leon, E., Pieper, F., Hollensteiner, K. J., Engler, G., & Engel, A. K.
  
• (2015). Crutchfield Information Metric for Quantifying the Inter-sequence Relationship of Multiparametric MRI Data. In BIOIMAGING (pp. 5-12)
  Kleesiek, J., Biller, A., & Ueltzhöffer, K.
  
• (2015). Crutchfield Information Metric: A Valid Tool for Quality Control of Multiparametric MRI Data?. In International Joint Conference on Biomedical Engineering Systems and Technologies (pp. 113-125). Springer International Publishing
  Kleesiek, J., Biller, A., Bartsch, A. J., & Ueltzhöffer, K.
  
• (2015). Effective connectivity between hippocampus and ventromedial prefrontal cortex controls preferential choices from memory. Neuron, 86(4), 1078-1090
  Gluth, S., Sommer, T., Rieskamp, J., & Büchel, C.
  
• (2015). Electrocorticography reveals enhanced visual cortex responses to visual speech. Cerebral Cortex, 25(11), 4103-4110
  Schepers, I. M., Yoshor, D., & Beauchamp, M. S.
  
• (2015). Feature quantification and abnormal detection on cervical squamous epithelial cells. Computational and mathematical methods in medicine, 2015
  Zhao, M., Chen, L., Bian, L., Zhang, J.H, Yao, C., & Zhang, J.
  
• (2015). Filling decision variables with life: the case of memory-based preferential choice. In proceedings of the Computational and Systems Neuroscience Workshop (Cosyne), Snowbird, USA
  Gluth, S.
  
• (2015). Flexibly weighted integration of tactile reference frames. Neuropsychologia, 70, 367-374
  Badde, S., Röder, B., & Heed, T.
  
• (2015). Gesture Production under Instructional Context: The Role of Mode of Instruction. In CogSci.
  Coskun, M., & Acartürk, C.
  
• (2015). Goal-and retrieval-dependent activity in the striatum during memory recognition. Neuropsychologia, 72, 1-11
  Clos, M., Schwarze, U., Gluth, S., Bunzeck, N., & Sommer, T.
  
• (2015). Haptic and visual perception in in-hand manipulation system. In 2015 IEEE International Conference on Robotics and Biomimetics (ROBIO), (pp. 303-308). IEEE
  He, J., Pu, S., & Zhang, J.
  
• (2015). Haptic exploration patterns in virtual line-graph comprehension. In International Conference of Design, User Experience, and Usability (pp. 403-414). Springer International Publishing
  Alaçam, Ö., Acartürk, C., & Habel, C.
  
• (2015). Intrinsic coupling modes reveal the functional architecture of cortico-tectal networks. Science advances, 1(7), e1500229
  Stitt, I., Galindo-Leon, E., Pieper, F., Engler, G., Fiedler, E., Stieglitz, T., & Engel, A. K.
  
• (2015). Isogeometric analysis for cardiac modeling and mechanical analysis. In proceedings of 2015 IEEE International Conference on Robotics and Biomimetics (ROBIO), (pp. 893-898). IEEE
  Guan, Q., Liu, Q., Yin, H., Zhang, J.H, & Hu, H.
  
• (2015). Modeling development of natural multi-sensory integration using neural self-organisation and probabilistic population codes. Connection Science, 27(4), 358-376
  Bauer, J., Dávila-Chacón, J., & Wermter, S.
  
• (2015). Modeling social influence on human decision-making with reinforcement learning theory: A Bayesian perspective. In proceedings of the Society for Neuroscience Annual meeting (SfN 2015), Chicago, IL, USA
  Zhang L. & Gläscher J.
  
• (2015). Modeling social influence on human decision-making. In proceedings of the 57th Conference of Experimental Psychologists (TeaP), Hildesheim, Germany
  Zhang L. & Gläscher J.
  
• (2015). Multimodal object recognition from visual and audio sequences. In 2015 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI), (pp. 133-138). IEEE
  He, W., Guan, H., & Zhang, J.
  
• (2015). Read that article: Exploring synergies between gaze and speech interaction. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility (pp. 341-342). ACM
  Vieira, D., Freitas, J. D., Acartürk, C., Teixeira, A., Sousa, L., Silva, S., & Dias, M. S.
  
• (2015). Semantic grasping escapes Weber's law. Neuropsychologia, 70, 235-245
  Löwenkamp, C., Gärtner, W., Haus, I. D., & Franz, V. H.
  
• (2015). Sensory recalibration integrates information from the immediate and the cumulative past. Scientific reports, 5, 12739
  Bruns, P., & Röder, B.
  
• (2015). Switching reference frame preferences during verbally assisted haptic graph comprehension. Cognitive processing, 16(1), 115-119
  Alaçam, Ö., Habel, C., & Acartürk, C.
  
• (2015). The role of auditory cortex in the audiovisual ventriloquist aftereffect. In Society for Neuroscience Annual Meeting
  Zierul, B., Röder,B., Tempelmann, C., Bruns, P., & Noesselt, T.
  
• (2015). The role of auditory cortex in the audiovisual ventriloquist aftereffect. NeuroImage, 162, 257-268
  Zierul, B., Röder,B., Tempelmann, C., Bruns, P., & Noesselt, T.
  
• (2015). The SNARC effect and visual and semantic features of Chinese numerals. Journal of vision 15(12), 910-910
  Kopiske, K. K., Löwenkamp, C., Eloka, O., Schiller, F., Kao, C. S., Wu, C., Gao, X. & Franz, V.
  
• (2015). Towards Parsing Language Learner Utterances in Context. In GSCL (pp. 144-153).
  Köhn, C., & Menzel, W.
  
• (2015). Verbally Assisted Haptic Graph Comprehension: The Role of Taking Initiative in Joint Activity. In Proceedings of the 2nd European and the 5th Nordic Symposium on Multimodal Communication, (pp. 17-24). Linköping University Electronic Press, Tartu, Estonia
  Alaçam, Ö., Habel, C., & Acartürk, C.
  
• (2015). What can explain illusion effects on grasping? A multi-lab preregistered study.In 57th Annual Meeting of the Psychonomic Society
  Kopiske, K. K., Bruno, N., Hesse, C., Schenk, T., & Franz, V. H.
  
• (2015, February 27). Oscillatory correlates of subjective pain perception. UKE Graduate Day, Hamburg, Germany
  Taesler, P. & Rose, M.
  
• (2015, November). Electrophysiological Recordings In Humans Implicate The Involvement Of The Centromedian-Parafascicular Complex In Speech And Non-Speech Cue Signaling. Brain States: Characterization and Neuromodulation by DBS. Cologne, Germany
  Schepers, I. M. Beck, A.-K. Bräuer, S. Schwabe, K. Lütjens, G. Krauss, J. K. & Rieger, J. W.
  
• Elderly speech-gaze interaction: State of the art and challenges for interaction design. Access to Today's Technologies (UAHCI/HCII 2015) (pp. 3-12)
  Acartürk, C., Freitas, J., Fal, M., & Dias, M. S.
  
• Pre-stimulus EEG markers of subjective pain perception. In proceedings of the Society for Neuroscience meeting, Chicago, IL, US
  Taesler P. & Rose M.
  
• (2016). Bio-inspired Sound Source Localisation for Improving Robot Speech Recognition. In International Conference on Artificial Neural Networks
  Dávila-Chacón, J., Liu, J., & Wermter, S.
  
• (2016). Comparing the underlying process between intertemporal choice and risky choice. In proceedings of the 35th Annual Meeting of the European Group of Process Tracing Studies (EGPROC), Bonn, Germany
  Zhou L., Zhang L. & Liang Z. Y.
  
• (2016). DALSA: domain adaptation for supervised learning from sparsely annotated MR images. IEEE transactions on medical imaging, 35(1), 184-196
  Goetz, M., Weber, C., Binczyk, F., Polanska, J., Tarnawski, R., Bobek-Billewicz, B., Koethe, U. Kleesiek, J. Stieltjes B. & Maier-Hein, K. H.
  
• (2016). Deep MRI brain extraction: a 3D convolutional neural network for skull stripping. NeuroImage, 129, 460-469
  Kleesiek, J., Urban, G., Hubert, A., Schwarz, D., Maier-Hein, K., Bendszus, M., & Biller, A.
  
• (2016). Disentangling the External Reference Frames Relevant to Tactile Localization. PloS one, 11(7), e0158829
  Heed, T., Backhaus, J., Röder, B. and Badde, S.
  
• (2016). Evaluation of dose reduction potentials of a novel scatter correction software for bedside chest x-ray imaging. Radiation protection dosimetry, 169(1-4), 60-67
  Renger, B., Brieskorn, C., Toth, V., Mentrup, D., Jockel, S., Lohöfer, F., ... & Noël, P. B.
  
• (2016). Improved brain tumor classification by sodium MR imaging: prediction of IDH mutation status and tumor progression. American Journal of Neuroradiology, 37(1), 66-73
  Biller, A., Badde, S., Nagel, A., Neumann, J. O., Wick, W., Hertenstein, A., ... & Kleesiek, J.
  
• (2016). In-hand Manipulation with Fixed and Spring Support Fingers. In International Conference on Cognitive Systems and Signal Processing (pp. 366-381). Springer, Singapore
  He, J., Pu, S., & Zhang, J.
  
• (2016). Integration of anatomical and external response mappings explains crossing effects in tactile localization: A probabilistic modeling approach. Psychonomic bulletin & review, 23(2), 387-404
  Badde, S., Heed, T., & Röder, B.
  
• (2016). Interactions between reinforcement learning and decision making processes. In proceedings of the Meeting of the Deutsche Gesellschaft für Psychologie (German Psychological Society), Leipzig, Germany
  Gluth, S., Fontanesi, L., Spektor M. S., & Rieskamp J.
  
• (2016). Intertemporal choice and valuation are influenced by the attraction effect. In proceedings of the Annual Conference of the Society for Neuroeconomics, Miami, USA
  Gluth, S. & Rieskamp F.
  
• (2016). Iterative scatter correction for grid-less bedside chest radiography: performance for a chest phantom. Radiation protection dosimetry, 169(1-4), 308-312
  Mentrup, D., Jockel, S., Menser, B., & Neitzel, U.
  
• (2016). Landy. Effect of prior knowledge on visual localization of tactile stimulation. Journal of Vision, 16(12): 1190-1190
  Badde, S. & Oh, H.
  
• (2016). Manual estimation: Feedback affects bias but not precision. Journal of Vision, 16(12), 450-450
  Kopiske, K. K., Gornik, A., & Franz, V.
  
• (2016). Multi-sensory based novel household object categorization system by using interactive learning. In 2016 IEEE International Conference on Robotics and Biomimetics (ROBIO), (pp. 1685-1690). IEEE
  Guan, H.,& Zhang, J.
  
• (2016). Neural Responses to Speech-Specific Modulations Derived from a Spectro-Temporal Filter Bank. In INTERSPEECH, 1368-1372
  Frye, M., Micheli, C., Schepers, I. M., Schalk, G., Rieger, J. W., & Meyer, B. T.
  
• (2016). Objectness ranking by uniform Bayesian model with multimodal and global cues. IET Computer Vision, 10(7), 736-745
  Zhang, J.H, Xie, Z., Xiao, J., Chen, S., & Zhang, J.
  
• (2016). Oscillatory Dynamics in the Frontoparietal Attention Network during Sustained Attention in the Ferret. Cell reports, 16(11), 2864-2874
  Sellers, K. K., Yu, C., Zhou, Z. C., Stitt, I., Li, Y., Radtke-Schuller, S., ... & Fröhlich, F.
  
• (2016). Prestimulus theta oscillations and connectivity modulate pain perception. Journal of Neuroscience, 36(18), 5026-5033
  Taesler, P., & Rose, M.
  
• (2016). Psychopathic traits affect the visual exploration of facial expressions. Biological psychology, 117, 194-201
  Boll, S. & Gamer, M.
  
• (2016). Real-time face alignment enhancement by tracking. In 2016 IEEE International Conference on Robotics and Biomimetics (ROBIO), (pp. 1011-1016). IEEE
  Tang, F., Zhang, J.H, Feng, Y., Guan, Q., & Zhou, X.
  
• (2016). Revealing neuro-computational mechanisms of reinforcement learning and decision-making with the hBayesDM package. Computational Psychiatry, 1, 24-57
  Ahn, W. Y., Haines, N., & Zhang, L.
  
• (2016). Revealing neuro-computational mechanisms of reinforcement learning and decision-making with the hBayesDM package. In proceedings of the Annual Meeting of the Society for Mathematical Psychology, New Brunswick, NJ, USA
  Ahn, W. Y., Haines, N., & Zhang, L.
  
• (2016). Sodium MRI in Multiple Sclerosis is Compatible with Intracellular Sodium Accumulation and Inflammation-Induced Hyper-Cellularity of Acute Brain Lesions. Scientific Reports, 6 (31269)
  Biller, A., Pflugmann, I., Badde, S., Diem, R., Wildemann, B., Nagel, A. M., ... & Kleesiek, J.
  
• (2016). Task demands affect spatial reference frame weighting during tactile localization in sighted 0and congenitally blind adults. PloS one, 12(12), e0189067
  Schubert, J. TW, Badde, S., Röder, B. and Heed, T.
  
• (2016). The functional subdivision of the visual brain: Is there a real illusion effect on action? A multi-lab replication study. cortex, 79, 130-152
  Kopiske, K. K., Bruno, N., Hesse, C., Schenk, T., & Franz, V. H.
  
• (2016). The interplay of hippocampus and ventromedial prefrontal cortex in memory-based decision making. Brain sciences, 7(1), 4
  Weilbächer, R. A., & Gluth, S.
  
• (2016). The Sense of Agency Is More Sensitive to Manipulations of Outcome than Movement-Related Feedback Irrespective of Sensory Modality. PloS one,11(8), e0161156
  David, N., Skoruppa, S., Gulberti, A., Schultz, J., & Engel, A. K.
  
• (2016). The SNARC Effect in Chinese Numerals: Do Visual Properties of Characters and Hand Signs Influence Number Processing?.PloS one, 11(9), e0163897
  Kopiske, K. K., Löwenkamp, C., Eloka, O., Schiller, F., Kao, C. S., Wu, C., & Franz, V. H.
  
• (2016). Towards explaining spatial touch perception: Weighted integration of multiple location codes. Cognitive neuropsychology, 33(1-2), 26-47
  Badde, S., & Heed, T.
  
• (2016). Triggering the use of external space in congenitally blind individuals. In Annual meeting of The cognitive neuroscience society. New York City, USA
  Badde,S., Ley, P. & Röder, B.
  
• (2016). Variability in behavior that cognitive models do not explain can be linked to neuroimaging data. Journal of Mathematical Psychology, 76, 104-116
  Gluth, S., & Rieskamp, J.
  
• (2016). Virtual Raters for Reproducible and Objective Assessments in Radiology. Scientific Reports, 6, 25007
  Kleesiek, J., Petersen, J., Döring, M., Maier-Hein, K., Köthe, U., Wick, W. & Biller, A.
  
• (2016). Wiring the altruistic brain. Science, 351 (6277), 1028-1029
  Gluth, S.,& Fontanesi，L.
  
• (2016, January). Beta range responses in thalamic CM/Pf complex indicate a role in speech cue signaling. Speech in Noise Workshop (SpiN). Groningen, Netherlands
  Schepers, I. M. Beck, A.-K. Bräuer, S. Schwabe, K. Lütjens, G. Krauss, J.K. & Rieger, J.W.
  
• (2016, September 19-21). Parsing Free-Form Language Learner Data: Current State and Error Analysis (pp. 135-145), Bochum, Germany
  Köhn, C., Staron, T., & Köhn, A.
  
• (2017). A double dissociation between anterior and posterior superior temporal gyrus for processing audiovisual speech demonstrated by electrocorticography. J Cogn. Neurosci, 2:1-18
  Ozker, M., Schepers, I. M., Magnotti, J., Yoshor, D., & Beauchamp M. S.
  
• (2017). A Spatio-Temporal CRF for Human Interaction Understanding. IEEE Transactions on Circuits and Systems for Video Technology, 27(8), 1647-1660
  Wang, Z., Liu, S., Zhang, J.H, Chen, S., & Guan, Q.
  
• (2017). Do visual illusions affect grasping? Considerable progress in a scientific debate. A reply to Whitwell & Goodale, 2016. Cortex, 88, 210-215
  Kopiske, K. K., Bruno, N., Hesse, C., Schenk, T., & Franz, V. H.
  
• (2017). Dynamic reconfiguration of cortical functional connectivity across brain states. Scientific Reports, 7(1), 8797
  Stitt, I., Hollensteiner, K. J., Galindo-Leon, E., Pieper, F., Fiedler, E., Stieglitz, T., ... & Engel, A. K.
  
• (2017). Experience with crossmodal statistics reduces the sensitivity for audio-visual temporal asynchrony. Scientific reports, 7(1), 1486
  Habets, B., Bruns, P., & Röder, B.
  
• (2017). Human centromedian-parafascicular complex signals sensory cues for goal-oriented behavior selection. Neuroimage, 152, 390-399
  Schepers, I. M., Beck, A.K., Bräuer, S., Schwabe, K., Abdallat, M., Sandmann, P., Dengler, R., Rieger, J. W., & Krauss, J.K.
  
• (2017). Negation in gesture accompanying speech: A cross-modal study. Journal of Multimodal Communication Studies. Vol. 4, issue 1-2
  Alaçam Ö. & Habel, C.
  
• (2017). Psychophysically-anchored, Robust Thresholding in Studying Pain-related Lateralization of Oscillatory Prestimulus Activity. JoVE (Journal of Visualized Experiments), (119), e55228-e55228
  Taesler, P., & Rose, M.
  
• (2017). Secondary-Task Effects on Learning With Multimedia: An Investigation Through Eye-Movement Analysis. The Journal of Experimental Education, 85(1), 126-141
  Acartürk, C., & Ozcelik, E.
  
• (2017). The attraction effect modulates reward prediction errors and intertemporal choices. Journal of Neuroscience, 37(2), 371-382
  Gluth, S., Hotaling, J. & Rieskamp, J.
  
• (2018). Spreading inequality: neural computations underlying paying-it-forward reciprocity. Social Cognitive and Affective Neuroscience, 13(6), 578-589
  Hu, Y., He, L., Zhang, L., Wölk, T., Dreher, J.-C. & Weber, B.
  
• (2018). Zen and the Art of Making a Bayesian Espresso. Neuron, 98(6), 1066-1068
  Zhang, L., Redžepović, S., Rose, M. & Gläscher, J.