Detailseite
Projekt
Audio-visual perception of acoustical environments
Antragsteller
Dr. Hans-Joachim Maempel
Fachliche Zuordnung
Akustik
Förderung
Förderung von 2011 bis 2020
Projektkennung
Deutsche Forschungsgemeinschaft (DFG) - Projektnummer 174776315
Acoustic research has largely ignored the mutual interdependence of the auditory and the visual modality a long time. The project experimentally investigates the particular contribution of the acoustical and optical stimulus component to important aspects of room perception. Recordings of both an artistic speech and a music performance were put in six existing concert/event halls the optical and acoustic data of which have been acquired beforehand, and presented as a 3D virtual environment. Subjects were asked to evaluate the scenes regarding auditory, visual, geometric and aesthetic aspects. By mutually independently varying the optical and the acoustic room or selected room property, main and potential interaction effects may be quantified. Experimental variations include structural and material variables (volume, shape, source-receiver distance, surface material), room acoustic variables (reverberation time, clarity index for music, lateral energy fraction), memory modality, completeness and dimensionality of the simulation of the optical sound source, and participants' experience and expertise. The potential bias introduced by the virtual environment was assessed by a comparison of real and simulated existing rooms.Collecting physical and perceptual measures at different stages of the perception process allows for the formation of an empirical model that predicts parameters of room perception from physical characteristics. Its structural relations and benchmarks which are expected to significantly contribute to the understanding of multimodal processes of perception, may also serve as criteria for the validation or interpretation of studies dealing with the perception of room acoustics under unimodal conditions, and are required for the extension and the refinement of simulation techniques as well as for the design of audio-visual environments.
DFG-Verfahren
Forschungsgruppen
