5D Adaptive Light Field Sampling (FiDALiS)

• Applicant: Professor Dr.-Ing. Thorsten Herfet
• Subject Area: Image and Language Processing, Computer Graphics and Visualisation, Human Computer Interaction, Ubiquitous and Wearable Computing
• Term: from 2019 to 2024
• Project identifier: Deutsche Forschungsgemeinschaft (DFG) - Project number 429078454

The dramatic increase in as well the spatial as the temporal resolution of current image sensors led to the desire to evolve the classical 2-dimensional (in case of motion pictures 3-dimensional) sampling raster, known and nearly unchanged since the time of the camera obscura. Light fields, which capture an excerpt of the plenoptic function, play a significant role in those developments. Such light fields are described by a 4-dimensional (in case of motion pictures 5-dimensional) sampling raster.The project aims at the ideal and dynamic adaptation of the 5-dimensional sampling raster to the content of the captured scene. All sensors resp. sensory systems have a limited data-rate (measured in rays / second) and hence the captured information content is highly dependent on the distribution of the rays over the 4 spatial plus the temporal coordinate. The project will fundamentally investigate and describe this adaptive 5-dimensional sampling. Restrictions founded in the physics of the underlying sensory system (typically rays can only be generated in groups and at discrete points in time) will be considered as constraints.

• DFG Programme: Research Grants