Adaptive, Distributed and Scalable Analysis of Massive Satellite Data (B05)

• Subject Area: Security and Dependability, Operating-, Communication- and Distributed Systems ; Data Management, Data-Intensive Systems, Computer Science Methods in Business Informatics ; Geodesy, Photogrammetry, Remote Sensing, Geoinformatics, Cartography
• Term: since 2020
• Project identifier: Deutsche Forschungsgemeinschaft (DFG) - Project number 414984028

Subproject B5 investigates means to improve adaptability and portability of DAWs for large-scale analysis of satellite data. DAWs for such problems are often long and involved and include tasks with very heterogeneous resource requirements (in terms of memory, runtime, and bandwidth). As the manner in which the concrete requirements of tools depend on the input data is a-priori unknown, these DAWs are very difficult to schedule. Today, this problem typically is solved by hardwiring data- and infrastructure dependent scheduling decisions into the DAW. B5 will research new methods for adaptive scheduling of DAWs that adapt to the concrete remote sensing scenario. It will work closely with A4, which also studies satellite data but with a focus on accuracy instead of scalability, and with B5 in the area of DAW scheduling. B5 is an interdisciplinary subproject, led by Prof. Hostert, expert in large-scale satellite data analysis, and Prof. Leser, an expert in workflow management systems for large-scale scientific data analysis.

• DFG Programme: Collaborative Research Centres
• Subproject of: SFB 1404: FONDA - Foundations of Workflows for Large-Scale Scientific Data Analysis
• Applicant Institution: Humboldt-Universität zu Berlin
• Project Heads: Professor Dr. Patrick Hostert; Professor Dr. Ulf Leser