Carbon-aware Multi-Site Workflow Scheduling Under Uncertainty (B01)

• Subject Area: Data Management, Data-Intensive Systems, Computer Science Methods in Business Informatics
• Term: since 2020
• Project identifier: Deutsche Forschungsgemeinschaft (DFG) - Project number 414984028

In phase I of FONDA, we researched methods to schedule and execute DAWs across heterogeneous infrastructures for improving adaptability and portability. We developed profilers and micro-benchmarks that analyze the cluster infrastructure and expose those metrics to our map-ping and scheduling methods. Further, we designed a novel approach to provide runtime estimates without historical monitoring and new methods for mapping tasks to heterogeneous infra-structures. Yet, the global need to reduce carbon emissions calls for new and carbon-aware optimization when scheduling over multiple data centers. Thus, in phase II we research adaptive multi-center scheduling methods under uncertainty, focusing on carbon footprint minimization of scientific DAWs.

• DFG Programme: Collaborative Research Centres
• Subproject of: SFB 1404: FONDA - Foundations of Workflows for Large-Scale Scientific Data Analysis
• Applicant Institution: Humboldt-Universität zu Berlin
• Project Heads: Professor Dr. Odej Kao; Professor Dr. Henning Meyerhenke