Performance Conscious HPC

• Applicants: Professor Dr. Thomas Ludwig; Professor Dr.-Ing. Stephan Olbrich; Professor Dr.-Ing. Matthias Riebisch (†)
• Subject Area: Data Management, Data-Intensive Systems, Computer Science Methods in Business Informatics ; Software Engineering and Programming Languages
• Term: from 2016 to 2020
• Project identifier: Deutsche Forschungsgemeinschaft (DFG) - Project number 320893435

• Final Report Year: 2020

Final Report Abstract

PeCoH has brought Hamburg HPC centers closer together. A broad range of topics was covered: improvement in scientific coding by employing: software engineering concepts and code co-development; raising performance awareness by modelling HPC usage cost and integration of cost-reports in the SLURM batch system; Hamburg HPC Competence Center (HHCC) was established. Most progress was made in certification and training: topics were structured in a skill tree; a framework for producing training material was developed; training material Getting started with HPC clusters was written; a Workshop on HPC Training, Education and Documentation was organized; as a spin-off the The HPC Certification Forum was founded, where development of the PeCoH skill tree is continued. Furthermore parallelization of R, Gaussian and MATLAB was studied and very interesting results were obtained with automatic software tuning: based on genetic algorithms; using a Black Box Optimizer (BBO).

Publications

• Towards an HPC Certification Program. In: Journal of Computational Science Education, 2019–01
  Julian Kunkel, Kai Himstedt, Nathanael Hübbe, Hinnerk Stüben, Sandra Schröder, Michael Kuhn, Matthias Riebisch, Stephan Olbrich, Thomas Ludwig, Weronika Filinger, Jean-Thomas Acquaviva, Anja Gerbes, Lev Lafayette
  (See online at https://doi.org/10.22369/issn.2153-4136/10/1/14)
• PeCoH – Performance Conscious HPC, FEPA Workshop “Job-specific Performance Monitoring”, RRZE Erlangen, 20 July 2017
  Hinnerk Stüben
  
• Performance Conscious HPC (PeCoH). Frankfurt, Germany, ISC High Performance 2017, 2017-06-20
  Julian Kunkel, Michael Kuhn, Thomas Ludwig, Matthias Riebisch, Stephan Olbrich, Hinnerk Stüben, Kai Himstedt, Hendryk Bockelmann, Markus Stammberger
  
• PeCoH – Raising Awareness for Costs and Performance, 7. HPC-Status-Konferenz der Gauß-Allianz, HLRS Stuttgart, 4 December 2018
  Nathanael Hübbe
  
• PeCoH — Performance Conscious HPC: Status, 8. HPC-Status-Konferenz der Gauß- Allianz, RRZE Erlangen, 9 October 2018
  J. Kunkel, K. Himstedt, N. Hübbe, S. Schröder, M. Kuhn, H. Stüben, T. Ludwig, S. Olbrich, M. Riebisch
  
• Performance Conscious HPC (PeCoH) — 201. Frankfurt, Germany, ISC High Performance 2018, 2018-06-26
  Kai Himstedt, Nathanael Hübbe, Sandra Schröder, Hendryk Bockelmann, Michael Kuhn, Julian Kunkel, Thomas Ludwig, Stephan Olbrich, Matthias Riebisch, Markus Stammberger, Hinnerk Stüben
  
• PeCoH — Performance Conscious HPC – Status 2019, 9. HPC-Status-Konferenz der Gauß-Allianz, PC2 Paderborn, 18 October 2019
  H. Stüben, K. Himstedt, N. Hübbe, S. Schöder, M. Kuhn, J. Kunkel, T. Ludwig, S. Olbrich, M. Riebisch
  
• PeCoH: HPC Skill Tree and Content Production Workflow, PeCoH workshop on HPC-Training, Education, and Documentation, RRZ Universität Hamburg, 31 July 2019
  K. Himstedt, N. Hübbe, S. Schröder, M. Kuhn, J. Kunkel, H. Stüben, T. Ludwig, S. Olbrich, M. Riebisch
  
• Performance Conscious HPC (PeCoH) — 2019. Frankfurt, Germany, ISC High Performance 2019, 2019-06-18
  Kai Himstedt, Nathanael Hübbe, Sandra Schröder, Hendryk Bockelmann, Michael Kuhn, Julian Kunkel, Thomas Ludwig, Stephan Olbrich, Matthias Riebisch, Markus Stammberger, Hinnerk Stüben
  
• Performance engineering in the PeCoH project, Performance Engineering Workshop, TU Dresden, 26 March 2019
  H. Stüben, K. Himstedt, N. Hübbe, S. Schröder, M. Kuhn, J. Kunkel, T. Ludwig, S. Olbrich, M. Riebisch
  
• The HPC Skill Tree – A Brief Overview, BoF: International HPC Certification Program, ISC 2019, Frankfurt, 18 June 2019
  Kai Himstedt