Enabling dynamic and intelligent workflows in the European HPC ecosystem

Share this on social media:

The eFlows4HPC project will create a European workflow platform for the design of complex applications that integrate HPC processes, data analytics, and artificial intelligence. 

Funded by the European High-Performance Computing Joint Undertaking (EuroHPC JU) and the participating states, and coordinated by the Barcelona Supercomputing Center (BSC). The project aims to demonstrate the novel technologies through use cases of three application pillars with high industrial and social relevance: manufacturing, climate, and urgent computing for natural hazards.

Nowadays, developers lack tools that enable the development of complex workflows involving HPC simulation and modelling with data analytics and machine learning. With an overall funding of €7,6M, eFlows4HPC aims to deliver a workflow software stack and an additional set of services for the integration of HPC simulation and modelling with big data analytics and machine learning, applied in scientific and industrial domains.

‘The eFlows4HPC workflow platform and software stack will enable the HPC resources in an efficient way with an emphasis on the accessibility and reusability of applications to reduce the time to solution’, said Rosa M Badia, eFlows4HPC project coordinator at BSC. ‘These new workflow technologies will widen access to HPC by selected user communities in industrial and social domains’, Badia added.

In order to achieve these goals, an ambitious and diverse group of partners came together from seven countries with expertise in different technical aspects: supercomputing and acceleration, workflow management and orchestration, numerical simulation, machine learning and big data analytics, data management and storage; topped with advanced skills in the pillar workflows’ areas of manufacturing, climate, and urgent computing for natural hazards.

eFlows4HPC is a European-funded project with a budget of €7.6M that started on 1 January 2021 and will last for three years. Coordinated by BSC (Spain), the project brings together a multidisciplinary consortium: CIMNE (Spain), FZJ (Germany), UPV (Spain), ATOS (France), DtoK Lab (Italy), CMCC (Italy), INRIA (France), SISSA (Italy), PSNC (Poland), UMA (Spain), AWI (Germany), INGV (Italy), ETHZ (Switzerland), Siemens (Germany), and NGI (Norway).

The eFlows4HPC project has received funding from the European High-Performance Computing Joint Undertaking (JU) under grant agreement No 955558. The JU receives support from the European Union’s Horizon 2020 research and innovation programme and Spain, Germany, France, Italy, Poland, Switzerland, Norway.