HPC, Big Data & Data Science
Status update on EESSI, the European Environment for Scientific Software Installations
<p>A few years ago, the <a href="https://eessi.io/">European Environment for Scientific Software Installations</a> (EESSI) was <a href="https://archive.fosdem.org/2021/schedule/event/eessi/">introduced at FOSDEM</a> as a pilot project for improving software distribution and deployment everywhere, from HPC environments, to cloud environments or even a personal workstation or a Raspberry Pi . Since then, it has gained wide adoption across <a href="https://eessi.io/docs/systems/">dozens of HPC systems</a> in Europe, being installed natively in EuroHPC systems and becoming a component within the <a href="https://my-eurohpc.eu/">EuroHPC Federation Platform</a>. </p>
<p>This session will highlight the progress EESSI has made, including the addition of new <a href="https://www.eessi.io/docs/software_layer/cpu_targets/">CPU</a> and <a href="https://www.eessi.io/docs/software_layer/gpu_targets/">GPU</a> targets, with broader support for modern computing technologies and much <a href="https://www.eessi.io/docs/available_software/overview">more software</a>, featuring 600+ unique software projects (or over 3500 if you count individual Python packages and R libraries that are included) shipped with it. EESSI's capabilities have expanded significantly, turning it into a key service for managing and deploying software across a wide range of infrastructures.</p>
<p>We will provide an overview of the current status of EESSI, focusing on its new capabilities, the integration with tools like <a href="https://spack.io/">Spack</a> and <a href="https://www.openondemand.org/">Open OnDemand</a>, as well as its growing software ecosystem. Through a live hands-on demo, we will showcase how EESSI is being used in real-world HPC environments and cloud systems, and discuss the future direction of the platform. Looking ahead, we will cover upcoming features and improvements that will continue to make EESSI a solid enabler for HPC software management in Europe and beyond.</p>
Additional information
| Live Stream | https://live.fosdem.org/watch/h1308 |
|---|---|
| Type | devroom |
| Language | English |
More sessions
| 2/1/26 |
<p>Scientific models are today limited by compute resources, forcing approximations driven by feasibility rather than theory. They consequently miss important physical processes and decision-relevant regional details. Advances in AI-driven supercomputing — specialized tensor accelerators, AI compiler stacks, and novel distributed systems — offer unprecedented computational power. Yet, scientific applications such as ocean models, often written in Fortran, C++, or Julia and built for ...
|
| 2/1/26 |
<p>ROCm™ has been AMD’s software foundation for both high-performance computing (HPC) and AI workloads and continues to support the distinct needs of each domain. As these domains increasingly converge, ROCm™ is evolving into a more modular and flexible platform. Soon, the distribution model shifts to a core SDK with domain-specific add-ons—such as HPC—allowing users to select only the components they need. This reduces unnecessary overhead while maintaining a cohesive and ...
|
| 2/1/26 |
<p>Wherever research software is developed and used, it needs to be installed, tested in various ways, benchmarked, and set up within complex workflows. Typically, in order to perform such tasks, either individual solutions are implemented - imposing significant restrictions due to the lack of portability - or the necessary steps are performed manually by developers or users, a time-consuming process, highly susceptible to errors. Furthermore, particularly in the field of high-performance ...
|
| 2/1/26 |
<h2>Content</h2> <p>High-frequency wave simulations in 3D (with e.g. Finite Elements) involve systems with hundreds of millions unknowns (up to 600M in our runs), prompting the use of massively parallel algorithms. In the harmonic regime, we favor Domain Decomposition Methods (DDMs) where local problems are solved in smaller regions (subdomains) and the full solution of the PDE is recovered iteratively. This requires each rank to own a portion of the mesh and to have a view on neighboring ...
|
| 2/1/26 |
<p>As the computing needs of the world have grown, the need for parallel systems has grown to match. However, the programming languages used to target those systems have not had the same growth. General parallel programming targeting distributed CPUs and GPUs is frequently locked behind low-level and unfriendly programming languages and frameworks. Programmers must choose between parallel performance with low-level programming or productivity with high-level languages.</p> <p><a ...
|
| 2/1/26 |
<p>With the rapid acceleration of ML/AI research in the last couple of years, the already energy-hungry HPC platforms have become even more demanding. A major part of this energy consumption is due to users’ workloads and it is only by the participation of end users that it is possible to reduce the overall energy consumption of the platforms. However, most of the HPC platforms do not provide any sort of metrics related to energy consumption, nor the performance metrics out of the box, which ...
|
| 2/1/26 |
<p><a href="www.ecmwf.int">ECMWF</a> manages petabytes of meteorological data critical for weather and climate research. But traditional storage formats pose challenges for machine learning, big-data analytics, and on-demand workflows. </p> <p>We propose a solution which introduces a Zarr store implementation for creating virtual views of ECMWF’s Fields Database (FDB), enabling users to access GRIB data as if it were a native Zarr dataset. Unlike existing approaches such as VirtualiZarr or ...
|
