Handbook of European HPC projects

ExaNest

European Exascale System Interconnect and Storage

European Exascale System Interconnect and Storage (ExaNeSt) project has successfully built a prototype for Exascale. ExaNeSt has taken a sensible integrated approach to co-design the hardware and software that is needed to enable the prototype to run in real-life evaluations. The energy-efficient solutions are expected to spread to standard off the shelf computing systems, assisting the efforts of the EU to reduce carbon dioxide emissions and reach environmental targets.

Achievements:

  • Unified, Optimized, Low-power, Hierarchical Interconnect
  • Unimem (zero-copy, user-level), low-cost; Top-of-Rack; Optical
  • Distributed, in-node NVM’s, scalable Storage
  • Modified BeeGFS parallel FS, ported data base; Resilience; Virtualization
  • Scalable dense packaging based on Liquid Cooling
  • Ultra-dense daughter boards; next-generation cooling technology
  • Not only simulations for scalability, but also built a rack prototype
  • Design tailored to entire Applications
  • Ported, re-engineered; WP6: integrated, evaluated
  • Exploitation Objective: New products; follow on projects

Interconnect:

  • Multi-tiered 4D topology
  • Custom, low-cost, resilient, virtualised, RDMA-capable interconnect
  • Sub-microsecond process-to-process communication
  • Low-latency packet-based prototype (ExaNet)
  • Running real HPC app’s (ExaNet MPI port) 10x or more improvement over Ethernet

Storage:

  • UNIMEM – PGAS
  • BeeGFS Filesystem
  • HPC Virtualization
  • Profiling Tools
  • Checkpointing
  • Status Monitoring
  • FPGA Acceleration

ExaNeSt has contributed to a new generation of European Supercomputers. The project’s advances in performance and efficiency will enable SME’s in several sectors of the economy to utilize HPC and data analytics, with an attractive trade-off between usability and affordability.

Exanest Prototype

PROJECT’S CONTACT:

Manolis Katevenis

Call:
FETHPC-1-2014

Coordinating Organization:
FORTH – Foundation for Research and Technology – Hellas, Greece

Project Timespan
2015-12-01 – 2019-05-31

Other Partners:
  • Iceotope, United Kingdom
  • Allinea, United Kingdom
  • EnginSoft SpA, Italy
  • eXact lab SRL, Italy
  • MonetDB Solutions, Netherlands
  • Virtual Open Systems SAS, France
  • INAF – Istituto Nazionale Di Astrofisica, Italy
  • INFN – Istituto Nazionale Di Fisica Nucleare, Italy
  • The University of Manchester, United Kingdom
  • Universitat Politècnica de València UPV, Spain
  • Fraunhofer-Gesellschaft zur Förderung der Angewandten Forschung e.V., Germany