Handbook of European HPC projects

ExaNoDe

European Exascale Processor & Memory Node Design
ExaNoDe designed core technologies for a highly energy efficient and highly integrated heterogeneous compute node directed towards Exascale computing. ExaNoDe has built a compute node prototype available for collaborative working comprising:
  • Technology and design solutions for an interposer-based computing device targeting HPC applications,
  • Integration of devices in a Multi- Chip-Module (MCM) to increase compute density and take advantage of heterogeneity,
  • System and middleware SW stack.

Contribution to Exascale Computing

The ExaNoDe final prototype consists of an integrated HW/SW daughter board with two MCMs, each including two chiplets stacked on one silicon interposer and two Xilinx Zynq Ultrascale+ FPGAs. It targets prototype-level use by system integrators, software teams and its subsequent evaluation through industrial deployment.   ExaNoDe’s main achievements cover all aspects of heterogeneous integration from silicon technology to system software including:
  • Design of innovative, high-speed and low-power interconnect for the heterogeneous integration of chiplets via a silicon interposer.
  • Design of a Convolutional Neural Network (CNN) accelerator hardware IP for a use case demonstrating heterogeneous integration.
  • Design and manufacturing of a chiplet System-on-Chip (SoC) in 28FDSOI technology node
  • 3D integration of chiplets on an active silicon interposer with about 50,000 high density (20 µm pitch) connections.
  • Advanced package integration with two FPGA bare dies including ARMv8 cores, one interposer and 43 decoupling capacitors in a 68.5 mm ×55 mm Multi-chip-Module (MCM).
  • Integration of two MCMs on a 260 mm x 120 mm daughter board. Development of a complete SW stack including UNIMEM-based system software and middleware; Runtimes libraries optimized for the UNIMEM architecture (OmpSs, MPI, OpenStream, GPI); Checkpointing technology for virtualisation; A set of mini-applications for benchmarking purposes.
  • A performance projection of ExaNoDe technologies into a strawman architecture representative of upcoming HPC processors.
The ExaNoDe prototype has been delivered at the end of June 2019.  It has been designed to demonstrate and to validate all technologies developed within the project. The methodology, the know-how and the building blocks related to advanced packaging (MCM and interposer) and system software for heterogeneous integration provide an IP baseline for the next generation of European processors to be used in future Exascale systems. ExaNoDe collaborated closely with the ExaNeSt and EcoScale projects on the basis of a joint MoU.

PROJECT’S CONTACT:

Denis Dutoit

Call:
FETHPC-1-2014

Coordinating Organization:
CEA Commissariat à l’Energie Atomique et aux Energies Alternatives, France

Project Timespan
2015-10-01 – 2019-06-30

Other Partners:
  • Arm Ltd, United Kingdom
  • ETHZ – Eidgenössische Technische Hochschule Zürich, Switzerland
  • FORTH – Foundation for Research and Technology – Hellas, Greece
  • Fraunhofer-Gesellschaft zur Förderung der Angewandten Forschung e.V., Germany
  • Scapos AG, Germany
  • The University of Manchester, United Kingdom
  • Atos (Bull SAS), France
  • Virtual Open Systems SAS, France
  • BSC – Barcelona Supercomputing Center, Spain
  • FZJ – Forschungszentrum Jülich GmbH, Germany
  • Kalray SA, France
  • CNRS – Centre National de la Recherche Scientifique, France