Handbook of European HPC projects

SAGE

Percipient StorAGe for Exascale Data Centric Computing

The StorAGe for Exascale Data Centric Computing (SAGE) system, researched and built as part of the SAGE project, aims to implement a Big Data/ Extreme Computing (BDEC) and High Performance Data Analytics (HPDA) capable infrastructure suitable for Extreme scales – Exascale and beyond. Increasingly, overlaps occur between Big Data Analysis and High Performance Computing (HPC), caused by the proliferation of massive data sources, such as large, dispersed scientific instruments, sensors, and social media data, whose data needs to be processed, analysed and integrated into computational simulations to derive scientific and innovative insights. The SAGE storage system, will be capable of efficiently storing and retrieving immense volumes of data at Extreme scales, with the added functionality of “Percipience” or the ability to accept and perform user defined computations integral to the storage system. The SAGE system is built around the Mero object storage software platform, and its API Clovis, and its supporting ecosystem of tools and techniques, that will work together to provide the required functionalities and scaling desired by Extreme scale workflows. The SAGE system will seamlessly integrate a new generation of storage device technologies, including non-volatile memories as they become available. The SAGE system will also offer a very flexible API and a powerful software framework suitable for easy extensibility by third parties.

The two racks of the SAGE system are now integrated into the Jülich Supercomputing Centre and undergoing software integration and application testing. Any communities interested in testing the SAGE prototype are advised to write to: info@sagestorage.eu.

The SAGE system

PROJECT’S CONTACT:

Sai Narasimhamurthy

Call:
FETHPC-1-2014

Coordinating Organization:
Seagate Systems UK Ltd, United Kingdom

Project Timespan
2015-09-01 – 2018-08-31

Other Partners:
  • Allinea, United Kingdom
  • Atos (Bull SAS), France
  • United Kingdom Atomic Energy Authority, United Kingdom
  • CEA – Commissariat à l’Energie Atomique et aux Energies Alternatives, France
  • DFKI – Deutsches Forschungszentrum für Künstliche Intelligenz GmbH, Germany
  • Diamond Light Source, United Kingdom
  • FZJ – Forschungszentrum Jülich GmbH, Germany
  • KTH – Kungliga Tekniska Högskolan, Sweden
  • STFC – Science and Technology Facilities Council, United Kingdom