Renewable energies | Eco-friendly production | Innovative transport | Eco-efficient processes | Sustainable resources

© 2

015

- IFP

Ene

rgie

s no

uvel

les

Arcane/ArcGeoSim, a software framework for geosciences simulation

Pascal Havé

© 2

015

- IFP

Ene

rgie

s no

uvel

les

Outline these are the questions.

n  Who are IFPEN ?

n  What was our problem… ?

n  … and our solution ?

n  A solution but another problem ?

n  Current activities.

ORAP – Arcane/ArcGeoSim, a software framework for geosciences simulation – November 5th 2015 2

© 2

015

- IFP

Ene

rgie

s no

uvel

les

Vocation n  IFPEN is a public research and training player(EPIC – Etablissement Public à caractère Industriel et Commercial -- state-owned industrial and commercial establishment)

n  It has an international scope, covering the fields or energy, transport and the environment

n  From research to industry, technological innovation is central to all its activities

ORAP – Arcane/ArcGeoSim, a software framework for geosciences simulation – November 5th 2015 3

Mission

As part of the public-interest mission with which it has been tasked by the public authorities, IFPEN focuses on: •  providing solutions to take up the challenges facing society in terms of energy and

the climate, promoting the emergence of a sustainable energy mix •  creating wealth and jobs by supporting French and European economic activity

and the competitiveness of related industrial sectors

Growth in energy demand

Climate change

Long development time of REs

Requirement for qualified personnel

Economic competitiveness

© 2

015

- IFP

Ene

rgie

s no

uvel

les

Strategic positioning

ORAP – Arcane/ArcGeoSim, a software framework for geosciences simulation – November 5th 2015 4

© 2

015

- IFP

Ene

rgie

s no

uvel

les

A suite for geosciences engineering

ORAP – Arcane/ArcGeoSim, a software framework for geosciences simulation – November 5th 2015 5

Complete modeling &

simulation workflows

âModeling the past, planning the present

â Modeling the present, predicting the future

â Facing reality

Geosciences Software Development

© 2

015

- IFP

Ene

rgie

s no

uvel

les

Motivations 2005, back to the origin n  New parallel hardware architectures

n  Linux cluster, multi-core processors n  Needs for new physical models and advanced

numerical methods n  A wide range of applications in geosciences: reservoir,

basin, CO2 but few common services n  Increasing cost to

n  maintain old scalar applications n  parallelize these applications n  implement advanced numerical methods n  industrialize current R&D

ORAP – Arcane/ArcGeoSim, a software framework for geosciences simulation – November 5th 2015 6

Move or die : a new generation of simulators

© 2

015

- IFP

Ene

rgie

s no

uvel

les

as a key for competitiveness : HPC n  Thru an hardware abstraction n  And low level optimizations

for an higher productivity in challenging environment

n  With an high level programming n  Focus on your own business

Physics / Numerics / Computer Science Fasten the development of applications

n  From research prototypes to industrial products n  By sharing common services

Reliability is not “the fifth wheel of the wagon” n  By defining a “standard” coding n  Given by a frame to the developer n  With an automated environment to enforce quality

ORAP – Arcane/ArcGeoSim, a software framework for geosciences simulation – November 5th 2015 7

An HPC framework for a new generation of simulators

Why and How

© 2

015

- IFP

Ene

rgie

s no

uvel

les

What framework ? A.  Building a new one from scratch

n  A custom made framework … n  … which may reinvent the square wheel n  How to estimate its cost ? n  What delay before the first commercial product ?

B.  Using an existing framework n  And following legacy choices n  What continuity ? / what autonomy ?

§  As a customer or as a partner ?

ORAP – Arcane/ArcGeoSim, a software framework for geosciences simulation – November 5th 2015 8

Today: ü  100% self-sufficient ü  50% co-owner ü  Geosciences exclusive use

© 2

015

- IFP

Ene

rgie

s no

uvel

les

What is Arcane ? An high level design to speed up development n  Developer-friendly API

n  Based on an Object Oriented language : C++ §  The highest performance OO language §  But sometimes too tricky ? (template, memory…)

n  With a C# binding for higher level programming n  For any physical/numerical developer

§  To write code mostly as sequential procedures in service containers §  With some wrappers for common usages

n  With common code services for computational sciences n  I/O management (XML, HDF5) n  Parallel management (data migration/synchronization/partitioning…)

n  With common concepts for mesh oriented simulations n  2D/3D unstructured distributed mesh, variables, groups, items

(node, edge, face, cell, dof, particle, link…) …

ORAP – Arcane/ArcGeoSim, a software framework for geosciences simulation – November 5th 2015 9

1/2

© 2

015

- IFP

Ene

rgie

s no

uvel

les

What is Arcane ? An high level design for lower level optimizations n  Hardware Abstraction and Performances

n  Message passing parallelism behind unique interface with implementations (MPI, multi-thread, hybrid…)

n  Tested up to 60,000 cores on CEA super-calculator. n  Integrates dynamic load balancing

(for all Arcane distributed objects : mesh, groups, variables…) n  Multi-platform support

n  Linux (workstation and cluster) / Windows (workstation)

ORAP – Arcane/ArcGeoSim, a software framework for geosciences simulation – November 5th 2015 10

a multi-layer architecture for HPC simulators

2/2

© 2

015

- IFP

Ene

rgie

s no

uvel

les

Centre de Résultats Ressources – DSTC ArcGeoSim - octobre 2015 11

Arcane for Geosciences Simulation

Co-developed

with

For a new generation from basin to reservoir simulators

ArcGeoSimTM ?

Since 2007, 10+10 FTE human resources by IFPEN and CEA in an active collaboration

IFPEN project for Innovation and Rationalization in software development for new geosciences simulators

© 2

015

- IFP

Ene

rgie

s no

uvel

les

Centre de Résultats Ressources – DSTC ArcGeoSim - octobre 2015 12

Geosciences development platform for parallel applications

HPC Simulator development parallel platform

A r c G e o S i m T M

Ext

erna

l Li

nks

Line

ar S

olve

rs,

XM

L, H

DF5…

Reservoir simulation & CO2 management PumaFlow CooresFlow …

Visco Puma Coores EOR CO2 Numerical Lab initiative

Basin Modeling TemisFlow & DionisosFlow

Advanced methods Numerical schemes, AMR,

(Non-)Linear Solvers

Common utilities

Mesh, I/O, //

Generic / multi-purpose library

Optimized library shared by geoscience applications

Arc

Tem

CA

ME

L

Arc

aDE

S

Geo

xim

Pro

spec

tive

R&

D

DSL

, Sol

ver,

Sc

hem

es, T

hesi

s

CAT

S

ArcGeoSimTM HPC framework for new generation of geosciences scientific softwares

Database

R & I

Environment & Productivity

Documentation, Training DailyTests, Code Analysis…

© 2

015

- IFP

Ene

rgie

s no

uvel

les

The life of a framework How to lead framework development n  What’s first ?

n  Request from business applications §  Usually requested for “yesterday”

n  Low level concepts / optimizations §  May be intrusive and requiring prototypes

n  Architectural design §  Ok for the integration of a new concept §  But not seen as a functional enhancement §  “When it works, why changing something ?” §  To see beyond the “functionalities”

§  Long time project §  To be ready to unexpected evolutions !

ORAP – Arcane/ArcGeoSim, a software framework for geosciences simulation – November 5th 2015 13

Application X New Business

features

Application Y New Business

features

© 2

015

- IFP

Ene

rgie

s no

uvel

les

Tools for a sustainable HPC framework And IFPEN illustrations n  Proactive analysis

n  Be ready before the business requirements n  “Innovation distinguishes between a leader and a follower”

n  Unify local cases into a larger framework n  Unified Linear Algebra Framework n  Unified mesh format n  Towards a new generation of distributed mesh in Arcane

n  Don’t let it wild n  ComTech, a multi-headed conscience n  Continuous Integration (DailyTests, , ) n  Internal parts may be tricky but external interfaces must be easy n  Have an “Orthogonalization staff”

§  A new feature may come to be able to mix others

ORAP – Arcane/ArcGeoSim, a software framework for geosciences simulation – November 5th 2015 14

1/2

© 2

015

- IFP

Ene

rgie

s no

uvel

les

Tools for a sustainable HPC framework And IFPEN illustrations n  Continuous R&I

n  (Non-) Linear solvers (adaptive criteria, AMG, DDM, multi/many-cores) n  Domain Specific Languages (in house & ∇-Nabla) n  Application Dataflow Analysis n  Automatic Differentiation / Code Generation (XSD/C#) n  Backend independent task based programming n  Numerical schemes

n  Continuous R&I n  (Unstructured) Adaptive Mesh Refinement n  Sub-Meshes, Multi-dimensional regional model coupling

n  Continuous tooling n  Debugger extension ( , HyODA : the Arcane Debugger) n  Development environment (C# extensible compilation framework)

15

2/2

ORAP – Arcane/ArcGeoSim, a software framework for geosciences simulation – November 5th 2015

© 2

015

- IFP

Ene

rgie

s no

uvel

les

http://www.rs-simrace.com