ARCHER: The next generation of UK National High Performance Computing FacilityDr Lorna Smith, EPCC. ARCHER CSE Deputy Director

Thanks to Alan Simpson and Andy Turner for particular slides

ARCHER

• UK National Supercomputing Service• Replacement for HECToR• LINPACK = 1.359 Pflop/s

• EPSRC is the managing partner on behalf of RCUK• NERC are the other partner

research council

• Cray XC30 Hardware• Nodes based on 2× Intel Ivy

Bridge 12-core processors• 64GB (or 128GB) memory per

node• 3008 nodes in total (72162 cores)• Linked by Cray Aries interconnect

(dragonfly topology)

0 10 20 30 40 50 60 700

500

1000

1500

2000

2500 VASP (TiO2 Supercell)

Nodes

Tim

e /

s

Advanced Computer Facility• Purpose built, secure, world-class facility

• Houses wide variety of leading-edgesystems and infrastructures

• National services• ARCHER• HECToR• IBM BlueGene/Q

• Local services• ECDF (provide hosting)• INDY – industry machine• EDIM1 – DIR machine

• Major expansion for ARCHER• 6MW, 850m2 plant room, 550m2 machine

3

ARCHER ComponentsService Provision

(EPCC, DL)• Overall Management• Helpdesk• Project Administration• System Setup/Maintenance• Documentation

Computational Science and Engineering

(EPCC)• In-Depth Support• Training• eCSE• Best Practice

Hardware(Cray Inc.)

• Hardware support• Provide software updates• Centre of Excellence

Accommodation(UoE, EPCC)

• Building• Power• Cooling• Networking• Security

Computational Science and Engineering (CSE) Support• EPCC aim to provide an innovative and user-focused

service• 20 years of experience in UK and Europe

• Two major elements for ARCHER CSE:• Centralised Team: in-depth queries, documentation, courses, …• Embedded CSE: funding calls, applications enabling projects, …

• Leverage with European projects • HPC (PRACE, CRESTA,…) and Big Data (EUDAT, RDA, …)

• ARCHER embedded in UK and European ecosystem• Facilitating movement between tiers

High Quality In-Depth Support

• Supporting a wide variety of scientific areas• Integrated service desk with a very high initial

volume of CSE queries• Contributing to ARCHER website to provide

• a valuable resource for users

• showcase impact of research on ARCHER

• Additional benefits to deliver Impact• SME engagement, thematic workshops,

Women in HPC, outreach, HPC MOOC,…

Training Across the UK• Builds on EPCC’s successful MSc in HPC and our

role as a PRACE Advanced Training Centre

Novel Engagement with Users• Consortium Contacts

• Each EPSRC/NERC Consortium has a named contact• Advocate for Consortium within service

• Technical Forum• Share experience, knowledge and expertise• Monthly web-based meetings• Open to all (not just ARCHER users)• Speakers from EPCC, Cray, DiRAC, Hartree,…

• Virtual Tutorials• Monthly on-line tutorials• Encourages interaction with new users• May include short presentation on key topic

Embedded CSE• Programme funding developers embedded within

UK research communities• to improve efficiency of application codes on ARCHER• …and/or to broaden the user base

• Important to support early career researchers and provide career path for software engineers

• Regular calls for support (every 4 months)• Eligibility: Projects in the EPSRC or NERC remit• Duration: 3 months – 1 year• Second call open just now…

Getting Access to ARCHER• Standard research grant

• Request Technical Assessment using form on ARCHER website• Submit completed TA with notional cost in J-eS• Apply for time for maximum of 2 years

• ARCHER Resource Allocation Panel (RAP)• Request Technical Assessment using form on ARCHER website• Submit completed TA with RAP form• Application for computer time only

• Instant Access – Pump-Priming Time• Request Technical Assessment using form on ARCHER website• Submit completed TA with 2 page description of work• Office decision on application

The mum spin - feel free to put a ‘I’m a Mum’ spin on the talk if you like

ARCHER

Energy consumption

Energy efficiency key to design

The mum spin - feel free to put a ‘I’m a Mum’ spin on the talk if you like

ARCHER 2 Boys – 5 and 6

Energy consumption

Energy efficiency key to design

Significant and increasing exponentially. Unsustainable

The mum spin - feel free to put a ‘I’m a Mum’ spin on the talk if you like

ARCHER 2 Boys – 5 and 6

Energy consumption

Energy efficiency key to design

Significant and increasing exponentially. Unsustainable

Cooling Water cooled

The mum spin - feel free to put a ‘I’m a Mum’ spin on the talk if you like

ARCHER 2 Boys – 5 and 6

Energy consumption

Energy efficiency key to design

Significant and increasing exponentially. Unsustainable

Cooling Water cooled Water cooling not recommended unless in extreme circumstances

The mum spin - feel free to put a ‘I’m a Mum’ spin on the talk if you like

ARCHER 2 Boys – 5 and 6

Energy consumption

Energy efficiency key to design

Significant and increasing exponentially. Unsustainable

Cooling Water cooled Water cooling not recommended unless in extreme circumstances

Training Extensive training courses, webinars, on-line material

The mum spin - feel free to put a ‘I’m a Mum’ spin on the talk if you like

ARCHER 2 Boys – 5 and 6

Energy consumption

Energy efficiency key to design

Significant and increasing exponentially. Unsustainable

Cooling Water cooled Water cooling not recommended unless in extreme circumstances

Training Extensive training courses, webinars, on-line material

No training, often baffling

The mum spin - feel free to put a ‘I’m a Mum’ spin on the talk if you like

ARCHER 2 Boys – 5 and 6

Energy consumption

Energy efficiency key to design

Significant and increasing exponentially. Unsustainable

Cooling Water cooled Water cooling not recommended unless in extreme circumstances

Training Extensive training courses, webinars, on-line material

No training, often baffling

Fault tolerance Mechanisms to cope with failures e.g. node failure

The mum spin - feel free to put a ‘I’m a Mum’ spin on the talk if you like

ARCHER 2 Boys – 5 and 6

Energy consumption

Energy efficiency key to design

Significant and increasing exponentially. Unsustainable

Cooling Water cooled Water cooling not recommended unless in extreme circumstances

Training Extensive training courses, webinars, on-line material

No training, often baffling

Fault tolerance Mechanisms to cope with failures e.g. node failure

Catastrophic. Single point of failure

The mum spin - feel free to put a ‘I’m a Mum’ spin on the talk if you like

ARCHER 2 Boys – 5 and 6

Energy consumption

Energy efficiency key to design

Significant and increasing exponentially. Unsustainable

Cooling Water cooled Water cooling not recommended unless in extreme circumstances

Training Extensive training courses, webinars, on-line material

No training, often baffling

Fault tolerance Mechanisms to cope with failures e.g. node failure

Catastrophic. Single point of failure

Support network Streamline professional support team

The mum spin - feel free to put a ‘I’m a Mum’ spin on the talk if you like

ARCHER 2 Boys – 5 and 6

Energy consumption

Energy efficiency key to design

Significant and increasing exponentially. Unsustainable

Cooling Water / air cooled, efficiency key

Water cooling not recommended unless in extreme circumstances

Training Extensive training courses, webinars, on-line material

No training, often baffling

Fault tolerance Mechanisms to cope with failures e.g. node failure

Catastrophic. Single point of failure

Support network Streamline professional support team

Extensive untrained volunteer support network

The mum spin…• Although ARCHER is clearly a better behaved child than

my two boys..• Work / life balance can be challenging at times• Can sometimes lead to lack of sleep – sick kids/grant deadlines

• Very lucky to have the opportunity to do both• Part time work has allowed me to enjoy time with my children • While allowing me to maintain a career I enjoy

• University policies on part time working, family leave etc have been important

• Support from managers has been critical • Dads do it too!