APM – Tuesday 15th March 2016

OGC Gateway process & it’s use in Met Office HPC Delivery

Who are we ?

Steve Murray

Met Office Senior Project Manager & OGC Reviewer

(aka “the Gamekeeper”)

Dave Underwood

Deputy Director Of High Performance Computing

(aka “the Poacher”)

OGC Gateways – a short history

1999 Review of civil procurement: Projects typically late, over cost and not delivering!

& as to “The justification and benefits!!!!”

2000 Office of Government Commerce (OGC) formed: Gateway reviews commence

2003 Senior Responsible Owner: “mandated for riskiest projects”

And more recently.........

2011 OGC becomes the Major Projects Authority (MPA) inside the Cabinet Office

2014 SRO personally responsible to Parliamentary Select Committees

2016 MPA became Infrastructure and Projects Authority when Infrastructure UK and MPA merged.

The Gateway process

Gate 0 Strategic Assessment

Gate 1 Business justification

Gate 2 Delivery strategy

Gate 3 Investment decision

Gate 4 Ready for service

Gate 5 Operational review and benefits realisation

The Gamekeepers! “Independent team” (3-5 people) of subject matter experts

First face to face meet is often when they arrive to review a project

Not policemen – cannot stop a project!

Provide assurance and recommendations to the SRO

Experience suggests most SRO’s will follow up and implement the recommendations

Review– code of conduct Write a report that is evidence based; confirmed by more than one person

We interview (interviewee and 2-3 panel members)

Everything said is confidential and non attributable

Looking for concerns and also evidence of best practise.

Many Programmes “start at the end” with Benefits Realisation

Not all benefits can be quantified in monetary terms

E.g. use by Met Office to demonstrate improved skill

Falling into our “Skills, Standards and Reputation” category

Providing accurate forecasts

Computers used for weather & climate prediction

Gates 1 & 2 Business Justification & Delivery Strategy

Gate 1 Looks at the What and the Why ?

Gate 2 How ?

Majority of projects undergo a combined Gate 1 & 2, but this is not always the case

Gate 3 Investment decision

Assessment of the proposed solution: did you do what you said you were going to do at Gate 2?

Business Case & Stakeholders: is this project still required?

Risk Management: are Risk and Issue logs up to date. Did any risks materialise – have they been resolved?

Review current phase: is this project under control?

Gate 4 Readiness for Service

Similar to Gate 3 re Business Case and Stakeholders

Risk Management

There are usually lots of positives, but people tend to remember the negatives and that’s what appears in Lessons Learnt reports

Testing complete; ownership; handover; contracts & SLA; Benefits realisation plan – remember, the project team will have gone!

Gate 5 Operational review and benefits realisation

Review the operating phase: SLA being met, measuring

performance, training materials up to date, governance satisfactory ?

Business Case and benefits management: Is the Business

Case still valid, are the business benefits being realised, did the organisation achieve more or less than expected, are the users satisfied ?

Plans for continuous improvements in VFM, performance and innovation

Review of organisational learning and maturity targets

Gate 5 – NAO Conclusions

NAO report 2016:

Data on benefits realisation is poor

If projects do not deliver their intended benefits they are unlikely to have provided value for money

Accountability is clearer but could be undermined by turnover of SRO’s

Met Office – a brief introduction

Why do we exist?

‘Working at the forefront of

weather and climate

science for protection,

prosperity and wellbeing’

Enabling protection of lives, infrastructure and the natural world

Increasing prosperity, enabling UK economic growth and

international competiveness

Improving wellbeing now, and in the future

Purpose

Forecasting the Weather

du = ∂p – fv dt ∂x dv = ∂p + fu dt ∂y p = RT ρ

Risk Analysis & Communication

Knowledge

70 levels 17km

80km high

Forecast Model

Observations

+ =

Operationalising science and data

Met Office

Academia and International

Met Office

Private Sector

Operationalising science and data

HPC Mass Spice

Operational Big IT

Expert Systems

Apps API’s Digital

12 km

4 km 1 km

Obs

SW Floods 6th – 7th July 2012

Alternative

tracks

Moderate to high

risk of a further

5–10 cm of snow,

particularly over high

ground but rain or

sleet near many

coasts.

MOST LIKELY

TRACK OF LOW

Rain turning to

snow early

Friday morning

Monday 28 October 2013

ALTERNATIVE

TRACK

ALTERNATIVE

TRACK

St Jude: 5 days ahead Amber warning issued

HPC Programme the Poachers perspective

HPC Programme – Journey

• Summer 2012 HC S&T Select Committee

• November 2012 Chancellor Announces.......

• Spring 2013 Strategic Outline Case “Unlocking Potential”

• Autumn 2013 Outline Business Case (Approved Spring 14)

• Competitive Dialogue – (Spring – Summer 14)

• Summer 2014 Full Business Case (Approved October 14)

• CRAY Contracted as HPC Supplier - (October 14)

HPC Vision: To deliver a step change in UK Government HPC capability that enables exploitation of:

• Higher resolution , ensemble models to give improved risk based local predictions of weather and impacts on safety of UK citizens and the efficient operation of the UK economy , globally

• Improved capabilities in Seasonal to Climate timescales enabling improved planning decisions that maximise the resilience of the public and national infrastructures and wider UK economy on these time horizons

• Greater collaboration in operational environmental modelling services across UK Govt

HPC Programme Mission • To specify and effectively acquire a step change in HPC capability

DONE

• To deliver to time, cost and specification UNDERWAY

• To operate and exploit HPC in such a way that we enable £2Bn of benefits to the UK economy between 2016 & 2020 TO BE Delivered from 1/4/2016

• To achieve this in such a manner that Funders, Stakeholders, Collaborators and Customers perceive we have successfully delivered those benefits

PWSCG ASSURANCE & IAG ESTABLISHED

• So that in 2018 the Government announces the further grant funding of our next HPC UNDERWAY

Programme Milestones

• Oct 14 – FBC Approved • Sep15 – Phase 1A Operational • Mar16 – Phase 1AB Operational • May16 - ITH 3 Completed • Spring 17 – Phase 1C Operational • “Benefits delivery commences April 16”

Procurement Approach • Fixed Price contract

• Contracted for Performance against benchmarks

• Use of Factory Acceptance Tests

• Clear Authority and Supplier Obligations

• Terms and Conditions

• Procurements: HPC, MASS, IT Hall3 & Spice

Audits and Health Checks

• Internal Health Checks completed by Project governance Process Manager (6 so far)

• Internal Audits on all projects

• OGC Audits Gate 1 Aug 2013 Business Justification

Gate 2 Nov 2013 Delivery Strategy

Gate 0 May 2014 Strategic Assessment

Gate 3 Aug 2014 Investment Decision

Gate 4 Jun 2015 Readiness for Service

Gate 0 Jan 2016 Strategic Assessment

HPC Programme Governance HPC Governance StructureWho Does What...

Lynda

JonesHead of

Property & FM

Alison

WilsonHead of

Procurement

Graham

MallinBCM for

Technology

Nick Jobling

SRO

Andy Brown

Science

BCM

Dave

UnderwoodProgramme

Manager

Andrew

McKeanExec Head

Finance

Iain ForsythBCM for

Forecasting &

Serv. Delivery

HPC Programme Board

Steve NoyesOperational

Impacts

Stakeholder

(Jan’15)

Met Office

Executive

BoardSponsoring Group

Phil EvansCustomer

Engagement

Stakeholder

Kay EldergillHuman Impacts

Stakeholder

Met Office

Board

(NEDs)

Programme

Advice &

Assurance

OGC, IA, BL

IT Hall 3 Build Project

IT Halls 1 & 2 Refresh Project

Attract Local funding activity.

HPC Category

HPC Procurement

(JM)

MASS Procurement

(JM)

Cabinet Office and ShEx

Engagement activity.

DatalinkProcurement

(DB)

IT Hall 3 (AW)

The HPC Science Capability and Pull Through Project (SB)

HPC Readiness for

Operation

MASS Installation

Downstream Impact

Architecture (Decoupler)

Scientific Compute

Environment (SPICE)

Trust Zones

Programme Office

Manager (LP)

Comms (LP)

Stakeholder Plan (LP)

Risk Mgmt (LP until Jan 16)

Benefits Plan & Mgmt (CR)

Prog Finance (AF)

Business Case (PW)

Corporate financial impacts activity

Ensuring the delivery of

quality weather

services to our

customers, as expected

from the new HPC

capability, including

associated deliverables and outputs

from the Reducing

Complexity CSF.

B

O

S

S

HPC Projects and Activities

Derrick RyallBCM for

Business (Govt

& Commercial)

Ensuring we maximise the return from our current

and new products and

services through

exploitation of our new

HPC capability.

Approvals and Assurance

HPC Programme Manual Approvals and Assurance

£97 Million Investment

By 2017 our new HPC………

Further information Richard Daniels

Departmental Assurance / Project Delivery Capability

Projects and Commercial Directorate

1 Victoria Street (Level 6 V1)

SW1H 0ET

020 721 50404

Thank You