Open Data & Government Data Programme Update event for external data users8 December 2015

Paul MaltbyDirector of DataGovernment Digital Service@maltbyps

In the last Parliament our data approach was dominated by open data

GDS

We did okay

GDS

The data user community worked wonders

GDS

But like ODI & others we know we now need to stretch our approach wider and deeper

GDS

That means, where appropriate, shared data, not just open data

GDS

That means quality, not just quantity

GDS

We will continue the deep involvement with external data users to keep pressure on the quality and quantity of open data

GDS

But the big shift is to drive data quality by dog-fooding within government

GDS

A new Government Data Programme aiming to transform how data is used across public services

GDS

GDS

Too much government data isDuplicatedIn many different formatsHard to reachHard to maintainHard to put to good use

GDS

Our aim = better digital services

GDS

Our aim = good policy and operational decisions

GDS

Our aim = economic benefits

GDS

Our aim = public trust & security

GDS

The Government Data Programme has 3 workstreams

1.Better use of data

GDS

Driving internal use of new data with:

Data science and open data projects on top policy challengesData capability and literacy (with ONS)

GDS

Maintaining UK’s international leadership on open data and transparency

GDS

Improving decision making and boosting demand for data quality for benefit of all

GDS

@cgchristrottConsul General, Cape Town, SA

Data science opportunities: Unstructured data and visualisations

GDS

Data Science & the Civil Service 22

Data science opportunities: Clustering and prediction

GDS

There is some unfinished business on open data

GDS

We especially want help from external users with ODI to keep driving the open data agenda

GDS

ONS creating mainstream data science capability among analysts in government

GDS

GDS will be supporting this, including through data literacy for non-data specialists

GDS

2. Modernising data infrastructure

GDS

Creating a security-conscious data layer in government consisting of

Data access toolsAPIsRegisters

GDS

Resulting in a National Information Infrastructure of open and shared data to fuel business and government innovation

GDS

Registers: lists of facts where the government is the canonical source of truth

API standards: so without friction appropriate data can be queried across government

Discovery tools: so civil servants can find out if data exists & if they can access it

GDS

companies, charities, trade unions, courts, schools, universities, hospitals, zoos, circuses, inspections, licences, certificates, births, marriages, deaths, electoral roll, insolvencies, bankruptcies, passports, animal passports, drivers, vehicles, land parcels, land ownership, land use, legal boundaries, awards, tax rates, benefits, livestock movements, flood risk, river levels, companies, fish caught, patents, trademarks, designs, non-native invasive plants, bank holidays, food standards, clock changes …

“SCOLAND UK” “SCOTALND UK” “SCOTKLAND UK”“SCOTLAD UK”“SCOTLAND”“SCOTLAND UK”“SCOTLAND UK”“SCOTLAND UNITED KINGDO”“SCOTLAND UNITED KINGDOM”“SCOTLAND UNITED KINGODM”“SCOTLAND, UK”

GDS

Registers are more than just a list

GDS

GDS

Persistent & canonicalMinimum viable datasetA service, not a listIntegrity of historyOpen / shared / private

GDS

GDS

Registers:Are owned by a departmentProvided as a service for others inside and outside governmentAccording to common design patterns & software

GDS

Starting with commonly referenced registers such as

CountriesCompanies (limited companies, charities, sole traders)Local authoritiesPremisesAddresses

GDS

No technology big bang required

Creating an API infrastructure across government and, where appropriate, to users outside

GDS

Reducing the need for bulk data sharing in government

GDS

So no more downloading and emailing data around Whitehall

GDS

And no more disks in the post

GDS

(but we know how important bulk availability of data is for some external users via data.gov.uk)

GDS

We’re also starting to think about better data discovery tools - both inside and outside government

GDS

GDS

There are currently no tools for civil servants to know whether non-open data exists across government

GDS

Never mind knowing whether they can or should access it

GDS

Or having tools available to help them query the data or provide basic manipulation, eg plot on a map

GDS

A discovery process on tooling will start in the new year - we will be doing user research with users inside and outside government

GDS

3. Data policy and governance

GDS

Supporting the programme through cross-dept governance:

Agree the technical approach and common policies Data access legislation?International engagement and policies

GDS

Creating shared vision & ambition and collective rules of the road

GDS

GDS

A new Ministerial Group on Digital Transformation - including data

An external Steering Group chaired by National Statistician John Pullinger

GDS

Open Data Institute keeping our feet to the fire and connected with external data users

GDS

See more on the ODI process

GDS

At the heart of the programme senior Data Leaders drawn from across government

Agreeing:Common policies (eg external sharing) Data standardsResponsibility for registersOpportunities for collaboration

And leading the new data vision across Whitehall

GDS

Possible new data access legislation?

GDS

Research and statistics●HMRC●ADRNs●ONS admin data

Tailored public services●Personal data for

defined & limited individual benefit

Fraud●Personal data for

tackling fraud (with sunset clause)

See more on the earlier open policy process with civil society at datasharing.org.uk

12345

Start with clear user need and public benefit

Use data and tools which have the minimum intrusion necessary

Create robust data science models

Be alert to public perceptions

Be as open as possible

Data science ethical framework

6 Keep data secure

GDS

And tackling the big questions

Citizen consent and control of data When and how data should/shouldn’t be shared outside government

GDS

Better use of dataOpen dataData ScienceData literacy and capability

GDS

Modernising data infrastructureData discovery toolsAPIsRegisters

Data policy and governanceCommon policies and leadershipPossible legislationInternational leadership

Paul MaltbyDirector of DataGovernment Digital Service@maltbyps