42
Tim Davies (@timdavies | [email protected]) Open Government Network: Romania April 30, 2015 Exploring the Data Standard
Tim Davies (@timdavies | [email protected])
Open Government Network: Romania April 30, 2015
Exploring the Data Standard
Overview1. What?
Introducing Open Contracting and the Open Contracting Data Standard
2. Why? The value of adopting OCDS
3. When & where? Exploring sources of contracting data
4. Who? Building around user needs
5. How? The technical implementation of OCDS
What? 1
4
What is Open Contracting?
5
Disclosure Participation
We open up public contracting through disclosure, data and
participation….
… so that the trillions of dollars spent every year on
providing goods and services to citizens deliver on their promise of public benefit
The Open Contracting Partnership (OCP)Started as a collaboration, based in the World Bank:
OCP became an independent organisation at the start of 2015: headquartered at the OpenGovHub in DC
Developed a prototype data standard, launched Nov 2014
Launched data standard helpdesk in March 2015
What is the Data Standard?
Planning Tender Award Contract Implementation
The data standard describes how to disclose documents and data at, and about, each stage of a contracting process…
10
Documents ¬ices
Buyer & supplierIDs
Key dates & durations
Contract value& transactions
Line-items Milestones& progress
Locationinformation
Joined-up data links
What to publish…
11
How to publish it…
JSON
[ REST ]
Why? 2
Why disclosure & open data?• Fighting corruption
• Enabling better planning & citizen engagement
• Increasing competition
• Getting better value for money
• Improving accountability
Data + Documents
Open Data
Why use OCDS?1. Designed around publisher and user need
The standard has been developed through in-depth research looking at supply-side and demand-side needs;
2. Interoperability: generating joined-up data Making it easier to compare procurement across borders, and re-use existing tools, analysis and workflows;
3. Benchmarking disclosureProviding a framework for progressively improve disclosure across the whole contracting process;
4. A growing ecosystem of tools and services Off-the-shelf tools to validate, convert and visualise data (coming soon);
5. Community governedExtensible, and held in trust by the Open Contracting Partnership;
When & where?
3
A contracting process…
Planning Tender Award Contract Implementation
Two contracting processes…Award Contract ImplementationTenderPlanning
Award Contract ImplementationTenderPlanning
Discussion:where is the data in Romania?
Where is the data?
Planning Tender Award Contract Implementation
Where is the data?
Documents ¬ices
Buyer & supplierIDs
Key dates & durations
Contract value& transactions
Line-items Milestones& progress
Locationinformation
Joined-up data links
Joining it up…
Open Contracting Identifier
ocid
One identifier per contracting process
Globally unique
Who? 4
Focus on user need…
Government:seeking value
for money
Corruption hunter:detecting fraud
& corruption
SMEs:competing for public
contracts
CSOs:monitoring service
delivery
Taking stock
Data capture <—————> Disclosure & standards
How? 5
Releases & records• Publish a JSON release for each stage of the contracting process
Including amendments and changes.
• Publish a record that presents a snapshot state The record should include links to each release, plus compiled content showing the current state of the contract.
• UK Contracts Finder has an API - We can use this to check for each time information about a contracting process changes, and to create a release. We use fields, structures and code lists from OCDS;
• Each release can be made available at its own URI
• Each releases links to key documents held externally
• The record provides an index of releases
• The compiled record tells us the state of the contracting process right now - and shows the change history.
• (We can bundle together release and records in ‘release packages’ or ‘record packages’, and can covert them on bulk to flat formats for bulk download)
Worked example (tbc)
Implementation levels
5 ½
Look at what you collect, what you can publish, and how to step-by-step improve data publication
Step 1: Focus on priority fields
Step 2: Start small, and scale up…
…using the 5
☆ ☆ Provide machine-readable data about contracts
☆ ☆ ☆ Structure data using the OCDS standards
☆ ☆ ☆ ☆ Use best practices for open data on the web
☆ ☆ ☆ ☆ ☆ Make links to other datasets
☆ Upload basic open contracting information to the web
☆ ’s of open data.
☆ Upload basic open contracting information to the web
Googlehttp://open-contracting.midfordshire.gov
Open Contracting Pages
•Procurement Plans •Tender Notices •Bidding Documents •Technical Specifications •Evaluation Criteria •Award Notices •Contract Notices •Signed contracts •Completion certificate
Share documents for each contracting
process
ocid tag tender/title tender/value/amounttender/value/currency tender/award/amount
ocds-abcde01-1234
ocds-abcde01-1234
ocds-abcde01-1234
tender
tenderAmendment
award
USD
Building a data standard
Building a data standard
Building a data standardUSD
$80,000
$90,000
$75,000
☆ ☆ Provide machine-readable data about contracts
ocid award/id supplier/identifier/scheme supplier/identifier/legalNamesupplier/identifier/id
ocds-abcde01-1234
ocds-abcde01-1234
ocds-abcde01-5316
US-EIN
supplier/name
GB-COH
ocds-abcde01-1234/A1
ocds-abcde01-1234/A2
262852431 World Wide Web Foundation Open Data Team
Aptivate04980791 Aptivate Ltd
ocds-abcde01-5316/A1 X-LOCAL 1235678 Data TeamDepartment of Data
Use, or map to, OCDS fields…
…one row per release
And break-out tables to share extra context…
Allowing users to access, combine, search and sort information on contracting processes.
☆ Upload basic open contracting information to the web
☆ ☆ ☆ Structure data using the OCDS standards
JSON
Follow the JSON schema to provide releases and records for download…
At 3 ☆s you are OCDS compliant……but you can go further…
…direct from your database……or mapping from existing systems.
OCDS
☆ ☆ Provide machine-readable data about contracts
☆ ☆ ☆ ☆ Use best practices for open data on the web
http://yoursite.gov/ocds/release/1OCDS
http://yoursite.gov/ocds/release/2OCDS
http://yoursite.gov/ocds/release/3OCDS
Each release at its own URI (web link)
Support data discovery and provide an API
Persistent, kept available in the same
place on the web
☆ ☆ ☆ Structure data using the OCDS standards
☆ ☆ ☆ ☆ ☆ Make links to other datasets
Providing links to other datasets supports the creation of ‘joined up data’ - increasing the usability and value of a
contracts dataset
☆ ☆ ☆ ☆ Use best practices for open data on the web
…
☆ ☆ ☆ ☆ Use best practices for open data on the web
Use the helpdesk
http://standard.open-contracting.org/get-involved
Community mailing list & hang-outs
Looking ahead
-
☆ ☆ ☆ ☆ Use best practices for open data on the web
Looking ahead
May/June 2015: new tools, new publishers, governance model for standard
August 2015: Version 1.1 Incorporating location and bidding information
Autumn/Winter 2015: Extractives extensions
Ongoing: Helpdesk on hand to support publishersget data online.
Discussion
