Plenario:The Next Stage in Open Data

Brett GoldsteinCfA Summit

September 23, 2014@bjgol

But first... what a year

We’ve gone from 0 1How do we go further?

Two friends got together...

and with a lot of help...

One APIOne query

Central data store

Socrata, CKAN, and CSV

City, county, state, and federal

Single spatial index

Single temporal index

Rich context and joins

Plenar.io

http://plenar.io/v1/api/detail/ ?dataset_name=crimes_2001_to_present &obs_date__ge=2014-1-1 &iucr=0110 &weather=true

goo.gl/NaFQ4r

objects: [{observation: {

case_number: "HX268077", domestic: false, primary_type: "HOMICIDE", district: 8, arrest: true, location: "(41.740149334, -87.702275654)", description: "FIRST DEGREE MURDER", beat: 834, date: "2014-05-19T17:04:00", ward: 18, iucr: "0110", location_description: "ALLEY", fbi_code: "01A", block: "084XX S KEDZIE AVE"

},weather: {

wind_speed: 21, sealevel_pressure: 29.98, sky_condition: "SCT070 BKN140 OVC200", wind_direction: "160", visibility: 10.0, wind_direction_cardinal: "SSE", relative_humidity: 34, hourly_precip: null, drybulb_fahrenheit: 70.0, station_pressure: 29.32, wban_code: "14819"

}}, {

observation: {case_number: "HX332990", domestic: false, primary_type: "HOMICIDE", district: 22, arrest: false, location: "(41.703648763, -87.635632145)", description: "FIRST DEGREE MURDER", beat: 2233, date: "2014-07-06T00:07:00", ward: 34, iucr: "0110", location_description: ”HOUSE", fbi_code: "01A", block: "104XX S NORMAL AVE"

},weather: {

wind_speed: 9, sealevel_pressure: 30.01, sky_condition: "SCT038 SCT080", wind_direction: "230", visibility: 10.0, wind_direction_cardinal: "SW", relative_humidity: 73, hourly_precip: null, drybulb_fahrenheit: 69.0, station_pressure: 29.38, wban_code: "14819"

}}, {

observation: {case_number: "HX343780", domestic: true,

goo.gl/NaFQ4r

http://plenar.io/examplesTell me the story of 700 Howard Street.

Give me weekly counts of 311 requests for every city in the country.

Let me download all pothole reports from the census tract containing the Sears Tower.

What recent traffic accidents in Manhattan resulted in a fatality—and what was the weather like?

Show me civilizational collapse during Winter Storm Nemo (Feb 2013).

Extensible tools: goo.gl/CpeuFa

You build the apps

We built the API

Let’s be smarter

Behind the curtain

id

Where the $$$ came from

• UrbanCCD• University of Chicago• DataMade AWS Schema

Who made it

• National Science Foundation EAGER grant

• MacArthur Foundation

Thank youhttp://plenar.io

@bjgol