1

SmartGrid and Spotfire Cloud Computing - Similarities in Innovation

Dr. Brand NiemannDirector and Senior Enterprise Architect – Data Scientist

Semantic Communityhttp://semanticommunity.info/

AOL Government Bloggerhttp://gov.aol.com/bloggers/brand-niemann/

February 9, 2012

2

Overview

• The SmartGrid• Cloud Computing• Open Energy Information Marathon Mashup

and Smart Grid Data Sets• My Data Science Process

3

The SmartGrid

http://www.smartgrid.gov/the_smart_grid#smart_grid

4

Cloud Computing• Characteristics: on-demand, scalable, elastic, and provisioned IT services from

computers and software on the Internet.• Report to the President and Congress on "Designing a Digital Future" that talks

about the importance of federal agencies having "interoperability interfaces" like the Smart Grid: – “The means by which components of the smart grid can talk to each other, for

example, or by which electronic health records can be shared and added to by many parties – are an important stimulus to technology innovation and adoption. Optimally, these interfaces would be open: anyone may create products that use the interfaces without paying fees; and a public, transparent process is used to establish and revise the standards that define the interfaces."• See Cross-Cutting Themes in the Designing a Digital Future Report.

• In my editorials for Federal Computer Week, I described a cloud computing interoperability interface for data sets as:– "Everything within Three Mouse Clicks: See the Data, Search the Data, and Download

the Data."

5

Data.gov Mashathon 2010:An Energy Mashup

http://en.openei.org/apps/mashathon2010/

Click on Washington, DC

See Below on Next Page

6

Data.gov Mashathon 2010:An Energy Mashup

http://en.openei.org/apps/mashathon2010/

Data Sources: See Next Slide

Digitize These Three Graphics

7

Data.gov Mashathon 2010:An Energy Mashup

http://www.eia.gov/cneaf/electricity/esr/table5.html

8

OpenEI Smart Grid

http://en.openei.org/wiki/Gateway:Smart_Grid

Click on Location and Get Only Name

9

Open EI Smart Grid Projects

http://en.openei.org/wiki/Category:Smart_Grid_Projects

Download CSV, But Only Get Part of the Data

Google Map

10

Individual Open EI Smart Grid Project

http://en.openei.org/wiki/ALLETE_Inc.,_d/b/a_Minnesota_Power_Smart_Grid_Project

11

Smart Grid Project UpdateNovember 2011 in PDF

http://energy.gov/sites/prod/files/SGIG%20Awards%20by%20Category%202011%2011%2015.pdf

Same as the Web!

12

Open EI Data Sets

http://en.openei.org/datasets/

A Search for Smart Grid Yields No Data Sets!

13

My Data Science Process

• 1. Get the metadata (data about the data)• 2. Get the data (usually in a spreadsheet)• 3. Combine 1 and 2 (usually by adding web

addresses to 1 in 2)• 4. Import spreadsheet to Spotfire and create

the visualizations• 5. Write the story referencing all the previous

14

1. Get the metadata (data about the data)

http://semanticommunity.info/AOL_Government/Open_Energy_Information_(OpenEI)_Innovations

15

2. Get the data (usually in a spreadsheet)

http://semanticommunity.info/@api/deki/files/17146/=OpenEI02062012.xlsx

3. Combine 1 and2 (usually by addingweb addresses to 1 in 2)

Note: I did not build a Data Warehouse or do major ETL!

16

Map data ©2012 Europa Technologies, INEGI, MapLink, Tele Atlas - Terms of Use

Google MapReconstructed Google Map TilesInto One Map for Import to Spotfire

17

4. Import spreadsheet to Spotfire and create the visualizations

Web Player

Click on Location and See Data!

18

4. Import spreadsheet to Spotfire and create the visualizations

Web Player

19

4. Import spreadsheet to Spotfire and create the visualizations

Web Player

20

5. Write the story referencing all the previous

http://semanticommunity.info/AOL_Government/Open_Energy_Information_(OpenEI)_Innovations

Spotfire provides and interoperability interfacelike the Smart Grid - multiple visualizations“talk to one another.”