Download - 13:30 Vision: Parsons Data Analytics and Society

REBECCA PARSONS

[email protected]://thoughtworks.com

CTO

BigDataData

Wednesday, November 7, 12

REBECCA PARSONS


CTO

The Evolving Panorama of Data


Changing Nature of Data

Response

How we use data nowWednesday, November 7, 12

Data is: Growing


Walmart: 1 million transactions per hour

Facebook: 40 billion photos

The Economist: Feb 25th 2010

Data is: Growing


640K ought to be enough for anybody


2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012

1,482,824

1,287,537

1,080,872

853,698

616,308

356,191

127,942

40,2238,6401,990442

Monthly Contributors to Wikipedia souce: wikipedia

Data is: Distributed





98% of internet access points in Africa are mobile

30 million networked sensor nodes

growing 30% per year

McKinsey Global Institute: Big data: The next frontier for innovation, competition, and productivity


Data is: Valuable

$300 billion / year for US health care

60% increase in retail margins

McKinsey Global Institute: Big data: The next frontier for innovation, competition, and productivity


Data is: Urgent


Data is: Connected



Response


"NoSQL"


Document

Graph

Graph

Key-value

Column-family


GraphWednesday, November 7, 12

Graph

Polyglot Persistence


Event Sourcing


Log

Application State


Data Sourceswere will be

textimagevideo

connections


Analyticswill be

pattern recognition

data mining

chasing connections

were

roll-ups

trends

variance


mapmapmapmap reduce

mapmapmapmap reduce

mapmapmapmap reduce

reduce

per order per month



10,000 ft view (literally)

CodeCity by Richard Wettel

http://www.inf.unisi.ch/phd/wettel/codecity.html






Response


Data Scientist Journalist




Data Warehousing



http://ureport.ug/Wednesday, November 7, 12

http://ushahidi.com/


http://libyacrisismap.net/Wednesday, November 7, 12

http://opendata.go.ke/Wednesday, November 7, 12


http://datawithoutborders.cc/Wednesday, November 7, 12



http://unglobalpulse.orgWednesday, November 7, 12

http://unglobalpulse.org/

http://unglobalpulse.org/

0

100

200

300

400

500

Supply Demand

Deep Analytical Talent in 2018

50% of supply

McKinsey Global Institute: Big data: The next frontier for innovation, competition, and productivityWednesday, November 7, 12


What about us?



Order-Taker Syndrome


REBECCA PARSONS


CTO

clip art from http://openclipart.org
