Leveraging Unusual Data Sources

Post on 12-Apr-2017

280 views 3 download

transcript

Leveraging Unusual Data Sources

Brian Lange, Data Scientist at

(our) 6 qualities of a great data scientist

1. Statistical thinking 2. Technical acumen 3. Multi-modal communication skills 4. Curiosity 5. Creativity 6. Grit

(our) 6 qualities of a great data scientist

1. Statistical thinking 2. Technical acumen 3. Multi-modal communication skills 4. Curiosity 5. Creativity 6. Grit

Why think outside the box?

What’s exciting about“Big Data”?

thanks for the graph, Mike Stringer

taking a quantified approach where one was not previously possible is where the greatest gains get made

an example

This is Kathie.

P&G has thousands of researchers & engineers across the globe

Kathie's job is to help them work together.

WE BUILT KATHIE A PEOPLE SEARCH ENGINE

Solution 1: “expert finder”

Japan

UK

USA

JapanUK

USA

Solution 2: strategic dataviz

Japan

UK

USA

JapanUK

USA

vs. expected collaboration rate

0%

15%

-15%

Lorem Ipsum: a narrative about blankets. Author: Charlie Brown Date: 31 Jan 2012

Lorem Ipsum is a dummy text used when typesetting or marking up documents. It has a long history starting from the 1500s and is still used in digital millennium for typesetting electronic documents, page designs, etc.

In itself, the original text of Lorem Ipsum might have been taken from an ancient Latin book that was written about 50 BC. Nevertheless, Lorem Ipsum’s words have been changed so they don’t read as a proper text.

Naturally, page designs that are made for text documents must contain some text rather than placeholder dots or something else. However, should they contain proper English words and sentences almost every reader will deliberately try to interpret it eventually, missing the design itself.

However, a placeholder text must have a natural distribution of letters and punctuation or otherwise the markup will look strange and unnatural. That’s what Lorem Ipsum helps to achieve.

I would like to thank Peppermint Patty for her support on studying Lorem Ipsum as well as the infinite wisdom of Linus van Pelt and his willingness to use his blanket in my experiments.

Both of these are powered by data derived from employee reports.

determine authorship + publish date

Lorem Ipsum: a narrative about blankets.

Author: Charlie Brown Date: 31 Jan 2012 Lorem Ipsum is a dummy text used when typesetting or marking up documents. It has a long history starting from the 1500s and is still used in digital millennium for typesetting electronic documents, page designs, etc.

In itself, the original text of Lorem Ipsum might have been taken from an ancient Latin book that was written about 50 BC. Nevertheless, Lorem Ipsum’s words have been changed so they don’t read as a proper text.

Naturally, page designs that are made for text documents must contain some text rather than placeholder dots or something else. However, should they contain proper English words and sentences almost every reader will deliberately try to interpret it eventually, missing the design itself.

However, a placeholder text must have a natural distribution of letters and punctuation or otherwise the markup will look strange and unnatural. That’s what Lorem Ipsum helps to achieve.

I would like to thank Peppermint Patty for her support on studying Lorem Ipsum as well as the infinite wisdom of Linus van Pelt and his willingness to use his blanket in my experiments.

determine authorship + publish date

Lorem Ipsum: a narrative about blankets.

Author: Charlie Brown Date: 31 Jan 2012 Lorem Ipsum is a dummy text used when typesetting or marking up documents. It has a long history starting from the 1500s and is still used in digital millennium for typesetting electronic documents, page designs, etc.

In itself, the original text of Lorem Ipsum might have been taken from an ancient Latin book that was written about 50 BC. Nevertheless, Lorem Ipsum’s words have been changed so they don’t read as a proper text.

Naturally, page designs that are made for text documents must contain some text rather than placeholder dots or something else. However, should they contain proper English words and sentences almost every reader will deliberately try to interpret it eventually, missing the design itself.

However, a placeholder text must have a natural distribution of letters and punctuation or otherwise the markup will look strange and unnatural. That’s what Lorem Ipsum helps to achieve.

I would like to thank Peppermint Patty for her support on studying Lorem Ipsum as well as the infinite wisdom of

Linus van Pelt and his willingness to use his blanket in my experiments.

find citations + mentions of other employees

determine authorship + publish date

find citations + mentions of other employees

Lorem Ipsum: a narrative about blankets.

Author: Charlie Brown Date: 31 Jan 2012 Lorem Ipsum is a dummy text used when typesetting or marking up documents. It has a long history starting from the 1500s and is still used in digital millennium for typesetting electronic documents, page designs, etc.

In itself, the original text of Lorem Ipsum might have been taken from an ancient Latin book that was written about 50 BC. Nevertheless, Lorem Ipsum’s words have been changed so they don’t read as a proper text.

Naturally, page designs that are made for text documents must contain some text rather than placeholder dots or something else. However, should they contain proper English words and sentences almost every reader will deliberately try to interpret it eventually, missing the design itself.

However, a placeholder text must have a natural distribution of letters and punctuation or otherwise the markup will look strange and unnatural. That’s what Lorem Ipsum helps to achieve.

I would like to thank Peppermint Patty for her support on studying Lorem Ipsum as well as the infinite wisdom of

Linus van Pelt and his willingness to use his blanket in my experiments.

determine subject matter using Wikipedia

plastics, sustainability, 3d printing

How do you come up with this stuff?

1. define a business problem to solve

If you had 1,000 interns, what

would you have them do?

1. define a business problem to solve2. explore potential solutions

start lo-fi

refine as the needs clarify

1. define a business problem to solve2. explore potential solutions3. go hunting for data to support the solution you’ve narrowed on

1. define a business problem to solve2. explore potential solutions3. go hunting for data to support the solution you’ve narrowed on

1. define a business problem to solve2. explore potential solutions3. go hunting for data to support the solution you’ve narrowed on

inspirational kernels of

wisdom time

the place you work has problems that data has never touched

reportsoffice sensors public APIs

civic/census dataoffice network usage

social media project management tools

sensors in your products server logsCRMs

enthusiast forumsjob applications

email activity surveyscalendar data

superheroes

superheroes

managers: set up your team to be capable of taking advantage of unusual data sources

choose tools that are adaptable, and have "good I/O"

choose people that are creative.

get them up close and personal with the real business problems

thanks!@bjlange

datascope.co/team/brian-lange