Data Science for Pervasive Intelligence

an AI flagship project for SDSI

May 23rd, 2014

Stanford UniversityComputer Science Department

Silvio Savarese

Ambient intelligence

“An environment that is sensitive to the presence of people and is capable to respond

to and predict people needs”

Zelkha & Epstein 1998; Aarts, Harwig & Schuurmans 2001):

Smart house, office or car

The intelligent home

Pervasive intelligence paradigm

• Sense the world

• Associate sensory data to semantics

• Understand human instructions

• Communicate back and act appropriately

Smart hospital rooms

Smart disaster management

Image: SERS

Key ingredients

• Personalized• Adaptive• Anticipatory• Communicative• Context aware

Context awareness

Key ingredients

• Personalized• Adaptive• Anticipatory• Communicative• Context aware• Knowledge aware

Knowledge awareness

Knowledge awareness

What could a data center do?

Don’t just need to stuck up data

but also make intelligent use of it!

What could a data center do?

Data Science for Pervasive Intelligence

Data

…

Data Science for Pervasive Intelligence

Data Semantics

…

Data Science for Pervasive Intelligence

Data

Context

Semantics

…

Data Science for Pervasive Intelligence

Data

Context

Semantics

…

Knowledge

Commu-nication

Data

Context

Data Science for Pervasive Intelligence

Semantics

…

Knowledge

Data Science for Pervasive Intelligence

Commu-nication

Data

Context

Semantics

…

Knowledge

Manning, Li, Liang, Ng, Bernstein, Re’, HanrahanSavarese, Guibas, Khatib, Thrun, Salisbury

Visual Genome ProjectFei-Fei Li

Michael Bernstein

Chris Re

Networks For Information Transport Between Data

Leo Guibas

Objects:PLATE, FORK

ON(FORK, TABLE)ON(PLATE, TABLE)ON(CAKE, PLATE)

“There is a piece of cake on a table.”

Scene Generation

3D ModelsSpatial Knowledge Base

Objects:CAKE, TABLE

ON(CAKE, TABLE)

Semantic Parsing

INTERACTION

Scene Inference

ObjectSelection

right

Text-to-3D Scene Generation

Manning, Liang, Ng, Hanrahan

24

Baby visionSavarese

Data Science for Pervasive Intelligence

Commu-nication

Data

Context

Semantics

…

Knowledge

Thank you!