Smarter places (AI Forum)

transcript

Wei-Chao Chen, Ph.D.Co-Founder, Skywatch Inc.

Adjunct Faculty, National Taiwan Universityweichao.chen@skywatch24.com

SMARTER PLACES

1998 2002 2006 2010 2016

ABOUT MYSELF

HOUSE ROBOTS

Source: turbosquid.com

NEURAL NETWORKS ARE EASILY FOOLED

“Intriguing properties of neural networks”,Szegedy, Zaremba, Sutskever, Bruna, Erhan, Goodfellow, Fergus, ICLR 2014.

CorrectRecognition

IncorrectRecognition

HAL 9000, 2001: A Space Odyssey

HARMLESS CONTROL

Source: http://mcfallliving.blogspot.tw/

Too Harmless?

GOLDBERG MACHINES

“Isaac Newton vs. Rube Goldberg”, 2D House https://www.youtube.com/watch?v=HnnMOx9_eBY

SKYWATCH’S LAW OF ROBOTICS

Informed decisionsIntelligent observations

Places Human

IF { } THEN { }

my daughterjust came homewith this punkI saw the otherday at school

add baseballbat to myshopping cart

Your place is your friend

TECH HIGHLIGHTS

Scalable Architecture

- Distributed Architecture- SureConnect

- P2P, Direct, Relay

318 BROADCASTING

High-bandwidthvideo traffic

Low-bandwidthAPI traffic

System Architecture

Overview (Dual Region)

Storage SAN

ComputeServers

StreamingServers

Region AP2P

Storage SAN

ComputeServers

StreamingServers

Region B

UserDB

ApplicationServersApplicationServers

TECH HIGHLIGHTS

Smarter Cameras

- Cloud-Edge Collaboration- Computer Vision Technology

CLOUD COMPUTATION(SOMEWHAT POINTLESS)

The Internet

Meta-dataCompute

HYBRID COMPUTATION(OUR VISION)

Early Vision

Partial Meta-data

The Internet

Late Vision

Data model Video storage

Various meta-data

results

SMART FAST FORWARD

Video activity level

Single button interface

SMART FAST FORWARD

•20x average speedup

•Compressed domain processing

•30x faster processing compared to competition

•3 seconds for every 10 minutes

SMART DAILY•Intelligent video summary

•Daily email on your past day’s activity

- Compressed domain analysis

- Very fast - totally I/O bound

- Detect events based on activity / sensible motion

TECH HIGHLIGHTS

Sensible Integration

- Hybrid Action Technology- Open RESTFul API

HYBRID ACTIONSkywatch Servers

User rules andtriggers

shadow macro

Gateway #1 Gateway #2

smoke switchcamera camera motion temp

shadow macro

No Internet

Local triggersstill work!

FIELD EXPERIENCES

EARLY LESSONS: #1

BobBob

Charles

Very early mistake — this won’t happen again

TESTABILITY

Test Subject

Support Units Interface

Sandbox (Truman’s world)

TESTABILITY

Test Subject

Test Data

Fake Camera Interface

Really hard to make a good fake device

USER BEHAVIOUR

•The most asked about features before purchase are seldom used in practice

•e.g. event notification (very annoying)

•be careful about listening to customers — fulfilling careless requests may ruin your product

INSTALLATION

•“Easy installation” is a requirement, not a feature.

•Consider the entire installation process

•e.g. for cameras, need to provide mount, drilling instructions, screws, power connectivity, network cables (sufficient length), router configuration, etc.

•#1issue for pro installer : router password?

•#1 issue for end user : power and network cabling

INSTALLATION

•Mesh network — very hard to deploy and stabilise

•customer: “they needed to come back every week to add the dongles and do some testing, and it took them 3 months overall”

SERVICE

•IoT: buy-once, service-forever product (!)

•Asking end user to pay for service is very hard

•Smarter tools needed to diagnose the end-user problem

•Usually the problem is network, but it is always your fault

MARKET

•IoT is not winner-take-all

•Services are location dependent

•Great news for us!

•Building channels are very hard

•Security is a very conservative market

Control

Converse

Connect

Almost there!

Wei-Chao Chen, Ph.D.Co-Founder, Skywatch Inc.

Adjunct Faculty, National Taiwan Universityweichao.chen@skywatch24.com

SMARTER PLACES