Futuristic World with Sensors and Smart Devices

Samarth Shah

Infosys Labs

Outline

• Future

• Sensors• Microsoft Kinect• Leap Motion

• Smart Devices• Pebble smart watch

• Few Case Studies

Future

• “You can not connect the dots looking forward , you can only connect them looking backwards” – Steve Jobs

• Internet Of Things

• Sensors

Image Source: http://www.businessinsider.in/Morgan-Stanley-75-Billion-Devices-Will-Be-Connected-To-The-Internet-Of-Things-By-2020/articleshow/23426604.cms

Sensors

• In general “A sensor is a device which can convert one form of signals to another form of signals.”

• Specific “A sensor is a device which can convert one form of signals to another form of signals which can be understood by the machine”

• Examples:• Gesture Recognition

• Microsoft Kinect• Leap Motion

• Sound• Thermal• Pressure• Brainwave• …

Microsoft Kinect

• Initially Started as Research Project “Project Natal”

• Kinect V1 and Kinect V2• Skeleton Tracking

• Speech Recognition

• Gesture Recognition

Image Source : http://www.microsoftstore.com/store/msusa/en_US/pdp/Kinect-for-Windows-v2-Sensor/productID.298810500

http://www.microsoft.com/en-us/news/features/2011/oct11/10-31kinecteffect.aspx

http://www.codeproject.com/Articles/213034/Kinect-Getting-Started-Become-The-Incredible-Hulk

Feature Kinect V1 Kinect V2

Color Camera 640 * 480 @30fps 1920 * 1080 @30fps

Depth Camera 320 * 240 512 * 424

Infrared Capabilities No Yes

Max. Depth Distance ~4.5m ~4.5m

Min. Depth Distance 40 cm 50 cm

Horizontal Field of View 57 Degrees 70 Degrees

Vertical Field of View 43 Degrees 60 Degrees

Tilt Motor Yes No

Skeleton Joints Defined 20 joints 25 joints

Full skeleton tracked 2 6

USB standard 2.0 3.0

Supported OS Win 7 , Win 8 Win 8

Use Cases

• Gesture Controlled Website

• Gesture Controlled Robot

• Medical Field

• Education Field

• Computer Vision Research

• Raspberry Pi (Kinect V1)

• …

Leap Motion

• Tracks both hands and all 10 fingers with pinpoint precision and incredible speed.

• Two monochromatic IR cameras and Three IR LEDs

• Distance : Up to 1 meter

Image Source : https://www.leapmotion.com/

Use Cases

• Navigating a website

• Using pinch-to-zoom gestures on maps

• High-precision drawing

• Manipulating complex 3D data visualizations

Smart Devices

• A smart device is an Electronic device, generally connected to other devices/sensors or networks via different protocols.

• Examples:• SmartWatch

• Pebble

• Apple Watch

• Moto 360

• SmartPhone

• Smart Coffee Maker

• Smart Toothbrush

• …

Pebble Smartwatch

• Kickstarter Campaign

• Sensors• Black and White E-paper display

• A Vibrating Motor

• A magnetometer

• Ambient light sensor

• An Accelerometer

• Connecting external sensors ?

Use cases

• Vibrating alert for• Text messages• Emails• Incoming calls• Notifications from social

media accounts

• Remote Controller for• Phone• Camera like GoPro• And maybe for your car

Image Source: https://blog.getpebble.com

Few Case Studies

• Where sensors are used to build a cool product• OpenRelief

• OpenROV

• …

• Intelligent Devices• RoboBrain

OpenRelief

• Planning disaster relief efforts is like trying to see through fog. OpenRelief is a project to develop better communications tools that help clear that fog. This enables the right aid to get to the right places at the right time.

Image Source: http://www.openrelief.org/home/

OpenRelief

OpenRelief

• Capabilities• Take off from footpaths

• Recognize roads , people and smoke

• Photograph , Film and Map the landscape

• Measure weather , radiation and other conditions via modular sensors

• Technical Specifications• Arduino Mega to fly the plane

• Super HAD CDD fisheye camera to see

• Arduino based sensors to gather information

• Raspberry Pi to process the data

• Raspian OS to analyze the results

Robo Brain

• Robo Brain is a large-scale computational system that learns from publicly available Internet resources, computer simulations, and real-life robot trials. It accumulates everything robotics into a comprehensive and interconnected knowledge base. Applications include prototyping for robotics research, household robots, and self-driving cars.

• Challenges:• Machine Learning• Large-Scale Data Processing• Language and Dialog• Perception• AI and Reasoning Systems• Embodiment• Robotics and Automation

Future

• “Logic will take you from A to B. Imagination will take you everywhere” – Albert Einstein

• Interconnected Intelligent Sensors and Smart Devices

• JIBO

Thank You

• Samarth@outlook.com

• @SamarthShah_

• +91-9561813730