Sahin KirtavitOctober 21, 2014

COMPUTER VISION, MACHINE LEARNING, AUTONOMOUS DRIVING

Cars* are getting smarter …

(*) Car Computers

Today’s Computer Vision Pipeline

car

ped

Data Gathering Pre-Processing

Petabytes of video

10,000 hours of video

100 thousands of images

Off-line Training

car

pe Positive and

Negative samples

Decision Tree

Data Crunching

Object Detection

Image Processing

Detection

Visualization

Offline Real-time

• Highly accelerated Vision primitives• Framework

• Assemble primitives, efficient pipelining• Memory access optimizations, locality• Schedule across different HW modules• Multimedia and graphics access abstraction

• Set of sample pipelines• Training tools for classifiers

• Speedup by desktop GPU

High Performance

Vision Primitives

High Performance

Vision Primitives

Framework

Samples and Apps

VisionWorks

VisionWorks Software Stack

Application Code

SamplePipelines

Tegra/Kepler dGPU

CUDA

VisionWorksFramework

OpenVX

VisionWorks APIs

…Classifier Corner Detection

FeatureTracking SLAM

Example : Feature Tracking

Grab• OpenCV

Framesource• NVMedia

Find• Harris

corners

Track• Pyramidal

Lucas-Kanade

Display• OpenCV

imshow• OpenGL

VisionWorks

Feature Tracking Speedup

Image Pyramid

FastCornerDetection

Harris Corner Detection

Optical Flow

8.8

21.05

84.04

21.25

1

10

100

Speedup (x) GPU vs ARM code on Tegra TK1*

5 TFLOPS 2048 Cores

Maxwell The Most Advanced GPU Ever Made

One is a photo,One is CG …

Next-Gen Computer Vision Pipeline

Deep Neural NetworksData Creation Intelligent Car

Evolution

Driver Software Designer Self Learning Machines

Questions?