+ All Categories
Home > Documents > COMPUTER VISION, MACHINE LEARNING, AUTONOMOUS DRIVING · 2014-11-07 · Today’s Computer Vision...

COMPUTER VISION, MACHINE LEARNING, AUTONOMOUS DRIVING · 2014-11-07 · Today’s Computer Vision...

Date post: 23-May-2020
Category:
Upload: others
View: 5 times
Download: 0 times
Share this document with a friend
15
Sahin Kirtavit October 21, 2014 COMPUTER VISION, MACHINE LEARNING, AUTONOMOUS DRIVING
Transcript
Page 1: COMPUTER VISION, MACHINE LEARNING, AUTONOMOUS DRIVING · 2014-11-07 · Today’s Computer Vision Pipeline c a r p e d Data Gathering Pre-Processing Petabytes of video 10,000 hours

Sahin KirtavitOctober 21, 2014

COMPUTER VISION, MACHINE LEARNING, AUTONOMOUS DRIVING

Page 2: COMPUTER VISION, MACHINE LEARNING, AUTONOMOUS DRIVING · 2014-11-07 · Today’s Computer Vision Pipeline c a r p e d Data Gathering Pre-Processing Petabytes of video 10,000 hours
Page 3: COMPUTER VISION, MACHINE LEARNING, AUTONOMOUS DRIVING · 2014-11-07 · Today’s Computer Vision Pipeline c a r p e d Data Gathering Pre-Processing Petabytes of video 10,000 hours
Page 4: COMPUTER VISION, MACHINE LEARNING, AUTONOMOUS DRIVING · 2014-11-07 · Today’s Computer Vision Pipeline c a r p e d Data Gathering Pre-Processing Petabytes of video 10,000 hours
Page 5: COMPUTER VISION, MACHINE LEARNING, AUTONOMOUS DRIVING · 2014-11-07 · Today’s Computer Vision Pipeline c a r p e d Data Gathering Pre-Processing Petabytes of video 10,000 hours

Cars* are getting smarter …

(*) Car Computers

Page 6: COMPUTER VISION, MACHINE LEARNING, AUTONOMOUS DRIVING · 2014-11-07 · Today’s Computer Vision Pipeline c a r p e d Data Gathering Pre-Processing Petabytes of video 10,000 hours

Today’s Computer Vision Pipeline

car

ped

Data Gathering Pre-Processing

Petabytes of video

10,000 hours of video

100 thousands of images

Off-line Training

car

pe Positive and

Negative samples

Decision Tree

Data Crunching

Object Detection

Image Processing

Detection

Visualization

Offline Real-time

Page 7: COMPUTER VISION, MACHINE LEARNING, AUTONOMOUS DRIVING · 2014-11-07 · Today’s Computer Vision Pipeline c a r p e d Data Gathering Pre-Processing Petabytes of video 10,000 hours

• Highly accelerated Vision primitives• Framework

• Assemble primitives, efficient pipelining• Memory access optimizations, locality• Schedule across different HW modules• Multimedia and graphics access abstraction

• Set of sample pipelines• Training tools for classifiers

• Speedup by desktop GPU

High Performance

Vision Primitives

High Performance

Vision Primitives

Framework

Samples and Apps

VisionWorks

Page 8: COMPUTER VISION, MACHINE LEARNING, AUTONOMOUS DRIVING · 2014-11-07 · Today’s Computer Vision Pipeline c a r p e d Data Gathering Pre-Processing Petabytes of video 10,000 hours

VisionWorks Software Stack

Application Code

SamplePipelines

Tegra/Kepler dGPU

CUDA

VisionWorksFramework

OpenVX

VisionWorks APIs

…Classifier Corner Detection

FeatureTracking SLAM

Page 9: COMPUTER VISION, MACHINE LEARNING, AUTONOMOUS DRIVING · 2014-11-07 · Today’s Computer Vision Pipeline c a r p e d Data Gathering Pre-Processing Petabytes of video 10,000 hours

Example : Feature Tracking

Grab• OpenCV

Framesource• NVMedia

Find• Harris

corners

Track• Pyramidal

Lucas-Kanade

Display• OpenCV

imshow• OpenGL

VisionWorks

Page 10: COMPUTER VISION, MACHINE LEARNING, AUTONOMOUS DRIVING · 2014-11-07 · Today’s Computer Vision Pipeline c a r p e d Data Gathering Pre-Processing Petabytes of video 10,000 hours

Feature Tracking Speedup

Image Pyramid

FastCornerDetection

Harris Corner Detection

Optical Flow

8.8

21.05

84.04

21.25

1

10

100

Speedup (x) GPU vs ARM code on Tegra TK1*

Page 11: COMPUTER VISION, MACHINE LEARNING, AUTONOMOUS DRIVING · 2014-11-07 · Today’s Computer Vision Pipeline c a r p e d Data Gathering Pre-Processing Petabytes of video 10,000 hours

5 TFLOPS 2048 Cores

Maxwell The Most Advanced GPU Ever Made

Page 12: COMPUTER VISION, MACHINE LEARNING, AUTONOMOUS DRIVING · 2014-11-07 · Today’s Computer Vision Pipeline c a r p e d Data Gathering Pre-Processing Petabytes of video 10,000 hours

One is a photo,One is CG …

Page 13: COMPUTER VISION, MACHINE LEARNING, AUTONOMOUS DRIVING · 2014-11-07 · Today’s Computer Vision Pipeline c a r p e d Data Gathering Pre-Processing Petabytes of video 10,000 hours

Next-Gen Computer Vision Pipeline

Deep Neural NetworksData Creation Intelligent Car

Page 14: COMPUTER VISION, MACHINE LEARNING, AUTONOMOUS DRIVING · 2014-11-07 · Today’s Computer Vision Pipeline c a r p e d Data Gathering Pre-Processing Petabytes of video 10,000 hours

Evolution

Driver Software Designer Self Learning Machines

Page 15: COMPUTER VISION, MACHINE LEARNING, AUTONOMOUS DRIVING · 2014-11-07 · Today’s Computer Vision Pipeline c a r p e d Data Gathering Pre-Processing Petabytes of video 10,000 hours

Questions?


Recommended