7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 1/55

LEAPS IN VISUAL COMPUTINGJEN-HSUN HUANG, CO-FOUNDER & CEO | GTC 2015

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 2/55

FOUR ANN

A New GPUand

Deep Learning

A Very Fast Boxand

Deep Learning

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 3/55

AMAZING YEAR IN

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 4/55

10X GROWTH IN2008

150,000

CUDA Downloads

4

,000

Academic Papers

60Universities Teaching

77Supercomputing Teraflops

6,000

Tesla GPUs

27CUDA Apps

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 5/55

2008

150,000

CUDA Downloads

4

,000

Academic Papers

60Universities Teaching

77Supercomputing Teraflops

6,000

Tesla GPUs

27CUDA Apps

2015

10X GROWTH IN

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 6/55

2015

10X GROWTH IN2008

150,000

CUDA Downloads

4

,000

Academic Papers

60Universities Teaching

77Supercomputing Teraflops

6,000

Tesla GPUs

27CUDA Apps

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 7/55

2015

10X GROWTH IN2008

150,000

CUDA Downloads

4

,000

Academic Papers

60Universities Teaching

77Supercomputing Teraflops

6,000

Tesla GPUs

27CUDA Apps

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 8/55

2015

10X GROWTH IN2008

150,000

CUDA Downloads

4

,000

Academic Papers

60Universities Teaching

77Supercomputing Teraflops

6,000

Tesla GPUs

27CUDA Apps

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 9/55

2015

10X GROWTH IN2008

150,000

CUDA Downloads

4

,000

Academic Papers

60Universities Teaching

77Supercomputing Teraflops

6,000

Tesla GPUs

27CUDA Apps

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 10/55

2015

10X GROWTH IN2008

150,000CUDA Downloads

4,000Academic Papers

60Universities Teaching

77Supercomputing Teraflops

6,000Tesla GPUs

27CUDA Apps

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 11/55

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 12/55

8 Billion Transistors

3,072 CUDA Cores7 TFLOPS SP / 0.2 TFLOPS DP12GB Memory

TITAN XTHE WORLD’S FASTEST GPU

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 13/55

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 14/55

0

1

2

3

4

5

6

7

TITAN X FORTra

   D  a

  y  s

16-core Xeon CPU TITA

~

43

 …

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 15/55

8 Billion Transistors3,072 CUDA Cores7 TFLOPS SP / 0.2 TFLOPS DP12GB Memory

TITAN XTHE WORLD’S FASTEST GPU

$999

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 16/55

FOUR ANN

A New GPUandDeep Learning

A Very Fast BoxandDeep Learning

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 17/55

A SHORT HISTORY

Convolutional Neural Networks for

Handwritten Digital RecognitionLECUN, BOTTOU, BENGIO, HAFFNER, 1998

1995 2000

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 18/55

“   Delving

Human

“   Deep Im

“   Batch N

by Red

IMAGENET CHALLENGE

Accuracy %

2010 201420122011 2013

74%

84%

DNN

CV

72%

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 19/55

THE B

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 20/55

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 21/55

GPU-ACCELERAT

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 22/55

Detecting Mitosis in Breast Cancer Cells— IDSIA

Predicting the— Johannes

DEEP LEARNING REVOLUT

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 23/55

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 24/55

USERINTERFACE

ConfigureDNN

ProcessData

GPUGPU HW GPU ClusterMulti-GPU

Theano

Torch

MonitorProgress

CaffecuDNN, cuBLAS

CUDA

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 25/55

D

Configure DNNProcess Data

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 26/55

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 27/55

DIGITS DEVBOX

“   DIGITS makes it way easier

to design the best network

 for the job”   

0x

1x

2x

3x

4x

1

Multi-GPU

AlexNet V

— Simon Osindero A.I. Architech

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 28/55

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 29/55

FOUR ANN

A New GPU

andDeep Learning

A Very Fast Box

andDeep Learning

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 30/55

   S   G   E   M   M   /   W

2008

48

36

12

0

24

60

72

GPU ROADMAP

Pascal 2x SGEMM/W

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 31/55

   F  r  a  m  e   B

  u   f   f  e  r   C  a  p  a  c   i   t  y   (   G   B   )

2008

40

30

10

0

20

50

60

GPU ROADMAP

Pascal 2.7x Memory Capacity

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 32/55

   H   G   E   M   M   /   W

2008

96

72

24

0

48

120

144

GPU ROADMAP

Pascal 4x Mixed Precision

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 33/55

   S   T   R   E   A   M   G   B   /  s

2008

600

450

150

0

300

750

900

GPU ROADMAP

Pascal 3x Bandwidth

PASCAL 1

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 34/55

PASCAL 1

CONVOLUTION FULLY CONNECTED FULLY CONNECTE(compute) (bandwidth) (bandwidth)

4x (FP16) 6x 6x

Mixed Precision 3D Memory

 forward backward 

3D Memory

FOUR ANN

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 35/55

FOUR ANN

A New GPU

andDeep Learning

A Very Fast Box

andDeep Learning

TODA

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 36/55

TODA

FPGACV ASIC

SENSE

NEXT GEN

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 37/55

NEXT-GEN

FPGACV ASIC

SENSE

NVIDIA DRIVE PX SELF

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 38/55

NVIDIA DRIVE PX SELF

FPGACV ASIC

DNN

SENSEIMAGENET CHALLENGE

Accuracy %

2010 201420122011 2013

74%

84%

DNN

CV

72%

NVIDIA DRIVE PX SELF

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 39/55

NVIDIA DRIVE PX SELF

FPGACV ASIC

DNN

SENSEIMAGENET CHALLENGE

Accuracy %

2010 201420122011 2013

74%

84%

DNN

CV

72%

NVIDIA DRIVE PX SELF

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 40/55

NVIDIA DRIVE PX SELF

FPGACV ASIC

DNN

SENSEIMAGENET CHALLENGE

Accuracy %

2010 201420122011 2013

74%

84%

DNN

CV

72%

NVIDIA DRIVE PX SELF

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 41/55

NVIDIA DRIVE PX SELF

FPGACV ASIC

DNN

SENSEIMAGENET CHALLENGE

Accuracy %

2010 201420122011 2013

74%

84%

DNN

CV

72%

NVIDIA DRIVE PX SELF

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 42/55

NVIDIA DRIVE PX SELF

FPGACV ASIC

DNN

SENSEIMAGENET CHALLENGE

Accuracy %

2010 201420122011 2013

74%

84%

DNN

CV

72%

NVIDIA DRIVE PX SELF

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 43/55

NVIDIA DRIVE PX SELF

FPGACV ASIC

DNN

SENSEIMAGENET CHALLENGE

Accuracy %

2010 201420122011 2013

74%

84%

DNN

CV

72%

PROJECT DAVE DARP

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 44/55

PROJECT DAVE — DARP

IMAGENET CHALLENGE

Accuracy %

2010 201420122011 2013

74%

84%

DNN

CV

72%

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 45/55

DAVE IN ACTION

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 46/55

TRAINING DATA225K Images

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 47/55

TEST DRIVENo Training

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 48/55

TEST DRIVEPartially Trained (52K images)

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 49/55

TEST DRIVEFully Trained (225K images)

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 50/55

Number of Connection

Frames / Secon

Connections / Secon

NVIDIA DRIVE PX SELF

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 51/55

NVIDIA DRIVE PX SELF

FPGACV ASIC

DNN

SENSEIMAGENET CHALLENGE

Accuracy %

2010 201420122011 2013

74%

84%

DNN

CV

72%

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 52/55

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 53/55

LEAPS IN VIS

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 54/55

LEAPS IN VIS

TITAN XThe World’s Fastest GPU

DIGITS DevBoxGPU Deep Learning Platform

7/23/2019 S5715 Keynote Jen Hsun Huang

http://slidepdf.com/reader/full/s5715-keynote-jen-hsun-huang 55/55