Deep Learning mit PowerAI -

Ein Überblick

Stephen Lutz

Open Group Master Certified IT Specialist

Technical Sales IBM Cognitive InfrastructureIBM Germany

Stephen.Lutz@de.ibm.com

What‘s that?

… and what‘s that?

… and what‘s that?

Overall Artificial Intelligence (AI) Space

Machine Learning

Deep LearningBreak tasks into

Artificial Neural

Networks

New Data

Sources:

NoSQL,

Hadoop &

Analytics

New class of applications

Opportunity in ML Training

▪ Pattern matching

▪ Image matching (Consumer Photos)

▪ Real-time decision support

▪ Complex workflows

▪ Data Lakes

Extend Enterprise applications

▪ Finance: Fraud detection /

prevention

▪ Retail: shopping advisors

▪ Healthcare: Diagnostics and

treatment

▪ Supply chain and logistics

Extend Predictive Analytics to

Advance Analytics with AI

Human Intelligence Exhibited by Machines

Cognitive /

ML/DL

“Trained” using large amounts of data &

ability to learn how to perform the task

Growing across Compute, Middleware, and Storage

Target Industries – Deep Learning

Automotive and Transportation

Security and PublicSafety

Consumer Web, Mobile, Retail

Medicine and Biology Broadcast, Media and Entertainment

• Autonomous driving:• Pedestrian detection• Accident avoidance

Auto, trucking, heavy equipment, Tier 1 suppliers

• Video Surveillance• Image analysis• Facial recognition and

detection

Local and national police, public and private safety/ security

• Image tagging• Speech recognition• Natural language • Sentiment analysis

Hyperscale web companies, large retail

• Drug discovery• Diagnostic assistance• Cancer cell detection

Pharmaceutical, Medical equipment, Diagnostic labs

• Captioning• Search• Recommendations• Real time translation

Consumer facing companies with large streaming of existing media, or real time content

Introducing PowerAI: Get Started Fast with Deep Learning

Enabled by High Performance Computing Infrastructure

Package of Pre-Compiled Major Deep Learning

Frameworks

Easy to install & get started with Deep Learning with Enterprise-Class Support

Optimized for Performance To Take Advantage of

NVLink

PowerAI Platform

Deep Learning

Frameworks

Accelerated

Servers and

Infrastructure

for Scaling

Spectrum Scale:High-Speed Parallel

File System

Scale toCloud

Cluster of NVLinkServers

Supporting

Libraries

Caffe NVCaffe TorchIBMCaffe

Distributed TensorFlowTensorFlow

OpenBLAS

Theano

Bazel DIGITSNCCLDistributed

Communications

Chainer

PowerAI

PowerAI Enterprise: Enhancing Developer Experience

DL Frameworks + Libraries(TensorFlow, CAFFE, ..)

Data Science

Experience (DSX)

Distributed Computing

with Spark & MPI

DL Developer Tools

Spectrum Scale High-Speed File System via HDFS APIs

Scale to CloudCluster of NVLink Servers

PowerAI Enterprise (Coming)

IBM Enterprise

Support

Application Dev

Services

Fastest GPU Server with NVLink: S822LC for HPC

2.5x Faster Data Throughput

2.5x Faster CPU-GPU Data Communication via NVLink

NVLink80 GB/s (3x)

GPU

P8

GPU GPU

P8

GPU

PCIe32 GB/s

GPU

x86

GPU GPU

x86

GPU

No NVLink between CPU & GPU for x86 Servers: PCIe Bottleneck

NVIDIA P100 Pascal GPU

“Minsky”POWER8 NVLink Server

x86 Servers with PCIe

▪ High-Speed NVLink Connections between CPUs & GPUs and among GPUs

▪ Features Latest NVIDIA P100 Pascal GPU

NVIDIA P100 “Pascal” GPUs inside a Minsky system

S822LC for HPC: recommended configuration for PowerAI2 Socket, 4 GPU System with NVLink

▪ Required:– 2 POWER8 10 Core CPUs

– 4 NVIDIA P100 ”Pascal” GPUs

– 256 GB System Memory

– 2 SSD storage devices

– High-speed interconnect (IB or Ethernet, depending on infrastructure)

▪ Optional:– Up to 1 TB System Memory

– PCIe attached NVMe storage

Introducing the IBM Power Systems LC Line

S822LC For High

Performance Computing

• Incorporates the new

POWER8 processor with

NVIDIA NVLink

• Delivers 2.8X the bandwidth

to GPUs accelerators

• Up to 4 integrated NVIDIA

“Pascal” GPUs

S822LC For Big Data

• Ideal for storage-centric

and high data through-

put workloads

• Brings 2 POWER8

sockets for Big Data

workloads

• Big data acceleration

with work CAPI and

GPUs

S821LC

• Storage rich single

socket system for big

data applications

• Memory Intensive

workloads

S822LC

• 2X memory bandwidth

of Intel x86 systems

• Memory Intensive

workloads

S812LC

• 2 POWER8 sockets in a

1U form factor

• Ideal for environments

requiring dense

computing

NEWNEW

NEW

High Performance

Computing

OpenPOWER servers for cloud and cluster deployments that are different by design

Performance Leadership Roadmap for HPC / HPDA

2015 2016 2017

POWER8

POWER8 with NVLink

POWER9

OpenPowerCAPI Interface

PowerAccelInterfaces:NVLink, CAPI, PCIeGen3

PowerAccel:OpenCAPI, NVLink 2.0, PCIe Gen4

Connect-IBFDR Infiniband

PCIe Gen3

ConnectX-4EDR Infiniband

CAPI over PCIe Gen3

ConnectX-5Next-Gen Infiniband

Enhanced CAPI over PCIe Gen4

MellanoxInterconnect Technology

IBM CPUs

NVIDIA GPUsKepler

PCIe Gen3Volta

NVLink Next GenPascalNVLink

IBM Nodes

Getting Started with PowerAI

▪ Install PowerAI on your existing S822LC for HPC server

http://ibm.biz/powerai

▪ Don’t have an S822LC for HPC?– Reference architecture / system requirements are available for

the first system shipping with POWER8, NVLink, and Tesla P100

– Visit IBM POWER HPC Cloud partners to test drive these frameworks on POWER8/P100 today

• https://power.jarvice.com/ (Nimbix HPC Cloud)

IBM Systems for Cognitive Solutions

Registration:https://www-

01.ibm.com/events/wwe/grp/grp308.nsf/Agenda.xsp?openform&seminar=A98AJKES&locale=de_DE

Die Anmeldung zum DLI-Workshop am 13.07. ist nur per Mail möglich!Bitte schreiben Sie eine E-Mail mit dem Subject "Anmeldung DLI Workshop" an folgende E-Mail-Adresse:

s.mueller1@de.ibm.com

Questions?

Stephen Lutz

Open Group Master Certified IT Specialist

Technical Sales IBM Cognitive InfrastructureIBM Germany

Stephen.Lutz@de.ibm.com