Intel® Graphics Virtualization Technology
Kevin Tian
Graphics Virtualization Architect
Legal Disclaimer
INFORMATION IN THIS DOCUMENT IS PROVIDED IN CONNECTION WITH INTEL PRODUCTS. NO LICENSE, EXPRESS OR IMPLIED, BY ESTOPPEL OR OTHERWISE, TO ANY INTELLECTUAL PROPERTY RIGHTS IS GRANTED BY THIS DOCUMENT. EXCEPT AS PROVIDED IN INTEL'S TERMS AND CONDITIONS OF SALE FOR SUCH PRODUCTS, INTEL ASSUMES NO LIABILITY WHATSOEVER AND INTEL DISCLAIMS ANY EXPRESS OR IMPLIED WARRANTY, RELATING TO SALE AND/OR USE OF INTEL PRODUCTS INCLUDING LIABILITY OR WARRANTIES RELATING TO FITNESS FOR A PARTICULAR PURPOSE, MERCHANTABILITY, OR INFRINGEMENT OF ANY PATENT, COPYRIGHT OR OTHER INTELLECTUAL PROPERTY RIGHT. A "Mission Critical Application" is any application in which failure of the Intel Product could result, directly or indirectly, in personal injury or death. SHOULD YOU PURCHASE OR USE INTEL'S PRODUCTS FOR ANY SUCH MISSION CRITICAL APPLICATION, YOU SHALL INDEMNIFY AND HOLD INTEL AND ITS SUBSIDIARIES, SUBCONTRACTORS AND AFFILIATES, AND THE DIRECTORS, OFFICERS, AND EMPLOYEES OF EACH, HARMLESS AGAINST ALL CLAIMS COSTS, DAMAGES, AND EXPENSES AND REASONABLE ATTORNEYS' FEES ARISING OUT OF, DIRECTLY OR INDIRECTLY, ANY CLAIM OF PRODUCT LIABILITY, PERSONAL INJURY, OR DEATH ARISING IN ANY WAY OUT OF SUCH MISSION CRITICAL APPLICATION, WHETHER OR NOT INTEL OR ITS SUBCONTRACTOR WAS NEGLIGENT IN THE DESIGN, MANUFACTURE, OR WARNING OF THE INTEL PRODUCT OR ANY OF ITS PARTS. Intel may make changes to specifications and product descriptions at any time, without notice. Designers must not rely on the absence or characteristics of any features or instructions marked "reserved" or "undefined". Intel reserves these for future definition and shall have no responsibility whatsoever for conflicts or incompatibilities arising from future changes to them. The information here is subject to change without notice. Do not finalize a design with this information. The products described in this document may contain design defects or errors known as errata which may cause the product to deviate from published specifications. Current characterized errata are available on request. Contact your local Intel sales office or your distributor to obtain the latest specifications and before placing your product order. Copies of documents which have an order number and are referenced in this document, or other Intel literature, may be obtained by calling 1-800-548-4725, or go to: http://www.intel.com/design/literature.htm Intel, Core, Look Inside, and the Intel logo are trademarks of Intel Corporation in the United States and other countries.
*Other names and brands may be claimed as the property of others. Copyright © 2014 Intel Corporation.
GPU Virtualization
3
VM VM
Hypervisor
Intel Processor Graphics
VM …
3D Media Compute
GPU Cloud
4
Visual Understanding Cloud Graphics
GPU-as-a-service GPU-as-a-service
Store/Stream, Transcode Gaming, Remote Apps,
Rendering
Search, Surveillance
GPU Cloud
Video Delivery
Media Processing Opportunity
5
Internet video traffic is forecasted to grow at 29% CAGR and will represent 69% of consumer traffic by 2017
Source: Cisco Systems Inc., Visual Network Index (VNI), 2013, 2015
Consumer Internet Traffic
Internet Video
File Sharing
Web, Email and Data
Online Gaming
Pe
tab
yte
s p
er
Mo
nth
T
ho
usa
nd
s 2011-2018 China Online Video Industry Market
Online video market (0.1B) Year on year growth (%)
Source: 2015.1 iResearch Inc., www.iresearch.com.cn
Media Delivery Example
6
Media Cloud
OTT, VOD, Offline Video …
Transport Edge (RAN, IP, Cable)
Service Provider
Transport Edge (RAN, IP, Cable)
Service Provider
Content Provider Content Provider Content Deliver Network
Content Deliver Network
1 Video files store in cloud storage 2
Media transcoding before deliver to CDN
Servers
3 Media transcoding for client in Edge
Laptop
VM VM VM VM VM VM
VM VM VM SDN
NFV
Data Center
Edge Cloud
Realtime, Video Conf, video awareness
Servers
Requirements of GPU Virtualization
hcsvg hb b Performance
Capability
Sharing
Direct GPU acceleration
Consistent visual experience
Multiple Virtual Machines
Intel Confidential
GPU Virtualization Approaches
8
API Forwarding Direct Pass-thru Full GPU Virtualization
Pros: • Performance • Sharing
Cons: • No media/GPGPU • Compatibility
Pros: • Performance • Capability
Cons: • No sharing
Pros: • Performance • Capability • Sharing
Intel® Graphics Virtualization Technology
Intel® GVT-s for API level GPU sharing Make existing API forwarding protocols running best on Intel platform
Intel® GVT-d for direct GPU passthrough Xen GPU passthrough upstreaming in progress
KVM PoC patch in community
Intel® GVT-g for vGPU based sharing Achieve a good balance of performance, feature and sharing
Xen implementations (a.k.a XenGT) in production quality on HSW
BDW support is in alpha quality in 2015/Q1 release
KVM support (a.k.a KVMGT) in prototype quality on HSW
9
Intel GVT-g: Full GPU Virtualization
Performance Performance Feature Feature Sharing Sharing
3DMark: 80%
H.264 transcoding: 90% (of native performance)
Native driver
DirectX 11.1, OpenGL 4.2, OpenCL 1.2, MediaSDK x.x
HSW BDW SKL …
Simultaneously accelerate multiple
VMs
Building Blocks
11
Host OS or VM
ISV Guest OS Ubuntu*14.04 LTS
OpenStack*
Nova Control point
OpenStack*
Nova Control point
Xen* Hypervisor Xen* Hypervisor
Intel Xeon® E3 Processor
ISV Guest OS Windows* 7 64bit
ISV Guest OS Windows 8 32bit
Media Server Video
Conference
Media Server Video
Conference
KVM Hypervisor KVM Hypervisor
Intel HD Driver Intel HD Driver
4th generation Intel® Core™ i7
Cloud Infrastructure
Media Server Real Time
Transcoding
Media Server Real Time
Transcoding
Intel HD Driver Intel HD Driver
Media Server VoD streaming Media Server
VoD streaming
Intel® HD Driver Intel® HD Driver
Intel® Media SDK Intel® Media SDK
OpenStack Network node
OpenStack Network node
OpenStack Storage/Image
OpenStack Storage/Image
XenGT XenGT KVMGT KVMGT
ISV/Non Intel ISV/Non Intel
Intel Hardware
Intel Own
Intel Contributed
Intel Media SDK Intel Media SDK Intel Media SDK Intel Media SDK GPU instance GPU instance
Video Conference Usage Case
12
Media Server Pool (x86 platform with
Intel® Processor graphics)
4K Display
Intel Processor graphics-based Encoding, Decoding, and Composing.
OpenStack* Media Cloud 1080P Camera
4K Camera
4K Video Conferencing on Media Plane NFV Demo @ MWC’15
Performance Summary
13
Avg S90% of native H.264 transcoding performance
0.0
50.0
100.0
150.0
200.0
250.0
300.0
350.0
400.0
450.0
High Density workload: 1080p transcoding
native vMediaServer
0.0
200.0
400.0
600.0
800.0
1000.0
1200.0
1400.0
1ch-D1 5ch-D1 10ch-D1 20ch-D1 25ch-D1 30ch-D1
High Density workload: 480p transcoding
Native vMediaServer
Config: I7 4770, Guest Ubuntu* 14.04LTS, 4GB mem, 1.5G GraphicMem, MediaSDK
CPU Transcoding vs. GPU Transcoding
14
Lab data. Config: I7 4770, Guest Windows* 7_x64, 4GB mem, 1.5G GraphicMem, MediaSDK
22.579
37.426
66.11 60.925
159.448
131.142 137.496
142.4
0.00%
20.00%
40.00%
60.00%
80.00%
100.00%
120.00%
0
20
40
60
80
100
120
140
160
180
1 vCPU 2 vCPU 4 vCPU 6 vCPU
CP
U%
uti
liz
ed
FP
S t
hro
ug
hp
ut
vCPU vs Intel® Graphics Virtualization Technology (Intel® GVT-g) total fps
(1ch x 1080p MPEG2->720p H264 transcoding)
IA Software Solution Intel GVT-g basedSW Solution vCPU % Intel GVT vCPU %
Performance boost with Intel GVT-g!
Q&A
Intel Confidential