Post on 14-Nov-2021
transcript
Copyright © 2018 Arm, All rights reserved.
#Arm Tech Symposia
Roadmap for the cloud to edge infrastructure for a world of 1T intelligent devicesBrian Jeff
Sr. Director, Product Management
Arm
2Copyright © 2018 Arm , All rights reserved.
Today’s compute model
Stream DownloadDistribute
Video IP content
(70% of Internet traffic)
Consume
Cloud Data Centers
Create& Distribute
Billionsof Devices
3Copyright © 2018 Arm , All rights reserved.
Compute model must change to manage 1T edge devices
Cloud Data Centers
1
TrillionDevices
Massive Amounts of Data
4Copyright © 2018 Arm , All rights reserved.
New compute/networking/storage/security architectures
1
TrillionAutonomousMachines & Smart Devices
Massive Amounts of Data
N+S+SOffloadCPU GPU TPU
Cloud Data Centers
5Copyright © 2018 Arm , All rights reserved.
New distributed compute model
Critical Data
N+S+S OffloadCPU GPU TPU
Cloud Data Centers
Cloud Tiers N+S+S Offload
CPU GPU TPU
Edge Clouds
N+S+S Offload
CPU
Critical Data
Massive Amounts of DataLocal Decisions
5G
1
TrillionAutonomousMachines & Smart Devices
Analyze& Store
Filter
& React
6Copyright © 2018 Arm , All rights reserved.
New infrastructure to unleash the brilliance of 1T Arm devices
Critical Data
N+S+S OffloadCPU GPU TPU
Cloud Data Centers
Cloud Tiers N+S+S Offload
CPU GPU TPU
Edge Clouds
N+S+S Offload
CPU
Critical Data
Massive Amounts of Data
5G
1
TrillionAutonomousMachines & Smart Devices
The New Infrastructure Will Be Designed from the Edge In
© 2
01
8A
rm L
imit
ed
The Cloud to Edge Infrastructure Foundationfor a World of 1T Intelligent Devices
© 2
01
8A
rm L
imit
ed
High Performance, Secure IP and Architectures
Diverse Solutions and Ecosystem
Scalable from Hyperscale to the Edge
The Cloud to Edge Infrastructure Foundationfor a World of 1T Intelligent Devices
© 2
01
8A
rm L
imit
ed
Diverse Solutions and Ecosystem
Scalable from Hyperscale to the Edge
High Performance, Secure IP and Architectures
The Cloud to Edge Infrastructure Foundationfor a World of 1T Intelligent Devices
10Copyright © 2018 Arm , All rights reserved.
Cloud ServerControl plane
ZeusPlatform
PoseidonPlatform
AresPlatform
Arm Neoverse IP roadmap – commitment to infrastructure
CosmosPlatform
Cortex-A72, A75
CMN-600
GIC, MMU
DDR4, 16nm
Zeus CPU
CMN,
GIC, MMU
DDR5, 7nm+
Poseidon CPU
CMN,
GIC, MMU
5nm
Ares CPU
CMN + CCIX
7nm
Silicon in
market2020 2021Today 2019
11Copyright © 2018 Arm , All rights reserved.
Arm Neoverse IP performance roadmap
AresPlatform
ZeusPlatform
PoseidonPlatform
CosmosPlatform
DDR4, 7nm
DDR5, 7nm+
5nm
2020 20212019Silicon in
marketToday
12Copyright © 2018 Arm , All rights reserved.
Secure platform software architecture
UEFI/EDK-II boot loader
Arm TrustZone Architecture - system-wide hardware isolation
Trusted firmware: PSCI, SMC, MM & SCMI
Operating System
Arm platform standards
User Applications
Industry standards
TCG, NIST,OCPEcosystem IP
Secure Arm Platform
Hypervisor
VM VM VM
Co
nta
ine
r
Co
nta
ine
r
Co
nta
ine
rArm ServerReady
test suite
Ecosystem security software
e.g. FW, boot-loader, BIOS
Neoverse CPU and System IP
CryptoIsland Secure Enclave
Trusted Execution
Environment (TEE)
LEGEND
Arm ecosystem
Compliance & standards
Arm open-source SW
Arm IP & Architecture
© 2
01
8A
rm L
imit
ed
High Performance, Secure IP and Architectures
Scalable from Hyperscale to the Edge
Diverse Solutions and Ecosystem
The Cloud to Edge Infrastructure Foundationfor a World of 1T Intelligent Devices
14Copyright © 2018 Arm , All rights reserved.
Maximum efficiencyData plane
Cloud serverControl plane
ZeusPlatform
PoseidonPlatform
HeliosPlatform
AresPlatform
Diversity - Arm Neoverse IP
CosmosPlatform
Cortex-A55
Cortex-A72, A75
CMN-600
GIC, MMU
DDR4, 16nm
Zeus CPU
CMN,
GIC, MMU
DDR5, 7nm+
Poseidon CPU
CMN,
GIC, MMU
5nm
Ares CPU
CMN + CCIX
GIC, MMU
7nm
2020 20212019Silicon in
marketToday
15Copyright © 2018 Arm , All rights reserved.
Tiered acceleration:
Local cluster, global,
Off-chip
Configurable:
Diversity - broad SoC design options with Arm
Cache size, core count
SIMD width
Arm Architectural designArm IP
Custom Arm High performance CPUCustom Fabric & IP
Accelerators
High performance CPUs
Foundry
Memory
Data plane CPUs
IO
TSMC 7FF, Samsung 7LPP, UMC
CMN FabricOther IP
ML, on-die FPGA
Networking, security, encryption
Video, Custom
DDR, HBM, Flash, Storage Class memory
PCIe, CCIX, 100G+ ethernet
Common Software Platform and EcosystemArm Architecture v8.x-A
© 2
01
8A
rm L
imit
ed
Diverse Solutions and Ecosystem
High Performance, Secure IP and Architectures
Scalable from Hyperscale to the Edge
The Cloud to Edge Infrastructure Foundationfor a World of 1T Intelligent Devices
17Copyright © 2018 Arm , All rights reserved.
Arm CPUs
128 big256 data plane
Bandwidth1 TB/s
System cache128MB
HBM8
DDR channels8
4
20 GB/s
0 MB
0
1
1ch DDR4
CMN 10G
RadioHelios CPUs
CMN
8ch DDR4PCIe 100GbE CCIX
Scalable IP system solutions from cloud to edge
Edge AccessN+S+S OffloadCPU GPU TPU
Cloud Data Centers
Cloud Tiers N+S+S Offload
CPU GPU TPU
Edge Clouds
N+S+S Offload
CPU
5G
18Copyright © 2018 Arm , All rights reserved.
Scalable system
Scalable Mesh interconnect
Designed together with Arm CPUs
0, 8, 16,32,64, 128MB cache
4 to 64 home nodes
Agile: can include mapped memory
Sustained bandwidth to 1TB/s
CMN
19Copyright © 2018 Arm , All rights reserved.
Scalable system
100GbE
A72, Ares
2x4 mesh
8 to 16 high performance CPUs
Or 32 small CPUs – A55, Helios
2ch DDR4
CMN
PCIe CCIX
20Copyright © 2018 Arm , All rights reserved.
Custom Acceleration
Network+Storage+Security Offload
100GbE
A72, Ares
Scalable system
2x4 to 4x4 mesh
16~24 CPU
16+ MB system cache
2ch DDR4
RDMA
Packet Inspection
TCP/IP offload
De-duplication
Compression
NVMe-OF Offload
Crypto
IPSec
Secure Enclave
Storage Security
WorkloadsOVS, IPSec, RoCE, NFV, software defined network/storage, virtualization
Network
CMN
35~65W Power budget
PCIe CCIX
$3.5B revenue opportunity to cloud vendor
21Copyright © 2018 Arm , All rights reserved.
Custom Acceleration
Network+Storage+Security Offload
100GbE
A72, Ares
Scalable system
2x4 to 4x4 mesh
16~24 CPU
16+ MB system cache
2ch DDR4
RDMA
Packet Inspection
TCP/IP offload
De-duplication
Compression
NVMe-OF Offload
Crypto
IPSec
Secure Enclave
Storage Security
WorkloadsOVS, IPSec, RoCE, NFV, software defined network/storage, virtualization
Network
CMN
35~65W Power budget
PCIe CCIX
$3.5B revenue opportunity to cloud vendor16 vCPUs per server lost to management1M servers * 16 vCPUs * $220/core/year
Smart Offload
22Copyright © 2018 Arm , All rights reserved.
Cloud server
Arm enables more performance per socket48, 64, 96 Arm cores per socket
100~200W Power budget
Scalable system
8x8 1TB/s mesh
48, 64, 96 CPU
64MB system cachePCIe CCIXAres, Zeus
ML Accelerator
Flash, SCM
8ch DDR
CryptoIslandSecure Enclave Smart Offload
SecurityNetwork Storage
CMN
WorkloadsJava, NGINX, Docker, Kubernetes, DB, Hadoop, Ceph, etc.
23Copyright © 2018 Arm , All rights reserved.
Cloud server
Arm enables more performance per socket48, 64, 96 Arm cores per socket
100~200W Power budget
Scalable system
8x8 1TB/s mesh
48, 64, 96 CPU
64MB system cachePCIe CCIXAres, ZeusCMN
ML Accelerator
Flash, SCM
8ch DDR
CryptoIsland
Server Compute Node
Smart Offload
SecurityNetwork Storage
WorkloadsJava, NGINX, Docker, Kubernetes, DB, Hadoop, Ceph, etc.
24Copyright © 2018 Arm , All rights reserved.
Cloud server
Arm enables more performance per socket48, 64, 96 Arm cores per socket
100~200W Power budget
Scalable system
8x8 1TB/s mesh
48, 64, 96 CPU
64MB system cache
Multi-socket
WorkloadsJava, NGINX, Docker, Kubernetes, DB, Hadoop, Ceph, etc.
8ch DDR
PCIe CCIXAres, ZeusCMN
ML Accelerator
Flash, SCM
CCIX
CCIX
Server Compute Node 2
Server Compute Node 1
Smart Offload
SecurityNetwork Storage
CryptoIsland
25Copyright © 2018 Arm , All rights reserved.
5G wireless and edge access
1ch DDR4
CMN 10G
Radio
ML
Helios CPUsCryptoIslandSecure Enclave
Arm enables more performance at the far edgemicroMEC, RRH, DFE, DPU
<15W Power budget
Bulk crypto offload
Scalable system
2x2 or 2x4 mesh
16 to 32 high efficiency CPUs
A55, Helios
Workloads4G/5G baseband, wireline, edge gateway
© 2
01
8A
rm L
imit
ed
High Performance, Secure IP and Architectures
Scalable from Hyperscale to the Edge
Diverse Solutions and EcosystemCommon software platform
The Cloud to Edge Infrastructure Foundationfor a World of 1T Intelligent Devices
© 2
01
8A
rm L
imit
ed
Endorsed by a robust ecosystem
Silicon Cloud Systems Operators
A M P E R E
Tencent Cloud
orange
© 2
01
8A
rm L
imit
ed
Endorsed by a broad and growing open networking and server ecosystem
Open SourceProjects Server& networking
Dev Tools &Resources
Container &Virtualization
Operating Systems
Language &Libraries
© 2
01
8A
rm L
imit
ed
High Performance, Secure IP and Architectures
Diverse Solutions and Ecosystem
Scalable from Hyperscale to the Edge
The Cloud to Edge Infrastructure Foundationfor a World of 1T Intelligent Devices
30Copyright © 2018 Arm , All rights reserved.
Trademark and copyright statementThe trademarks featured in this presentation are registered and/or unregistered trademarks of <COMPANY NAME> (or its subsidiaries) in the EU and/or elsewhere. All rights reserved. All other marks featured may be trademarks of their respective owners.
Copyright © 2018
Thank You!
30