The Pace of Innovation at AWS

Ian MassinghamTechnology Evangelist, AWS

@IanMmmm

What sets AWS apart from other providers?

Breadth and Depth of Services

Infrastructure

Foundation Services

Regions Availability Zones Edge POPs

Compute Storage Networking & Content Delivery

Security & Access

Infrastructure

Foundation Services

Regions Availability Zones Edge POPs

Compute Storage Networking & Content Delivery

Security & Access

Platform Services

Databases

Relational

NoSQL

Columnar

Caching

Infrastructure

Foundation Services

Regions Availability Zones Edge POPs

Compute Storage Networking & Content Delivery

Security & Access

Platform Services

Databases

Relational

NoSQL

Columnar

Caching

Analytics

Hadoop

Real time

Data warehouse

Infrastructure

Foundation Services

Regions Availability Zones Edge POPs

Compute Storage Networking & Content Delivery

Security & Access

Platform Services

Databases

Relational

NoSQL

Columnar

Caching

Analytics

Hadoop

Real time

Data warehouse

App Services

Queuing

Orchestration

App streaming

Transcoding

Email

Search

Infrastructure

Foundation Services

Regions Availability Zones Edge POPs

Compute Storage Networking & Content Delivery

Security & Access

Platform Services

Databases

Relational

NoSQL

Columnar

Caching

Analytics

Hadoop

Real time

Data warehouse

App Services

Queuing

Orchestration

App streaming

Transcoding

Email

Search

Deployment & Management

Containers

Dev/ops

Templates

Infrastructure

Foundation Services

Regions Availability Zones Edge POPs

Compute Storage Networking & Content Delivery

Security & Access

Platform Services

Databases

Relational

NoSQL

Columnar

Caching

Analytics

Hadoop

Real time

Data warehouse

App Services

Queuing

Orchestration

App streaming

Transcoding

Email

Search

Deployment & Management

Containers

Dev/ops

Templates

Mobile & Devices

Identity

Sync

Analytics

Notifications

Amazon WorkSpaces

Delivering on the promise of desktop virtualization

Most successful preview, ever

Infrastructure & admin tools

End user desktop and mobile apps

Fully managed, secure document storage and sharing service for the Enterprise

Amazon WorkDocs

Secure

Easy sharing Simple documentfeedback

Access from any device

Integrate yourcorporate directory Low cost

Is secure email and calendaring made easyAmazon WorkMail

Managed email and calendaring solution

Always available, anytime, anywhere.

Integrates with Amazon WorkDocs

Infrastructure

Foundation Services

Regions Availability Zones CDN Points of Presence

Storage(Object, Block and Archive)

NetworkingSecurity & Access Control

Platform Services

Databases

Relational

NoSQL

Columnar

Caching

Analytics

Hadoop

Real-time

Data warehouse

App Services

Queuing

Orchestration

App streaming

Transcoding

Email

Search

Deployment & Management

Containers

Dev/ops Tools

Resource Templates

Mobile & Devices

Identity

Sync

Mobile Analytics

Notifications

Applications Virtual Desktops Collaboration and Sharing

Data Workflows

Usage Tracking

Monitoring and Logs

Compute(VMs, Auto-scaling and Load Balancing)

What sets AWS apart from other providers?

Breadth and Depth of Services

What sets AWS apart from other providers?

Breadth and Depth of Services

Relentless Focus on Cost Reduction

The AWS Price Reduction Philosophy47 Price Reductions Since 2006

Infrastructure innovation

EcosystemGlobal Footprint

New FeaturesNew Services

AWS Trusted AdvisorFour reports available to all

What sets AWS apart from other providers?

Breadth and Depth of Services

Relentless Focus on Cost Reduction

Customer Driven Innovation

Small, autonomous teamsRoadmap ownership

Decoupled launch schedules

Small, “Two Pizza” Teams

Get Core Functionality in the Hands of Customers, QuicklyOperational stabilityHigh scale

Limited initial feature set

Iterate Based on Customer Feedback

AmazonRedshift

AmazonGlacier

AmazonWorkspaces

EPICCOLLABORATION

+

=

Rapid pace of Innovation

2008 2009 2010 2011 2012 2013 2014

280

159

826148

24

516

What sets AWS apart from other providers?

Breadth and Depth of Services

Relentless Focus on Cost Reduction

Customer Driven Innovation

Innovation at every level of the stack

Every day, AWS adds enough new server capacity to support all of Amazon’s global infrastructure when it was

a $7B annual revenue enterprise

Get Networks Out of the WayRelative cost of networking increasing quickly

• Server & storage prices falling fast• Network costs trending to dominate

Networking frozen in time• Vertically integrated ecosystem• Indefensible profit margins

AWS solution:• Custom net H/W & protocol stack• Private long haul links

57%

8%

18%

13%

4%Servers

Networking  Equipment

Power  Distribution  &  Cooling

Power

Other  Infrastructure

Monthly Costs

3yr server & 10 yr infrastructure amortization

AWS Global Regions Locations

US-WEST (Oregon)

GOV CLOUD

US-WEST (N. California)US-EAST (Virginia)

EU (Dublin)

EU (Frankfurt)

SOUTH AMERICA (Sao Paulo)

CHINA (Beijing)

ASIA PAC (Sydney)

ASIA PAC (Singapore)

ASIA PAC (Tokyo)

Regions

PoP

Redundant paths to transit centersTransit centers connect to:• Private links to other AWS regions• Private links to AWS Direct Connect customers• Internet through peering & paid transit

Redundant paths to transit centersTransit centers connect to:• Private links to other AWS regions• Private links to AWS Direct Connect customers• Internet through peering & paid transit

82, 864 fiber strands in regionAZs <2ms apart & usually <1ms25Tbps peak inter-AZs traffic

Why Does AWS Offer AZs?Asynchronous replication between distant data centers• Committing to an SSD order 1 to 2ms• But, LA to New York is 74ms round trip• You can’t wait 74ms to commit a transactionOn failure, difficult & high skill decision:• Fail-over & lose transactions, or• Or don’t fail-over & lose availability• Difficult choice• Use AZs for no-admin failover• Sync works when <2ms• Can be combined with regional replication for

very high availability

74ms

1 of 28 availability zones world-wide

All regions have 2 or more AZs

Each AZ is 1 or more DC- No data center is in two AZs

- Some AZs have as many as 6 DCs

DCs in AZ less than ¼ ms apart

Data centers & Availability zones

Single DC typically over 50,000 servers & often over 80,000

• Larger DCs undesirable (blast radius)

• Diminishing returns on scale

Up to 102Tbps provisioned in to a single DC

AWS custom network equipment:• Multi-ODM sourced• Amazon custom network protocol

stack

Remove the “virtualization tax”

NIC supports Supports Single Root I/O VirtualizationMuch lower latency & less latency jitter

Logarithmic  Scale

tp0 tp50 tp99 tp99.9 tp00

>2x average latency

reduction

>10x latency variability

improvement

Previous  generation

Current  generation

OEM servers• Very general designs able to run wide variety of workloads• Vast, expensive, world-wide distribution network (30% of cost)

AWS custom servers & storage• Specialized servers optimized for a specific workload• Move hot software kernels to hardware implementations• Custom Intel processors beyond commercially available clock rates• DCs, servers, networking, storage designed to integrated specs

Example Storage Rack864 disks, 2,350lb

Power InfrastructureSome DCs with custom power sub-stations

• Lower power cost & build more quickly

• Negotiated power purchasing agreements

Custom switchgear firmware3 100% carbon neutral regions:

• US West (Oregon)• AWS GovCloud (US)• EU (Frankfurt)

Thank you

ianm@amazon.com