Why the Internet Future Scares Me and How Scalability is the Only Survivor Vinod Chandramouli...

Why the Internet Future Scares Me and How Scalability is the Only Survivor

Vinod Chandramouli

Technology Evangelist, Connected Devices

©2013 AKAMAI | Proprietary & Confidential - FASTER FORWARDTM

Grow revenue opportunities with fast, personalized web experiences and manage complexity from peak demand, mobile devices and data collection.We are the leading provider of cloud

services for delivering, optimizing and securing online content and business applications.

$1.6BRevenue

2,000Locations

5,000Customers

5,000Employees

CORPORATE STATS:

OUR HISTORY:

Founded 1998 and rooted in MIT technology—solving Internet congestion with math not hardware.

©2014 AKAMAI | FASTER FORWARDTM


Grow revenue opportunities with fast, personalized web experiences and manage complexity from peak demand, mobile devices and data collection.


A distributed cloud platform that manages the underlying complexities of the Internet–

• Device and format proliferation

• Application and network security

• Performance and reliability issues

The AkamaiIntelligent Platform


™

Delivers over 2 trillion Internet transactions daily

A single hop away from 90% of Internet users


1. List compiled by Fortune Magazine

http://www.tax.vt.edu/logoIRS.jpg


QUALITY EXPECTATIONS ARE ON THE RISE18,000+ distinct Android

devices — 58% more than last year

80% of all IP traffic will be video by 2018

Abandonment begins 2 seconds after

start-up time


Avoid data theft and downtime by extending the security perimeter outside the data-center and protect from increasing frequency, scale and sophistication of web attacks.

What a Difference a Few Years Makes…

63% CAGR

29PETABYTES

IN 2010

FIFA World Cup

222PETABYTES

IN 2014

12PETABYTES

IN 2010

Winter Olympics

81PETABYTES

IN 2014



1999 2002 2004 2007 2008 2009 2010 2011 2012 2013 2014+

<1 Gbps 15.9 Gbps21.0 Gbps

4GLTE

1.08 Tbps

444 Gbps1.3 Tbps

1.4 Tbps

7 Tbps

World Cup

1Gbps

7,000x

81% CAGR!

Growing Viewership


Grow revenue opportunities with fast, personalized web experiences and manage complexity from peak demand, mobile devices and data collection.

GRAND CHALLENGE FOR MEDIA

The ultimate in video quality over IP at scale


Quality Is Increasing



12,000

8,000

6,000

4,000

2,000

10,000

2000 2002 2004 2006 2008 2010 2012 2014

0

10

20

30

Pea

k T

bp

s

>26 Tbps

>60% CAGR

Traffic Growth on Akamai’s Platform


Delivering Quality at Scale

0

10 Tbps

20 Tbps

2011 peak becomes 2012 norm

1 Year

2012 peak becomes 2013 norm

2013 peak will be 2014 norm

>26 Tbps



12,000

8,000

6,000

4,000

2,000

10,000

2000 2002 2004 2006 2008 2010 2012 2014

0

10

20

30

Pea

k T

bp

s

~2020

>26 Tbps

>60% CAGR

Traffic Growth on Akamai’s Platform

FUTURE DEMAND2.5B Primetime Viewers

x 10 Mbps

~25,000 Tbps


WILL VIDEO BREAK THE INTERNET?



The Scalability Challenge



The Last Mile Has Enormous Capacity

400M Lines

10,000 Tbps

X 25 Mbps



The Problem is at the CoreCloud Data Centers

100 Major Networks

500 Tbps

X 5 Tbps



The Problem is at the CoreCloud Data Centers

500 Tbps

25,000 Tbps

2% of what

we need!=



Akamai’s Edge Strategy Today: Inside Over 1,200 NetworksAkamai Servers



THE FUTURE: Further Extending the Akamai Edge: Moving Into Homes


Delivery Innovation: Next Generation Networks

Akamai Media Client

Core Services

API

Cache

HybridHTTP/UDP

Acceleration

Predictive Video Over

CellularIP Relay

Akamai’s Innovation Initiative to Address Online Video’s Grand Challenge


The Technical Challenge: Poor Network Conditions

Network conditions begin to deteriorate when• Packet loss is > 1%• Latency is > 150ms

Factors that contribute to poor network conditions include:• Home network routers• Geographically remote users• Cellular connections


US Japan Great Britain Germany France China Canada Mexico Italy Egypt Brazil India

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

>4%

4%

2.67%

1.67%

0.67%

0.33%

0.25%

0.17%

0.08%

Packet Loss Breakdown By Country*Edge To End User* Loss Modeled On Measured Retransmission Rate Reduced By 1/3

Lar

ge

st Im

pro

vem

en

ts

Percentage of users experiencing > 0.67% packet loss

47.7% 46.4%55.5% 47.8% 50.2%

78.3%

40.5%59.2%

80.6%63.1%

75.7%52.5%


Hybrid UDP Protocol

• Hybrid HTTP/UDP protocol.

• Helps overcome TCP inefficiencies

• Reduces Video Latency and Buffer Time.

• Improves download and start up times

• Works for content delivered over the Akamai platform

• Built-in Multicast support

Internet Protocol (IP)

TCP

Astraeus Hybrid HTTP +

UDP

HTTP

Application

HTTP proxy style interface


Astraeus Workflow


Connected Device Stack

Integration Options

OS

Services / Libraries

Application Framework

App

Astraeus SDK

Astraeus SDK

App layer integration.

Service layer integration.

Standard HTTP

App


— DEMO —

Predictive Video Over Cellular


Video over Cellular. No one is happy.

• Cannot control content flow or demand • Cannot work with each content provider • Look to better utilize their network • Need to reduce cost of delivery

Mobile Operators

• Look to improve monetization • Expecting better QoE• Hurt by data caps• Cannot negotiate with each carrier

Content Providers

• Want better and more consistent experience

• Are constrained by data caps

Mobile Subscribers


Mobile Network Utilization

• Cellular networks are about 50% utilized during peak times• Surplus capacity can be utilized through controlled demand and represents a

significant monetization opportunity

Network Utilization

5 minutes window

Cellular


Solution Concept

Better mobile experience significantly changes usage patterns and affect ad revenue

Zero cost capacity opportunity

…..

50% unutilized cellular capacity

+25 GB available device storage

Carriers want to be creative when selling the next GB


Network Load Prediction

Content Download Prediction

ANDSF Server

High level architecture

Cellular

Wi-Fi

Content Download Prediction

Network Load Prediction

Media Player

ANDSF Client

Core Functionality:1. Cellular network load prediction2. Content download prediction3. ANDSF 4. Media Player5. Billing integration (Zero rating)

Storage & Battery Management


— DEMO —

Akamai’s IP Relay TURN Service


Peer-to-Peer is Predicted to Explode

APPLICATIONSReal-time Communications

CHATTING

GAMING

CONFERENCING

SALES & SUPPORT

• HTML5 & WebRTC has standardized peer-to-peer communications

• WebRTC enabled devices is growing

• A TURN solution will be required to transverse firewalls between these WebRTC connections

Source: Google, Disruptive Analysis, & ABI Research

Q1'

14

Q2'

14

Q3'

14

Q4'

14

Q1'

15

Q2'

15

Q3'

15

Q4'

15

Q1'

16

Q2'

16

Q3'

16

Q4'

16

Q1'

17

Q2'

17

Q3'

17

Q4'

17

Q1'

18

Q2'

18

Q3'

18

Q4'

18

0

1

2

3

4

5

6

7

WebRTC Enable Devices (in billions)


TURN Inefficiencies

Problem: Peer-to-peer connections are complicated by NAT devices (address- and address-port mapping). If both peers behind a NAT, they may not be able to talk directly.

Problem: TURN service can significantly impact performance when either of the end-points are far away from the centralized TURN server.

Problem: Geographically dispersed clients can have performance issues even when connecting directly due to long latency and packet loss.

Solution: Akamai's IP Relay service provides an improved, fully distributed TURN-like service

• Global deployment, fault-tolerant technology

• Akamai's famed network knowledge• SureRoute™ technology to find better

routes than the Internet• Improve Performance: UDP encoding

over the long "middle mile”

Client A

Firewall A

Client B

Firewall B

TURN Server


Akamai IP Relay Service

Problem: Peer-to-peer connections are complicated by NAT devices (address- and address-port mapping). If both peers behind a NAT, they may not be able to talk directly.

Problem: TURN service can significantly impact performance when either of the end-points are far away from the centralized TURN server.

Problem: Geographically dispersed clients can have performance issues even when connecting directly due to long latency and packet loss.

Solution: Akamai's IP Relay service provides an improved, fully distributed TURN-like service

• Global deployment, fault-tolerant technology

• Akamai's famed network knowledge• SureRoute™ technology to find better

routes than the Internet• Improve Performance: UDP encoding

over the long "middle mile”

Client A

Firewall A

Client B

Firewall B

TURN Server A

TURN Server B


How does the IP Relay service work?

CustomerDirectory Service

Client A

Firewall A

EDGE BClient B

Firewall B

Clients : Each Client is engaging in peer-to-peer communication. The clients will typically have a private IP address that is not publicly routable. Akamai serves as a globally distributed TURN service

Directory service: A customer owned and operated directory service that functions as a backend communication path for exchange of information required for connection establishment.

Clients Connect To Akamai Edge: Akamai determines the ideal Edge server for each client, providing the best connection into the Akamai Network

Akamai Optimizes traffic between Edges: The IPA network optimizes the connection by reducing latency and improving throughput, providing both clients a better experience

EDGE A


Relative Call Distances by Country/Geography

United States

Europe Asia United Kingdom

China

Long Haul

Cal

l V

olu

me

(mil

lio

ns)

Country/Geography

• 29% of all video calls are estimated to be “Long Haul” (3000+ miles apart) where latency and packet loss can be significantly higher

Distance Key (miles)

Long Haul

Long Haul

Long Haul

Long Haul

Measuring IP Relay Quality


Akamai Agent based Quality Testing Framework

SFO

LON

DataCollector

HKG

SEL

DataCollector

- Internet Connection - “Akamaized” Relay Connection

Internet

Call 1

Call 2

Test Agent

Test Agent

Test Agent

Test Agent


Akamai Agent based Test Background

• Test Agents conduct IP Relay video calls in 15 cities across 10 countries worldwide

• 1,152 video calls between test agents per day city to city through IP Relay

• Latency & packet loss captured across actual customer calls & public Internet

Test Agent Locations:

Netanya, IL Paris, FR Seoul, KR Hong Kong, CN Dallas, US

Seattle, US San Mateo, US Los Angeles, US Beijing, CN Tokyo, JP

Krakow, PL Cambridge, US Munich, DE New York, US London, UK

Packet Loss


Why Packet Loss Matters

5% Packet Loss

Effects of Packet Loss on H.264 video codec

0% Packet LossEffects of Packet Loss

Video: “Blocky” video and a frozen or jerky end user experience.

Audio: Stutter or intermittent speech.

Experience: Lower resolution video

Add skype video stats


Akamai IP Relay Reduces Packet Loss on Long Haul Calls

Packet loss on “long haul” calls reduced to sub-1%

Packet Loss metrics shown are end to end, including last mile call segments beyond the IP

relay.

Many test calls are nearly devoid of packet loss.

Packet Loss (%)

Internet Loss

Akamaized

Key

Best <-Case -> < --Acceptable --

>Unacceptable -->

Latency


Akamai Improves Latency on Long Haul Calls by up to 35%

Key

• Increased latency resulting in callers frequently talking over one another reduced effectiveness compared to audio calls

150 ms 300 ms

Gold Standard Acceptable Unacceptable

For intrinsically high latency connections, unless packet loss is tightly constrained, it becomes practically impossible to maintain a high quality video call.


Akamai Improves Latency on Long Haul Calls by up to 35%

Many long haul video calls experience unacceptable

latency over Public Internet

Latency metrics shown are end to end, including last

mile call segments beyond the IP relay.

Akamai brings many of these video calls into the “acceptable” quality

range

Latency (ms)

Internet Latency

Akamaized

Key

<--- Acceptable Unacceptable --->

Increased latency resulting in callers frequently talking over one another reduced effectiveness compared to audio calls


— THANK YOU —


BACKUP SLIDES


Host System(e.g., Android device)

Host Application (e.g., customer’s video app)

Application Core

Akamai Client

Application Integration - Local HTTP Proxy-Like Model

Host System(e.g., Android device)

Host Application (e.g., customer’s video app)

Application Core (e.g., video player, DLM)

Without The Akamai Client With The Akamai Client

HTTP Requests & Responses

AkamaiServers

HTTP

AkamaiServers

HTTP Requests & ResponsesUDP packet flowsMulticast/AMT Channels


Recap of CAD Hybrid HTTP/UDP

• HTTP/UDP Hybrid Protocol

• Advanced Congestion Control

• Based on FastTCP

• Forward Error Correction (FEC)

• Based on Raptor codes

Charts


Latency: Akamaized vs. Internet Route


Packet Loss: Akamaized vs. Internet Route


Akamai Significantly Reduces Video Call Packet Loss Up to 30% of Calls Improved by More Than 50%

Pac

ket

Loss

(%

)P

acket Loss Improvem

ent

krako

wbeij

ing

beijing

seoul

paris

sanmate

oseo

ulseo

ul

beijing

seattle

beijing

sanmate

o

sanmate

o

losange

les

losange

lespari

s

netanya

tokyo

seattle

hongkong

paris

sanmate

o

krako

w

hongkong

hongkong

beijing

tokyo

paris

sanmate

osea

ttlepari

s

sanmate

otoky

oseo

uldall

as

losange

les0

2

4

6

8

10

12

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

Country to Country Packet Loss without Akamai

FaceTime Country to Country Packet Loss with Akamai

Percentage Packet Loss Reduction with Akamai

Country to Country Packet Loss with Akamai

Date post:	16-Dec-2015
Category:	Documents
Upload:	tracey-nelson
View:	218 times
Download:	0 times

Why the Internet Future Scares Me and How Scalability is the Only Survivor Vinod Chandramouli...

Documents