+ All Categories
Home > Documents > Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and...

Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and...

Date post: 29-Dec-2015
Category:
Upload: sheena-small
View: 215 times
Download: 1 times
Share this document with a friend
Popular Tags:
22
Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery System
Transcript
Page 1: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.

Ming-Chen Zhao, Paarijaat Aditya, Yin LinAndreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon

A First Look at a Hybrid Content Delivery System

Page 2: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.

Powering a Better Internet © 2011 Akamai

Akamai Network Deployment

160000+Servers

1000+Networks

79+Countries

2500+POPs

Page 3: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.

Powering a Better Internet © 2011 Akamai

Akamai Peak Instant and Daily Statistics

• Bit rate (01/09/11): 4.8 Tbps• Request rate (02/21/11): 16.7 million hits/sec

• Bytes delivered (12/27/10): 42.3 Pbytes• HTTP requests received (02/21/11): 961.5 billion• Unique client IPs (02/16/11): 471.5 million

Page 4: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.

Powering a Better Internet © 2011 Akamai

Download Manager Product/Service

• Hybrid between a fixed-infrastructure CDN and a pure peer-to-peer delivery system

• Based on technology developed by Red Swoosh (acquired by Akamai in 2007)• Goal is to deliver large files at lower cost

Page 5: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.

Powering a Better Internet © 2011 Akamai

NetSession Interface

• client-side software• runs as a service on Windows or MacOS• provides an API to installation software or

browser• stays connected to an Akamai Control Node• each installation is supposed to have a

unique GUID

Page 6: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.

Powering a Better Internet © 2011 Akamai

Growth in Number of Installations

Full product roll-out expected summer 2011.

Page 7: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.

Powering a Better Internet © 2011 Akamai

Architecture

• BitTorrent-like protocol with control nodes serving as “trackers” and assigning peers

• CDN acts as a backstop

Akamai Control Nodes Akamai Edge Servers

Peers

Page 8: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.

Powering a Better Internet © 2011 Akamai

Logging

• Content providers want all downloads to be logged

• Peers must report P2P downloads to control nodes as they occur

• Akamai Edge Servers also log downloads from peers

Page 9: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.

Powering a Better Internet © 2011 Akamai

Statistics from December 2010 Logs

Page 10: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.

Powering a Better Internet © 2011 Akamai

Locations of Clients per EdgeScape

Granularity of predictions varies by continent.

Page 11: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.

Powering a Better Internet © 2011 Akamai

December Client Logins

What happened December 8?

Page 12: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.

Powering a Better Internet © 2011 Akamai

IP Addresses per GUID in December

Category 3 (flagged) look like multiple installations with the same GUID.

Page 13: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.

Powering a Better Internet © 2011 Akamai

Clients Leave P2P Setting Unchanged

Content provider decides on initial setting.

Page 14: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.

Powering a Better Internet © 2011 Akamai

File Size Distribution

For customers other than J and F, median file size was 872MB.

Page 15: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.

Powering a Better Internet © 2011 Akamai

P2P Efficiency for Largest Enabled Customers

Matches or exceeds earlier predictions.

Page 16: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.

Powering a Better Internet © 2011 Akamai

Efficiency versus Number of Peers

Page 17: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.

Powering a Better Internet © 2011 Akamai

Success Rates, All Downloads

Over 86% success rate in December 2010.

Page 18: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.

Powering a Better Internet © 2011 Akamai

Terminations and Failures Occur Early

Page 19: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.

Powering a Better Internet © 2011 Akamai

Performance

Majority P2P downloads average several Mbps.

Page 20: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.

Powering a Better Internet © 2011 Akamai

Content Popularity

Typical?

Page 21: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.

Powering a Better Internet © 2011 Akamai

NetSession Versions Observed in Field

NetSession should excel at downloading itself.

Page 22: Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.

Powering a Better Internet © 2011 Akamai

Ongoing Work

• Designing mechanisms to protect the logging system against attacks

• (Successfully attacked it ourselves.)


Recommended