Liip Techtalk: Amazon Web Services - An Overview

Post on 17-Dec-2014

1,259 views 0 download

description

A short overview of almost all the services available at Amazon Web Services

transcript

Date: March 2011

Amazon Web Services - An Overview

Many many services

Constantly more

Pay as you go

5 Datacenters (US East,

US West, Europe, Singapore, Tokyo)

Everything’s scriptable (Rest and SOAP)

The Cloud!

Doooh!

Storage for the internet

Write, read, and delete objects

From 1 byte to 5 terabytes of data each.

Authentication possible

BitTorrent included! :)

99.999999999% durability and 99.99% availability of objects

S3 (Simple Storage Service)

Versioning

Reduced Redundancy Storage (RRS) (99.99% durability)

Do Static Webpages only with S3 (eg. http://php-osx.liip.ch)

S3 (Simple Storage Service)

0.14$ per GB/month = 143 $ per TB/month ( - 1 TB, then cheaper)

RRS = 30% off

Datatransfer out: 0.15 $ / GB = 153 $ / TB (- 10 TB)

Datatransfer in: 0.10 $ / GB = 102 $ / TB

GET Requests: $0.01 per 10,000 Requests

POST/PUT Requests: $0.01 per 1,000 Requests

S3 (Simple Storage Service) - Pricing

Your personal Content Delivery Network

For fast delivery of static content

Chooses automatically the best location

Streaming and HTTPS is supported

18 “Edge” Locations

In Europe: Amsterdam, Dublin, Frankfurt, London, Paris

You can use your own domain name

Invalidation is possible

Amazon CloudFront

0.15 $ / GB = 153$ / TB ( - 10 TB)

0.009$ / 10’000 HTTP Requests (HTTPS is more expensive)

Invalidation: 1’000 per month free, then $0.005 per file.

Amazon CloudFront - Pricing

provides resizable compute capacity

Just like your virtual server from a trad. hosting

Based on xen

Choose your OS, Kernel, Distribution

Start, Stop, Terminate

Make your own Images

Built in Firewall

Amazon Elastic Compute Cloud (EC2)

Amazon Elastic Compute Cloud (EC2) - Pricing

Type RAM CPU Storage $ / hour $/month

Micro 613 MB up to 2 EBS only 0.025 18

Small 1.7 GB 1 Core x 1 ECU 160 GB 0.095 68

Large 7.5 GB 2 x 2 850 GB 0.38 274

Extra Large 15 GB 4 x 2 1690 GB 0.76 547

High-Memory XL 17.1 GB 2 x 3.25 420 GB 0.62 446

HM Double XL 34.2 GB 4 x 3.25 850 GB 1.14 821

HM Quad XL 68.4 GB 8 x 3.25 1690 GB 2.28 1'642

High-CPU Medium 1.7 GB 2 x 2.5 350 GB 0.29 209

HC XL 7 GB 8 x 2.5 1690 GB 0.76 547

Cluster Quad XL 23 GB 33.5 1690 GB 1.60 1'152

1 EC2 Compute Unit (ECU) ~ 1.0-1.2 GHz 2007 Xeon

Reserved Instances: pay up-front, get cheaper hours

=> up to 30% off over 3 years

Spot Instances: bid on unused Amazon EC2 capacity

=> 40-50% of regular price: http://www.cloudexchange.org/

Windows approx. 30% more expensive

SQL Server even more (1$/hour for our RAI Server)

Amazon Elastic Compute Cloud (EC2) - Pricing

In the beginning: Only local instance store

Boot of S3 Image, lost on termination

Now additionally: EBS Volumes

“Independent” persistent Devices, survive termination

Fast

Can be attached to EC2 instances on-the-go

Snapshots (for backup or other purposes)

Pay per I/O Request (and Size, of course)

Amazon Elastic Compute Cloud (EC2) - Storage

By default, IPs are randomly assigned

But you can get a fix IP and ...

... associate it to any EC2 instance you want

Anytime.

Price: $0.01 per non-attached address per hour (7 $ / month)

Amazon Elastic IP (EIP)

Automatically distributes incoming application traffic

Detects unhealthy instances

Supports sticky sessions

Supports SSL termination

Auto Scaling

No fixed IP! Just CNAME (ie. no http://liip.ch/ only with www.)

Costs: 0.025 $ / hour = 18 $ / month

0.008 $ / GB = 8 $ / TB

Amazon Elastic Load Balancing (ELB)

Automatically start or stop instances

Scale dynamically based on CloudWatch metrics ...

... or by schedule

No additional fees

Auto Scaling

Provides monitoring for AWS cloud resources

For EC2, EBS, ELB and RDS

CPU utilizisation, disk reads/write, Network traffic

Set alarms to receive notifications

Free for basic monitoring (5 minutes intervall)

Detailed monitoring (1 minute interval) available

Costs: 0.015 per instance-hour = 11$ / month

Costs. 0.10$ per alarm (10 are for free)

Amazon CloudWatch

Imports VMWare images

Just for Windows right now

Export will maybe come some day

VM Import

Hosted full-featured MySQL Server

Monitor via CloudWatch

Automated Backups

DB Snapshots

Replication with ...

... Multi-AZ Deployments (standby replica)

... Read Replicas (traditional Master/Slave MySQL)

Amazon Relational Database Service (RDS)

Amazon Elastic Compute Cloud (EC2) - Pricing

Type RAM CPU $ / hour $/month

Small 1.7 GB 1 Core x 1 ECU 0.12 86

Large 7.5 GB 2 x 2 0.48 346

Extra Large 15 GB 4 x 2 0.97 698

High-Memory XL 17.1 GB 2 x 3.25 0.74 533

HM Double XL 34.2 GB 4 x 3.25 1.48 1'066

HM Quad XL 68.4 GB 8 x 3.25 2.96 2'131

Multi-AZ: double the price, reserved instances available

0.11 $/GB/month = 112 $/TB/month. 0.11 $ per 1 mio requests

NoSQL DB, key-value store

High availability

Scalable (you don’t have to define RAM/CPU/..:)

Fast

No values > 1024 bytes

Costs: First 25 computing hours free

Then $0.154 per Amazon SimpleDB Machine Hour consumed

0.275$/GB/month = 281$/TB/month

Amazon SimpleDB

Lets you provision a private, isolated section of the AWS Cloud

Own IP Ranges

Control access

Attach IPs for public access

Connect to your own VPN (with IPSec)

Costs: 0.05 per VPN Connection-Hour = 36 $ / month

Amazon Virtual Private Cloud (VPC)

A cloudy Queue Service

Simple with just five APIs:

SendMessage, ReceiveMessage, DeleteMessage

Scalable, no need to define CPU/RAM/...

Costs: 0.01$ per 10’000 Requests

Usual Data fees.

Amazon Simple Queue Service (SQS)

A cloudy Publish/Subscribe Service

Create a topic, publish notifications, Subscribe to a topic

Get pushs via HTTPS/HTTP/Email/SQS

Scalable, no need to define CPU/RAM/...

Costs: 0.06$ per 100’000 API-Requests (first 100’000 free)

0.06 $ per 100’000 HTTP Notifications (first 100’000 free)

2.00 $ per 100’000 Email Notifications (first 1’000 free)

SQS is free

Amazon Simple Notification Service (SNS)

Send (many many) mails

Scalable, no need to define CPU/RAM/...

You get statistics about Bounces

They make sure, mails are not blocked (blacklists)

“Thanks” to spammers, setup is a little bit complicated

First 1’000 mails a day, then continuously more

Costs: 0.10$ per thousand

Amazon Simple Email Service (SES)

Hadoop in the cloud

Process vast amounts of data

Choose your instances -> start

Amazon Elastic MapReduce

Tomcat in the cloud

Scale, loadbalance, monitor automatically

Upload your WAR file, deploy, done

Costs: Like EC2

Amazon Elastic BeanStalk

Create a collection of related AWS resources

Provision them in an orderly and predictable fashion

Many templates already available (Drupal, Wordpress, etc..)

Templates are JSON formatted text files.

Costs: Free

Amazon CloudFormation

Almost anything is scriptable with the SDK

For Java, .NET and PHP

Clean OO Syntax

Very handsome for automating tasks, like

... creating snapshots (for backup)

... starting/stopping instances (ask Pascal)

... clone and start running machines

many many more

AWS SDK For PHP

http://console.aws.amazon.com/

A lot can be configured here

S3, EC2, VPC, CloudWatch, CloudFront, CloudFormation, RDS, SNS

Some stuff still has to be scripted

AWS Console