Amazon web serviceEC2 & S3 Overview

EC2EC2 is an instance that is used for all compute work inside AWS.

It can be used as:

●Separate virtual machine with OS

●Load Balancer

●Part of RDC and other clusters

●etc

AMIOperation System + Software = Amazon

Machine Image●Used for app scaling purposes

●Migration between regions and AZ

EC2 instances types

● General purpose● Compute optimized● Memory optimized● Storage optimized

Storage● Elastic Block Storage (EBS)● Instance Store● Elastic File System (EFS)● Simple Storage Service (S3)

Instance StoreInstance store provides temporary block-level

storage for your instance.Instance store is ideal for temporary storage of information that changes

frequently, such as buffers, caches, scratch data, and other temporary content, or for data that is replicated across a fleet of instances, such as a load-balanced pool of web servers.

The data in an instance store persists only during the lifetime of its associated instance. If an instance reboots (intentionally or unintentionally), data in the instance store persists. However, data in the instance store is lost under the following circumstances:

● The underlying disk drive fails

● The instance stops

● The instance terminates

Elastic Block Store

EC2

EBS

Elastic Block Store●EBS volumes are highly available and reliable storage volumes that

can be attached to any running instance that is in the same Availability Zone.

●Encryption available (temp EC2 store -> EBS)

●Volumes are up to 16TiB

●Types: ○ General purpose SSD (3 IOPS/GiB; up to 10,000 IOPS and 160 MB/s of throughput)

○ Provisioned IOPS SSD (up to 20,000 IOPS and 320 MB/s of throughput)

○ Throughput Optimized HDD (throughput of up to 500 MiB/s,)

○ Cold HDD (throughput of up to 250 MiB/s, )

●Can create point-in-time snapshots of EBS volumes, which are persisted to Amazon S3

●EBS volumes are created in a specific Availability Zone, and can then be attached to any instances in that same Availability Zone.

Elastic File SystemAmazon EFS provides scalable file storage

for use with Amazon EC2.

Main feature is to easily customize file system for multiple instances.

VPCINTERNET

AWS

VPC

VPCVPC - logically isolated cloud section in AWS.

Features:●All instances launches inside VPC●Separation for public and private networks●Ability to connect to private network via VPN●Using S3 locally

SUBNET SUBNET

EC2 EC2 EC2 EC2

10.0.0.1 10.0.0.2 10.0.1.1 10.0.1.2

VPC

Network Access Control List

Routing Table

Network Access Control List

Routing Table

Public Subnet

EC2 EC2

EC2

10.0.0.1 10.0.0.2

VPC

NAT Gateway

S3Simple Storage Service - service for storing

files.

S3 stores files in any region you specify.

Maximum object size by single upload 5 Terabytes

S3

FILE

Metadata

Object

File typeModified date

*.*for example: *.jpg; *.png; *.js;

Object Object Object

Object Object Object

Bucket

Bucket features●Bucket names should be unique through all AWS

●Bucket name is used to generate link to get access from browser or app

●Cross-region replication (copy to only one other region)

Uploading to S3

Console

small number of file uploading

CLI

recursive directory uploading

SDK

Dynamic in Code uploading

CORS

Amazon re:Invent 2016

Amazon re:Invent 2016

During 2016 have already been launched or will have

been launched soon ~1000 new services

Amazon re:Invent 2016Computing:

● New Instances:

○ R4 - up to 64 vCPUs and 488 GiB of memory

○ t2.xlarge (16 Gib of memory) and t2.2xlarge(32 Gib of memory)

○ F1 - give you access to FPGA. You can write code that runs on the FPGA and speeds up many types of genomics, seismic analysis, financial risk analysis, big data search, and encryption algorithms by up to 30 times

○ New C5 Instances - Intel’s brand new Xeon “Skylake” processor (up to 72 vCPUs and 144 GiB of memory.)

● Elastic GPUs - EC2 instance types, with your choice of 1 GiB to 8 GiB of GPU memory and compute power to match.

● New I3 Instances - instances will be equipped with fast, low-latency, Non Volatile Memory Express (NVMe) based Solid State Drives. They’ll deliver up to to 3.3 million random IOPS at a 4 KB block size and up to 16 GB/second of disk throughput ( up to 64 vCPUs, 488 GiB of memory, and 15.2 TB of storage ).

Amazon Elastic Beanstalk manages●EC2 instance prefered

●S3 connection

●SNS, Alarms

●Load Balancing

●Auto Scaling

●Application Health Monitoring

You just need to:● Select platform

●Select instance type

●Select additional services to use

Amazon re:Invent 2016Amazon LightSa

il

Amazon re:Invent 2016Amazon Athena - a new serverless query service that makes it

easy to analyze large amounts of data stored in Amazon S3 using Standard SQL.

Features:● You pay only for the queries that you run.

● Behind the scenes, Athena parallelizes your query, spreads it out across hundreds or thousands of cores, and delivers results in seconds

● Queries are expressed in standard ANSI SQL and can use JOINs, window functions, and other advanced features

● Can query data in many different formats including JSON, CSV, log files, text with custom delimiters, Apache Parquet, and Apache ORC.

● You can run your queries from the AWS Management Console or from a SQL clients such as SQL Workbench, and you can use Amazon QuickSight to visualize your data.

Amazon re:Invent 2016Amazon Aurora Update – PostgreSQL Compatibility

Amazon Aurora – Cost-Effective MySQL-Compatible Database Engine for Amazon RDS

Amazon re:Invent 2016Other innovations:

●AWS Snowmobile (Data transferring)

●AWS Greengrass (IoT)

●AI & Machine Learning:○ Amazon Polly – Text to speech (47 Voices and 24 Languages)

○ Amazon Recognition – Image Detection and Recognition Powered by Deep Learning

○ Amazon Lex – Automatic Speech Recognition