No More Mr. Nice Guy The MEAN Stack

transcript

No More Mr. Nice Guy

The MEAN Stack

What we will coverFault toleranceScalabilityPerformance

MongodbExpress.jsAngularNode.js(a.k.a. the MEAN stack)

What we won't coverDetailed implementation

Why the MEAN stack?MongodbExpress.jsAngularNode.js

CassandraReactAWS API GatewayPython

Goals of a Highly Available EnvironmentFault toleranceScalablePerformance

Programming today is a race between software engineers striving to build bigger and better idiot-proof

programs, and the Universe trying to produce bigger and better idiots. So far, the Universe is winning.-- Rick Cook, The Wizardry Compiled (1989)

Building Our Environment

PM2 { “apps”: [{ “name”: “App1”, “script”: “server.js” “instances”: 0, “max_memory_restart”: “2G” }]}

Node.js

Scaling Node.js

Node.js Node.js Node.js

Elastic Load Balancer

Use The VPC, Luke

Availability Zone CAvailability Zone BAvailability Zone A

Geographical Fault Tolerance

Adding Our MongoDB Servers

MongoDB1 MongoDB2 MongoDB3

MongoDB Fault Tolerance

MongoDB1 MongoDB2 MongoDB3MongoDB1 MongoDB2 MongoDB3

module.exports = { db: 'mongodb://MongoDB1/myApp,MongoDB2/myApp,MongoDB2/myApp', dbOptions: { server: { replset: { rs_name: 'myReplicaSet', readPreference: 'nearest' } }

EuropeUnited StatesChina

Scaling MongoDB

MongoDB1MongoDB1

MongoDB1

MongoDB1MongoDB2

MongoDB2

MongoDB1MongoDB3

MongoDB3MongoDB1 MongoDB2 MongoDB3

Scaling MongoDB

MongoDB1MongoDB1

MongoDB1

MongoDB1MongoDB2

MongoDB2

MongoDB1MongoDB3

MongoDB || Cassandra || MySql || Postgresql || Couchdb || etc...

Breaking The Bank

MongoDB1 MongoDB2 MongoDB3MongoDB1 MongoDB2 MongoDB3

Breaking The Bank

ELB ($20/month):3 Node.js servers: 3 MongoDB servers:

t2.medium: 2 CPU/ 4GB RAM

$ 20$120$120

$260/month

But How Much Is That… really?

MongoDB3

t2.medium: 2 CPU/ 4GB RAM

500 - 1000 requests per minute

Scaling Even More...

MongoDB1MongoDB1

MongoDB1

MongoDB1MongoDB2

MongoDB2

MongoDB1MongoDB3

Node.js Node.js

MongoDB1MongoDB1

MongoDB1MongoDB2

MongoDB1MongoDB3

Node.js

MongoDB1MongoDB1

MongoDB1

MongoDB1MongoDB2

MongoDB2

MongoDB1MongoDB3

MongoDB3

MongoDB1MongoDB1

MongoDB1MongoDB2

MongoDB1MongoDB3

Elasticsearch

Monitoring

CPU utilization - percentage of time CPU spends doing workCPU load - measure of computational work averaged over timeMemory utilization - percentage of memory allocatedDisk space - amount of disk space allocated vs. availableNetwork throughput - amount of traffic (in bytes)

CPU Wait - indicates time spent by the CPU waiting for resources to come availableCPU Steal - indicates time not available to the CPU due to the underlying host

Monitoring

• Know your goal (MVP or HA)• Monitoring drives direction• Load-test all the things• Learn to forecast expenses

Take-aways

Resources

Links:• http://www.mean.io• https://angularjs.org/• http://expressjs.com/• https://www.mongodb

.org/• http://aws.amazon.co

m/• http://kkovacs.eu/cas

sandra-vs-mongodb-vs-couchdb-vs-redis

Will Button @wfbuttonhttp://willbutton.co

Don’t be jealous that I was at IteratePhx chatting with Will Button all day.

No More Mr. Nice Guy The MEAN Stack

Software