© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.1

Lee Atchison, Principal Cloud Architect at New Relic.

@leeatchison leeatchison

Cloud Monitoring: Change

Is The New Normal

Safe Harbor

This document and the information herein (including any information that may be incorporated by reference) is provided for

informational purposes only and should not be construed as an offer, commitment, promise or obligation on behalf of New Relic, Inc.

(“New Relic”) to sell securities or deliver any product, material, code, functionality, or other feature. Any information provided hereby is

proprietary to New Relic and may not be replicated or disclosed without New Relic’s express written permission.

Such information may contain forward-looking statements within the meaning of federal securities laws. Any statement that is not a

historical fact or refers to expectations, projections, future plans, objectives, estimates, goals, or other characterizations of future

events is a forward-looking statement. These forward-looking statements can often be identified as such because the context of the

statement will include words such as “believes,” “anticipates,”, “expects” or words of similar import.

Actual results may differ materially from those expressed in these forward-looking statements, which speak only as of the date hereof,

and are subject to change at any time without notice. Existing and prospective investors, customers and other third parties transacting

business with New Relic are cautioned not to place undue reliance on this forward-looking information. The achievement or success of

the matters covered by such forward-looking statements are based on New Relic’s current assumptions, expectations, and beliefs and

are subject to substantial risks, uncertainties, assumptions, and changes in circumstances that may cause the actual results,

performance, or achievements to differ materially from those expressed or implied in any forward-looking statement. Further

information on factors that could affect such forward-looking statements is included in the filings we make with the SEC from time to

time. Copies of these documents may be obtained by visiting New Relic’s Investor Relations website at http://ir.newrelic.com or the

SEC’s website at www.sec.gov.

New Relic assumes no obligation and does not Intend to update these forward-looking statements, except as required by law. New

Relic makes no warranties, expressed or implied, in this document or otherwise, with respect to the information provided.

Who am I?

29 years in industry

4+ in New Relic

(Architecture Lead, Cloud, Service Migration)

7 in Amazon Retail & AWS

(Built SW/VG AppStore, AWS Elastic Beanstalk)

Who Specialize in:

Cloud computing

Services & Microservices

Scalability, Availability

@leeatchison leeatchison

Principal Cloud Architect

Customer Care App Owners

Executives

Customer Care

Operations Developers

App Owners

Marketing

Picture

Your

Apps

HERE

Behind every app is a team

Running a Digital Business is a Team Sport

What Data Do You Need To Run The Business?

How is my

business doing?

BusinessSuccess

Am I open

for business?

ApplicationPerformance

How are customers

engaging?

CustomerExperience

Asking Important Questions..

… About Constant Change

First Deploy in AWS India AZ

Java Security

Vulnerability?

Traffic Spike from Celebrity Tweet!

New Mobile App!

Flaky Ad Network?

New Location Feature

Experiment!

Cloud Reboot!

DevsDeploy Docker

Acquire New Team! (They use Node.js)

Apple Changes Terms of Service

Key Engineer on Open

Source Tool Leaves

6 million new sensors now

lve!

BugFix!

DNS Outage?

Try New CDN in Europe

How is my

business doing?

BusinessSuccess

Am I open

for business?

ApplicationPerformance

How are customers

engaging?

CustomerExperience

New Aviation Service

Static vs. Dynamic Applications

Better

Data Center

Dynamic

Environment

How do we use the cloud to accomplish this?

Dynamic Cloud Application

• Services/Microservices

• Uses Mobile/Browser Apps

• Dynamic Provisioning

Server OS

Server (Virtual)Hardware

Application & Application

Microservices

Provisioning

Application & Application

Microservices

Application & Application

Microservices

BrowserMobile

Server OS

Server (Virtual)Hardware

Application & Application

Microservices

Provisioning

Application & Application

Microservices

Application & Application

Microservices

BrowserMobile

Monitoring Dynamic Cloud Application

Amazon CloudWatchAWS

CONSOLE

New RelicApplicationMonitoring

New Relic Infrastructure

Monitoring

DASHBOARDS

Change Is The New Normal

Previous - STATIC World

Ops

Dev

Now - DYNAMIC World

Ops

Why Measurement Matters

Success for Modern Applications

Digital Intelligence

Application

Performance

Customer

Experience

Business

Outcome

It’s All About Data

300ms

1.5s

.9s

The Data from Monitoring Your App

Dwarfs the data inside the App

User Experience

Business Outcome

Servers

Apps

Big Data Problem

What Game Are You Playing?What Data Matters to You?

What is your Digital Intelligence?

In A Changing World…What Is Your Priority?

Am I Open for Business

and Making Money?

Are My Applications

Working?

Two different views into the same problem

Software Measurement Framework

• Daily Revenue

• Cart Value / Volume

• What do you sell?

Software Business

• Daily Revenue

• Cart Value / Volume

• What do you sell?

Software Measurement Framework

• Daily Revenue

• Cart Value / Volume

• What do you sell?

• Conversion Rates

• Engagement / Interactions

• End-User Performance

Software Business

• Daily Revenue

• Cart Value / Volume

• What do you sell?

Customer Experience

• Conversion Rates

• Engagement / Interactions

• End-User Performance

Software Measurement Framework

Software Business

• Daily Revenue

• Cart Value / Volume

• What do you sell?

Customer Experience

• Conversion Rates

• Engagement / Interactions

• End-User Performance

Application Performance &

Infrastructure

• App performance

• Slow Queries

• Burst Scale

Software Measurement Framework

ServiceQuality

• Uptime

• App Errors

• Successful Deploys

Software Business

• Daily Revenue

• Cart Value / Volume

• What do you sell?

Customer Experience

• Conversion Rates

• Engagement / Interactions

• End-User Performance

Application Performance &

Infrastructure

• App performance

• Slow Queries

• Burst Scale

Software Measurement Framework

Software Business

• Daily Revenue

• Cart Value / Volume

• What do you sell?

Customer Experience

• Conversion Rates

• Engagement / Interactions

• End-User Performance

Application Performance &

Infrastructure

• App performance

• Slow Queries

• Burst Scale

EngineeringVelocity

• Lead Time

• Deploys

• MTTR

ServiceQuality

• Uptime

• App Errors

• Successful Deploys

Framework for a Journey

Software Business

• Daily Revenue

• Cart Value / Volume

• What do you sell?

Customer Experience

• Conversion Rates

• Engagement / Interactions

• End-User Performance

Application Performance &

Infrastructure

• App performance

• Slow Queries

• Burst Scale

EngineeringVelocity

• Lead Time

• Deploys

• MTTR

ServiceQuality

• Uptime

• App Errors

• Successful Deploys

A Digital Intelligence Journey

Am I Open for Business

and Making Money?

Are My Applications

Working?

A Digital Intelligence Journey

Software Business

• Daily Revenue

• Cart Value / Volume

• What do you sell?

Customer Experience

• Conversion Rates

• Engagement / Interactions

• End-User Performance

Application Performance &

Infrastructure

• App performance

• Slow Queries

• Burst Scale

EngineeringVelocity

• Lead Time

• Deploys

• MTTR

ServiceQuality

• Uptime

• App Errors

• Successful Deploys

How Do Other Companies Make This Journey?

Software Business

• Daily Revenue

• Cart Value / Volume

• What do you sell?

Customer Experience

• Conversion Rates

• Engagement / Interactions

• End-User Performance

Application Performance &

Infrastructure

• App performance

• Slow Queries

• Burst Scale

EngineeringVelocity

• Lead Time

• Deploys

• MTTR

ServiceQuality

• Uptime

• App Errors

• Successful Deploys

Brian Lieberman

Systems Engineer, Platform as a Service Delivery

Gannett/USA Today

Monitoring a brand new Infrastructure on Election night

Measuring Success for Elections and Large events

Speeding up Release Cycle and Feedback Loop to real time

Thank You

leeatchison@leeatchison

Gannett/USA Today Office Hours4pm Today

New Relic Booth #610