Monitoring End User Experiences With Splunk and New RelicBreak down the silos in your observability infrastructure.
Abner Germanow | New Relic, Partner Marketing & EvangelismTom Martin | Splunk, Staff ITOA Practitioner
Date | Washington, DC
During the course of this presentation, we may make forward-looking statements regarding future events or the expected performance of the company. We caution you that such statements reflect our current expectations and estimates based on factors currently known to us and that actual events or results could differ materially. For important factors that may cause actual results to differ from those contained in our forward-looking statements, please review our filings with the SEC.
The forward-looking statements made in this presentation are being made as of the time and date of its live presentation. If reviewed after its live presentation, this presentation may not contain current or accurate information. We do not assume any obligation to update any forward looking statements we may make. In addition, any information about our roadmap outlines our general product direction and is subject to change at any time without notice. It is for informational purposes only and shall not be incorporated into any contract or other commitment. Splunk undertakes no obligation either to develop the features or functionality described or to include any such feature or functionality in a future release.
Splunk, Splunk>, Listen to Your Data, The Engine for Machine Data, Splunk Cloud, Splunk Light and SPL are trademarks and registered trademarks of Splunk Inc. in the United States and other countries. All other brand names, product names, or trademarks belong to their respective owners. © 2017 Splunk Inc. All rights reserved.
Forward-Looking Statements
THIS SLIDE IS REQUIRED FOR ALL 3 PARTY PRESENTATIONS.
Confidential ©2008–17 New Relic, Inc. All rights reserved
NEWRNYSE – 2014
15k+Customers
1.5BScale: Events & Metrics Per Minute
New Relic At A Glance:
13,500+ Disruptors1,700+ Global Enterprises
Confidential ©2008–17 New Relic, Inc. All rights reserved
Why is monitoring hard?
5
300ms
1.5s
6
.9s
7
Confidential ©2008–17 New Relic, Inc. All rights reserved
Application Agents
Browser Agents
InfrastructureAgents
Lots of Data Sources
Synthetic Infrastructure
Synthetic Users
Wire DataLogging / Machine Data
Social & Contact Center
Mobile SDK
Cloud & Custom Metrics
StatsD
Confidential ©2008–17 New Relic, Inc. All rights reserved
From any source, monitoring data can be organized into three main categories
9
Logs
Metrics
Human-readableevents
Measurement of an event
Examples
System startup output,process output
Throughput, error rate,request rate, request duration
New Relic Provides
*via Splunk Integrations
TracesRelationships between events
Application components involved during a request with an error
Confidential ©2008–17 New Relic, Inc. All rights reserved
What is a transaction trace?
Confidential ©2008–17 New Relic, Inc. All rights reserved
Traces: How Did an Application Arrive at a Result?
11
The Application
Result
Confidential ©2008–17 New Relic, Inc. All rights reserved
Tracing Provides Information on Which Segments of an Application Were Involved in a Result
12
Result
New Relic Agent
Confidential ©2008–17 New Relic, Inc. All rights reserved
Transactions Are a Central Part of New Relic's Product and Help Developers Diagnose and Troubleshoot
Many Problems Without Guessing.
13
Confidential ©2008–17 New Relic, Inc. All rights reserved
With Microservices, Applications ("Monoliths") Get Broken Up Into Smaller Pieces.
The Traces Now Go Through Multiple Programs.
14
OriginalJava Application
Node.js Service
PHP ServiceExternalService
Ruby
Mic
rose
rvic
e
Result
New Relic Agent
New Relic Agent
New Relic Agent
New Relic Agent
New Relic Agent
Open Tracing
©2008–17 New Relic, Inc. All rights reserved.
©2008–17 New Relic, Inc. All rights reserved.1
5
Confidential ©2008–17 New Relic, Inc. All rights reserved
What’s The Problem New Relic & Splunk Are Trying To Solve?
Confidential ©2008–17 New Relic, Inc. All rights reserved
Volume of operational data being generated is growing exponentially.
Web App: Then Web App: Now
1 application 3 large servers
1 database1 data center
1 deploy/quarter
30 containers4 services
10 small instances2 managed services
2 databases2 cloud regions3 deploys/day
Confidential ©2008–17 New Relic, Inc. All rights reserved
Each tool, framework, platform and languagehas unique operational questions.
18
What’s the error rate of my Java application?
Java Engineer VP of IT Infrastructure
Web Developer Site Reliability Engineer
Is the database slowing down Rails?
What’s our spend in us-west-2?
How can we improve deploys to Amazon ECS?
Confidential ©2008–17 New Relic, Inc. All rights reserved
To answer operational questions, teams define their own metrics, logging, and alerting practices.
19
Operations Backend Frontend
Confidential ©2008–17 New Relic, Inc. All rights reserved
Important operational data becomes siloed by service, app, or infrastructure type.
20
Backend Frontend
Java application logs Application Traces
Operations
Infrastructure Metrics
Confidential ©2008–17 New Relic, Inc. All rights reserved
New Relic consolidates operational data to answer hard questions across teams, apps, and platforms.
21
Operations Backend Frontend
Infrastructure Metrics Java application logs Application Traces
Reduce MTTR with production log insights
+metric-based application
monitoring
See real-time application behaviors with byte-code
instrumentation data in Splunk
See Splunk infra & security alerts in New Relic
Why would you want this?
DataSources- SplunkandNewRelic
Splunk Strengths
▶ MachineData(specifically,aroundlogs)
▶ Breadthacrossinfrastructure(network,
server,cloudinfrastructure)
▶ Rootcauseanalysis(oftenviaconfig changes
thatarelogged)
▶ Business-levelKPIs,SLOs,etc.thatspan
multipleapplications
▶ Longtermstorageofrawmanagementdata
NewRelicStrengths
▶ Dependenciesacrossapp(viaAgents
embeddedinsideappsµservices)
▶ BreadthofCodelevel(BCI)(Java,.Net,Ruby,
Node.js,PHP,Python,Go,iOS,Android,
Javascript)
▶ EndUserMonitoring(responsetime,etc.)
▶ Real-timeTrace/Transactionstime-seriesdata
▶ Easeofinstrumentation&agentinstall
Confidential ©2008–17 New Relic, Inc. All rights reserved
How about you demo this thing already?
IntegrationHighlights-SplunkAppforNewRelic▶ EaseofintegrationwithNewRelicAPIstocollect
application,transaction,mobile,browserandsyntheticperformanceandqualitykeyperformanceindicators
▶ Out-of-the-boxdashboardstosummarizetransactionresponsetime,ApDex,errorsandotherkeyinformation
▶ LongtermstorageofdatacollectedbyNewRelicadd-on
SplunkandNewRelic:BreakDownSilos▶ Combinedashboardelementsspanningmanydatasources
▶ Providedashboardsacrossmanyusers
▶ Correlatetime-seriesdatabasedonSplunkSearchProcessingLanguage(SPL)
Splunk Alerts In New Relic
IntegrationHighlights- NewRelic
▶ SplunkReportsinNewRelicInsightstocorrelatecode-levelperformanceinNewRelic,alongsidedetailedlogsthatprovideadditionalcontext;forthoseusingNewRelicastheirUI,havingallthedatainoneplaceisvaluable
▶ Ad-hocqueryingofSplunkdatatocreateflexibleviewsofapplicationlogsagainstNewRelicmetricsandeventsformobile,browserandAPM
▶ SplunkAlertsavailableincontexttoAPMandinfrastructuremonitoringviaNewRelicInsights
▶ Inthelongterm,SplunklogscorrelatedtoTransactiontracesinAPMtogivethefullcontextaboutapplicationperformanceissues
DeckunderNDAuntil03/23/17
IntegrationExample- MediaCompanySituation▶ AppDevandnewlycreated“DevOps”teamshavebeentheprimary“buyer”forNewRelic▶ Operationsteamhasbeentheprimary“buyer”forSplunk▶ BothteamswouldgetmorevaluebyseeingmonitoringdataacrossentireenvironmentSplunk+NewRelic▶ AllowsOperationsteamtoseeEndUserMonitoringandappservermetricsalongsideinfrastructure
componentstheyaremeasuring▶ DevOpsteamscanad-hocquerySplunkandgeteventsfromSplunk,offeringbetterinsightintohow
infrastructureimpactstheappstheyareresponsiblefor
DeckunderNDAuntil03/23/17
Have your New Relic license key?
Install theSplunkbase plug-in
Send Splunk Alerts to New Relic Insights
See pre-built dashboards in Splunk.
What should you do next?
© 2017 Splunk Inc.
Don't forget to rate this session in the .conf2017 mobile app
Thank You
