Apps & API Monitoring

Apigee@apigee

Ole Lensmar@olensmar

Alan Ho@karlunho

SmartBear@SmartBear

Building a 5-Star Reputation for your Apps

groups.google.com/group/api-craft

groups.google.com/group/app-craft

youtube.com/apigee

slideshare.net/apigee

@olensmarOle Lensmar

@karlunhoAlan Ho

@SmartBear @Apigee

During webcast - participate on twitter hastag #5starapp

Agenda

• Why (Web) API performance matters• How can you avoid performance issues?

• Synthetic Transaction monitoring• Real User monitoring

• Recap pros/cons of different techniques• Questions

What matters to the user?

900,000 apps & growing

Performance Matters

• Poor reviews skew your overall app ratings

• Majority of Poor Reviews Occurred in first 24 hours

• Customers do not tolerate software Errors

• Combination of App & API problems

• Fixing Problems without trace logs is difficult

Don’t crash

Don’t give me errors

Don’t slow me down

Return on Features vs. Performance

Features

Perform

ance

Benefit

Application Maturity

Inflection

How can you avoid performance issues?

API performance = app performance

Indirect vs. Direct API Integration

Synthetic Monitoring

• Functional Consistency• Perf. Consistency• Proactive Error Detection

Real User Monitoring• API Errors• API Performance• Variation of Devices /

Networks

Demo

Real User Monitoring

Synthetic Monitoring

Pros Cons

Real User Monitoring

• Capture Real User problems

• Exercise real devices and networks

• Correlate with errors & abandonment

• Need critical mass of traffic for each API monitored

• Need to instrument your code• Potential Bandwidth / Battery

issues

Synthetic Transaction Monitoring

• Can monitor all APIs all the time

• Doesn’t require instrumentation of app

• Can reuse existing test assets from Dev & QA

• Doesn’t simulate real users / devices / networks

• Need to setup and maintain the monitors

• Cannot tell you the end behavior of the app

Use both techniques!

• Reduce effect of cons of both techniques

• Use RUM traffic to create tests for Synthetic Transaction Monitoring

• Correlate STM failures to usage in RUM

In Summary . . .

Mobile app experience depends on API performanceSuccess depends on meeting users’ performance

expectationsUse multiple techniques for monitoring your app

Questions

THANK YOUQuestions and ideas to:

@olensmar@karlunho

groups.google.com/group/api-craft

groups.google.com/group/app-craft