17
A Day In The Life, 2013 Mark Tomlinson, Sr. Product Manager, HP LoadRunner David Berg, Sr. Product Manager, Shunra Will the Mobile Tipping Point Bury Your Apps?
A Day In The Life, 2013
Mark Tomlinson, Sr. Product Manager, HP LoadRunnerDavid Berg, Sr. Product Manager, Shunra
Will the Mobile Tipping Point Bury Your Apps?
Agenda
Trends in the Mobile Markets
Threats to Performance with Mobile Devices
Application Performance Engineering (APE)
Preparing for the Mobile Load
Confidence in Performance over Mobile Networks
Mobile Market Trends – Enterprise Applications
“Mobile data traffic will double every year through 2014, increasing 39 times between 2009 and 2014.”
Mobile Market Trends – Enterprise Applications
Mobile Phones PCs1.76
1.77
1.78
1.79
1.8
1.81
1.82
2013 Forecast
2013 Forecast (Billion Units)
The complete report is available from Gartner http://www.gartner.com/resId=1268513
Adobe Scene7 Rich Mobile Commerce Survey http://www.adobe.com/aboutadobe/pressroom/pressreleases/pdfs/201008/081210AdobeScene7MobileCommerceSurvey.pdf
The big question
How will your application run in standard browsers over a 3G connection? (iPad, Kindle, Laptop + data card)
Threats to Performance
New Ways to Access Applications
Performance Redefined
More Volatile Network Conditions
Lower Abandonment Thresholds
Scalability Recomputed
Application Performance Engineering
Preparing for the Mobile Load
Mobile Virtual User Options:1. Use a GUI Virtual User
– Automating a mobile device emulator– Automating a tethered mobile device
2. Use a Transport-level Virtual User– Recorded from tethered mobile device– Recorded from portmapped traffic– Recorded from Emulator (recommended)
GUI Virtual Users are most accurate
Preparing for the Mobile Load
Capture the full end-to-end experience of the emulated device or the actual device if you have it.
Scripting difficulty is low-to-medium, leveraging QuickTest Professional.
Limited quantity – GUI Vusers are limited to 1 host each.
Good choice when augmenting an existing test scenario with mobile clients.
Feeling adventurous? Try Portmapped Recording
Preparing for the Mobile Load
Must have a shared private network for the VUGen machine, the mobile device and the target server.
Security and firewalls must be temporarily disabled during recording.
Configure the Recording Options in the VUGen (default is ‘All’ traffic) for Socket level data.
Access to mobile device operating system via terminal/ssh is recommended for troubleshooting.
Preparing for the Mobile Load
Controller Configuration:1. Create groups for emulated
types– Groups for each type of device and
location– Each vuser should iterate multiple
samples– Configure schedule for real-world
ramp-up
2. Configure SLOs and monitors– Response time is critical – set SLO’s– WAN throughput is also critical– Measure CPU of the Device or
Emulator
Preparing for the Mobile Load
Results Analysis and Reporting:1. Remember Mobile is the
context– Results should reflect end-user
impacts– Response times impact
productivity– Know the ‘real world’ -> (Gaps?
Dropouts?)
2. Look for key bottlenecks– High network round-trips (# of
calls)– Excessive data transfer to/from the
device– Excessive device CPU and slow I/O– WAN is the weakness of all Web
2.0 apps
Confidence in Application Performance over Mobile Networks
Define Service Level Objectives (SLOs) by Location
Shunra for HP Software – Automated Results
Shunrafor
HP Software
Summary
Mobility is a fact. The adoption rate is high and access of enterprise applications from mobile decides will soon eclipse desktops.
Preparing for applications to be accessed by mobile devices presents new challenges for testing and performance management. Application Performance Engineering provides a framework to ensure that you are prepared to meet those challenges.
Shunra and HP have teamed together to offer a targeted approach for mobile testing.
