Post on 15-Jul-2015
transcript
April 16, 2015 1© 2015 SOASTA. All rights reserved.
Webinar
April 16, 2015 2© 2015 SOASTA. All rights reserved.
Today’s Presenters
Mark Tomlinson
Independent
Performance Coach
F1000 Companies
Microsoft
HP (former LoadRunner PM)
Brad Johnson
Performance Product
“Lifer”
SOASTA
Borland
Mercury Interactive
Compuware
April 16, 2015 3© 2015 SOASTA. All rights reserved.
April 16, 2015 4© 2015 SOASTA. All rights reserved.
AgendaChanges are upon us
1. Breaking the Status Quo
2. Apps are Eating the World
3. What about the Center of Excellence?
User ExpectationsUnpredictable Demand
Continuous DeliveryMultiple Devices
PPerformance Is Complicated
Speed
Quality
April 16, 2015 6© 2015 SOASTA. All rights reserved.
Models are inaccurate
April 16, 2015 7© 2015 SOASTA. All rights reserved.
Models are inaccurate
Silos are not agile
April 16, 2015 8© 2015 SOASTA. All rights reserved.
Models are inaccurate
Silos are not agile
Production scale tests are
rare
April 16, 2015 9© 2015 SOASTA. All rights reserved.
RetestTest Development Infra setup RepeatFixTes
tAnalyze
TIME
Breaking the Status Quo
The Legacy Approach
April 16, 2015 10© 2015 SOASTA. All rights reserved.
Breaking the Status QuoEverything has changed…
o Real user data-driven test specifications
o Collaborative teams are displacing specialist teams
o Increased test frequency
April 16, 2015 11© 2015 SOASTA. All rights reserved.
Breaking the Status QuoEverything has changed…
o Real user data-driven test specifications
o Collaborative teams are displacing specialist teams
April 16, 2015 12© 2015 SOASTA. All rights reserved.
o Real user data-driven test specifications
o Collaborative teams are displacing specialist teams
o Increased test frequency
Breaking the Status QuoEverything has changed…
April 16, 2015 13© 2015 SOASTA. All rights reserved.
Tips for Breaking the Status Quo
Taking your first steps into a larger world…
o Calculate the ROI of increased feedback on performance
o Calculate the KPI trends on repeated release candidates
o Invade the sprint planning and add performance to the stories
o Replace your test plans with continuous feedback from APM
April 16, 2015 14© 2015 SOASTA. All rights reserved.
Apps are Eating the WorldSo What?
o Mobile is everywhere (obviously)
April 16, 2015 15© 2015 SOASTA. All rights reserved.
Apps are Eating the WorldSo What?
o Mobile is everywhere (obviously)
o Digital commerce & User Experience has changed Dev Cycles
o Competing is different
April 16, 2015 16© 2015 SOASTA. All rights reserved.
Apps are Eating the WorldSo What?
o Mobile is everywhere (obviously)
o Digital commerce & User Experience has changed Dev Cycles
o Competing is different
April 16, 2015 17© 2015 SOASTA. All rights reserved.
Tips for the Explosion of Apps
Less is more…
o Investigate performance sooner & faster, in smaller scope
o Trust external dependencies, until proven otherwise
o Know your competitors’ performance - leverage that knowledge
o Calculate your impact on time-to-market or project schedules
April 16, 2015 18© 2015 SOASTA. All rights reserved.
What About the Center of Excellence?Agile meets a Silo
April 16, 2015 19© 2015 SOASTA. All rights reserved.
What About the Center of Excellence?Agile meets a Silo
o Stop being a bottleneck
April 16, 2015 20© 2015 SOASTA. All rights reserved.
What About the Center of Excellence?Agile meets a Silo
o Stop being a bottleneck
o Integrate to the continuous pace
o Add value with complete, integrated performance tests
April 16, 2015 21© 2015 SOASTA. All rights reserved.
What About the Center of Excellence?Agile meets a Silo
o Stop being a bottleneck
o Integrate to the continuous pace
o Add value with complete, integrated performance tests
April 16, 2015 22© 2015 SOASTA. All rights reserved.
The Modern Approach
TIME
The Legacy Approach
Run more tests in less time.
Start earlier.
Cover more ground.repeat
/ TestAnalyz
e
Fix
Test Dev
Test Development Infra setupTes
tAnalyze Retest RepeatFix
Distributed Performance
April 16, 2015 23© 2015 SOASTA. All rights reserved.
Distributed Perforamance
Component
scalability
Performance
baseline
Integration testing
End to End
w/ Service
Virtualization
Unit scalability
Database testing
3rd party
services
Live E2E
tests
Stress
testing Soak test
(reliability)
Failover
Capacity
Latency
Performance
Regression
(smoke tests)
Network
Testing (staging) Operations (prod)Development (sandbox)
Define Tests with Real User Data
April 16, 2015 24© 2015 SOASTA. All rights reserved.
Tips for Distributed ExcellenceMeasure yourself by the impact on others…
o Find project champions - create institutionalized excellence there
o Start an inclusive, collaborative working group - not exclusive silo
o Integrate with open-source tools across the lifecycle - enable them
o Abandon the questionnaire - assign full-time facilitators
April 16, 2015 25© 2015 SOASTA. All rights reserved.
• Rapidly collect accurate test specifications
• Collaborate with all teams
• Integrate testing processes
• Try new approaches….
April 16, 2015 26© 2015 SOASTA. All rights reserved.
1. Break the Status Quo
2. Embrace the “App” culture of change
3. Reconsider centalized approches in an agile world
April 16, 2015 27© 2015 SOASTA. All rights reserved.
o Read up on Performance Engineering
o Try a free product
o Get certified for FREE (SOASTA University)
o Test Now and see!
NEW WHITEPAPER!
www.soasta.com