+ All Categories
Home > Technology > Get Ready for Changes To Load Testing

Get Ready for Changes To Load Testing

Date post: 15-Jul-2015
Category:
Upload: soasta
View: 677 times
Download: 2 times
Share this document with a friend
Popular Tags:
27
April 16, 2015 1 © 2015 SOASTA. All rights reserved. Webinar
Transcript
Page 1: Get Ready for Changes To Load Testing

April 16, 2015 1© 2015 SOASTA. All rights reserved.

Webinar

Page 2: Get Ready for Changes To Load Testing

April 16, 2015 2© 2015 SOASTA. All rights reserved.

Today’s Presenters

Mark Tomlinson

Independent

Performance Coach

F1000 Companies

Microsoft

HP (former LoadRunner PM)

Brad Johnson

Performance Product

“Lifer”

SOASTA

Borland

Mercury Interactive

Compuware

Page 3: Get Ready for Changes To Load Testing

April 16, 2015 3© 2015 SOASTA. All rights reserved.

Page 4: Get Ready for Changes To Load Testing

April 16, 2015 4© 2015 SOASTA. All rights reserved.

AgendaChanges are upon us

1. Breaking the Status Quo

2. Apps are Eating the World

3. What about the Center of Excellence?

Page 5: Get Ready for Changes To Load Testing

User ExpectationsUnpredictable Demand

Continuous DeliveryMultiple Devices

PPerformance Is Complicated

Speed

Quality

Page 6: Get Ready for Changes To Load Testing

April 16, 2015 6© 2015 SOASTA. All rights reserved.

Models are inaccurate

Page 7: Get Ready for Changes To Load Testing

April 16, 2015 7© 2015 SOASTA. All rights reserved.

Models are inaccurate

Silos are not agile

Page 8: Get Ready for Changes To Load Testing

April 16, 2015 8© 2015 SOASTA. All rights reserved.

Models are inaccurate

Silos are not agile

Production scale tests are

rare

Page 9: Get Ready for Changes To Load Testing

April 16, 2015 9© 2015 SOASTA. All rights reserved.

RetestTest Development Infra setup RepeatFixTes

tAnalyze

TIME

Breaking the Status Quo

The Legacy Approach

Page 10: Get Ready for Changes To Load Testing

April 16, 2015 10© 2015 SOASTA. All rights reserved.

Breaking the Status QuoEverything has changed…

o Real user data-driven test specifications

o Collaborative teams are displacing specialist teams

o Increased test frequency

Page 11: Get Ready for Changes To Load Testing

April 16, 2015 11© 2015 SOASTA. All rights reserved.

Breaking the Status QuoEverything has changed…

o Real user data-driven test specifications

o Collaborative teams are displacing specialist teams

Page 12: Get Ready for Changes To Load Testing

April 16, 2015 12© 2015 SOASTA. All rights reserved.

o Real user data-driven test specifications

o Collaborative teams are displacing specialist teams

o Increased test frequency

Breaking the Status QuoEverything has changed…

Page 13: Get Ready for Changes To Load Testing

April 16, 2015 13© 2015 SOASTA. All rights reserved.

Tips for Breaking the Status Quo

Taking your first steps into a larger world…

o Calculate the ROI of increased feedback on performance

o Calculate the KPI trends on repeated release candidates

o Invade the sprint planning and add performance to the stories

o Replace your test plans with continuous feedback from APM

Page 14: Get Ready for Changes To Load Testing

April 16, 2015 14© 2015 SOASTA. All rights reserved.

Apps are Eating the WorldSo What?

o Mobile is everywhere (obviously)

Page 15: Get Ready for Changes To Load Testing

April 16, 2015 15© 2015 SOASTA. All rights reserved.

Apps are Eating the WorldSo What?

o Mobile is everywhere (obviously)

o Digital commerce & User Experience has changed Dev Cycles

o Competing is different

Page 16: Get Ready for Changes To Load Testing

April 16, 2015 16© 2015 SOASTA. All rights reserved.

Apps are Eating the WorldSo What?

o Mobile is everywhere (obviously)

o Digital commerce & User Experience has changed Dev Cycles

o Competing is different

Page 17: Get Ready for Changes To Load Testing

April 16, 2015 17© 2015 SOASTA. All rights reserved.

Tips for the Explosion of Apps

Less is more…

o Investigate performance sooner & faster, in smaller scope

o Trust external dependencies, until proven otherwise

o Know your competitors’ performance - leverage that knowledge

o Calculate your impact on time-to-market or project schedules

Page 18: Get Ready for Changes To Load Testing

April 16, 2015 18© 2015 SOASTA. All rights reserved.

What About the Center of Excellence?Agile meets a Silo

Page 19: Get Ready for Changes To Load Testing

April 16, 2015 19© 2015 SOASTA. All rights reserved.

What About the Center of Excellence?Agile meets a Silo

o Stop being a bottleneck

Page 20: Get Ready for Changes To Load Testing

April 16, 2015 20© 2015 SOASTA. All rights reserved.

What About the Center of Excellence?Agile meets a Silo

o Stop being a bottleneck

o Integrate to the continuous pace

o Add value with complete, integrated performance tests

Page 21: Get Ready for Changes To Load Testing

April 16, 2015 21© 2015 SOASTA. All rights reserved.

What About the Center of Excellence?Agile meets a Silo

o Stop being a bottleneck

o Integrate to the continuous pace

o Add value with complete, integrated performance tests

Page 22: Get Ready for Changes To Load Testing

April 16, 2015 22© 2015 SOASTA. All rights reserved.

The Modern Approach

TIME

The Legacy Approach

Run more tests in less time.

Start earlier.

Cover more ground.repeat

/ TestAnalyz

e

Fix

Test Dev

Test Development Infra setupTes

tAnalyze Retest RepeatFix

Distributed Performance

Page 23: Get Ready for Changes To Load Testing

April 16, 2015 23© 2015 SOASTA. All rights reserved.

Distributed Perforamance

Component

scalability

Performance

baseline

Integration testing

End to End

w/ Service

Virtualization

Unit scalability

Database testing

3rd party

services

Live E2E

tests

Stress

testing Soak test

(reliability)

Failover

Capacity

Latency

Performance

Regression

(smoke tests)

Network

Testing (staging) Operations (prod)Development (sandbox)

Define Tests with Real User Data

Page 24: Get Ready for Changes To Load Testing

April 16, 2015 24© 2015 SOASTA. All rights reserved.

Tips for Distributed ExcellenceMeasure yourself by the impact on others…

o Find project champions - create institutionalized excellence there

o Start an inclusive, collaborative working group - not exclusive silo

o Integrate with open-source tools across the lifecycle - enable them

o Abandon the questionnaire - assign full-time facilitators

Page 25: Get Ready for Changes To Load Testing

April 16, 2015 25© 2015 SOASTA. All rights reserved.

• Rapidly collect accurate test specifications

• Collaborate with all teams

• Integrate testing processes

• Try new approaches….

Page 26: Get Ready for Changes To Load Testing

April 16, 2015 26© 2015 SOASTA. All rights reserved.

1. Break the Status Quo

2. Embrace the “App” culture of change

3. Reconsider centalized approches in an agile world

Page 27: Get Ready for Changes To Load Testing

April 16, 2015 27© 2015 SOASTA. All rights reserved.

o Read up on Performance Engineering

o Try a free product

o Get certified for FREE (SOASTA University)

o Test Now and see!

NEW WHITEPAPER!

www.soasta.com


Recommended