LoadRunner in the Cloud

What does LoadRunner offer ?

TruClient etc. easier scripting.

Simple record / replay

Multi-protocol support, unlike competition.

Single tool for Mobile, Ajax, Flex, HTML (5)

.Net, Java, Silverlight, SOAP, Citrix,

ERP and legacy applications

Browser and mobile device emulation built in.

Options to extend testing with network and service virtualisation.

Various cloud options:

Integration with Amazon & HP Cloud or other third parties.

SaaS options with StormRunner and Performance Centre.

Integration with multiple IDEs as well as CI and automated build systems.

Real time analytics built in, options to extend with SiteScope.

Diagnostic tool support, HP Diagnostics & third party tools.

Excellent reporting.

LoadRunner and related products

LoadRunner6.0

PerformanceCenter

9.0

1990sO

n-P

rem

ise

In-c

lou

d2006

PerformanceCenter

LoadRunner in the Cloud

V1

2008 2010 2014

StormRunner

LoadRunner in the Cloud

V2

LoadRunner8.0

LoadRunner9.0

2012

LoadRunner11.0

LoadRunner12.0

PerformanceCenter

11.0

PerformanceCenter

12.0

StormRunner

LoadRunner in the Cloud

V2

LoadRunner12.0

PerformanceCenter

12.0

LoadRunner and related products

Best of breed performance test tool

Integrates with other ALM products

Multi-protocol support, excellent reporting capabilities

Alternative to LoadRunner (on-premise)

On-demand licensing and hardware

Detailed reporting

Multi-protocol support

Cloud only

On demand usage

Uses standard LoadRunner scripts (web only)

Less detailed reporting but great for “burst testing”

Enterprise testing

Better integration with HP ALM suite

Dashboards, shared assets, ideal for global “follow the sun” operations

Which tool should I choose?

• Application Under Test

• Comms protocols

• vUser numbers

• vUser locations

• Tester locations

• Tester skillset

• Existing test assets

• Script complexity

• Test data requirements

• Security

• Budget

• Timescales

• Cloud?

Decision factors

Choosing a cloud-based test tool

StormRunnerLoadRunner in the Cloud

LoadRunner12.0

PerformanceCenterSaaS

PerformanceCenter

On-premise

Load Generators

Load Generators

LoadRunner on-premise

Load Generators

Load Generators

LoadRunner12.0

LoadRunner in the Cloud

LoadRunner in the Cloud

Load Generators

Load Generators

Performance Center on-premise

PerformanceCenter

On-premise

Load Generators

Load Generators

Performance Center SaaS

PerformanceCenterSaaS

Load Generators

Load Generators

StormRunner

StormRunner

Load Generators

Remote testers

StormRunner

LoadRunner12.0

PerformanceCenterSaaS

PerformanceCenter

On-premise

Remote tester

Remote tester

LoadRunner in the Cloud

So which product should I choose?

StormRunner

LoadRunner in the Cloud

LoadRunner

PerformanceCenter

Quick, high volume tests

Web only

Remote load generation

Short-term engagement (s)

Any protocol

Remote and local load generation

Advanced use e.g. NV, diagnostics etc.

More frequent testing

C of E approach

Remote and local load generation

Detailed reporting and analysis

On-site testers

Very frequent testing

Larger C of E / “follow the sun”

Dashboard for stakeholders

Integration with ALM etc.

LoadRunner in the Cloud

Web-based VM admin console

• Pre-built servers

• Controllers and Load Generators

• CPU / RAM / HDD

user configurable

• With or without firewall support

• LGs can be anywhere

• NV support built in

• UFT and other software available

• Different license options

• 100, 200 & 500 vUsers

• All protocols supported

• On-demand availability and pricing

• PayPal or Account

• Pay for what you use

• Efficient license use

Is “The Cloud” any good for testing?

“Cloud computing is a model for enabling convenient, on-demand network

access to a shared pool of configurable computing resources that can be

rapidly provisioned and released with minimal management effort

or service provider interaction.”

Source: The National Institute of Standards and Technology

BUT….

• Unproven technology for testing:

reliability/repeatability

• Steep learning curve

• Costs difficult to quantify

• Security concerns

• Performance

Is “The Cloud” any good for testing?

Is “The Cloud” any good for testing?

Is “The Cloud” any good for testing?

Is “The Cloud” any good for testing?

Realism Repeatability

But how will it

really perform?

Did my change

make a difference?

Avoid pitfalls

Repeat tests to obtain average results

Re-validate tests with in physical test environments

Use diagnostics software to drill down into application performance

…..better application understanding is vital

Use benefits of the cloud/virtualisation

Low cost

On-demand

Flex up & down

Over provision

Demonstration

LoadRunner in the Cloud

Contact:

richard.bishop@trustiv.co.uk

http://blog.trustiv.co.uk/

@Richard Bishop@TrustIV

@VivitWorldwide