Customer

Performance Tester

Collaborative

Phase I: Planning

Project Meeting Technical Meeting

Data Flow Diagram

Infrastructure Diagram

Technical Questionnaire

Understand Customer Environment

Understand Customer Application

Verify Expectations

Understand PT Methodology

Establish PTKPI’s

Create Performance Test Plan

Ou

tpu

t

Business Process to Infra Mapping

Business Processes

The Performance Testing

Process

Ou

tpu

t

Phase II: Setup & Script Development

PT EnvironmentEnvironment Analysis

& Data Preparation

Development &

Validation

Estimate Injector

Requirements

Setup Controllers &

Injectors

Identify PTE location

(on site)

Assist PTE setup

(on site)

Analyze Environment

Monitoring

Analyze Required Data

Develop Test Scripts

Develop Specialized Scripts

Assist with Information

Obtain Required DataComplete PTE setupCompleted

Test Scripts

Validated

PTE & Test ScriptsSetup Monitoring

Customer

Performance Tester

Collaborative

The Performance Testing

Process

Phase III: Performance Testing Sessions

Initial Baseline Final BaselineSessions

Collaborative Input Collaborative Input

Collaborative Input

Session Goals

Lead Session

Produce Summary Report

Conduct Session De-Brief

De-Brief Session

Final Baseline

Create Final Summary

Report

Initial Baseline

Ou

tpu

t

Customer

Performance Tester

Collaborative

The Performance Testing

Process

The Performance Testing

Project

Phase I: Planning

Phase III: Performance Testing Session (PTS)

Phase II: Preparation and Scripting

Phase I: Planning

Define the goals

Business goals (Business Key Performance Indicators)

○ Define measurable goals for the performance of the application, for example:

The system needs to create X number of orders per hour with a response time per

page of less than Y seconds in 95% of all cases.

IT goals (Technical Key Performance Indicators)

○ In addition to the business goals there can be IT specific goals, for example:

The bandwidth utilization should not exceed 8 mbps

Phase I: Planning

Define the Test Key Performance Indicators

Test Key Performance Indicators (TKPI’s) are used to measure the goal

achievements, for example:

○ Response Time

○ Throughput

○ Utilization

○ Efficiency

Define the scope

Define which part of the application/service to test

Define which 3rd part service to include/exclude

Define the timeline

Phase II: Preparation

Application assessment

Business Processes

Scenario

○ Think time

○ Iteration

○ User distribution

Data Flow (in combination with Infrastructure Assessment)

Infrastructure assessment

Technical Questionnaire

○ Physical Access to the application

○ Monitoring

○ Data Flow

Phase II: Preparation

Data assessment

Volume data

Unique data

One time data

Reusable data

Asses the impact of

Write

Update

Delete

Phase II: Setup Monitoring

Infrastructure

Phase III: PVS Session

Phase III: Analysis and

Reporting Summary Report for each performance test

– KPI achievement

– Changes since last test

– Issues and bottlenecks

Analysis tool

Session data collected with Performance Center

De-brief

Phase III: Performance Testing

Cycle

Phase I: Planning

Phase II: Preparation

Phase III: Execution

Phase II: Preparation

Application Assessment

Infrastructure Assessment

Phase II: Application

Assessment

Analyze current or planned application usage

Translate the business processes into scripts

Define the think time and iteration pace

Define the percentage user distribution

Test the scenario against the plan

Define the business processes

Phase II: Application

Assessment

What key business functions are used ?

E.g. Submit Order, Search Products

What is the application flow for an end user to perform these business

functions ?

E.g. “Go to homepage”, “Log-in”, “Enter Search Criteria”, “Click Submit”

What is the frequency of these business functions ?

E.g. 100 submitted orders per hour

Step1: Analyze the current or planned usage

“Use those business functions for load testing that generate 80% of

the value.”

Phase II: Application

AssessmentStep1: Define the business process

Phase II: Application

AssessmentStep2: The business process is translated into a program

Phase II: Application

Assessment

Think time and iteration pace

Step3: Define the Scenario

PacingRT TT TTRT RT TT

Iteration

Response Time

Think Time

Phase II: Application

Assessment Percentage user distribution

Business Process Name Percentage

bp01_Transfer Funds 24 %

bp02_DisplayTransactionDetails 67 %

bp03_MakePayment 9 %

Step3: Define the Scenario

Phase II: Infrastructure

Assessment

System Landscape (Scope)

System Monitoring

Domain specific Monitoring

Resource Monitoring Domains

Phase II: Infrastructure

Assessment

Define System and Domain specific monitoring

Work on the response time breakdown

Draw the system landscape

Phase III: Performance Validation Session

Performance test run

Analysis and reporting

Script calibration

Phase III: Performance test run