Sogeti’s updated Test Management approach · Sogeti’s updated Test Management approach Geert...

TMap® Next

Sogeti’s updated Test Management approach

Geert Vanhove

People you know. Knowledge you need2

© Copyright Sogeti 2009 All Rights Reserved - Proprietary and Confidential

Agenda

Sogeti

Situation of TMap® Next

Business driven test management

Structured test process

Complete toolbox

Adaptivity

Conclusion

Questions



Sweden

Norway

Denmark

Germany

Switzerland

Spain

Belgium/Luxemburg

Netherlands

Ireland*

France

UK**

Geographical presence Sogeti

◦ Revenues 2008 €1.6 billion, profit >10%

◦ A work force of over 20.000 staff spread over 200 locations

India

USA

* Insight Test Services

- acquired 04/2008

- 80 employees

** Vizuri

- acquired 10/2008

- 90 employees



Our services

4

Application Management

High Tech Engineering

Infrastructure Management

Software Control Testing



A company specialized on business driven testing based on internationally acknowledged methods TMap® and TPI®

Markets the unique Managed Testing Services model with a fit-for-purpose match of on shore, near shore and off shore capabilities

Sogeti Group employs 2.500 career test specialists organized in dedicated entities spread over 14 countries including our full-flex off shore test center in India

On shore in 12 European countries

On shore throughout the U.S.

Sogeti testing facts



Sogeti testing service portfolio

Test Management

— BDTM

— Risk based testing strategy

Test Automation / Tool Support

— Compuware suite

— HP Mercury suite

— IBM Rational suite

— Borland (Performance testing as a service)

— Other specialist tool providersTest Engineering

— Unit testing

— Integration testing

— System testing

— Acceptance testing

— Maintenance testing

Training

— Test Management

— Test Engineering

— TPI

— Test Automation

— TMap Certification (Foundation, Advanced)

— ISTQBSpecialized Testing

— Agile testing

— SOA testing

— End-to-end testing

— SAP testing

— Data warehouse & BI testing

— Migration testing

— Performance testing

— Security testing

— Usability testing

— Infrastructure testing

Consulting & Quality Assurance

— Assessments (e.g. TPI)

— Audits (e.g. CMMI)

— Quick scans

— Implementation management

— Operational QA

High Tech Testing

— System testing (e.g. aircraft control)

— General physics testing (e.g. mechanical)

Managed Testing Services



Agenda

Sogeti




Complete toolbox

Adaptivity

Conclusion

Questions



Many different Many different

disciplinesdisciplines

Conflicting Conflicting

interestsinterests

UnpredictabilityUnpredictability

Complex Complex

managementmanagement

Time pressureTime pressure

Maximum value Maximum value

from softwarefrom software

Take control on Take control on

risksrisks

Make better Make better

decisionsdecisions

Manage risksManage risks

Software testing



Delivers insight into, and advice on, any risks in

respect of the quality of the tested system

Testing is on the critical path of the total

development as briefly as possible

Finds defects at an early stage, prevents

defects

Test products are reusable

Test process is understandable and manageable

For any situation, client or system

development approach:

Deliver

"more for less, faster and better"

with TMap® Next

Software testing



Sogeti and testing

Inventor of TMap®(Next), TPI®, TAKT®

International standards

Various alternatives



Test Management Approach (TMap®Next)

Key elements

◦ Business driven test

management

◦ Full description of the test process

◦ Complete tool set

◦ Adaptive

Business driven test management Structured test

process

Complete toolbox

Adaptive

Flexible

Method

Testing is a processthat provides insight into, and advice on, quality and the related risks



TMap® Next - the book and the web site

Checklists

Templates

Tools

White papers

Etc.

www.tmap.net



TMap® Next – index of book

1 Introduction

2 Framework and importance of testing

3 The essentials of TMAP®

4 Introduction to the processes

5 Master test plan, managing the total test process

6 Acceptance and system tests

7 Development tests

8 Supporting processes

9 Product risk analysis

10 Quality characteristics and test types

11 Estimation techniques

12 Defect management

13 Metrics

14 Test design techniques

15 Evaluation techniques

16 Test roles

GENERAL

PROCESSES

COMPONENTS



TMap® related services

TMap®



Agenda

Sogeti




Complete toolbox

Adaptivity

Conclusion

Questions




Business case:

• Result

• Risks

• Time

• Costs

Find a good balance between the 4 BDTM aspects




Demonstrate

Infor

m

Appoint

BDTM

Project status(Time/Costs)

Risks

Result



Test execution

Creating test cases

Test basis

5

Allocating test techniques


4

Result, risks,time and costs

6

3

Determining light/thorough testing

Critical success factors

Change proposalsRequirements

Business processes… 2

Determining risk class

CLIENTCLIENT

1

Assignment and test goals



Risks and test coverage

risks

testcoverage

Plan:- strategy-budget- planning

risks

testcoverage

Execution:- other risks- less test coverage

risks

testcoverage

Adjusted approach:- strategy-budget- planning

With client



• Damage• Frequency of use

System

administrator

Data

center

Accountancy

CM & CC

Technical

design

Project

TEST

QADBA

Business

Functional

design

• Chance of defects

management

Developer

Physical

management

Business Driven Test Management



BDTM – Product risk analysis (example)

Outcome of product risk analysis

• Combining characteristics/object parts/risk classes

Performance

B-> Online

BUser-friendliness

Functionality

High chance of failure, used in vital processes 1 and 2A-> System 1

Medium chance of failure, used only to limited extent in vital process2

B-> System 2

If system 1 and 2 function correctly, the risk of integration problemsis low

C-> Total

C-> Batch

Risk class

MotivationCharacteristic



BDTM – High level test strategy (example)

�

�

Evaluation

�

�

DT

I

�

��

��

ST

��

�

��

UAT

��

��

PAT

Performance

B-> Online

BUser-friendliness

Functionality

A-> System 1

B-> System 2

C-> Total

C-> Batch

Risk class

Characteristic

Product risk analysis Test strategy



BDTM – Detailed test strategy (example)

ToolPerformance testTotal system (B / �)

Performance - online

Exploratory testingRegression testSystem 2

(B / �)

Functionality

DCT, SYN, SEMFunctional testSystem 2

(A / ��)

Functionality

Test techniqueTest typeObject partCharacteristic

High level test strategy Detailed test strategy



Business Driven Test Management

The key to BDTM is balanceThe key to BDTM is balance



Characteristics of BDTM

• Gives client grip on test process• Uses client language • Bases testing on product risks• Delivers appropriate test coverage on right spot

• Makes test results visible



Agenda

Sogeti




Complete toolbox

Adaptivity

Conclusion

Questions



V-model



Master test plan - Managing the total test process

Planning phase

Master test plan

System test

Development test

Acceptance test

Reviews

Special attention for:• Business driven test management• Set up organisation

Master test plan

Test plan per test level

control, report and adjust

execute

and Control phase



Master Test Plan (MTP)

Main purposes of MTP:

• Total overview of test process: what to test (when and how) in which test levels – alligning test levels

• Minimizing risks of overlap or gaps in test coverage

• Detect most important defects as early as possible (critical path)

• Ensure uniformity in processes (e.g. defect procedure)

• Optimal distribution of available resources (testers, test environment, tools, expertise)

• Agreements with stakeholders

• Approach, planning, estimated effort and activities anddeliverables in relation to total test process




Phasing model as a base

P P S E C

I

Planning

Control

Setting up and maintaining infrastructure

Preparation Specification Execution Completion

C

>> Mainly for acceptance and system testing




Specify infrastructureRealise infrastructureSpecify intake infrastructureIntake infrastructureManage infrastructureConserve infrastructure

Specify infrastructureRealise infrastructureSpecify intake infrastructureIntake infrastructureManage infrastructureConserve infrastructure

InfrastructureInfrastructure

P S E C

I

C

P

Collect test baseSet up checklistAssess test baseSet up report detail intake

Collect test baseSet up checklistAssess test baseSet up report detail intake

PreparationPreparation

Set up specificationsDefine situationsSpecify intake test object

Set up specificationsDefine situationsSpecify intake test object

SpecificationSpecification

Intake test object (pretest)Set up situationExecute (re)testsControl and assess

Intake test object (pretest)Set up situationExecute (re)testsControl and assess

ExecutionExecutionControlControl

Manage, monitor, report, steerManage, monitor, report, steer

Planning Planning

Determine assignment……Assign test techniques……Fix test plan

Determine assignment……Assign test techniques……Fix test plan

Master te

st p

lan

Evaluate test procesConserve testware

Evaluate test procesConserve testware

CompletionCompletion



BDTM in TMap® Next phasing model

1. Establishing the assignment

2. Understanding the assignment

3. Determining test base

4. Analysing the product risks

5. Determining the test strategy

6. Estimating the effort

7. Determining the planning

8. Assign test units and test techniques

9. Defining the test products

10.Defining the organisation

11.Defining the infrastructure

12.Organising the management

13.Determining the test project risks

and adjustments

14. Feedback and consolidation of the plan

1. Management

2. Monitoring

3. Reporting

4. Adjusting

BDTM

BDTM

BDTM

P S E C

I

C

P



TMap® Next processes

Master test plan, managing the total test process

Acceptance and system test

Development test



Main differences from system/acceptancetesting:

• Not an independent process by an independent team, part of development process

• Other type of defects found (technical aspect)

• Each statement in the code has been touched once

• Communication on defects is minimal (tester and developer are often the same person)

• Approach: all found defects should be resolved beforedelivery of software (minimal reporting)

• First test traject: cheap and fast defect resolving(flexible environment needed)

• Mindset of developer and tester is different

Development test



Using knowledge of the technical

implementation of the system

Unit test: testing the smallest parts of the system

Unit integration test: testing the integration with the other units

• Test-driven development

• Pair programming

• Code review

• Continuous integration

• Application integrator

approach

Development test



Characteristics of structured test process

• Applicable for all test levels• Coordinates and synchronizes different test levels

• Assigns tasks and responsibilities among parties involved

• Split in phases, activities and products



Agenda

Sogeti




Complete toolbox

Adaptivity

Conclusion

Questions



Complete toolbox

Techniques

• How is tested?

Infrastructure

• Where is tested?

• With what is tested?

Organisation

• By whom is tested?



Techniques

Test design techniques

Estimation techniques

Defect management

Metrics

Templates

Product risk analysis

Evaluation techniques

Etc.




Appropriate coverage on according system part

Various types of coverage

Defineassignment

Riskanalysis

Test basis Test cases

Test strategy

Coverage

Test designtechniques

Specification oftest cases




Test basis

Test cases

Test situations

Test designtechnique

Coverage

Coverage type

Coverage ratio

Basic technique

Detailed overview




Coverage types & basic techniques

.

.

.




Test design

Test situation

Test case

Test script

Show that the requested coverage has been met

Concrete development of test casePreparation of test execution

Logical test case

Physical test case

Logical test design

Physical test design

Relation between test design concepts



Coverage types

Paths

Decision points

Equivalence classes

Boundary value analysis

Pairwise testing

Create/Read/Update/Delete (CRUD)

Right paths/Fault paths

Checklist

Orthogonal arrays

Operational profiles

Load profiles




Decision table test (DTT)

Data combination test (DCT)

Elementary Comparison test (ECT)

Error guessing (EG)

Exploratory testing (ET)

Data cycle test (DCyT)

Process cycle test (PCT)

Real life test (RLT)

Semantic test (SEM)

Syntactic test (SYN)

Use case test (UCT)



Complete toolbox

Techniques

• How is tested?

Infrastructure



Organisation




Infrastructure

Main components

• Test environment

• Tools

• Workplace



Test tools

Situation in the V-model

RequirementsSpecification

FunctionalDesign

TechnicalDesign

Realisation

AcceptanceTest

IntegrationTest

SystemTest

UnitTest

Test designtools

Staticanalysis tools

Coveragetools

Performanceand simulatortools

Test execution andcomparison tools

Management tools



Complete toolbox

Techniques

• How is tested?

Infrastructure



Organisation




Organisation

Project

Managed

Testing

Services

Managed

Resourcing

Time &

Material



Agenda

Sogeti




Complete toolbox

Adaptivity

Conclusion

Questions



Adaptivity

Adaptive on different levels

• Client

• Application

• Tool box



Adaptivity

React on changes

(Re)use

Learn from experience

Try before use



Be adaptive!… Use it!

More than 400 tips, cases and examples

www.tmap.net



Agenda




Complete toolbox

Adaptivity

Conclusion

Questions



What does TMap® Next offer?

Ready to go tool set

Tips and examples

Insight and support to tailor your solution

Find as many defects as possible as early as possible

Focus on risk!

Keep testing off the critical path

Testing is more cost-effective and efficient

Coverage without overlap

Repeatable process

Test organisation prepared and efficient

Industry-standard methodology



Questions?



Thank you for your attention!

Sogeti BeLux nv

Prins Boudewijnlaan 53B-2650 Edegem

Tel.: +32 (0)3 231 12 90

Sogeti BeLux nv

Jules Bordetlaan 160B-1140 Brussel

Tel.: +32 (0)2 538 92 92

www.sogeti.be

www.tmap.net [email protected]

Technical manager Testing Services

Date post:	18-May-2018
Category:	Documents
Upload:	lenhu
View:	215 times
Download:	2 times

Sogeti’s updated Test Management approach · Sogeti’s updated Test Management approach Geert...

Documents