How does your organization compare against today’s trends ... · The World Quality Report...

The World Quality Report 2010-2011

How does your organization compare against

today’s trends in software quality and

testing?

2World Quality Report 2010

Copyright © 2010 Capgemini and Sogeti. All Rights Reserved.

Mattias Bergströmner

- Global Service Line Testing

- Subject Matter Expert Testing

- Strategic Sales & Delivery

+46 730 88 40 26

+ 46 853 68 40 26

[email protected]

Speaker

mailto:[email protected]



Report Demographics

Key Findings

Industry Perspectives

Testing Tools and Technology

Skills and Test Organization

Testing Outsourcing Trends

Virtualization and Testing on the Cloud

Leveraging Agile Methodologies

The State of Quality

What next ?

Agenda



This presentation

Take off

Go directly to10 000 ft

Hope you are well seated

Enjoy and relax.



Report Demographics



World Quality Report profile - geography

North America

52%

Europe

30%

Asia

9%

Rest of the World

9%

30 000 CXOs,

IT directors, QA Mgrs

and engineers at various

companies around the

world.



World Quality Report profile – size of the company

0%

5%

10%

15%

20%

25%

30%

35%

40%

Enterprise Large Mid size Small

27%

17% 18%

38%

Below 1000* Over 20 000*1000 – 4999*5000 – 20 000*

*employees

World Quality Report 2010-2011

Key Findings



Highlights and Key Trends

Economic Impact

Most companies had to reduce their IT spend, but 71% are still investing in new

application development projects

50% indicate resource cuts and heavier project loads have forced their project

teams to take on more work

Methodology

70% admit to following specific ALM (Application Lifecycle Management)

methodology

82% follow testing processes consistently for more than half of their projects

Skills

QA organizations increasingly require well-rounded resource skill sets; testing,

development & methodologies = greater convergence



Highlights and Key Trends

Agile

Agile delivery methods continue to gain popularity; 60%+ leverage agile, although

mostly experimentally and gradually, with time to market & quality benefits

Outsourcing

Nearly 50% outsource application development and testing irrespective of

methodology used, and plan to increase offshore resources in the coming year. The

biggest growth is seen in Europe.

Virtualization and the Cloud

Nearly 75% starting to leverage deployment of some applications on the Cloud -

cost reduction and agile are main reasons

Industry Perspectives



CPR companies place greater premium

on aligning business and IT priorities,

but there is significant disconnect

between business and QA groups in

sector

63% of survey responses feel that

business thinks role of QA is to

execute scripts, even though execution

accounts for only a fraction (20-25%) of

QA activities.

CPR respondent say 67% of their testers

have little CPR domain expertise, lower

than other sectors

Despite downturn, CPR sector is

increasing investment in IT and new

application development

Almost half are leveraging outsourced

resources for testing

Industry notes: Consumer Products and Retail

“I don’t get no

RESPECT!”



Heavy reliance on IT systems for core

functions but no standardized ERP solution

– a lot of systems requiring effort to

maintain and difficult to integrate in

acquisition/ merger

Still supporting ever-expanding datacenters

and aging infrastructure

70% of Distributions/Logistics respondents

turning to agile development to help build new

SOA platforms

All claim to be using integrated automation tools

to support agile initiatives, but number of

initiatives remains small (less than 25%)

Some are starting to bring their applications

to the cloud

Industry notes: Distribution/Logistics



Application performance testing considered

a requirement in this sector; accuracy and

precision are essential given multi-trillion $

transactions

Still feeling the impact of the recession and

increasing regulation

Banks’ existing distribution and legacy

systems not set up to support changing

customer banking behavior patterns with

heavy reliance on web-based services and

transactions

64% of respondents have reduced IT

investments due to the economic conditions

But 80% say they are still investing in new

application developments projects

66% are leveraging Agile in their ALM

Nearly 70% are using outsourcing services

for testing, with increasing reliance

Industry notes: Financial Services

“I’m repaying the

bailout money from

my phone”



“It’s better to be first than to be better” - quality often takes second place

to time to market

Quality = usability, design and positive user experience

Sector achieves higher quality with limited resources

through efficiency and innovation

80% use Agile; of those 30% use Agile for over 50%

of their application development

Among the first to embrace the Cloud to optimize

IT infrastructure

They plan to test 25%+ of applications on the Cloud

Outsourcing is not preferred route – as app development

core to the business

QA is integral to app delivery process: 76% understand that

primary function of QA is not simply execution of test scripts

Industry notes: High Tech

“Iphone

came

first!”

“Droid

is

faster!

”



IT budgets shrinking, public scrutiny and

regulation forcing sector to take more strategic

and ROI-approach to IT investment

Cloud coming to the fore; all government

sector respondents confirm they intend to

move some applications to the cloud in next

3 years

Quality is very important due to downstream

consequences of poorly performing applications

Most have well-defined ALM methodology +

highest number of responses for following a

standard methodology such as TMap®

But slow to adopt Agile. 69% respondents do

not use agile

Sector traditionally not used outsourcing and

offshoring; 32% use QA outsourcing and 21%

plan to increase their use

Industry notes: Public Sector

“Yes we can???”



IT is second largest capital expense

with investment in self-service online

applications for customer interaction

Sector continues to invest heavily in

new IT projects – 76% in new

application development

Looking to consolidate, centralize and

simplify strategic IT systems –

standardizing on a single streamlined

system

69% - greatest challenge is capturing

business requirements and managing

change

Quality is more than functionality – its

about the user experience.

Industry notes: Telecommunications

40% are increasing their outsourcing and

want more specialist services eg SAP

Forefront of adopting virtualization – all

are planning to test applications in the

Cloud, + 31% indicate they expect to test

over half of their applications in the Cloud

Testing Tools and Technology

• The Role of Automation

• The Case for Return on Investment



Leverage of automation technology across ALM

Test

Cases

Defect

Manage-

ment

Require-

ments

Use

Case

Business

IP

Domain

Mgmt

All of the

AboveBusiness

Flow

Modeling



Need for Automation Investment

0%

5%

10%

15%

20%

25%23%

20% 20% 19%

14%

1%

3%

Business

Flow

Modeling

Require-

ments

Test

Manage-

ment &

Execution

Defect

Manage-

ment

Environ-

ments &

Data

Management

None; we

have all that

we need

Testing

Through

the Cloud



How much ROI are you getting from Investments?

100%

Up to 80%

Up to 50%

Less than 25%

None

Can't Quantify

Skills and Test Organization

• Domain knowledge and Skills



Does QA need to have domain knowledge?

NA

EU

ROW

ASIA

Experts in our

industry domain

Few years’ relevant

industry domain knowledge

Very little

Doing more with less is here to stay.



Most important skills when hiring QA

Security skills

Networking skills

Mainframe skills

Database skills

Scripting skills (Perl, Python, etc.)

Development skills (C++, Java, etc.)

Business Knowledge

QA skills

Testing Outsourcing Trends



Do you outsource QA?

NA

EU

ROW

ASIA

Yes

No



South East Asia

Eastern Europe

South America/Latin America

Nearshore

India

Contractors Co-located

China

Africa

Where do you prefer to outsource QA?

Virtualization and Testing on the Cloud



What percentage of applications are virtualized?



Top Cloud migration challenges

Application performance

issues

We have issues but we do not

know the reasons

We have not seen any issues

Infrastructure performance

problems

Application functionality

issues

Security and vulnerability

problems



How are you leveraging cloud in testing?

We do not leverage virtualization

/cloud in our testing efforts

We leverage cloud services to

generate traffic for our performance

testing efforts

We use testing tools hosted

in the cloud

We set up test environments using

cloud services

Leveraging Agile Methodologies



Do you leverage Agile methods in application

delivery?

No

Yes



What is the biggest challenge working with

offshore resources for Agile delivery?

The State of Quality

• Year on Year improvement

• The Role of processes and frameworks



Overall is Quality getting better? (Last two years)

Yes

No



Which Test Methodologies are used?

What Next?



What next?

Investment shift to requirements visualization, business flow modeling and test

environment and data management

Increased demand for testers with strong technical skills and relevant domain and

business knowledge

Agile delivery methods will enable businesses to focus on projects that bring fast ROI

Hosting applications on a cloud will help reduce infrastructure costs, increase agility

and capacity planning

Trend for increased outsourcing remains, provided vendors offer more specialized

value-added services and assets and industry skills

Speak to us about participating in our 2011-12 WQR survey

[email protected]



For more information

Download the World Quality Report at

www.capgemini.com/wqr2010-11

www.sogeti.com/Curious-about-

Sogeti/publications

Or contact

Mattias Bergströmner

+46 730 88 40 26

+46 853 68 40 26

[email protected]

http://www.capgemini.com/wqr2010-11



http://www.sogeti.com/Curious-about-Sogeti/publications





http://www.sogeti.com/

mailto:[email protected]

Thank you !

Date post:	21-Aug-2020
Category:	Documents
Upload:	others
View:	0 times
Download:	0 times

How does your organization compare against today’s trends ... · The World Quality Report...

Documents