Joseph Ours - The Scourge Of Testing: Test Data Management

www.cohesion.com | 877.774.3001

Test Data Management

The Scourge of Testing


Introducing Joseph Ours

About Joseph

• Owns development and delivery of Cohesion's Quality Assurance and Testing Services

• More than 15 years of IT experience spanning several industries and roles

• Notable success managing multi-million dollar initiatives while introducing innovative solutions for Fortune 1000 companies, resulting in improved quality, increased client satisfaction, cost avoidance, on-time delivery, and establishing a true team culture

Contacting Me

@justjoehere

[email protected]

614.423.5253

www.linkedin.com/in/josephours

mailto:[email protected]

http://www.linkedin.com/in/josephours


What is this about

Purpose of TDM

TDM Lifecycle

Key TDM Lifecycle Aspects

Key TDM Support Roles


• Company #1

• 42 Systems needed for E2E testing

• Systems couldn’t talk because data didn’t match

• Project teams added 15% more testing time for test data collection/creation

• 10% of tests could not be executed due to bad data

• All defects had to be investigated as bad data first

• Old data triggered many invalid defects

• Some production defects existed because of unique data in production that wasn’t in a test environment

• Company #2

• Agile teams (6)

• Used automation, ran tests every day/evening

• Created business transactions as a part of testing

• Transactions had a default renewal date

• Actual renewal date hit, test environment came down as it tried to process all the renewals

Quick Examples


You manage test data or test data manages you

Test data can impede the overall speed of testing

• Performance testing

• Security testing

Test data affects the ability to conduct types of testing such as:

Why Manage Test Data?


Challenges Associated with Test Data?

Labor

Skipped tests

Availability

Security/PII

Storage space

Freshness of data


Have you ever tried to test…

• Big Data

• Data Warehouses

• Predictive Analytics


Reduce ambiguity in data sourcing and control

Establish roles and responsibilities around test data

Ensure right size test databases that accurately reflect into in business processes

Support comprehensive nonfunctional testing to obtain in user confidence in production performance and scalability

Allow for managing risks associated with test data

Facilitate communicating test data needs

Identify SLA’s for test data turnaround

Why a Test Data Management Strategy


Reu

sable

• Standardized

• Modular

• Managed

• Known CIM C

onsu

mab

le

• Quality

• Self-Serve

• Data Catalog

• Fast Acquisition S

cala

ble

• Competency Center

• Operational Efficiency

• Traceable

• Compliance

Mature TDM is…


Test Data Management Lifecycle

Analysis Design Creation

Use and Maintenance

Disuse

Governance


Permissions

Encryption

Masking

Translation

Governance

Acquisition

Refresh

Maintenance

Scrubbing

Enrichment

Integrity


• The simplest phase, with the most work!

Analysis and Design

• Test scenario data needs identified

• Refresh frequency

• Storage needs identified

Analysis

• Implementation of storage infrastructure

• Implementation of TDM tools, if required

• Any data prep work

Design

Analysis Design Creation

Use and Maintenan

ce

Disuse


Creation

Reverse migration

• Clone

• Subsetting

Creation through

• UI or API

• Direct injection

Massage

Analysis Design Creation Use and

Maintenance

Disuse


Provides Real World Data

Ensures Data Integrity

Entire Book of Business Available

Reduces Data Set Size

Minimizes Security Risks

Covers All Test Scenarios

Fast Acquisition Time for Data

Minimizes Duplicate Data

Creation - Key Evaluation Criteria


Reverse Migration


Data Creation


Massage


Reverse Migration Creation Massage

Full

Clone

Subset UI/A

PI

Direct

Injection

Provides Real World Data X X

Ensures Data Integrity X X

Entire Book of Business

Available

X

Reduces Data Set Size X X X X

Minimizes Security Risks X X X

Covers All Test Scenarios X X

Fast Acquisition Time for

Data

X X X

Minimizes Duplicate Data X X

Instantiation Summary


Preparation

Validation

Execution

Maintenance

Use of Test Data Analysis Design

Creation Use and

Maintenance

Disuse


Archival Deletion Retain

Dis-use Analysis Design

Creation Use and Maintenan

ce Disuse


TDM Manager

Application Architect

TDM Architect

Test Lead

Database Administrator

Security and Compliance

Officer

Infrastructure Architect

Key Roles Supporting TDM


Improve defect quality

Facilitate test coverage

Reduce labor costs

Manage storage needs

Manage security risks

Recap

Analysis Design

Creation Use and Maintenance Disuse

Governance

Reu

sab

le

•Standardized

•Modular

•Managed

•Known CIM

Co

nsu

mab

le

•Quality

•Self-Serve

•Data Catalog

•Fast Acquisition S

cala

ble

•Competency Center

•Operational Efficiency

•Traceable

•Compliance

TDM Manager

Application Architect

TDM Architect

Test Lead

Database Administrator

Security and Compliance

Officer

Infrastructure Architect


Questions?


Joseph Ours, MBA, PMP

[email protected]

614.423.5253

www.cohesion.com

@justjoehere

www.linkedin.com/in/josephours

http://www.cohesion.com/

http://www.linkedin.com/in/josephours

Date post:	11-May-2015
Category:	Technology
Upload:	qaoth
View:	646 times
Download:	0 times

Joseph Ours - The Scourge Of Testing: Test Data Management

Technology