Joseph Ours - The Scourge Of Testing: Test Data Management

transcript

www.cohesion.com | 877.774.3001

Test Data Management

The Scourge of Testing

Introducing Joseph Ours

About Joseph

• Owns development and delivery of Cohesion's Quality Assurance and Testing Services

• More than 15 years of IT experience spanning several industries and roles

• Notable success managing multi-million dollar initiatives while introducing innovative solutions for Fortune 1000 companies, resulting in improved quality, increased client satisfaction, cost avoidance, on-time delivery, and establishing a true team culture

Contacting Me

@justjoehere

jours@cohesion.com

614.423.5253

www.linkedin.com/in/josephours

What is this about

Purpose of TDM

TDM Lifecycle

Key TDM Lifecycle Aspects

Key TDM Support Roles

• Company #1

• 42 Systems needed for E2E testing

• Systems couldn’t talk because data didn’t match

• Project teams added 15% more testing time for test data collection/creation

• 10% of tests could not be executed due to bad data

• All defects had to be investigated as bad data first

• Old data triggered many invalid defects

• Some production defects existed because of unique data in production that wasn’t in a test environment

• Company #2

• Agile teams (6)

• Used automation, ran tests every day/evening

• Created business transactions as a part of testing

• Transactions had a default renewal date

• Actual renewal date hit, test environment came down as it tried to process all the renewals

Quick Examples

You manage test data or test data manages you

Test data can impede the overall speed of testing

• Performance testing

• Security testing

Test data affects the ability to conduct types of testing such as:

Why Manage Test Data?

Challenges Associated with Test Data?

Skipped tests

Availability

Security/PII

Storage space

Freshness of data

Have you ever tried to test…

• Big Data

• Data Warehouses

• Predictive Analytics

Reduce ambiguity in data sourcing and control

Establish roles and responsibilities around test data

Ensure right size test databases that accurately reflect into in business processes

Support comprehensive nonfunctional testing to obtain in user confidence in production performance and scalability

Allow for managing risks associated with test data

Facilitate communicating test data needs

Identify SLA’s for test data turnaround

Why a Test Data Management Strategy

• Standardized

• Modular

• Managed

• Known CIM C

• Quality

• Self-Serve

• Data Catalog

• Fast Acquisition S

• Competency Center

• Operational Efficiency

• Traceable

• Compliance

Mature TDM is…

Test Data Management Lifecycle

Analysis Design Creation

Use and Maintenance

Disuse

Governance

Permissions

Encryption

Masking

Translation

Governance

Acquisition

Refresh

Maintenance

Scrubbing

Enrichment

Integrity

• The simplest phase, with the most work!

Analysis and Design

• Test scenario data needs identified

• Refresh frequency

• Storage needs identified

Analysis

• Implementation of storage infrastructure

• Implementation of TDM tools, if required

• Any data prep work

Design

Analysis Design Creation

Use and Maintenan

Disuse

Creation

Reverse migration

• Clone

• Subsetting

Creation through

• UI or API

• Direct injection

Massage

Analysis Design Creation Use and

Maintenance

Disuse

Provides Real World Data

Ensures Data Integrity

Entire Book of Business Available

Reduces Data Set Size

Minimizes Security Risks

Covers All Test Scenarios

Fast Acquisition Time for Data

Minimizes Duplicate Data

Creation - Key Evaluation Criteria

Reverse Migration

Data Creation

Massage

Reverse Migration Creation Massage

Subset UI/A

Direct

Injection

Provides Real World Data X X

Ensures Data Integrity X X

Entire Book of Business

Available

Reduces Data Set Size X X X X

Minimizes Security Risks X X X

Covers All Test Scenarios X X

Fast Acquisition Time for

Minimizes Duplicate Data X X

Instantiation Summary

Preparation

Validation

Execution

Maintenance

Use of Test Data Analysis Design

Creation Use and

Maintenance

Disuse

Archival Deletion Retain

Dis-use Analysis Design

Creation Use and Maintenan

ce Disuse

TDM Manager

Application Architect

TDM Architect

Test Lead

Database Administrator

Security and Compliance

Officer

Infrastructure Architect

Key Roles Supporting TDM

Improve defect quality

Facilitate test coverage

Reduce labor costs

Manage storage needs

Manage security risks

Analysis Design

Creation Use and Maintenance Disuse

Governance

•Standardized

•Modular

•Managed

•Known CIM

•Quality

•Self-Serve

•Data Catalog

•Fast Acquisition S

•Competency Center

•Operational Efficiency

•Traceable

•Compliance

TDM Manager

Application Architect

TDM Architect

Test Lead

Database Administrator

Security and Compliance

Officer

Infrastructure Architect

Questions?

Joseph Ours, MBA, PMP

jours@cohesion.com

614.423.5253

www.cohesion.com

@justjoehere

www.linkedin.com/in/josephours

Joseph Ours - The Scourge Of Testing: Test Data Management

Technology