1 of 21
From qualitative concept to From qualitative concept to practical implementation.practical implementation.
Evolution of the Evolution of the Data Quality Objectives Data Quality Objectives
ConceptConcept
DOE EM-5 DQO Training WorkshopDOE EM-5 DQO Training Workshop - Day 1- Day 1Appendix AAppendix A
2 of 21
Evolution of the DQO ConceptEvolution of the DQO Concept
Objectives:Objectives:– To illustrate how the DQO Process has matured To illustrate how the DQO Process has matured
over time from a qualitative concept to practical over time from a qualitative concept to practical implementation.implementation.
– To reinforce DOE’s requirement for integrating the To reinforce DOE’s requirement for integrating the DQO Process into all environmental sampling DQO Process into all environmental sampling programs.programs.
– To dispel the misconception that DQOs are the To dispel the misconception that DQOs are the PARCC parameters.PARCC parameters.
3 of 21
EPA QAMS-005/80EPA QAMS-005/80
DQO concept first defined in terms of DQO concept first defined in terms of the the PARCCPARCC parameters: parameters:– PPrecision recision – AAccuracyccuracy– RRepresentativenessepresentativeness– CCompletenessompleteness– CComparabilityomparability
EPA, 1983, Interim Guidelines and Specifications for Preparing Quality Assurance Project Plans, QAMS-005/80, February
4 of 21
EPA/540/G-87/003EPA/540/G-87/003EPA/540/G-87/004EPA/540/G-87/004
19871987
Defined DQOs as:Defined DQOs as:– “…“…qualitative and quantitative statements qualitative and quantitative statements
which specify the quality of the data which specify the quality of the data required to support the Agency decisions required to support the Agency decisions during remedial response activities”during remedial response activities”
EPA, 1987, Data Quality Objectives for Remedial Response Activities, EPA/540/G-87/003, March
EPA, 1987, Data Quality Objectives for Remedial Response Activities: Example Scenario, EPA/540/G-87/004, March
5 of 21
Major Elements:Major Elements:– Analytical Levels I - IVAnalytical Levels I - IV– PARCC ParametersPARCC Parameters– Three stage DQO Process:Three stage DQO Process:
Stage 1: Identify decision types Stage 2: Identify data uses and needs Stage 3: Design data collection program
EPA, 1987, Data Quality Objectives for Remedial Response Activities, EPA/540/G-87/003, March
EPA, 1987, Data Quality Objectives for Remedial Response Activities: Example Scenario, EPA/540/G-87/004, March
EPA/540/G-87/003EPA/540/G-87/003EPA/540/G-87/004EPA/540/G-87/004
19871987
Stage 3: Design data collection program
6 of 21
EPA QA/G-4EPA QA/G-419941994
Supercedes previous DQO guidance.Supercedes previous DQO guidance. Defined DQOs as:Defined DQOs as:
“…“…a a systematic planningsystematic planning tool based on the tool based on the Scientific Method for establishing criteria Scientific Method for establishing criteria for data quality and for developing data for data quality and for developing data collection designs”collection designs”
EPA, 1994, Guidance for the Data Quality Objectives Process, EPA QA/G-4, September
7 of 21
EPA QA/G-4EPA QA/G-419941994
Step 4: Specify Boundaries
Step 2: Identify Decisions
Step 3: Identify Inputs
Step 1: State the Problem
Step 5: Define Decision Rules
Step 6: Specify Error Tolerances
Step 7: Optimize Sample Design
Presents a new Presents a new 7-Step DQO 7-Step DQO Process.Process.
EPA, 1994, Guidance for the Data Quality Objectives Process, EPA QA/G-4, September
8 of 21
MisconceptionMisconception The term Data Quality The term Data Quality
Objectives is misleading since Objectives is misleading since “data quality” is only one “data quality” is only one component of the DQO component of the DQO process.process.
This underplays the role of This underplays the role of DQOs as a DQOs as a Planning ProcessPlanning Process
More appropriate terms would More appropriate terms would be:be:– Planning Quality Objectives Planning Quality Objectives
(PQOs)(PQOs)– Systematic PlanningSystematic Planning
Objectives (SPOs)Objectives (SPOs)– Decision Making ObjectivesDecision Making Objectives
(DMOs)(DMOs)
DQOs
PQOs SPOsDMOs
9 of 21
OpinionOpinion
DQO guidance should be housed in a DQO guidance should be housed in a non-datanon-data section of EPA. This would section of EPA. This would help eliminate the misconception that help eliminate the misconception that the DQO Process is simply the PARCC the DQO Process is simply the PARCC parameters.parameters.
10 of 21
DOE-HQDOE-HQSeptember 7, 1994September 7, 1994
DOE Letter, DOE EM-263 to all Field Offices, 1994, Institutionalizing the Data Quality Objectives Process, September
Thomas Grumbly memo:Thomas Grumbly memo:“…“…it is the policy of…(EM) to it is the policy of…(EM) to apply up-front planning…to apply up-front planning…to ensure safer, better, faster, and ensure safer, better, faster, and cheaper environmental cheaper environmental sampling…It is EM policy that sampling…It is EM policy that the…(DQO) process be used in the…(DQO) process be used in all environmental projects...”all environmental projects...”
}
11 of 21
Implement DQOs . . .Implement DQOs . . . Easier said than doneEasier said than done Grumbly memo directs sites to do Grumbly memo directs sites to do
DQOs, but...DQOs, but...– No guidance for an implementation No guidance for an implementation
mechanism.mechanism. Lack of a uniform approach results in an
unwieldy process.– No guidance on documentation/format.No guidance on documentation/format.
Lack of documentation format guidance yields variable products (defensibility?).
12 of 21
ImpactImpact DOE Cleanup decisions are vulnerable to DOE Cleanup decisions are vulnerable to
criticism - if not rejection.criticism - if not rejection.– Non-standard approach/documentation often lack Non-standard approach/documentation often lack
clearly stated:clearly stated: Decision Statements (Principal Study Questions) Decision Rules Error Tolerances Sample Design
– These shortcomings are revealed in the Data Quality These shortcomings are revealed in the Data Quality Assessment Process.Assessment Process.
13 of 21
Challenges at HanfordChallenges at Hanford
Unstructured approach to DQOsUnstructured approach to DQOs– proves to be quite unmanageable.proves to be quite unmanageable.– aggravates acceptance.aggravates acceptance.– Perception that DQOs are waste of time and Perception that DQOs are waste of time and
money.money. Cultural barrierCultural barrier
– SAPs are well understood.SAPs are well understood.– DQOs are not.DQOs are not.
14 of 21
EPAQA-G4
Certification of
DQO Training
?*!!
DQO
SOP
15 of 21
16 of 21
Challenges at HanfordChallenges at Hanford(continued)(continued)
Reality:Reality:– DQOs are not the problem.DQOs are not the problem.– Flawed approach is the problem.Flawed approach is the problem.– More was needed.More was needed.
Merely giving Projects QA/G-4 - not enough.
17 of 21
Highly structured, Highly structured, tactical approach to tactical approach to implementing the implementing the overall DQO Process.overall DQO Process.- Identify Projects requiring Identify Projects requiring DQOs.DQOs.- Begins with Scoping - a key Begins with Scoping - a key element. element. - Gets early input from Gets early input from regulatory agencies and key regulatory agencies and key decision makers. decision makers. - Utilizes a facilitator to Utilizes a facilitator to coordinate everythingcoordinate everything- Global Issues identified and Global Issues identified and resolved prior to DQOs.resolved prior to DQOs.
18 of 21
- Workbook captures the Workbook captures the inputs/outputs of the 7-Step inputs/outputs of the 7-Step Process.Process.11stst Draft provides Strawman Draft provides Strawman- Visual Sample Plan used in Visual Sample Plan used in DQO meeting to what-if DQO meeting to what-if sample designs.sample designs.
Tools further Tools further streamline the streamline the implementation . . .implementation . . .
1st Draft DQOWorkbook
2nd Draft DQOWorkbook Final DQO
Workbook
- Scoping Checklist to Scoping Checklist to ensure a good start.ensure a good start.
More details to come . . . More details to come . . . (Module 9)(Module 9)
19 of 21
History SummaryHistory Summary
ERC DQO Tools
PARCC
3 Stage Process
7 Step Process
ERC DQO Implementation Process
20 of 21
Contacts:Contacts:
Sebastian C. Tindall Sebastian C. Tindall Bechtel Hanford Inc.Bechtel Hanford Inc.509-372-9195 509-372-9195 3350 George Washington Way, HO-3350 George Washington Way, HO-
[email protected] [email protected] Richland, WA 99352Richland, WA 99352
Elizabeth M. (Liz) BowersElizabeth M. (Liz) Bowers Department of Energy Department of Energy 509-373-9276 509-373-9276 825 Jadwin Avenue, A2-15825 Jadwin Avenue, [email protected] [email protected] Richland, WA 99352Richland, WA 99352
James R. Davidson, Jr. James R. Davidson, Jr. Davidson & Davidson, Inc.Davidson & Davidson, Inc.509-374-4498 509-374-4498 8390 Gage Blvd., Suite 2058390 Gage Blvd., Suite [email protected] [email protected] Kennewick, WA 99336Kennewick, WA 99336
21 of 21
End of ModuleEnd of Module
