30
1 of 30 Closing Remarks Presenter: Sebastian Tindall 4:45 PM - 5:00 PM (15 minutes) Day 2 DQO Training Course Module 10
1 of 30
Closing Remarks
Presenter: Sebastian Tindall
4:45 PM - 5:00 PM (15 minutes)
Day 2 DQO Training CourseModule 10
2 of 30
Module 10Closing Remarks & Final Exam
Course Objectives:
To summarize key points made today Closing Remarks “Final Exam” Questions/feedback from the audience
3 of 30
The DQO Process
“A systematic planning process based on the scientific method for the unambiguous defining of
• Environmental decision criteria
• Data requirements
• Error tolerances
and the documentation/preservation of these details in a consistent, standardized format providing a defensible record of the decision”Merrick “Rick” Blancq, USACE, Portland, OR
4 of 30
Systematic Planning Doesn’t Just “Happen”
Haphazard approaches yield haphazard results
Tactical approach to implementation Decision makers must work together Successful implementation model evolved
as the DQO Process was used
5 of 30
Tools Make the Job Easier
Scoping Checklist DQO e-Workbook (electronic template)
– Standardized DQO Report format DQO Web Site
– DQO tools and materials– Latest version of all of today’s slides
Visual Sample Plan (VSP)– Download free software
Data Quality Assessment tools also!
6 of 30
Managing Uncertainty We are forced to make environmental decisions based on
estimates Estimates always involve errors Errors in estimates are not mistakes If unmanaged, errors in estimates CAN lead to
Decision Errors which ARE MISTAKES Decision Errors must be managed
– Identify– Quantify
Severe consequences of decision errors mandate a statistical basis
7 of 30
Defensibility
Comes from doing good science
S ampling and A nalys is P lan
Sc oping
Data QualityA ssessment
Dec is ion
Sampling&
A nalys is
Data Quality Objec tives
(DQO)
L aboratory Data Verific ation /
Validation
F ie l d S a mpl ingP l a n(F S P )
Qua l it y A s sura nc e P ro je c t P l a n
(Q A P j P )
H e a lt h a ndSa fe t y P l a n
(H S P )
Requires documentation– “If it isn’t written down, it
didn’t happen” Use a standardized format We must employ the
scientific method to make defensible decisions
8 of 30
How Many Samples do I Need?
REMEMBER:
HETEROGENEITY
IS THE RULE!
9 of 30
How many samples do I need?
Begin With the End in Mind
Optimal Sampling Design
Alternative Sample Designs
, , , Correct Equation for n (Statistical Method)
Population Frequency Distribution
Contaminant Concentrations in the Spatial Distribution of the Population
The end
DATA
10 of 30
Logic to Assess Distribution and Calculate Number of Samples
SkewedCalculate the number of
samples based on skeweddistributions (e.g.,
nonparametric tests suchas WSR or WRS)
Is frequencydistribution from eachpopulation normal or
approximatelynormal?
YesNormal
Use equations based onnormal distribution.
No
Option 1 Option 2
Badly SkewedBadly skewed or for any
distribution, use computersimulations
(e.g.,Monte Carlo) to performcalculations to estimate the
number of samples
11 of 30
“Normal” FD
“Skewed” FD
Computer Simulations: “Badly skewed” or Any FD
• Evaluate and errors to select n
Using the LBGR to Estimate n
212
1
211
2
5.0
Z
AL
ZZn
212
1
211
2
5.016.1
ZAL
ZZn
12 of 30
Project Planning Documents
Work Plan
Must contain a clear presentation of (and the reasoning behind):
DQO Report FSP Quality Assurance Project Plan HSP
13 of 30
Project Planning Documents
• General project decision goals
• More detailed, technical project goals/decision rules (DQOs), that will guide project decision-making
• Goals for data quality (MQOs)
• How sampling representativeness will be ensured, and how sampling uncertainty will be controlled
• List of analytical technologies and methods
• QC protocols and criteria to demonstrate that data of known quality will be generated
• Description how data will be assessed and interpreted according to the decision rules
14 of 30
Analytical +
Sub-sampling +
Natural heterogeneity of the site=
Total Uncertainty
Uncertainty is Additive!Remember the uncertainty is additive for
all steps in sampling and analysis
15 of 30
Keys to success– Sound technical basis– Complete and thorough documentation
Do it!Do it!(Get the job done - right)
Prove it!Prove it!(Document what/why/how)
SiteClosed
16 of 30
FINAL EXAM
• What is the Question?
What is the DQO Process in a Nutshell?
• What is the Population?
• What is the Confidence required?
17 of 30
TRIAD: Systematic PlanningManaging Uncertainty for Environmental Decision Making
Systematic Planning in Environmental Decision Making
http://www.doe.hanford.gov/dqo
Sebastian Tindall
Bechtel Hanford Inc.
3350 George Washington Way
Richland, WA 99352
(509) 372-9195
18 of 30
TRIAD: Dynamic Work PlansA Guideline
for
Dynamic Workplans and Field Analytics:
The Keys to Cost-Effective Site Characterization and Cleanup
http://cluin.org/char1_edu.cfm#dyna_work
Albert Robbat, Jr.
Tufts University, Chemistry Department
Center for Field Analytical Studies and Technology
Medford, Massachusetts, 02155
tel: 617-627-3474 and fax: 617-627-3443
19 of 30
TRIAD: On-Site AnalysisApplying the Concept of Effective Data to Environmental
Analyses for Contaminated Sites
http://cluin.org/
Deana M. Crumbling, M.S.
Technology Innovation Office
U.S Environmental Protection Agency
401 M Street, SW, Mail Code 5102G
Washington, DC 20460
(703) 603-0643
20 of 30
Sampling for
Environmental Activities
Charles “Chuck” Ramsey
EnviroStat, Inc.,P.O. Box 636
Fort Collins, CO 80522-0636
(970) 689-5700; Fax: (970) 229-9977
21 of 30
DQO Consultants:Preparation & Facilitation
Mitzi Miller
Environmental Quality Management (EQM)1777 Terminal Drive
Richland, WA 99352
(509) 946-4985; Fax: (509) 946-4595
22 of 30
DQO Consultants:Preparation & Facilitation
Al Robinson
Environmental Quality Management (EQM)1777 Terminal Drive
Richland, WA 99352
(509) 946-4985; Fax: (509) 946-4595
23 of 30
DQO Consultants:Environmental Statistics
Jim Davidson
Davidson and Davidson, Inc.8390 Gage Blvd., Suite 205
Kennewick, WA 99336
(509) 374-4498;
24 of 30
DOE EM-5/NAMP Sponsored Web Pages
http:/www.hanford.gov/dqo/
http://dqo.pnl.gov/
http://www.em.doe.gov/safetyhealth/3d/
25 of 30
DQO Training Points of Contact
DQO Process Expert Sebastian Tindall
Program ManagerBechtel Hanford Inc.
3350 George Washington WayRichland, WA 99352
(509) [email protected]
Visual Sample PlanJames R. Davidson, Jr.
Davidson and Davidson, Inc.8390 Gage Blvd., Suite 205
Kennewick, WA 99336Tel: (509) [email protected]
26 of 30
Program POCsElizabeth M. Bowers
Department of Energy/Richland Operations Office
825 Jadwin AvenueRichland, WA 99352
(509) [email protected]
Dave BottrellDepartment of Energy/EM-5/NAMP
19901 Germantown RoadCloverleaf Building
Room 1078Germantown, MD 20874-1290
(301) 903-7251 [email protected]
Sebastian TindallProgram Manager
Bechtel Hanford Inc. 3350 George Washington Way
Richland, WA 99352(509) 372-9195
Brent PulsipherProgram Manager
Pacific Northwest National Laboratories.
2400 Stevens DriveRichland, WA 99352
(509) 375-3989 [email protected]
27 of 30
Day 2 Training Credits
• Susan Blackburn, SAIC, Richland, WA• Dave Blumenkranz, SAIC, Richland, WA• Mitzi Miller, EQM, Richland, WA & Knoxville, TN• Al Robinson, EQM, Richland, WA • Kelly Black, Neptune and Associates, Denver, CO• Candy Hawk, Blue Sky Software, Richland, WA• Mike Schwab, Bechtel Hanford, RL, WA• Surajit Amrit, Bechtel Hanford, RL, WA
28 of 30
VSP Acknowledgements
John Wilson, PNNL
Dick Gilbert, Nancy Hassig, Tim Schiebe, PNNL
Don Singer, USGS
Brent Pulsipher, PNNL
29 of 30
How Many Samples do I Need?
REMEMBER:
HETEROGENEITY
IS THE RULE!
30 of 30
End of Day 2 Course
Please take a few minutes to fill out and turn in all the
course evaluation forms.
Thank you for your attention today.
Questions? Feedback?
