+ All Categories
Home > Documents > DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of...

DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of...

Date post: 04-Jan-2016
Category:
Upload: shana-butler
View: 218 times
Download: 3 times
Share this document with a friend
21
DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La Jolla, CA
Transcript
Page 1: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.

DATA QUALITY CONTROL

Julie ThomasCoastal Data Information Program (CDIP)

Scripps Institution of Oceanography

CI Design Workshop17-19 October 2007

La Jolla, CA

Page 2: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.

ACTQARTOD

REAL-TIME CASE STUDY

INTERNATIONAL EFFORTS

WMO, OceanSITES/Eurosites/IFREMER, JCOMM, ……..

Page 3: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.

Directional Wave Observations1) The Basics

2) Remote Sensing v. In Situ : It’s all good.

3) Estimating directional wave properties.

4) Measurement accuracy and user needs.

5) A Recipe for instrument evaluation.

ALLIANCE FOR COASTAL TECHNOLOGIES

ACTWave Sensor Technologies

University of South Florida, March 7-9 2007By Bill O’Reilly

Page 4: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.

z

xy

w

u

v

The Big 3

X, Y, Z

The Basics: Estimating the Motion of a Sea Surface Particle

Pressure SensorsAccelerometersTilt sensorsAngular Rate SensorsAcoustic SensorsRadarLidar

dz/dx,dz/dy

z

Page 5: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.

In-Situ and Remotely Sensed Waves

MethodO(cm) X,Y,Z Accuracy

SpatialCoverage

Time Coverage

In situ

SAR,LIDAR

HF, X-Band Radar

In situ and remote sensing systems are complimentary, NOT redundant.

Page 6: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.

XYZ TIME SERIES

Page 7: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.

The Big 3: X, Y, Z Time Series Analysis The First 5: S(f),a1(f),b1(f),a2(f),b2(f) !!

S

Page 8: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.

Theoretical maximum level of breaking wave in a fully developed sea

Each box represents the number of hourly observation – Datawell Buoy Mark II w/ hippy used as data source (standard).

Page 9: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.

Comparison between a Datawell Buoy w/ hippy and a PROTOTYPE Datawell w/ GPS. Low numbers indicate good correlations. InstrumentsWere co-located.

GPS instrument dropped out during low Frequency – causing spikes in data

Instruments tend to disagree asthey are interpreting sea surface differently under breaking wave conditions.

Page 10: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.

Datawell w/ hippy and Datawell w/ GPS tend to agree well with wave direction. Note how both instruments reach their noise floor during long period, low energy events.

Page 11: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.

Directional spread is where many instruments fall apart! Good indication of the quality of the instrument – demonstrates their directional noise level!

GPS antenna on top of the buoy has a “natural” noise when it wobbles – a method has been devised to correct for this problem.

Page 12: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.

QUALITY ASSURANCE OF REAL-TIME DATA

QARTODhttp://qartod.org

QARTOD is a continuing multi-agency effort to address the Quality Assurance and Quality Control issues of the Integrated Ocean Observing System (IOOS) and broader international community.

Quality Control standards have been submitted to DMAC for both waves and Currents. Ocean.US is now soliciting submissions from the Regional Associations for all standards including QA/QC. The QARTOD submissionsWill be posted soon on the Ocean.US website.

Parameters addressed through QARTOD: Waves, In-situ Currents, Remote Currents (HF RADAR), CTDs, Dissolved Oxygen.

Collaborated with DMAC Metadata team for a one day appended workshopDuring QARTOD IV, June 2006.

Page 13: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.

http://qartod.orghttp://cdip.ucsd.edu/documents/index/product_docs/qc_summaries/waves/waves_table.php

Quality Assurance (QA) – Verify that instrumentation is calibrated and tested to assure collection of the highest qualitydata possible.

Quality Control (QC) – Analyze and verify the data streamto assure the highest quality datapossible.

Page 14: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.
Page 15: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.
Page 16: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.

VALIDATION CASE STUDY - Real-time Buoy Data

Eel RiverCape Mendocino (094)

Humboldt Bay South Spit (128)

OREGON

CALIFORNIA

NDBC BUOY 46022, EEL RIVER, re-deployed this summer with 3DMG sensor. 46022 is 34 miles away from buoy 46213 (CDIP Datawell Buoy Station 094).

Page 17: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.

Full spectra looks ok at first glance!

Page 18: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.

Under predicts LONG PERIOD SWELL (12-33 sec)

Noisy directional spread

Page 19: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.

Comparison of the Datawell /hippy and the NDBC 46022 (Eel River Buoy) w/ 3DMG sensor .

46022 under predicts low frequency waves.

Buoys are moored 34 miles apart. Part of this difference in the high frequency could be caused by local sea conditions.

Page 20: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.

Why is directional spread important? Why do we need accurate wave measurements?

The models are only as good as their input source.

In Southern California, for instance, 5 degrees can makea big difference in how much energy reaches the beach.

Page 21: DATA QUALITY CONTROL Julie Thomas Coastal Data Information Program (CDIP) Scripps Institution of Oceanography CI Design Workshop 17-19 October 2007 La.

Let’s come together as an IOOS community and further validate our wave instrumentation!


Recommended