33
ADMT-18 - November 2017 Hamburg 1 C. COATANOAN with the Coriolis operators : V. BERNARD, C. PAUGAM, C.CLENET Status of Anomalies at GDAC
AD
MT
-18 -
No
vem
ber
2017 H
am
bu
rg
1
C. COATANOAN
with the Coriolis operators : V. BERNARD, C. PAUGAM, C.CLENET
Status of Anomalies at GDAC
AD
MT
-18 -
No
vem
ber
2017 H
am
bu
rg
List of Anomalies
Message - QC changes
To DAC operators Monthly report
To argo-dm / argo-dm-dm
ftp site ftp://ftp.ifremer.fr/ifremer/argo/etc/ObjectiveAnalysisWarning/
- Look at the QC correction
- Agree : change the QC and resubmit nc files to both GDAC
(feedback also welcome)
- Desagree : send an email to [email protected] saying that
initial QC is correct
- Need more information : send an email to [email protected]
AD
MT
-18 -
No
vem
ber
2017 H
am
bu
rg
3
Help to understand message
DAC_CODE,PLATFORM_CODE,CV_NUMBER,DATE_UPDATE,DIRECTION,WEB_URL,PARAMETER,START_IMME
RSION,STOP_IMMERSION,OLD_QC,NEW_QC,VERTICAL_SAMPLING_SCHEME
AO,4902104,67,30/07/2017 00:00:00,A,http://www.ifremer.fr/co-argoFloats/station?stationId=53054408
,PSAL,1.16,2011.6,1,3,Primary sampling
Message
New version
Database
ftp
DAC
DAC
DAC
Feedback [email protected]
Correction
Request :To go back to the first QC (in our database)
Comment : Float to be reviewed in DMQC
1
2
3
VERTICAL_SAMPLING_SCHEME
Primary sampling
Near-surface sampling
n\a
AD
MT
-18 -
No
vem
ber
2017 H
am
bu
rg
4
Messages
- Message to DACs (generic address – operator address) AOML [email protected] BODC [email protected] CORIOLIS [email protected] / [email protected] / [email protected]
CSIO [email protected] CSIRO [email protected] / [email protected] INCOIS [email protected] / [email protected] JMA [email protected] KMA [email protected] / [email protected] / [email protected]
KORDI [email protected] MEDS [email protected] NMDIS [email protected]
- Message also available on Coriolis ftp site ftp://ftp.ifremer.fr/ifremer/argo/etc/ObjectiveAnalysisWarning/
- Monthly report • [email protected] & [email protected] • on Coriolis ftp site ftp://ftp.ifremer.fr/ifremer/argo/etc/Report_ObjectiveAnalysisWarning/
AD
MT
-18 -
No
vem
ber
2017 H
am
bu
rg
5
Warning Objective Analysis
YEAR 2017 : 1st January to 20th November
AOML BODC CSIRO
CSIO INCOIS JMA JAMSTEC KMA
KORDI
MEDS NMDIS
AD
MT
-18 -
No
vem
ber
2017 H
am
bu
rg
6
Focus on last month : October 2017
AOML BODC CSIRO
CSIO INCOIS JMA
KMA
KORDI
MEDS
JAMSTEC
NMDIS
Warning Objective Analysis
AD
MT
-18 -
No
vem
ber
2017 H
am
bu
rg
7
Anomalies by month, from all DACs, less than 360
anomalies
Warning Objective Analysis
Specific work on CORA (Coriolis ReAnalysis) feedback / Identified error
AD
MT
-18 -
No
vem
ber
2017 H
am
bu
rg
8
AOML profiles requiring
corrections
Between 100 and 200 by
month
Warning Objective Analysis
Feedback: From Elizabeth Forteza
AD
MT
-18 -
No
vem
ber
2017 H
am
bu
rg
9
BODC anomalies
less than 25/month (except January : feedback from bodc to
change back QC on some cycles of one
float)
Warning Objective Analysis
Feedback: From Matthew Donnelly
AD
MT
-18 -
No
vem
ber
2017 H
am
bu
rg
10
Warning Objective Analysis
CSIRO anomalies
less than 14 /month
Feedback: From Catriona Johnson
and Rebecca Cowley
AD
MT
-18 -
No
vem
ber
2017 H
am
bu
rg
11
CSIO anomalies
less than 10 /month
Warning Objective Analysis
Feedback: From Liu Zenghong
AD
MT
-18 -
No
vem
ber
2017 H
am
bu
rg
12
INCOIS anomalies
Less than 6 /month
Warning Objective Analysis
Feedback: From T V S Uday Bhaskar
Except July : Specific error on TEMP_ADJUSTED in data_mode=‘A’, floats have been re-decoded
and re-submitted at the end of july
AD
MT
-18 -
No
vem
ber
2017 H
am
bu
rg
13
JMA anomalies
5 / month but increase
for the last 3 months
Warning Objective Analysis
Feedback: From Katsunari Sato and
Kensaku Koayashi
AD
MT
-18 -
No
vem
ber
2017 H
am
bu
rg
14
KMA anomalies
less than 12 /
month
Warning Objective Analysis
Feedback: No Feedback since
ADMT16
AD
MT
-18 -
No
vem
ber
2017 H
am
bu
rg
15
KORDI
anomalies
Less than 4 /
month
Warning Objective Analysis
Feedback: No Feedback
AD
MT
-18 -
No
vem
ber
2017 H
am
bu
rg
16
MEDS anomalies
less than 15/month
Warning Objective Analysis
Feedback: Isabelle Gaboury
AD
MT
-18 -
No
vem
ber
2017 H
am
bu
rg
17
NMDIS anomalies
0/month
Warning Objective Analysis
Feedback: Mingmei
Inactive floats
AD
MT
-18 -
No
vem
ber
2017 H
am
bu
rg
Warning Objective Analysis
Missing data = Extra OA – analysis > 1 month
AD
MT
-18 -
No
vem
ber
2017 H
am
bu
rg
Number of anomalies by year, by month
20th September 2016
Extra work : Feedback from CORA, …
AD
MT
-18 -
No
vem
ber
2017 H
am
bu
rg
Profiles with bad data not failed by the automatic tests
RTQC Procedures QC=4 BAD QC=1 GOOD
AD
MT
-18 -
No
vem
ber
2017 H
am
bu
rg
RTQC Procedures QC=4 BAD QC=1 GOOD
Profiles with bad data not failed by the automatic tests
AD
MT
-18 -
No
vem
ber
2017 H
am
bu
rg
RTQC Procedures QC=4 BAD QC=1 GOOD
Profiles with bad data not failed by the automatic tests
Need to work on the tests ?
See next presentation
AD
MT
-18 -
No
vem
ber
2017 H
am
bu
rg
New automatic tool to check the quality of the data (for TEMP & PSAL)
MinMax method developed by J.Gourrion
RTQC Procedures – MINMAX METHOD
AD
MT
-18 -
No
vem
ber
2017 H
am
bu
rg
RTQC Procedures – MINMAX METHOD
Number of samples per grid cell.
Top: the 0-10 db layer. Bottom: 500-510 db layer.
Main assumptions on data distribution
currently implemented :
Unimodal
Symmetric
Homogeneously non-gaussian
AD
MT
-18 -
No
vem
ber
2017 H
am
bu
rg
RTQC Procedures – MINMAX METHOD
AD
MT
-18 -
No
vem
ber
2017 H
am
bu
rg
RTQC Procedures – MINMAX METHOD
AD
MT
-18 -
No
vem
ber
2017 H
am
bu
rg
Some statistics : results at 21th November 2017
AD
MT
-18 -
No
vem
ber
2017 H
am
bu
rg
ADMT17 ADMT18
AD
MT
-18 -
No
vem
ber
2017 H
am
bu
rg
Some statistics – ADMT17: 09/22/2016 – ADMT18: 06/11/2017
AD
MT
-18 -
No
vem
ber
2017 H
am
bu
rg
Some statistics – ADMT17: 09/22/2016 – ADMT18: 06/11/2017
List of the files with the format_version number available from request
AD
MT
-18 -
No
vem
ber
2017 H
am
bu
rg
NMDIS : DM files - data_state_indicator=“2C” but data_mode=“R” and R*.nc
For floats : 2901615 – 2901631 - 2901632
2901632 : all cycles with data_state_indicator=“2C” – DM files but still R***.nc and data_mode=‘R’
netcdf R2901632_004 {
DATA_STATE_INDICATOR = "2C " ;
DATA_MODE = "R" ;
PRES_ADJUSTED =
0.0, 6.0, 16.0, 25.0, 35.0, 45.0, 55.0, 66.0, …
PSAL_ADJUSTED =
33.927, 34.244, 34.317, 34.342, 34.515, 34.629, …
TEMP_ADJUSTED =
27.716, 26.863, 26.664, 26.225, 25.034, 23.338, …
SCIENTIFIC_CALIB_EQUATION =
"none ",
"none ",
"PSAL_ADJUSTED is calculated from a conductivity multiplicative adjustment term r. " ;
Review on adjusted paRameteRs data_mode “R” oR “a”
NMDIS Feedback : Priority on format v3.1
AD
MT
-18 -
No
vem
ber
2017 H
am
bu
rg
NMDIS : DM files - data_state_indicator=“2C” but data_mode=“R” and R*.nc
For floats : 2901615 – 2901631 - 2901632
2901615 : cycles with data_state_indicator=“2C” – DM files but still R***.nc and data_mode=‘R’
netcdf R2901615_001 {
DATA_STATE_INDICATOR = "2C " ;
DATA_MODE = "R" ;
PRES_ADJUSTED =
0.0, 6.0, 16.0, 25.0, 35.0, 45.0, 55.0, 66.0, …
PSAL_ADJUSTED =
34.775, 34.802, 34.829, 34.823, 34.853, 34.860, …
TEMP_ADJUSTED =
28.447, 28.163, 27.201, 25.359, 23.666, 23.202, …
SCIENTIFIC_CALIB_EQUATION =
"none ",
"none ",
"PSAL_ADJUSTED is calculated from a conductivity multiplicative adjustment term r. " ;
TEMP_ADJUSTED_QC =
"99999999999999999999999999999999999999999999999999999999999999999999999999999999999999999999"
;
Review on adjusted paRameteRs data_mode “R” oR “a”
AD
MT
-18 -
No
vem
ber
2017 H
am
bu
rg
Thanks
Message - QC changes
To DAC operators Monthly report
To argo-dm / argo-dm-dm ftp site
ftp://ftp.ifremer.fr/ifremer/argo/etc/ObjectiveAnalysisWarning/
Mail to : [email protected] or [email protected]
