Observing System Monitoring Observing System Monitoring Center (OSMC)Center (OSMC)
Work in progress in briefWork in progress in brief
June 2005June 2005
Steve Hankin, Kevin O’Brien – Steve Hankin, Kevin O’Brien – PMELPMEL
… … a system view of global ocean a system view of global ocean climate observationsclimate observations
““Big fleas have little fleasBig fleas have little fleas upon their backs to bite upon their backs to bite ‘em.‘em.And those fleas have lesser And those fleas have lesser fleasfleas and so ad infinitum.” and so ad infinitum.”
Leo Brody, Leo Brody, Starting FORTHStarting FORTH(I think)(I think)
The analogy The analogy (lame)(lame)::
When the metadata is the data,When the metadata is the data,even metadata has metadata.even metadata has metadata.
A partnership …A partnership …
• PMELPMELUser interface logic & toolsUser interface logic & tools
• NDBCNDBCMetadata assembly & operationsMetadata assembly & operations
• NGDC NGDC (new partner)(new partner)GIS and DB technical servicesGIS and DB technical services
with assistance fromwith assistance from• JCOMM-OBS (platform metadata)JCOMM-OBS (platform metadata)• US GODAE Server (GTS metadata US GODAE Server (GTS metadata
feed) feed)
Getting a handle on the Getting a handle on the “climate data record”“climate data record”
•Current (meta)data Current (meta)data (“realtime”)(“realtime”)
– GTS -- primary sourceGTS -- primary source
•Historical (meta)dataHistorical (meta)data– poorly integratedpoorly integrated– need “DMAC” style of integrationneed “DMAC” style of integration– (for now … use a GTS archive(for now … use a GTS archive
& acknowledge missing data e.g. research & acknowledge missing data e.g. research
cruisescruises))
OSMC (meta)database at NDBCOSMC (meta)database at NDBC
• Met and Ocean data from GODAE Met and Ocean data from GODAE Server ~350 MB of data per dayServer ~350 MB of data per dayURL=URL=http://usgodae2.fnmoc.navy.mil/ftp/outgoing/fnmoc/data/met/2005031706.tar.Zhttp://usgodae2.fnmoc.navy.mil/ftp/outgoing/fnmoc/data/met/2005031706.tar.Z
• Mooring updates from NDBC-hosted Mooring updates from NDBC-hosted metadatametadata
• Ship call sign info from the WMO Pub Ship call sign info from the WMO Pub 4747
• Float updates from JCOMMOPSFloat updates from JCOMMOPSURL = URL = ftp://ftp://ftp.jcommops.org/Argo/Status/status.txtftp.jcommops.org/Argo/Status/status.txt
• Country information is assigned based Country information is assigned based on WMO allocation tableon WMO allocation tableURL = URL = http://www.wmo.ch/web/aom/marprog/Operational-Information/buoy-ids.htmhttp://www.wmo.ch/web/aom/marprog/Operational-Information/buoy-ids.htm
OSMC (meta)database at NDBCOSMC (meta)database at NDBC
• Database back to 2004 (for now)Database back to 2004 (for now)• Metadata tracking not easy - about 10% Metadata tracking not easy - about 10% undefinedundefined
Platform TypePlatform Type # # ObservationsObservations
ARGO FLOAT 5,4326
CMAN 794,262
DRIFTING BUOY
4,447,127
MOORED BUOY
2,066,686
SHIP 682,757
NOT DEFINED 934,451
Platform_ID Last_Report Type Description Organization URL Country XML
OSMC_Platform
ID Name Abbrev
OCMC_Country
ID Name Country URL Contact_Name Contact_Email
OSMC_Organization
Platform_ID Ob_Date Latitude Longitude SLP SST ATMP DEWPOINT WINDSPD WINDDIR CLOUDS XML
OSMC_Observation
OS
MC
Data
base –
En
tity
D
iag
ram
Country is based on ISO 3166, which defines unique 2-character identifiers for each country
Organization identifies an agency, institute, university, or private company that owns or operates a reporting platform
Platform identifies a ship, drifting buoy, moored buoy station, or other platform that reports marine data
Observation records the instance of a marine observation for a reporting date and time.
OSMC (meta)databaseOSMC (meta)database
• Derived gridded filesDerived gridded files
Observation metadata are Observation metadata are summarized into 1X1 degree daily summarized into 1X1 degree daily gridded files (netCDF) to support gridded files (netCDF) to support interactive observing evaluation interactive observing evaluation operationsoperations
FunctionalityFunctionalitythat OSMC must that OSMC must provide:provide:
•Overview (where are the obs?)Overview (where are the obs?)
•Drill-down (what are the obs?)Drill-down (what are the obs?)
•Evaluation (are the obs adequate?)Evaluation (are the obs adequate?)
Reports in Time frame
Reports in Time frame
Average of obs
Average of obs
Percentage of Adequate Sampling
Percentage of Adequate Sampling
countrycountry
platformplatform
Parametervalue
Parametervalue
Time sinceLast report
Time sinceLast report
STD deviationfrom
Climatology (future)
STD deviationfrom
Climatology (future)
Observing System Monitoring Center
DOMAIN
Selectglobal, oneocean, orpoint and
drag aregion.
PLATFORMS
Select oneor a set
ALL
SHIPS OFOPPORTUNITY
TROPICALMOORINGS
DRIFTERS
TIDE GAUGES
ARGO
REFERENCESTATIONS
COASTALMOORINGS
GLOBAL
ATLANTICOCEAN
PARAMETERS
Select oneor a set
SST
SEA SURFACEPRESSURE
SEA SURFACEWIND
UPPER OCEANTEMPERATURE
SURFACECURRENTS
SUBSURFACECURRENTS
SEA LEVEL
PRECIPITATION
RADIATION
AIRTEMPERATURE
PCO2
OCEAN CARBON
TOTAL DEPTHTEMPERATURE
SEA SURFACESALINITY
SALINITY ATDEPTH
SAVE
BASE MAPMenu bar across top.
Color/symbol key acrossbottom.
UTC clock at upper right.
Any screen orwindow.
PACIFIC OCEAN
INDIAN OCEAN
SELECT AREGION
High-to-low(hot-to-cool)color scale.
CLOCK
UTC
DATA POINTSIf IPRC, filled circle. Ifnot, open circle from
Monterey. If not, crossfrom telemetry.
RESEARCHVESSELS
TRANSPORTARRAYS
UTILITIES
LOCAL TIME INSELECT CITIES
BASE MAPAPPEARANCE
DATA POINTAPPEARANCE
TEXT
DRAW
Zoom
Web toMonterey,
IPRC
Hard Wire toTelemetry
Time FrameTime Frame
Select OneSelect One
ArbitraryRange
ArbitraryRangeConvenience
choices
Convenience choices
TodayToday
yesterdayyesterday
2 days ago2 days ago
This weekThis week
Last weekLast week
This quarterThis quarter
Last quarterLast quarter
othersothers
Data SourceData Source
Select one orboth
Select one orboth
IndividualObs
IndividualObs
Gridded Field
Gridded Field
Color byColor by
otherother
Select OneSelect One Select OneSelect One
1x1 degree1x1 degree
3x3 degree3x3 degree
5x5 degree5x5 degree
10x10 degree10x10 degree
Levitusvariability
(via NVODS)
Levitusvariability
(via NVODS)
Levitus meanValue
(via NVODS)
Levitus meanValue
(via NVODS)
1Major ocean Basins
(N. Atlantic, Trop.
Atlantic,etc.)
1Major ocean Basins
(N. Atlantic, Trop.
Atlantic,etc.)
1Whole globe
1Whole globe
Drill DownDrill Down
Grid cell
Grid cell
Single Observation
Single Observation
Select oneSelect one
Select OneSelect One
Metadata report
Metadata report
Instrument history
Trace map
Instrument history
Trace map
InstrumentMeasurementTime series
InstrumentMeasurementTime series
Plot of profileValues (future)
Plot of profileValues (future)
Select OneSelect One
StatisticsSummary of Obs in grid
Cell
StatisticsSummary of Obs in grid
Cell
Clickable listOf
Individual Reports
Clickable listOf
Individual Reports
1.Gridded fields shown with graticuleoverlay. Click on grid cells for drill down
KEY: Blue = Completed Red = FY05 Work Green = System Navigation Note: Data accumulation will occur over time. Currently the database has data
from 1 June 2004, however, it will be back filled to 1 January 2004
User interface & User interface & tools for tools for
evaluationevaluation
Web-accessible to the Web-accessible to the communitycommunity
Visualization & evaluationVisualization & evaluationOverview (tour)Overview (tour)
all platforms reporting today
Visualization & evaluationVisualization & evaluationOverviewOverview
all platforms reporting air temp. today
all platforms reporting SST today
Visualization & evaluationVisualization & evaluationOverviewOverview
all platforms reporting SST today colored by age
Visualization & evaluationVisualization & evaluationOverviewOverview
Drifters reporting SST today
Visualization & evaluationVisualization & evaluationOverviewOverview
U.S. drifters reporting SST today
Visualization & evaluationVisualization & evaluationOverviewOverview
U.S. drifters reporting SST this week
Visualization & evaluationVisualization & evaluationOverviewOverview
U.S. Pacific drifters reporting SST this week
Visualization & evaluationVisualization & evaluationOverviewOverview
U.S. Pacific drifters reporting SST this month
User interface & tools for User interface & tools for evaluationevaluation
•Overview (where are the obs?)Overview (where are the obs?)
Drill-downDrill-down (what are the obs?) (what are the obs?)
•Evaluation (are the obs adequate?)Evaluation (are the obs adequate?)
mouse click for metadata summary
Visualization & evaluationVisualization & evaluationDrill DownDrill Down
mouse click to view data
Visualization & evaluationVisualization & evaluationDrill DownDrill Down
mouse click to view plot
Visualization & evaluationVisualization & evaluationDrill DownDrill Down
User interface & tools for User interface & tools for evaluationevaluation
•Overview (where are the obs?)Overview (where are the obs?)
•Drill-down (what are the obs?)Drill-down (what are the obs?)
EvaluationEvaluation (are the obs adequate?) (are the obs adequate?)
Number of platforms per 1x1 degree box reporting SST today
Visualization & evaluationVisualization & evaluation
Number of platforms per 1x1 degree box reporting SST this week
Visualization & evaluationVisualization & evaluation
Number of platforms per 1x1 degree box reporting SST this month
Visualization & evaluationVisualization & evaluation
Number of platforms per 5x5 degree box reporting SST this month
Visualization & evaluationVisualization & evaluation
5x5 degree boxes this month that had one or more SST obs every day
Visualization & evaluationVisualization & evaluation
Percentage of days when a 5x5 degree box had at least 5 SST obs
Visualization & evaluationVisualization & evaluation
Click for time series record of SST obs in a single 5x5 grid cell
Visualization & evaluationVisualization & evaluation
Click for time series record of SST obs in of an ocean basin
Visualization & evaluationVisualization & evaluation
Click for global time series of SST obs
Visualization & evaluationVisualization & evaluation
OSMC LAS
The OSMC doesn’t look like a Live Access Server …
(Shown is the more traditional LAS user interface)
Ready for integration into NVODS, DMAC, IOOS and GOOS
Next stepsNext steps
• Wire it together robustlyWire it together robustly(It is not as mature as it appears)(It is not as mature as it appears)
• Tune for performanceTune for performance(caching schemes)(caching schemes)
• Bring NGDC GIS and RDBMS Bring NGDC GIS and RDBMS expertise into the partnershipexpertise into the partnership
Suggestions? Questions?Suggestions? Questions?