Date post: | 23-Feb-2017 |
Category: |
Documents |
Upload: | datacenters |
View: | 215 times |
Download: | 0 times |
U.S. Climate Reference NetworkU.S. Climate Reference NetworkPart 4: MetadataPart 4: Metadata
Jeff ArnfieldNational Climatic Data CenterAsheville, NC
CRN Metadata: the authorsCRN Metadata: the authors
Jeffrey D. Arnfield National Climatic Data Center
Claude E. Duchon University of Oklahoma
C. Bruce Baker National Climatic Data Center
Robert G. Quayle National Climatic Data Center
Richard R. Heim Jr. National Climatic Data Center
Kevin D. Robbins Southern Regional Climate Center
Michael J. JanisSoutheast Regional Climate Center
Andrew H. Horvitz National Weather Service
CRN Goals
Leading edge climate monitoring for 21st century
Improve quantification & detection of climate change
Place climate anomalies and extreme events into historical perspective
ApproachApproach Build on experience from current observation and
analysis systems and climate research
Take best advantage of modern equipment and methods
High quality data records are central
Detailed metadata are crucial to establishing and interpreting data records
What else do you need to know?What else do you need to know?
42.000
The information chainThe information chain
Information requirementsSpecifications & procedures
Installation &
MaintenanceSampling & Averaging
Network Administration Observations
Transmission
Data Handling Product Creation Information access
Learning from the pastLearning from the past Need a precise, comprehensive view of every link in the
information chain at any point in time, and previous versions of information and their effective dates must be accessible
Every aspect of an observing system can change over time
Seemingly small changes can be significant
Information system requirements evolve
Key system characteristicsKey system characteristics
Flexible, extensible design to accommodate changing information requirements
Oracle relational database engine to manage the data and business rules
Metadata available via the WebUser interface should require minimal
training, installation and administration
Metadata of interestMetadata of interest
Traditional Metadata Station identity Latitude, Longitude,
Elevation Instrumentation Equipment exposure
information Observer
Expanded Metadata Digital images Instrument specifications Calibration and service
procedures and history Sampling and validation
procedures Processing and quality control
algorithms Network administration
information Historical versions of values
Metadata subject areasMetadata subject areas Station identification,
location & operation Station equipment
and maintenance Equipment
specifications and service procedures
Pre-transmission sampling and averaging procedures
Data transmission system and procedures
Data handling procedures & systems
Derivative data products
Network administration information
Names Identifiers from various
networks Latitude & longitude in
decimal degrees from GPS GPS model, PDOP,
observation date & time Elevation above mean sea
level Geopolitical location
– State, county, MSA, city... Driving instructions
Station identification & locationStation identification & location
Soil type Vegetation types & condition Exposure Digital images, including
– Digital photos– LANDSAT imagery– Aerial Imagery– Maps of area– Station layout diagram
Involved parties, with contact information
Neighboring stations
Installed equipmentInstalled equipment
Instrument make and model
Serial number Firmware version Date of purchase Horizontal location Height above
ground
Exposure details, including images as appropriate
Phenomena observed Priority
– primary, backup, etc Units & scale reported Sampling interval Reporting frequency
Installed equipment:Installed equipment: maintenancemaintenance
Scheduled maintenance and calibration Performed maintenance and calibration log
– Date & time of service– Instruments serviced– Service type– Agency & technician name– Procedures used– Results, readings & other objective measurements– Technician’s notes
Equipment specifications & proceduresEquipment specifications & procedures
Manufacturer Model Phenomena measured How the instrument
functions Sampling interval range Measurement range Resolution Accuracy Siting and installation
requirements
Digital images– Photos– Diagrams– Copy of spec sheets
Service schedule & details– Service type– Procedure description– Standard values– Schedule / frequency– Required equipment– Required expertise
Pre-transmission sampling & averagingPre-transmission sampling & averaging
Procedure description Frequency Algorithms Software & hardware used
– Version– Firmware
Input source Special notes
Data transmission system & proceduresData transmission system & procedures
Method of transmission
External communication identifiers needed– SHEF, WMO, etc
Data format transmitted
Time standard Transmission time Hardware &
software used Involved parties &
agencies
Data handling procedures & systemsData handling procedures & systems
Ingest, quality control and conversion procedures & algorithms
Constants & parameter values usedSignificant changes to observationsProcessing & storage systemsData inventory and catalog creationInvolved parties & agencies
Derivative data productsDerivative data products
Systems, procedures, algorithms usedDescriptionPeriod of recordGeographic coveragePhenomena (elements) includedProduct media and format(s)Access systems
Network administration informationNetwork administration information
Controlling agency Supporting agencies Program manager(s) Contact information, including DB manager Defining documentation Legislative authorizations Manuals Training material Standards used
Current StatusCurrent Status
Metadata requirements definedLogical system design in progressInitial station implementation underwayValidating metadata requirements and
specificationsRequirements are influencing other metadata
system development at NCDChttp://www.ncdc.noaa.gov/crn.html
How does it all fit?How does it all fit?
S tation Identifie r
LocationS erv ice R ecord
Ins talledIns trum entation N am eequ ipm ent
T ransm iss ionP ro tocol
S erv iceP rocedures
N etw ork
O pera tingP rocedures
Invo lved P arty/ Agency
D ata P roductP henom ena
conta ins
hasass igned
has
has
hasnoted
has
has
assigns
hasrecom m ende
dhas
basedon
is an
reportsus ing
m easures
usesreports
observations
from
has a
hasstandard
inc ludes
hasrela ted
has
has