Automating Model Skill Assessmentwith Python
Rich Signell (USGS, Woods Hole, MA)Filipe Fernandes (SECOORA)
Kyle Wilcox (Axiom Data Science, Wickford, RI)
CEOS WGISS Tech Expo Webinar 2017-08-22
US Integrated Ocean Observing System (IOOS®)
IOOS® Plan defines:• Global Component• Coastal Component
▪ 17 Federal Agencies▪ 11 Regional Associations
IOOS Recommended Web Servicesand Data Encodings
IOOS Model Data Interoperability Design
ROMS
ADCIRC
HYCOM
SELFE
SLOSH NcML
NcML
NcML
NcML
Common Data Model
OPeNDAP+CF+UGRID|SGRID
WCS
NetCDF Subset
THREDDS Data Server (TDS)
Standardized (CF-1.6, UGRID-1.0, SGRID-0.3) Virtual Datasets
NonstandardModel Output Data Files
Web ServicesMatlab
Panoply
IDV
Clients
NetCDF-Java
Libraryor Broker
WMS
ncISO
ArcGISNetCDF4-Python
FVCOM
PythonERDDAP
NetCDF-Java
SOS
Geoportal Server
GeoNetwork
GI-CAT
Observed data (buoy, gauge, ADCP, glider)
Godiva2
pycsw-CKAN
NcML
GridSgridUgridTimeSeriesProfileTrajectoryTimeSeriesProfile
NonstandardData Files
CatalogServices
CMG Portal
Delft3D NcML
sudo apt-get dockerdocker run –d unidata/thredds-docker
IOOS Catalog
5
Interoperable Access in Python (Iris)
Boston Light Swim
8 mile swimNo wet suitHow cold will the water be?
Boston Light Swim Paper
Demo
Conda-Forge is Awesome
2900+ packages and growing!
Summary
• Standardized framework makes skill assessment easy and powerful
• Services are now easy to install and maintain• Skill assessment notebooks are reproducible
by others (for free)• More assessment leads to more appropriate
use of modeling products• More assessment of models leads to better
models
Demo
Boston Light Swim Notebook