USGS National Hydrography Dataset Newsletter Vol. 17, No. 1, January 2018 GeoPackage as a Potential Non-Proprietary Dataset Download Solution Interested in Helping with NHDPlus High Resolution? Hydro Fun Fact NHDPlus Medium Resolution Update Provisional Names Pilot Project Ending NHDPlus High Resolution Update NHDPlus HR Availability NHDPlus HR Ingredient Dataset Status - Network Improvement Project NHDPlus HR Ingredient Dataset Status - WBD 4-digit Improvement Project Hydrography Photo of the Month Hydrography Quiz Upcoming USGS Hydrography Calls, Trainings, and Meetings GeoPackage as a Potential Non-Proprietary Dataset Download Solution Contacts: Steve Aichele ([email protected]), Greg Cocks ([email protected], ATA Services | Contractor in support of the USGS) The USGS produces and distributes the National Hydrography Dataset (NHD), Watershed Boundary Dataset (WBD), and NHDPlus High Resolution (NHDPlus HR) in Esri’s proprietary File Geodatabase (FGDB) and as a variety of spatial web services. NHD and WBD also are distributed in shapefile (SHP) format, however, NHDPlus HR is not distributed in shapefile format because the datasets would frequently exceed limitations on shapefile file sizes. The USGS has actively been exploring non-proprietary, open source formats for spatial data distribution to supplement and extend the FGDB and spatial web services deliveries. A variety of open source formats were recently evaluated as potential downloadable delivery formats, including GeoPackage, GDAL/OGR, GeoSPARQL, GML, GraphDB, SpatialLite, PostgreSQL+PostGIS, and various XML formats such as GeoJSON. After researching and testing these options, we found that Open Geospatial Consortium (OGC) GeoPackage is a suitable, modern, non-proprietary spatial dataset downloadable delivery format. GeoPackage is designed to be as lightweight as possible, and to be contained in a ‘ready-to-use’ single file. Since a GeoPackage is a true relational database (based on SQLite) with built-in indexing, it supports direct use, meaning that: ● its data can be readily accessed and updated in a ‘native’ storage format without any intermediate ETL (extract, load, transform), ● it can be accessed by multiple applications simultaneously, ● is designed for mobile app development and use - as well as efficient and robust sharing on cloud storage, USB drives, etc., and, ● it has integrity assertions, content constraints, table definitions, etc. 1
Transcript
USGS National Hydrography Dataset Newsletter Vol. 17, No. 1, January 2018
GeoPackage as a Potential Non-Proprietary Dataset Download Solution
Interested in Helping with NHDPlus High Resolution?
Hydro Fun Fact
NHDPlus Medium Resolution Update
Provisional Names Pilot Project Ending
NHDPlus High Resolution Update
NHDPlus HR Availability
NHDPlus HR Ingredient Dataset Status - Network Improvement Project
NHDPlus HR Ingredient Dataset Status - WBD 4-digit Improvement Project
Hydrography Photo of the Month
Hydrography Quiz
Upcoming USGS Hydrography Calls, Trainings, and Meetings
GeoPackage as a Potential Non-Proprietary Dataset Download Solution Contacts: Steve Aichele ([email protected]), Greg Cocks ([email protected], ATA Services | Contractor in support of the USGS)
The USGS produces and distributes the National Hydrography Dataset (NHD), Watershed Boundary Dataset (WBD), and NHDPlus High Resolution (NHDPlus HR) in Esri’s proprietary File Geodatabase (FGDB) and as a variety of spatial web services. NHD and WBD also are distributed in shapefile (SHP) format, however, NHDPlus HR is not distributed in shapefile format because the datasets would frequently exceed limitations on shapefile file sizes. The USGS has actively been exploring non-proprietary, open source formats for spatial data distribution to supplement and extend the FGDB and spatial web services deliveries. A variety of open source formats were recently evaluated as potential downloadable delivery formats, including GeoPackage, GDAL/OGR, GeoSPARQL, GML, GraphDB, SpatialLite, PostgreSQL+PostGIS, and various XML formats such as GeoJSON. After researching and testing these options, we found that Open Geospatial Consortium (OGC) GeoPackage is a suitable, modern, non-proprietary spatial dataset downloadable delivery format. GeoPackage is designed to be as lightweight as possible, and to be contained in a ‘ready-to-use’ single file. Since a GeoPackage is a true relational database (based on SQLite) with built-in indexing, it supports direct use, meaning that:
● its data can be readily accessed and updated in a ‘native’ storage format without any intermediate ETL (extract, load, transform),
● it can be accessed by multiple applications simultaneously,
● is designed for mobile app development and use - as well as efficient and robust sharing on cloud storage, USB drives, etc., and,
● it has integrity assertions, content constraints, table definitions, etc.
Geopackage is an open-standard product with active development by OGC and the user community. GeoPackages support both vector and raster data - including tiles and pyramids, as well as being designed for extensibility (i.e., R-Tree indexing extension for much improved performance when querying vector data, Tiled Gridded Elevation Data extension, Related Table extension, customisable extensions, etc.). Geopackage also supports z & m values. In addition, GeoPackage extensions may be developed to support additional types of geospatial data such as routing networks. Many proprietary (e.g. Esri) and open source (e.g. QGIS) desktop GIS software solutions support the use of Geopackage. A series of preliminary GeoPackage USGS dataset conversions for review are available at: ftp://rockyftp.cr.usgs.gov/ngtoc/hydro/outgoing/GeoPackage_hydrography_examples/ We welcome appraisals and suggestions - please send feedback to Greg Cocks ([email protected]).
Interested in Helping with NHDPlus High Resolution? Contact: Cynthia Ritmiller ([email protected])
There are two ways you can help with NHDPlus HR: 1. Improving the NHD or WBD prior to NHDPlus HR Production Partners proficient with NHD or WBD editing tools can perform the required review/quality control (QC) to fix problems in the NHD or WBD data before the datasets are used in NHDPlus HR production. Partners who have local knowledge but are not trained editors can get involved in the review/QC effort following the release of the web-based Markup Application. Please contact the USGS Partner Support Point of Contact in your area for questions about NHD or WBD editing. 2. NHDPlus HR Beta review/QC The USGS is seeking volunteers to perform a review/QC of the NHDPlus HR Beta in various Hydrologic Regions. This opportunity is ideal for users with previous NHDPlus Version 2 (medium resolution) experience and, most importantly, local hydrography knowledge. Once these changes have been reviewed and approved by the steward, they are incorporated into the NHD or WBD. Please fill out the NHDPlus HR QC interest Google form to participate in the NHDPlus HR Beta review/QC process. For more information on NHDPlus HR, please see the NHDPlus HR webpage.
National Hydrography Dataset Newsletter, Vol. 17, No. 1, January 2018 2
Hydro Fun Fact from Elizabeth Smith, Bureau of Water, Kansas Department of Health and Environment
January 29 was Kansas Day. The state song mentions not one, but TWO waterbodies by name – Beaver Creek and Solomon River. And what is the Kansas state song? None other than Home on the Range! https://en.wikipedia.org/wiki/Home_on_the_Range Thanks Elizabeth!
What’s your hydro fun fact? Send it to Becci Anderson ([email protected]).
NHDPlus Medium Resolution Update Contact: Tommy Dewald ([email protected])
There are several new and improved medium resolution NHDPlus products and services available - including new user applications, updates to training materials, and new visualization capabilities. The User Applications section on the NHDPlus web site (https://www.epa.gov/waterdata/nhdplus-applications) has been updated with over 50 new entries adding to the rich collection found there. Click on the Date Posted column heading to sort the most recent entries to the top of the table. As always, your additions, which benefit the larger water resources community by sharing with others what's possible with NHDPlus, are welcomed and encouraged. While visiting the site, you might also check out the additions to the training materials including the presentation videos and a comprehensive self-directed companion exercise from the 2016 NHDPlus Workshop. See https://www.epa.gov/waterdata/nhdplus-national-hydrography-dataset-plus, click on the Learn More tab, then expand the Documentation item. On the EPA Watershed Assessment, Tracking and Environmental Results (WATERS) web site, you'll find the new WATERS GeoViewer which leverages ArcGIS Online and the EPA GeoPlatform to provide upstream/downstream search, watershed delineation and an enhanced watershed report service featuring dynamic access to the extensive StreamCat library of landscape attributes. The underlying NHDPlus-based web services are available for general access as well. See https://www.epa.gov/waterdata/waters-watershed-assessment-tracking-environmental-results-system, then click on the Get Data/Tool tab. It's exciting to deliver these capabilities which are expected to enable even more creative applications of the existing medium resolution NHDPlus, while production of the new NHDPlus High Resolution continues to progress (https://nhd.usgs.gov/NHDPlus_HR.html). If you would like to receive periodic email updates about the availability of medium resolution NHDPlus data, tools and updates, please send your name, phone
National Hydrography Dataset Newsletter, Vol. 17, No. 1, January 2018 3
number, organization, and email address to NHDPlus Support ([email protected]).
Provisional Names Pilot Project Ending Contact: Michael Tinker ([email protected])
The USGS is ending the Provisional Names pilot project. Unfortunately, the tool did not adequately fulfill its intended use, and the beta Provisional Names Add-In tool for ArcMap and corresponding web service will no longer be supported or available for use. This tool allowed NHD stewards to submit a name and link to supporting documentation for unnamed features in the NHD during the editing of an active NHD job. Partners who have been using the beta Provisional Names Add-In tool are requested to please uninstall it from ArcMap. The USGS is looking at alternative options that can cover the important function and workflow of the Provisional Names tool. Thanks to those who were a part of the Provisional Names pilot project. Your work is helping to guide the creation of an improved solution. For questions, please contact Michael Tinker ([email protected]).
NHDPlus High Resolution Update NHDPlus HR Availability
The map below provides a general overview of NHDPlus HR availability. This status map is updated frequently on the “Where is NHDPlus HR Available?” section of the NHDPlus HR webpage.
● Blue areas - NHDPlus HR Beta is currently available and Beta QC is either in process or completed for these areas. Please see the NHDPlus HR Beta QC section of the NHDPlus HR webpage.
● Yellow areas - The NHDPlus HR Beta is in production and the USGS is currently seeking volunteers for the upcoming Beta QC for these areas. Please see the NHDPlus HR Beta QC section of the NHDPlus HR webpage for more information. Please contact the NHD/WBD Point of Contact in your area for more information on the status of NHD and WBD editing in these areas.
● Gray areas - NHDPlus HR Beta will be produced at a later date. Please see the general processing schedule on the NHDPlus HR webpage for more information. These areas are currently open for NHD and WBD editing.
● Red outline - These areas are currently closed to NHD and WBD editing. Please contact the NHD/WBD Point of Contact in your area for more information.
National Hydrography Dataset Newsletter, Vol. 17, No. 1, January 2018 4
The Network Improvement Project is identifying and correcting network and data quality issues in the NHD. One of the key drivers for this work is to provide data ready for the production of NHDPlus HR. Coordination with appropriate NHD POCs will begin prior to review. Please Note: For all areas listed below, all new data will go through the QA/QC process as it becomes available.
Network Improvement - Work Completed ● Regions - 01, 02, 05, 06, 07, 09, 10, 11, 12,
14, 15 , 16, 20, 21 and 22 ● Pilot areas - 0903, 041504, and 1902
Network Improvement - Currently In Work ● Regions - 03, 08, 13 and 17
Network Improvement - Future Work
● Regions - 04, 18, and 19
National Hydrography Dataset Newsletter, Vol. 17, No. 1, January 2018 5
NHDPlus HR Ingredient Dataset Status - WBD 4-digit Improvement Project Contacts: Kimberly Jones ([email protected]), Lily Niknami ([email protected])
The WBD 4-digit Improvement Project is identifying and correcting hydrologic boundary issues in the WBD at the 4-digit level in support of the production of NHDPlus HR. Instances where the NHD and WBD intersect are being reviewed and invalid intersections are being addressed when appropriate. All proposed major updates to the WBD will be coordinated with the appropriate WBD state steward prior to implementation. WBD 4-digit Improvement - Work Completed
● Regions - 01, 02, 03, 05, 06, 07, 08, 09, 10, 11, 12, 13, 14, 15, and 16
● Pilot areas - 0903, 041504, 190204, and 190205
WBD 4-digit Improvement - Currently In Work ● Regions - 04 and 17
WBD 4-digit Improvement - Future Work
● Regions - 18, 19, 20, 21 and 22 ● Mexico contributing hydrologic units in
Region 13
Hydrography Photo of the Month This month's photo, by Denise Gerdes, is of Crex Meadows in Western Wisconsin near Grantsburg, Wisconsin. We’d love to see photos of the hydrology near you or from your travels! Please send submissions to Becci Anderson ([email protected]). Check out current and past photos on the Photo of the Month webpage.
National Hydrography Dataset Newsletter, Vol. 17, No. 1, January 2018 6
Hydrography Quiz Congratulations to Becca Conklin as the first to respond to November’s quiz with the correct answer - the Jefferson River! Becca is the Water Quality Standards coordinator for the WA State Department of Ecology. They are using NHD in their current rulemaking to help provide more precise locational information on where standards apply. Becca - bragging rights are all yours this month! Thanks to our other respondents for for playing along: Elizabeth Smith, Evan Hammer, Wendy Steinberger, Laurie Morgan, Josh Keeley, Bruce Prud'homme, Becky Schaffner, Matt Rehwald, and Roger Barlow. This Month’s Quiz, by Alex Kaufman ([email protected]): What river derives its name from a common waterfowl and is the most biologically diverse river in North America?
Send your answers with an email subject including the phrase “Hydro Quiz” to Becci Anderson ([email protected]). Happy hydro hunting!
Upcoming USGS Hydrography Calls, Trainings, and Meetings
Date Time Event
Feb 1 10:30 am ET NHD Basics Training
Feb 7 12:00 pm ET NHD Technical Exchange Meeting (TEM)
Feb 14 12:00 pm ET WBD Technical Exchange Meeting (TEM)
National Hydrography Dataset Newsletter, Vol. 17, No. 1, January 2018 7
Feb 15 10:30 am ET NHD Update Tools Training (editing) Part 1
Feb 22 10:30 am ET NHD Update Tools Training (QC) Part 2
Feb 27 1:00 pm ET NHD/WBD Advisory Call
To be added to the NHD/WBD Advisory Call email list, please contact Becci Anderson ([email protected]). For more information on technical exchange meetings and trainings, please see the Hydrographic Data Community (HDC) site. For access to the HDC site, please contact Lily Niknami ([email protected]).
Thank you to this month’s USGS National Hydrography Dataset Newsletter contributors: Steve Aichele, Greg Cocks, Cynthia Ritmiller, Elizabeth Smith, Tommy Dewald, Mike Tinker, Phil Rufe, Hannah Boggs, Kimberly Jones, Lily Niknami, Denise Gerdes, Alex Kaufman, Al Rea, Susan Buto, and Becci Anderson.
Join Our Community! For more information, to sign up for the newsletter, or to contribute, please contact
Becci Anderson, USGS National Hydrography Co-Lead, at [email protected].
Visit us anytime at nhd.usgs.gov and follow us on Twitter @USGSNHD Any use of trade, product, or firm names is for descriptive purposes only and does not imply endorsement by the U.S. Government.
National Hydrography Dataset Newsletter, Vol. 17, No. 1, January 2018 8
