Hydrologic Modeling with Arc Hydro Tools 1
Copyright © 2007 ESRI. All rights reserved. Arc Hydro
Arc Hydro: GIS in Water Resources
Seminar/WorkshopGainesville, Florida – November 15, 2007
Christine Dartiguenave, ESRI [email protected]
Hydrologic Modeling with Arc Hydro Tools 2
2Arc HydroCopyright © 2007 ESRI. All rights reserved.
What is Arc Hydro?
Extension of geodatabase model for support of water resources applications (template data model)
Culmination of a three year process led by D.R. Maidment through GIS in Water Resources Consortium (Arc Hydro book)
Collection of tools for support of Arc Hydro geodatabase design and basic water resources functions
Starting point for water resources database and application development
Hydrologic Modeling with Arc Hydro Tools 3
3Arc HydroCopyright © 2007 ESRI. All rights reserved.
Overview
Arc Hydro Data Model
Arc Hydro Tools
Model Integration
Applying Arc Hydro
Hydrologic Modeling with Arc Hydro Tools 4
4Arc HydroCopyright © 2007 ESRI. All rights reserved.
How “Things” Build Up
Database design
Data preparation
Terrain preparation
“Watershed” delineation
“Watershed” characterization
Parameterization
Model pre and post-processing
Generic
Semi-Generic
Model Specific
Hydrologic Modeling with Arc Hydro Tools 5
5Arc HydroCopyright © 2007 ESRI. All rights reserved.
Geodatabase
MS AccessFile
OracleSQL Server
InformixDB2
FeatureIFeature : IRowIFeature
IFeatureBuffer IFeatureBuffer : IRowBuffer
IFeatureDraw IFeatureDraw : IUnknown
ArcGIS Introduces
New geographic data model
New geographic databaseStored in an RDBMS
Many new capabilities
GeodatabasePersistent store of geographic information in a DBMS
Hydrologic Modeling with Arc Hydro Tools 6
6Arc HydroCopyright © 2007 ESRI. All rights reserved.
Inside the GeodatabaseGeodatabase
Survey datasets
Survey folder Survey
LocatorsAddressesx,y locationsZip codes
Route eventsRoute locations
Raster datasets
Validation rulesDefault valuesAttribute domains Split/Merge policy
Connectivity rulesRelationship rulesTopology rules
Tables, subtypes
Spatial reference
Multi-patch FCRoute FCDimension FC
Polygon FCLine FCPoint FCAnnotation FC
Feature classes (FCs), subtypes
Relationship classes
Topology
Geometric networks
Feature dataset
Inside the geodatabase
Geodatabases organize geographic data into a hierarchy of data objects. These data objects are stored in feature classes, object classes, and feature datasets. An object class is a table in the geodatabase that stores nonspatial data. A feature class is a collection of features with the same geometry and the same attributes.
A feature dataset is a collection of feature classes that share the same spatial reference. Feature classes that store simple features can be organized either inside or outside a feature dataset. Simple feature classes that are outside a feature dataset are called stand-alone feature classes. Feature classes that store topological features must be contained within a feature dataset to ensure a common spatial reference.
The geodatabase supports a model of topologically integrated feature classes, that is further extended with support for complex networks, topologies and relationships among feature classes, and other object-oriented features.
Feature classes
Collections of points, lines, polygons, or annotation (map text) managed as feature tables. Related feature classes (i.e., those that participate in a topology or a network) are managed as a collection in feature datasets.
Raster datasets
Individual images or multi-tiled rasters managed as raster tables.
Tables
A collection of records (rows) and fields (columns) used to represent non-graphic objects (e.g., parcel owners).
Hydrologic Modeling with Arc Hydro Tools 7
7Arc HydroCopyright © 2007 ESRI. All rights reserved.
GIS/IT Standards
Parcel …Arc Hydro
Template Data Models (30+)
HEC …FEMA
Project Data Models
Feature TopologyObject
ArcGIS Core Data Model
OGC
FGDC
ISO
Industry
Templates Provide an Important Link Between Project Teams, Standards, and ESRI Software Development
Template Data Models
Hydrologic Modeling with Arc Hydro Tools 8
8Arc HydroCopyright © 2007 ESRI. All rights reserved.
Arc Hydro
Template Data Model Approaches
Floodplain WQ
Permitting
Water Resources
Hydrologic Modeling with Arc Hydro Tools 9
9Arc HydroCopyright © 2007 ESRI. All rights reserved.
Arc Hydro Database Definition
A geospatial and temporal data model for water resources that operates within ArcGIS
Five key conceptual areasDrainage - Drainage areas and stream lines defined from surface topography
Flow network - Connected sets of points and lines showing pathways of water flow
Hydrography - The base data from topographic maps and tabular data inventories
Channel description - A 3-D line representation of the shape of river and stream channels
Time series - Tabular attribute data describing time-varying water properties for any hydro feature
Hydrologic Modeling with Arc Hydro Tools 10
10Arc HydroCopyright © 2007 ESRI. All rights reserved.
Arc Hydro Schema
Flow
Time
Time Series
Hydrography
Network
Channel
Drainage
HydroFeatures
Hydrologic Modeling with Arc Hydro Tools 11
11Arc HydroCopyright © 2007 ESRI. All rights reserved.
Arc Hydro Data Model
Hydrologic Modeling with Arc Hydro Tools 12
12Arc HydroCopyright © 2007 ESRI. All rights reserved.
Hydrologic Modeling with Arc Hydro Tools 13
Arc Hydro Tools
Hydrologic Modeling with Arc Hydro Tools 14
14Arc HydroCopyright © 2007 ESRI. All rights reserved.
Key Concepts
Transitions between the raster and vector worlds –integrated operations
“Relationships between objects linked by tracing path of water movement”
Raster NetworkVector
Logical SchemaExtended Network
Hydrologic Modeling with Arc Hydro Tools 15
15Arc HydroCopyright © 2007 ESRI. All rights reserved.
Terrain Processing
• Start with the terrain model
• Identify drainage patterns
• Identify catchments
Hydrologic Modeling with Arc Hydro Tools 16
16Arc HydroCopyright © 2007 ESRI. All rights reserved.
Network Generation
• Start with the drainage pattern
• Define hydro edges from drainage lines
• Generate junctions at confluences
• Build the geometric network
Hydrologic Modeling with Arc Hydro Tools 17
17Arc HydroCopyright © 2007 ESRI. All rights reserved.
Connecting Catchments to Junctions
• Start with the catchments
• Identify drainage points
• Link drainage points to junctions
Hydrologic Modeling with Arc Hydro Tools 18
18Arc HydroCopyright © 2007 ESRI. All rights reserved.
Extended (Hydrologic) Network
• Combination of hydro network and drainage areas connected through junctions.
• Allows tracing through network and selection on drainage areas
Hydrologic Modeling with Arc Hydro Tools 19
19Arc HydroCopyright © 2007 ESRI. All rights reserved.
Node-Link Schematization (1)
• Start with the catchments
• Find centroids
• Continue with drainage lines
• Find confluences
• Connect nodes
Hydrologic Modeling with Arc Hydro Tools 20
20Arc HydroCopyright © 2007 ESRI. All rights reserved.
• Transition from geo representation to logical representation
Node-Link Schematization (2)
• Support for various modeling efforts
Hydrologic Modeling with Arc Hydro Tools 21
Arc Hydro Tools Overview
Hydrologic Modeling with Arc Hydro Tools 22
22Arc HydroCopyright © 2007 ESRI. All rights reserved.
A set of tools that “exercises” the Arc Hydro modelIntegral with standard ArcGIS functionality
Key field (property) management.HydroID & related IDs
Length/Area measures
Core functionsDEM-based watershed delineation
Network generation
Attribute and network tracing and summary operations
Parameters computation
Arc Hydro Tools Overview (1)
Hydrologic Modeling with Arc Hydro Tools 23
23Arc HydroCopyright © 2007 ESRI. All rights reserved.
Arc Hydro Tools Overview (2)
Distribution (version 1.2 available – 1.3 to be released soon)A toolbar with packaged menus and buttons
Supporting documentation/help
ArcGIS 9/9.1/9.2 versions
ApFrameworkSimplify boring development tasks
Consistent development structure
Starting point for additional functionality development
ApUtilitiesSet of utilities common to most ArcObject-based applications developed at ESRI Professional Services in water resources area
Hydrologic Modeling with Arc Hydro Tools 24
24Arc HydroCopyright © 2007 ESRI. All rights reserved.
The Arc Hydro ToolbarTerrain Preprocessing
Terrain Morphology
Watershed Processing
Attribute Tools
Network Tools
ApUtilities
Buttons
Arc Hydro Tools Overview (3)
Hydrologic Modeling with Arc Hydro Tools 25
25Arc HydroCopyright © 2007 ESRI. All rights reserved.
Arc Hydro Tools Overview (4)
Terrain PreprocessingSet of functions for processing of DEMs
Preprocessing of DEM-based data needed for watershed delineation and watershed characteristics extractions
Hydrologic Modeling with Arc Hydro Tools 26
26Arc HydroCopyright © 2007 ESRI. All rights reserved.
DEM Preprocessing
Goal: develop hydrologically correct DEM and develop layers to optimize performance
Flow direction (D8 method)
Flow accumulation
Stream definition and segmentation
Catchment delineation
Adjoint catchment definition
Iterative processReview results and fix terrain if necessary until “correct” flow patterns are established
Hydrologic Modeling with Arc Hydro Tools 27
27Arc HydroCopyright © 2007 ESRI. All rights reserved.
DEM Preprocessing (cont.)
Flow direction codes
1
248
16
32 64 128
71
56
445369
74
78 72 69 71
4768
58 55
21
31
67
58
49 46
37 38
64 22
61 16
Digital elevation model (DEM)
22
2 2 2
2
4 4
4 4
1 1 2 4 8
128
128 1 2 4
128 1 41
128
Flow direction grid
Stream NetworkFlow accumulation grid
0 0 0 0 0
0 1 1 2 1
0
0
0 0 0
3 8 5 2
1 1 20 0
1 24
Source: Olivera, 1998
Flow direction (D8 method)
Flow accumulation
Hydrologic Modeling with Arc Hydro Tools 28
28Arc HydroCopyright © 2007 ESRI. All rights reserved.
DEM Preprocessing (cont.)
Stream definition and segmentation
Threshold (performance)
New function to handle loops and flow splits
Catchment delineation
At stream confluences
Adjoint catchmentsPerformance implications
Hydrologic Modeling with Arc Hydro Tools 29
29Arc HydroCopyright © 2007 ESRI. All rights reserved.
DEM Editing
Sinks: when sinks are (or are not) sinks – lakes, depressions, …
Global fill
Dealing with internal basins
Selective fillDepth
Area
How to include internal basins in hydrologic schema
Hydrologic Modeling with Arc Hydro Tools 30
30Arc HydroCopyright © 2007 ESRI. All rights reserved.
DEM Editing (cont.)
Streams: when streams are not where they “should” beFlat areas – difficulty in determining the flow pattern
Barriers (roads) diverting the flow pathsHow to “model” bridges and culverts in DEM
How to model dams
Imposing the flow pattern - to burn or not to burn (beware of the scale issues and artifacts – Saunders, 2000)
Simple burn
AGREE
OMNR
Hydrologic Modeling with Arc Hydro Tools 31
31Arc HydroCopyright © 2007 ESRI. All rights reserved.
AGREE (UT – Hellweger)
Hydrologic Modeling with Arc Hydro Tools 32
32Arc HydroCopyright © 2007 ESRI. All rights reserved.
DEM Editing (cont.)
Boundaries - when watershed boundaries are not where they “should” be
To fence or not to fence
Ineffective flow areas
Hydrologic Modeling with Arc Hydro Tools 33
33Arc HydroCopyright © 2007 ESRI. All rights reserved.
Raster Preprocessing Workflows (1)
Complexity depends on the terrain type and level of detail that needs to be established.
Different workflows for different type of terrain configurations:
Dendritic
Deranged
Combined
Can be complex and iterative process.Separate document describing multitude of options using Arc Hydro tools.
Develop your agency’s specific workflows.
Hydrologic Modeling with Arc Hydro Tools 34
34Arc HydroCopyright © 2007 ESRI. All rights reserved.
Raster Preprocessing Workflows (2)
Standard dendritic process:
Fill sinks
DEMgrid
HydroDEM (1)grid
Flow direction
Flow directiongrid
Flow accumulation
Flow accumulationgrid
Stream definition
Streamgrid
Stream segmentation
Stream linkgrid
1
Start 1
Catchment grid delineation
Catchmentgrid
Catchment polygon
processing
Catchmentfeature class
Drainage line processing
Drainage linefeature class
Adjoint catchment processing
Adjoint catchmentfeature class
End
Grid datasset
Feature class dataset
Function
Legend
Alte
rnat
ive
Pro
cess
ing
Hydrologic Modeling with Arc Hydro Tools 35
35Arc HydroCopyright © 2007 ESRI. All rights reserved.
Raster Preprocessing Workflows (3)
Standard deranged process:
Hydrologic Modeling with Arc Hydro Tools 36
36Arc HydroCopyright © 2007 ESRI. All rights reserved.
Transition to Geoprocessing Environment
Terrain Preprocessing tools are migrated to the GP environment and available as tools in ArcToolbox.
Can be used in a model to build a workflow
Can be combined with other tools in ArcToolbox, including your own
Will publish development standard for Arc Hydro tools in GP
Hydrologic Modeling with Arc Hydro Tools 37
37Arc HydroCopyright © 2007 ESRI. All rights reserved.
Arc Hydro Tools Overview (5)
Terrain MorphologySet of functions for:
Characterization of drainage areas (E-A-V)
Characterization of drainage boundaries (E-A-W)
Area connectivity (“spider web”)
Hydrologic Modeling with Arc Hydro Tools 38
38Arc HydroCopyright © 2007 ESRI. All rights reserved.
Arc Hydro Tools Overview (6)
Watershed ProcessingSet of tools for watershed delineation and characteristics extraction
Every menu has a Data Management form for setting up the layers to be used in operations associated with that menu (not required as each tool will request input and output data if necessary).
Hydrologic Modeling with Arc Hydro Tools 39
39Arc HydroCopyright © 2007 ESRI. All rights reserved.
Arc Hydro Tools Overview (7)
Attribute ToolsSet of tools for attribute management (some of the tools require geometric network)
Can configure additional parameters (e.g. any grid statistics for grid with values 0/1) – 39 preconfigured
Can define you own set of parameters and share the configuration (USGS)
Hydrologic Modeling with Arc Hydro Tools 40
40Arc HydroCopyright © 2007 ESRI. All rights reserved.
Arc Hydro Tools Overview (8)
Network ToolsNetwork specific tools
Create Arc Hydro geometric network.
Create relationship between network junction and drainage area (link network to area).
Initialize flow direction.
Hydrologic Modeling with Arc Hydro Tools 41
41Arc HydroCopyright © 2007 ESRI. All rights reserved.
Arc Hydro Tools Overview (9)
ApUtilitiesVarious utilities common to multiple applications
Access to Arc Hydro tools configuration through XML Manager
Switch between configuration
Access Export to Excel function
Hydrologic Modeling with Arc Hydro Tools 42
42Arc HydroCopyright © 2007 ESRI. All rights reserved.
ButtonsFlow path tracing
Interactive flow path tracing
Point delineation
Batch point generation
Assign related identifier
Global point delineation
Trace by NextDownID
Main Flow Path
Arc Hydro Tools Overview (10)
Hydrologic Modeling with Arc Hydro Tools 43
43Arc HydroCopyright © 2007 ESRI. All rights reserved.
Phase II of Arc Hydro
More Tools Time series, ID management, ...
Groundwater extension to the data modelTrainingStatus
Self-sustaining
Get involved into Consortium activitiesMeetingsContributorsPersonal communicationProjects
Hydrologic Modeling with Arc Hydro Tools 44
44Arc HydroCopyright © 2007 ESRI. All rights reserved.
Integration of Surface Water and Groundwater Models
HydrographyHydrography
Hydro NetworkHydro Network
Channel SystemChannel System
Drainage SystemDrainage System Hydrogeologic unit Borehole
Layers Solid
Groundwater models
Simulated results
Surface water models
Simulated results
Arc Hydro data model
This also leads us into integration of surface water and groundwater models.
If the core geographical data model describes the surface water and groundwater objects, and if relationships are established between those objects, surface and groundwater models can be integrated.
Each model will interface to the common underling data model and results of one simulation can be integrated into other models.
Hydrologic Modeling with Arc Hydro Tools 45
45Arc HydroCopyright © 2007 ESRI. All rights reserved.
Where is Arc Hydro?
Hydro model page at: support.esri.com/datamodels
Arc Hydro home page at GIS Water Resources Consortium at: www.crwr.utexas.edu/giswr/hydro
Dr.Maidment’s home page at: www.ce.utexas.edu/profile.cfm?profilePK=110
Hydrologic Modeling with Arc Hydro Tools 46
46Arc HydroCopyright © 2007 ESRI. All rights reserved.
FTP Download Site
ftp: ftp.esri.com
username: RiverHydraulics
password: river.1114
directory: ArcHydro
Case sensitive
Make sure you log in (most browsers will log you in as anonymous and you will not be able to download)
Hydrologic Modeling with Arc Hydro Tools 47
47Arc HydroCopyright © 2007 ESRI. All rights reserved.
Arc Hydro Support
Water Resources/Arc Hydro Discussion Forum at: http://forums.esri.com/Forums.asp?c=121
Hydrologic Modeling with Arc Hydro Tools 48
Copyright © 2007 ESRI. All rights reserved. Arc Hydro
Model Integration
Hydrologic Modeling with Arc Hydro Tools 49
49Arc HydroCopyright © 2007 ESRI. All rights reserved.
Data Exchange with model
GIS
DB
GIS
DB
Model Input/Output
Excel spreadsheet – configure Arc Hydro configuration XML
Input/Output files:XML based data exchange –
GeoRAS, GeoHMS, iCPR
Custom coding (NSS: Streamstats/Wisconsin DNR)
Model DB
Hydrologic Modeling with Arc Hydro Tools 50
50Arc HydroCopyright © 2007 ESRI. All rights reserved.
XML(1)-Based Spatial Data Exchange
Semantic tags for spatial data are user specified
Easy customization of data structure for different systems
Data structure is extensible
Good for data distribution on Internet (multi-platform)
Existing technologies for XML management (parsers, editors, viewers, components, checkers, converters, …) – economy of development
(1) XML – eXtensible Markup Language
Hydrologic Modeling with Arc Hydro Tools 51
51Arc HydroCopyright © 2007 ESRI. All rights reserved.
Anatomy of an XML File
Hydrologic Modeling with Arc Hydro Tools 52
52Arc HydroCopyright © 2007 ESRI. All rights reserved.
System Design of the XML-Based ExchangeArchitecture
A central exchange mechanism accompanied by customizable XML structures
Three componentsCentral data exchange mechanism embedded in GIS (ArcMap-based) Predefined XML structure for import Customizable control XML structure for export
Different than the “standard” ArcGIS XML I/O formatSimpler and more focused on model interfaces (not everything can be exported and imported)
Public domain code and documentation for direct or code implementation
Hydrologic Modeling with Arc Hydro Tools 53
53Arc HydroCopyright © 2007 ESRI. All rights reserved.
GIS
External Data Analysis Package
Customizable ExportXML Structure
Predefined ImportXML Structure
Import Data as XML Document
Export GIS Data as XML Document
Import Engine
Export Engine
Import
Export
Central Exchange Mechanism
System Design of the XML-Based Exchange
Hydrologic Modeling with Arc Hydro Tools 54
Copyright © 2007 ESRI. All rights reserved. Arc Hydro
Applying Arc Hydro
Hydrologic Modeling with Arc Hydro Tools 55
55Arc HydroCopyright © 2007 ESRI. All rights reserved.
Applying Arc Hydro
Extension of Arc Hydro data model for support of water resources applications
Addition of features and feature classes
Addition of functionality (tools)
Various entitiesESRI
CRWR (SFWMD, SARA, WAM, …)
Other (USGS, OMNR, SJRWMD, PBS&J, …)
Hydrologic Modeling with Arc Hydro Tools 56
56Arc HydroCopyright © 2007 ESRI. All rights reserved.
Applying Arc Hydro (ESRI)Examples
USGS Streamflow Statistics Application (StreamStats)
So.Cal fires debris flow predictions
DEM editing tools
NHDinGeo editing tools
Hydrologic Modeling with Arc Hydro Tools 57
57Arc HydroCopyright © 2007 ESRI. All rights reserved.
StreamStats (USGS)Implementation of USGS regression equations for flow computations at ungaged locations (WDNR ArcView 3 implementation)
Web based application (and desktop)
Full implementation in Arc Hydro – all additional GIS functionality is rolled-into Arc Hydro
Hydrologic Modeling with Arc Hydro Tools 58
58Arc HydroCopyright © 2007 ESRI. All rights reserved.
Functionality:Select point of interest
Delineate watershed
Extract watershed characteristics (area, CN, 10-85 slope, mean elevation, relief, etc.)
Send to NSS and get results back
“Publish” results
StreamStats (USGS)
Hydrologic Modeling with Arc Hydro Tools 59
59Arc HydroCopyright © 2007 ESRI. All rights reserved.
StreamStats (USGS) - WEB
1) Select area
2) Delineate watershed
3) Get results
Hydrologic Modeling with Arc Hydro Tools 60
60Arc HydroCopyright © 2007 ESRI. All rights reserved.
StreamStats (USGS) - Desktop1) Select area and delineate watershed
3) Get results
2) Get parameters
Hydrologic Modeling with Arc Hydro Tools 61
61Arc HydroCopyright © 2007 ESRI. All rights reserved.
DEM Editing Tools (HEC)
Tools for micro-editing of DEM (grid)Develop “hydrologically”-correct DEM
Status – application delivered to HEC
FunctionalityRaise or drop a point of interest
Burn/fence local lines/polys
DEM QC functions
DEM assembly
Hydrologic Modeling with Arc Hydro Tools 62
62Arc HydroCopyright © 2007 ESRI. All rights reserved.
DEM Editing Tools (HEC)
Hydrologic Modeling with Arc Hydro Tools 63
63Arc HydroCopyright © 2007 ESRI. All rights reserved.
NHDinGeo Editing Tools (FS/USGS)
Editing application for NHD data (NHDinGeo)Process-driven (workflow)
NHDinGeo data model completed
NHDinGeo and NHDinGeoARC data being generated
Work on making NHDinGeo Arc Hydro compliant (take advantage of Arc Hydro functionality with NHDinGeo geometry)
Hydrologic Modeling with Arc Hydro Tools 64
64Arc HydroCopyright © 2007 ESRI. All rights reserved.
Questions