Integrated Geotechnical Data Integrated Geotechnical Data Management for Working Management for Working Engineers and GeologistsEngineers and Geologists
Geohazards in Transportation Geohazards in Transportation in the Appalachian Regionin the Appalachian Region
4 4 –– 5 August 20045 August 2004Columbus, OhioColumbus, Ohio
Scot D. WeaverScot D. WeaverEarthSoft, Inc.EarthSoft, Inc.
AgendaAgenda
�� Geotechnical Data Management and the Geotechnical Data Management and the Impact on Geohazard MitigationImpact on Geohazard Mitigation
�� U.S. Army Corps of Engineers ApproachU.S. Army Corps of Engineers Approach�� Proposed SystemProposed System�� Benefits of CollaborationBenefits of Collaboration�� ConclusionConclusion�� QuestionsQuestions
Geotechnical Data ManagementGeotechnical Data Management
�� Volume of DataVolume of Data�� Inability/Difficulty in Accessing DataInability/Difficulty in Accessing Data�� Incompatibility of Existing SystemsIncompatibility of Existing Systems�� Impact on Geohazards MitigationImpact on Geohazards Mitigation
Geotechnical Data ManagementGeotechnical Data ManagementVolume of DataVolume of Data
��Some project datasets filled thirty or more boxes.Some project datasets filled thirty or more boxes.��When the When the case was closed, as there was no practical way to archive case was closed, as there was no practical way to archive the data, it was all thrown awaythe data, it was all thrown away��..��
Quote from state agency:
Geotechnical Data ManagementGeotechnical Data ManagementVolume of DataVolume of Data
���Without the ability to manage data electronically, the quality of work suffered and hundreds of millions of data were lost forever.��
Quote from state agency:
Geotechnical Data ManagementGeotechnical Data ManagementInability/Difficulty in Accessing DataInability/Difficulty in Accessing Data
District only uses hard copies of log and testing District only uses hard copies of log and testing data.data. The information is stored in warehouses at The information is stored in warehouses at different places throughout Omaha.different places throughout Omaha.��
��The department is truly archaic The department is truly archaic when dealing with records.when dealing with records. It is It is my understanding that themy understanding that the
Quote from an engineer in Quote from an engineer in the US Army Corps of the US Army Corps of Engineers:Engineers:
Geotechnical Data ManagementGeotechnical Data ManagementInability/Difficulty in Accessing DataInability/Difficulty in Accessing Data
What can this result in?What can this result in?
In one Army Corps District, tens of In one Army Corps District, tens of thousands of dollars were spent thousands of dollars were spent unnecessarily on drilling new unnecessarily on drilling new boreholes within meters of boreholes within meters of previous drilling sites, simply previous drilling sites, simply because they didnbecause they didn��t know that the t know that the data existed.data existed.
Geotechnical Data ManagementGeotechnical Data ManagementIncompatibility of Existing SystemsIncompatibility of Existing Systems
�� Legacy SystemsLegacy Systems
�� New data acquisition systemsNew data acquisition systems�� Observation/field notebookObservation/field notebook�� RealReal--time monitoringtime monitoring�� Tabular field data entry (EDDs)Tabular field data entry (EDDs)�� Electronic field data entry formsElectronic field data entry forms�� Instrumentation/telemetryInstrumentation/telemetry
�� New data transfer protocols (and old devices)New data transfer protocols (and old devices)
�� Data Data ��hostagehostage�� scenarios (proprietary formats)scenarios (proprietary formats)
Geotechnical Data ManagementGeotechnical Data ManagementImpact on Geohazards MitigationImpact on Geohazards Mitigation
Nothing is more damaging to a new truth than an old Nothing is more damaging to a new truth than an old error.error.
──Johann Wolfgang von GoetheJohann Wolfgang von Goethe
If approached correctly, geotechnical data If approached correctly, geotechnical data management can be the cornerstone and foundation management can be the cornerstone and foundation for effective decision support and risk management. for effective decision support and risk management. Strong corollaries exist in the environmental market to Strong corollaries exist in the environmental market to support this approach.support this approach.
�� In 2003, the CADD/GIS Technology Center at the CorpsIn 2003, the CADD/GIS Technology Center at the Corps��Waterways Experiment Station (WES) in Vicksburg, MS Waterways Experiment Station (WES) in Vicksburg, MS funded Center Project #03.005funded Center Project #03.005
�� Objective: Objective: ��Develop an enterpriseDevelop an enterprise--wide geotechnical databasewide geotechnical database��
�� 17 US Army Corps of Engineer Districts were surveyed 17 US Army Corps of Engineer Districts were surveyed to determineto determine
�� the type and extent of geotechnical data of concernthe type and extent of geotechnical data of concern�� existing tools utilized for geotechnical data existing tools utilized for geotechnical data management and analysismanagement and analysis
U.S. Army Corps of Engineers ApproachU.S. Army Corps of Engineers ApproachData StructureData Structure
U.S. Army Corps of Engineers ApproachU.S. Army Corps of Engineers ApproachData StructureData Structure
�� In 2003, the CADD/GIS Technology Center at the CorpsIn 2003, the CADD/GIS Technology Center at the Corps��Waterways Experiment Station (WES) in Vicksburg, MS Waterways Experiment Station (WES) in Vicksburg, MS funded Center Project #03.005funded Center Project #03.005
�� Objective: Objective: ��Develop an enterpriseDevelop an enterprise--wide geotechnical databasewide geotechnical database��
�� 17 US Army Corps of Engineer Districts were surveyed 17 US Army Corps of Engineer Districts were surveyed to determineto determine
�� the type and extent of geotechnical data of concernthe type and extent of geotechnical data of concern�� existing tools utilized for geotechnical data existing tools utilized for geotechnical data management and analysismanagement and analysis
U.S. Army Corps of Engineers ApproachU.S. Army Corps of Engineers ApproachData StructureData Structure
�� In 2003, the CADD/GIS Technology Center at the CorpsIn 2003, the CADD/GIS Technology Center at the Corps��Waterways Experiment Station (WES) in Vicksburg, MS Waterways Experiment Station (WES) in Vicksburg, MS funded Center Project #03.005funded Center Project #03.005
�� Objective: Objective: ��Develop an enterpriseDevelop an enterprise--wide geotechnical databasewide geotechnical database��
�� 17 US Army Corps of Engineer Districts were surveyed 17 US Army Corps of Engineer Districts were surveyed to determineto determine
�� the type and extent of geotechnical data of concernthe type and extent of geotechnical data of concern�� existing tools utilized for geotechnical data existing tools utilized for geotechnical data management and analysismanagement and analysis
U.S. Army Corps of Engineers ApproachU.S. Army Corps of Engineers ApproachData StructureData Structure
As a result of the survey a data structure has been As a result of the survey a data structure has been proposed that encompasses all known geotechnical data proposed that encompasses all known geotechnical data elements currently used within the Corps.elements currently used within the Corps.
�� Geotechnical, Geologic, NonGeotechnical, Geologic, Non--Geotechnical TablesGeotechnical Tables
�� 53 tables, over 600 fields53 tables, over 600 fields
�� Relational structureRelational structure
U.S. Army Corps of Engineers ApproachU.S. Army Corps of Engineers ApproachData StructureData Structure
As a result of the survey a data structure has been As a result of the survey a data structure has been proposed that encompasses all known geotechnical data proposed that encompasses all known geotechnical data elements currently used within the Corps.elements currently used within the Corps.
�� Definition includes fieldDefinition includes field�� namename�� typetype�� length (if applicable)length (if applicable)�� required?required?�� key field?key field?
�� validationvalidation�� descriptiondescription�� aliases, abbreviationsaliases, abbreviations�� exampleexample
U.S. Army Corps of Engineers ApproachU.S. Army Corps of Engineers ApproachData StructureData Structure
Geotechnical TablesGeotechnical TablesStatic material properties, water content, density, Static material properties, water content, density, AtterbergAtterberg, sieve, , sieve, hydrometer, specific gravity, compaction, UU/CU, compression, hydrometer, specific gravity, compaction, UU/CU, compression, direct shear, permeability, sedimentation, elastic modulus, direct shear, permeability, sedimentation, elastic modulus, downhole point (CPT), downhole point (CPT), ��
Geologic TablesGeologic TablesLithology, stratigraphy, sample, sample parameter, drill activitLithology, stratigraphy, sample, sample parameter, drill activity, y, drill parameter, drill parameter, ��
NonNon--Geotechnical TablesGeotechnical TablesProject, location, location parameter, coordinate, well, well Project, location, location parameter, coordinate, well, well construction, water level, water table, company, construction, water level, water table, company, ��
U.S. Army Corps of Engineers ApproachU.S. Army Corps of Engineers ApproachData StructureData Structure
Geotechnical TablesGeotechnical TablesStatic material properties, water content, density, Static material properties, water content, density, AtterbergAtterberg, sieve, , sieve, hydrometer, specific gravity, compaction, UU/CU, compression, hydrometer, specific gravity, compaction, UU/CU, compression, direct shear, permeability, sedimentation, elastic modulus, direct shear, permeability, sedimentation, elastic modulus, downhole point (CPT), downhole point (CPT), ��
Geologic TablesGeologic TablesLithology, stratigraphy, sample, sample parameter, drill activitLithology, stratigraphy, sample, sample parameter, drill activity, y, drill parameter, drill parameter, ��
NonNon--Geotechnical TablesGeotechnical TablesProject, location, location parameter, coordinate, well, well Project, location, location parameter, coordinate, well, well construction, water level, water table, company, construction, water level, water table, company, ��
U.S. Army Corps of Engineers ApproachU.S. Army Corps of Engineers ApproachData StructureData Structure
Geotechnical TablesGeotechnical TablesStatic material properties, water content, density, Static material properties, water content, density, AtterbergAtterberg, sieve, , sieve, hydrometer, specific gravity, compaction, UU/CU, compression, hydrometer, specific gravity, compaction, UU/CU, compression, direct shear, permeability, sedimentation, elastic modulus, direct shear, permeability, sedimentation, elastic modulus, downhole point (CPT), downhole point (CPT), ��
Geologic TablesGeologic TablesLithology, stratigraphy, sample, sample parameter, drill activitLithology, stratigraphy, sample, sample parameter, drill activity, y, drill parameter, drill parameter, ��
NonNon--Geotechnical TablesGeotechnical TablesProject, location, location parameter, coordinate, well, well Project, location, location parameter, coordinate, well, well construction, water level, water table, company, construction, water level, water table, company, ��
U.S. Army Corps of Engineers ApproachU.S. Army Corps of Engineers ApproachData StructureData Structure
Data Structure must be compatible with SDSFIE.Data Structure must be compatible with SDSFIE.
What is SDSFIE?What is SDSFIE?
Spatial Data Standard for Facilities, Infrastructure, and Spatial Data Standard for Facilities, Infrastructure, and Environment (SDSFIE)Environment (SDSFIE)
�� Set of graphic and nonSet of graphic and non--graphic standards for GIS graphic standards for GIS implementationimplementation
�� The only nonThe only non--proprietary data content standard designed proprietary data content standard designed for use with predominant commercial GIS, CADD, and for use with predominant commercial GIS, CADD, and database softwaredatabase software
U.S. Army Corps of Engineers ApproachU.S. Army Corps of Engineers ApproachData StructureData Structure
Data Structure must be compatible with SDSFIE.Data Structure must be compatible with SDSFIE.
What is SDSFIE?What is SDSFIE?
Spatial Data Standard for Facilities, Infrastructure, and Spatial Data Standard for Facilities, Infrastructure, and Environment (SDSFIE)Environment (SDSFIE)
�� Set of graphic and nonSet of graphic and non--graphic standards for GIS graphic standards for GIS implementationimplementation
�� The only nonThe only non--proprietary data content standard designed proprietary data content standard designed for use with predominant commercial GIS, CADD, and for use with predominant commercial GIS, CADD, and database softwaredatabase software
U.S. Army Corps of Engineers ApproachU.S. Army Corps of Engineers ApproachData StructureData Structure
Data Structure must be compatible with SDSFIE.Data Structure must be compatible with SDSFIE.
What is SDSFIE?What is SDSFIE?
Spatial Data Standard for Facilities, Infrastructure, and Spatial Data Standard for Facilities, Infrastructure, and Environment (SDSFIE)Environment (SDSFIE)
�� Set of graphic and nonSet of graphic and non--graphic standards for GIS graphic standards for GIS implementationimplementation
�� The only nonThe only non--proprietary data content standard designed proprietary data content standard designed for use with predominant commercial GIS, CADD, and for use with predominant commercial GIS, CADD, and database softwaredatabase software
U.S. Army Corps of Engineers ApproachU.S. Army Corps of Engineers ApproachData StructureData Structure
Spatial Data Standard for Facilities, Infrastructure, and Spatial Data Standard for Facilities, Infrastructure, and Environment (SDSFIE)Environment (SDSFIE)
�� Standard for GIS implementation throughout the Standard for GIS implementation throughout the Department of DefenseDepartment of Defense
�� de facto standard for GIS implementation in many de facto standard for GIS implementation in many federal, state, and local agencies; public utilities; and federal, state, and local agencies; public utilities; and private industryprivate industry
HoweverHowever��
U.S. Army Corps of Engineers ApproachU.S. Army Corps of Engineers ApproachData StructureData Structure
Spatial Data Standard for Facilities, Infrastructure, and Spatial Data Standard for Facilities, Infrastructure, and Environment (SDSFIE)Environment (SDSFIE)
�� Standard for GIS implementation throughout the Standard for GIS implementation throughout the Department of DefenseDepartment of Defense
�� de facto standard for GIS implementation in many de facto standard for GIS implementation in many federal, state, and local agencies; public utilities; and federal, state, and local agencies; public utilities; and private industryprivate industry
HoweverHowever��
U.S. Army Corps of Engineers ApproachU.S. Army Corps of Engineers ApproachData StructureData Structure
Spatial Data Standard for Facilities, Infrastructure, and Spatial Data Standard for Facilities, Infrastructure, and Environment (SDSFIE)Environment (SDSFIE)
��while the SDSFIE is great with 2D features, and above while the SDSFIE is great with 2D features, and above ground, it is lacking in support of 3D subsurface features. ground, it is lacking in support of 3D subsurface features. It can well handle commissariesIt can well handle commissaries��
��but not but not consolidation consolidation
tests.tests.
U.S. Army Corps of Engineers ApproachU.S. Army Corps of Engineers ApproachData StructureData Structure
Spatial Data Standard for Facilities, Infrastructure, and Spatial Data Standard for Facilities, Infrastructure, and Environment (SDSFIE)Environment (SDSFIE)
The geotechnical attributes and domain tables defined in The geotechnical attributes and domain tables defined in the data structure will be added to the next version of the data structure will be added to the next version of SDSFIE.SDSFIE.
U.S. Army Corps of Engineers ApproachU.S. Army Corps of Engineers ApproachData StructureData Structure
Ultimate goal of Center Project #03.005 is to produce an Ultimate goal of Center Project #03.005 is to produce an enterprise Geotechnical Data Management Systementerprise Geotechnical Data Management System
�� Easy to enter, edit, retrieve subsurface/laboratory dataEasy to enter, edit, retrieve subsurface/laboratory data
�� Interface with GIS, engineering design applicationsInterface with GIS, engineering design applications
�� Support production of boring logs for contract documentsSupport production of boring logs for contract documents
U.S. Army Corps of Engineers ApproachU.S. Army Corps of Engineers ApproachData StructureData Structure
Ultimate goal of Center Project #03.005 is to produce an Ultimate goal of Center Project #03.005 is to produce an enterprise Geotechnical Data Management Systementerprise Geotechnical Data Management System
�� Anticipated implementation:Anticipated implementation:�� ArmyArmy 80 installations80 installations�� Army CorpsArmy Corps 41 District offices41 District offices�� NavyNavy 110 installations110 installations�� Air ForceAir Force 110 installations110 installations�� Other Federal agenciesOther Federal agencies 2929
The proposed system includes not only support for field The proposed system includes not only support for field and laboratory rock and soils data, but also:and laboratory rock and soils data, but also:
�� Geohazard InventoriesGeohazard Inventories�� Document ManagementDocument Management�� Research & PlanningResearch & Planning�� Instrumentation & MonitoringInstrumentation & Monitoring�� Archived Data and DocumentsArchived Data and Documents�� Emergency ResponseEmergency Response�� ConstructionConstruction�� StructuresStructures�� Highway Maintenance Highway Maintenance
Proposed SystemProposed SystemScopeScope
Proposed SystemProposed SystemData Entry and ImportingData Entry and Importing
Data Entry Forms Data Entry Forms
Enter data in a familiar format
Proposed SystemProposed SystemData Entry and ImportingData Entry and Importing
Let the DEF automatically generate EDD
formats
Proposed SystemProposed SystemData Entry and ImportingData Entry and Importing
Electronic DataElectronic DataDeliverableDeliverable(EDD) Checking(EDD) Checking
.Net, XML C# codeOffline EDD Preparation and CheckingOffers Private Checking mechanism Supports many EDDsUsed by more than 100 laboratories
.Net, XML C# codeOnline EDD Web-enabledReceipt and Checking, Automated WorkflowSharePoint Doc Mgmt Interfaces
StandaloneEDP
Enterprise EDP EQuIS
Enterprise
EDD Submission
Valid Values, Format Definitions Downloaded from EQuIS
Checkers use same code—closed loop transaction!
EDP Data FlowEDP Data Flow
EQuISEnterpriseData Mgmt
SharePointDocument
Mgmt
EDD Reports�Failure Reports and Error Logs
�Acceptance Reports
�Analysis Reports
�Decision Support Reports
�3rd Party Graphics
�DQM Reports
Doc mgmt provides:
Version Controls
File Mgmt
Edit Mgmt
Keyword Searches
EDP Feedback LoopEDP Feedback Loop
Proposed SystemProposed SystemData Entry and ImportingData Entry and Importing
Integration/Import from gINT Databases Integration/Import from gINT Databases
GeotechnicalData
ManagementSystem
Proposed SystemProposed SystemData Entry and ImportingData Entry and Importing
ArcPadArcPad integration with handheld device for incorporation integration with handheld device for incorporation of GPS data of GPS data
Proposed SystemProposed SystemDocument ManagementDocument Management
Integration with Falcon/DMS Integration with Falcon/DMS
Proposed SystemProposed SystemGeotechnical Reports/GraphicsGeotechnical Reports/Graphics
IntegrationIntegrationwith gINT:with gINT:Borehole Log Borehole Log
Proposed SystemProposed SystemGISGIS
�� Open GIS Consortium (OGC) CompliantOpen GIS Consortium (OGC) Compliant�� Support Dynamic Linear SegmentationSupport Dynamic Linear Segmentation�� Both thinBoth thin--client (i.e. client (i.e. ArcIMSArcIMS) and thick) and thick--client (i.e. client (i.e. ArcGISArcGIS) solutions) solutions�� Conventionally, GIS is used as an analysis tool. Conventionally, GIS is used as an analysis tool. Solution uses GIS as a user interface:Solution uses GIS as a user interface:
�� data selectiondata selection�� postingposting�� viewingviewing�� integration with other modeling and analysis toolsintegration with other modeling and analysis tools
Proposed SystemProposed System““PushPush”” Automated ReportingAutomated Reporting
�� Reports (or graphs, or logs) delivered automaticallyReports (or graphs, or logs) delivered automatically
�� May be eventMay be event--driven, i.e.driven, i.e.��a new borehole has been entered into the databasea new borehole has been entered into the database��
OrOr
�� May be scheduled, i.e.May be scheduled, i.e.��every Friday at 1 p.m. give me a report of all drilling every Friday at 1 p.m. give me a report of all drilling activity for that weekactivity for that week��
Proposed SystemProposed System““PushPush”” Automated ReportingAutomated Reporting
1. Report 1. Report scheduledscheduled
2. Report 2. Report generated generated when condition when condition is metis met
EQuIS Integrated OutputEQuIS Integrated Output
Data must be Data must be integrated into its integrated into its geophysical, geophysical, environmental, environmental, and cultural and cultural context for many context for many analyses leading analyses leading to decisionto decision--making. This is making. This is achieved at a high achieved at a high level through the level through the EQuIS for ArcGIS EQuIS for ArcGIS interface.interface.
Benefits of CollaborationBenefits of Collaboration
This project may benefit by collaboration and cooperation This project may benefit by collaboration and cooperation of several agencies and companies.of several agencies and companies.
�� Consistent with national initiative to support information Consistent with national initiative to support information and technology transferand technology transfer
�� Requires the establishment of electronic standards for Requires the establishment of electronic standards for geotechnical data (soil, rock and water)geotechnical data (soil, rock and water)
�� Provides the foundation for data sharing in similar Provides the foundation for data sharing in similar geologic regionsgeologic regions
Benefits of CollaborationBenefits of Collaboration
This project may benefit by collaboration and cooperation This project may benefit by collaboration and cooperation of several agencies and companies.of several agencies and companies.
�� Lessens the significance of political boundaries Lessens the significance of political boundaries
�� Improves cooperation between state agencies and Improves cooperation between state agencies and between state agencies and federal oversight agenciesbetween state agencies and federal oversight agencies
�� Reduces cost and delay associated with change ordersReduces cost and delay associated with change orders
�� Reduces costs associated with project designReduces costs associated with project design
�� Overall improved decisionOverall improved decision--support to mitigate geohazardssupport to mitigate geohazards
ConclusionConclusion
The described collaborative approach, The described collaborative approach, innovative, marketinnovative, market--leading, proven base leading, proven base technology and combined experience will technology and combined experience will
provide the foundation for effective provide the foundation for effective geotechnical decision support, leading to geotechnical decision support, leading to
improved geohazard mitigation.improved geohazard mitigation.
ConclusionConclusion
The Geotechnical Data Management The Geotechnical Data Management System described is the anticipated course System described is the anticipated course
of action for the Ohio DOT.of action for the Ohio DOT.
Questions?Questions?
Thank You!Thank You!