NAVOCEANO & NVODS
10 Sep 2003
James Rigney
NAVOCEANO/NVODS History
NAVOCEANO engaged in NOPP process to establish NVODS Listed as a partner on the winning proposal from URI
Conducted NVODS workshop at SSC in late Oct 2000. At that time committed to host a server.
Established an NVODS regional server at NAVO in late 2000, early 2001.
Original holdings were DBDB and GDEM. Used DODS/LAS, the community protocols for NVODS. “If you build it they will come” – didn’t work. Never
received a single data set from the Gulf community to host on our server.
NAVOCEANO Data Access Server Status - as of 04/09/2001
Data or Program DODS LASNAVOCEANO Public Data Access Server Yes YesNAVOCEANO MEL Server (SUN E450) No NoDBDBV – (Available via NAVO WWW server) No NoDBDB-5 – (Selected Areas) Yes YesWAM* Yes NoMCSST* Yes NoSelected Data form NGLI – (Available via NAVOWWW server)
No No
* Note: WAM and MCSST Netcdf format is currently being modified for LAS compatibility.
NAVOCEANO Data/Product Dissemination
NAVO has a robust Data/Products Dissemination segment. NVODS server is just one part.
Open DataAccess
Open DataAccess
Non-WebProduct
Distribution
Non-WebProduct
DistributionWeb
Products
WebProducts
DODS TEDSDPSLASMELNGLISMWVMVL FTPWIPE
DWH
DBDBV GDEMV
Open Data Access Segment Concept of Operations
• NAVOCEANO White Front Door– Support NAVOCEANO vision to provide oceanographic
expertise to the military and civil community
• Support Operational DOD requirements, and a broad range of Educational/ Research Customers
• Provide a site for access to open access of Meteorology and Oceanography (METOC) products, information, and data.
Open Data Access Segment
• Distributed Oceanographic Data System (DODS) / Open source Project for a Network Data Access Protocol (OPeNDAP)
• Live Access Server (LAS)• Master Environmental Library (MEL)• Northern Gulf of Mexico Littoral Initiative
(NGLI)• Data WareHouse
IndustryK-12
UniversitiesGovernment Agencies
Individuals
WAMGDEMMCSSTNLOMSWAFSMODASCOAMP
NGLIOTISDWH
DBDB-V
DODS/LAS(Sun E450)
DWH(Windows 2000)
MEL(Sun E450)
NGLI(Sun Server)
NAVOCEANO Open Data AccessCustomersData Source Data Servers
Live Access Server
• LAS provides a query and visualization capability for a DODS server.
• LAS enables the Web user to request data subsets in a choice of file formats .
• Hosted on Sun E450 server.
• 2,908 Data Objects/Files Currently Stored on System.
Distributed Oceanographic Data System
• DODS is software that simplifies all aspects of remote data access.
• DODS enables existing software to access remote data transparently.
• Hosted on Sun E450
• WAM, DBDB-V, MCSST, SWAFS, NLOM, GDEM Data
• 3,487 Data Files Containing 37 GB Data
Customer
FTP TransferFrom Remote
Source
NAVO HPC Server
NAVO HPC Storage Silo
N-ODA Disk Storage Resource
NAVOCEANO N-ODA Server
NAVO FTP Server
InternalNAVOCEANO
Data Load
Open Data Access Data Flow
Master Environmental Library
• MEL is a DMSO sponsored, one-stop site for ordering environmental information.
• MEL, users can locate and order environmental information that resides on U.S. military and government sites.
• Data sent to FTP address or picked up at data source.
• Hosted on Sun E450 server.
Open Data Access Product StatusSep 2003
Data or Program DODS LASNAVOCEANO Public Data Access Server Yes YesNAVOCEANO MEL Server No NoDBDBV – (Available via NAVO WWW server) No NoDBDB-5 – (Selected Areas) Yes YesGDEM Yes YesMCSST Yes YesNLOM Yes YesSWAFS Yes YesWAM Yes Yes
METOC Data Standards• The Data Warehouse Catalog physically
implements the metadata requirements contained by the Federal Geographic Data Committee (FGDC) Metadata Content Standard
• The NAVOCEANO Logical Data Model is consistent with the Joint Meteorology and Oceanography Conceptual Data Model (JMCDM)
• On-going data standardization efforts include:– NetCDF– Environmental Data Coding Standard (EDCS)– eXtensible Markup Language (XML)
METOC Data Standards• Cooperative Ocean/Atmosphere Research Data Service (COARDS)
Conventions for the Standardization of NetCDF Files
• NetCDF (Network Common Data Form) is an interface for scientific data access which implements a machine-independent, self-describing, extendible file format. NetCDF was originally developed by Unidata for the storage and exchange of data within the space and earth science communities. It is based on the earlier work on the Common Data Form (CDF). NetCDF software uses the concept of an abstract data type, via a defined set of C library functions. Internal data representations can be changed without affecting the user program.
• The Cooperative Ocean/Atmosphere Research Data Service (COARDS), a NOAA/university cooperative for the sharing and distribution of global atmospheric and oceanographic research data sets, has written a summary of conventions for the standardization of netCDF file headers to provide for greater interoperability.
Open Data Access Server Statistics
1
10
100
1000
10000
100000D
ata
Pag
es
mil 29371 3511 1163 431 1186 35662
navy.mil 29352 3490 1178 430 1304 35754
navo.navy.mil 29346 3470 1172 426 1289 35703
edu 138 169 22 16 57 402
com 23050 1434 802 204 673 26163
.gov 52 813 14 1 6 886
.net 55029 159 74 22 96 55380
WAM MCSST SWAFS NLOM DBDBV Total
Open Data Access Server Statistics
Month UniqueVisitors
Pages Volume Domains Countries .EDUIPs
.MILIPs
NAVY.MIL
.GOVIPs
September '02 1211 159597 564 MB 343 36 75 122 98 31October ‘02 1338 177562 539 MB 399 38 81 122 83 29
November ‘02 1300 88129 287 MB 403 43 62 117 87 27December ‘02 1381 201890 287 MB 392 43 52 144 107 28
January ‘03 1532 81307 289 MB 445 49 68 147 100 35February ‘03 1226 67862 223 MB 380 45 64 135 96 28
March ‘03 1415 107100 1.38 GB 404 43 74 137 100 33April ‘03 1428 87995 279 MB 424 43 98 103 67 20May ‘03 1415 94000 232 MB 411 45 66 129 97 31
June ‘03 1244 89585 379 MB 365 34 100 228 178 58July ‘03 1818 123957 442 MB 500 42 93 142 104 34
August ‘03 1652 143398 336 MB 462 42 61 130 96 28
Note: Bandwidth used for DODS data access is not included in data volume for each month.
NIPRNET - TOP TEN PRODUCTSFY02 (1 Oct 01 - 17 Apr 02)
TOTAL PRODUCT HITS - 3,196,898
• WAM (2,530,073)• OFA (240,890• K10 MCSST (127,763)• DATA MODEL (61,807)• SWAFS (52,437)• PDOM (43,336)• WAVE MODEL (28,067)• SAT VISIBILITY (20,198)• STWAVE (19,610)• WEEKLY MCSST (18,708)• ALL OTHER (54,009)
WAM OFA
K10 MCSST DATA MODEL
SWAFS PDOM
WAVE MODEL SAT VISIBILITY
STWAVE WEEKLY MCSST
ALL OTHER
Task Force Web*
• In April 2001, the Chief of Naval Operations chartered TFW to lead the Navy’s transformation to a web-enabled environment by:– Establishing and maintaining a web architecture.– Providing recommendations on Web Enablement
technologies.– Reviewing Operational Requirements for Web Enablement
opportunities.– Working with major the Navy’s major System Commands to
prioritize and migrate existing systems.
*From: “Web Enabled Navy”, CAPT Skip Hiser, NMCI Industry Sympsiumhttp://www.nmci.navy.mil/Secondary_Areas/Industry_Info/SymposiumDailyNews/Files/Briefings/Tuesday/breakout/TFWebHiser2.ppt
WEN Benefits*• More ubiquitous access to information services• Improved interoperability
– Extensive use of recognized commercial standards – Separation of data from presentation enables support for
multiple display devices
• Improved quality of information– Establish authoritative databases supporting similar services
across multiple locations– Provides ability to aggregate data from multiple sources
• Reduced Total Costs– Software support & hardware costs reduced– Configuration management simplified
*From: “Web Enabled Navy”, CAPT Skip Hiser, NMCI Industry Sympsiumhttp://www.nmci.navy.mil/Secondary_Areas/Industry_Info/SymposiumDailyNews/Files/Briefings/Tuesday/breakout/TFWebHiser2.ppt
Network Centric Warfare Is the Theory.
Net-centric Operations Is the Concept.
FORCEnet Is the Process of Making the Theory and Concept a Reality.
“FORCEnet is the operational construct and architectural framework for Naval Warfare in the Information Age which
integrates Warriors, sensors, networks, command and control, platforms and
weapons into a networked, distributed combat force, scalable across the
spectrum of conflict from seabed to space and sea to land.”*
*CNO’s Strategic Study Group - XXI definition from 22 July 02 CNO Briefing
• FORCEnet Is Not – A Program of Record– A Redundant Effort– A Box or System– Just a Network
What Is FORCEnet?
From: SPAWAR brief by Mr. Leonard Coppenrath
Warfighting in the 21st Century
J O CJ IC
U U V
G P S
S A T C O M
D S PN A T IO N A L
S E N S O R
C S G
E S GS O F
C o n t r o l
E n g a g e
T r a c k ( p r e c is e p o s i t io n a n d t im e )
E n r o u t e G u id a n c e
G P S G u id a n c e
T e r m in a l G u id a n c e
F O R C E n e t2 5 A p r i l 2 0 0 3
D R A F T
L in k 4 /1 1 /1 6 /2 2C E C /V o ic e /D a t a
L in k 4 /1 1 /1 6 /2 2V o ic e /D a t a
C O M M U N IC A T IN G
S E N S I N G
CND
C N DM A G T F
M P F ( F )
I n t r a - T h e a t e r N e t w o r k s
L o c a l P la t f o r mN e t w o r k s
J o in t S e n s o r s
S p a c e S e g m e n tN e t w o r k s
B r o a d c a s t
T a c t ic a l S e n s o r s
C o m m a n d & C o n t r o l
C A S
T a r g e t in g
M in e R e c o n n a i s s a n c e
O u t b o a r dS e n s o r
L in k 1 6 /E P L R SV o ic e /D a t a
T h e a t e r S e n s o r s
D IS N
J F A C C
J F M C C
M in eH u n t in g -
U n d e r W a t e rR e c o n n a i s s a n c e
M C M
A c o u s t icS e a r c h
2 5 A p r i l 2 0 0 3
D R A F T
C O M M U N IC A T IN G
S E N S IN G
A T T A C K IN G
B R O A D C A S T
N O C
T e le p o r t in g
• Exploit Every Source – Leverage What We Have
• Provide Shared Situation Awareness/ Understanding
• Support Dominant Speed of Command
• Permit Precise, Synchronized Execution
• Allow Agility and Flexibility
Dynamic Force CompositionDynamic Force Composition
From: SPAWAR brief by Mr. Leonard Coppenrath
Distributed Services Provides Composeable Capabilities
Transform Warfighting Operations• Composing Capabilities - “Assemble Components on the Fly”• Joint - Agile - Tailorable• Geospatial –Based Shared Awareness and Collaboration• Intuitive Linkage to Information
Transform the Acquisition Process• Sea Enterprise:
- Collaborative Development- Re-usable Components - Spiral Development
• Legacy System Interoperability
• Sea Trial
“Composeable”Joint Organizations
“Composeable”Tactics & Doctrine
“Composeable” Capabilities
Services Services Services Services
STOM
JMF
EnduringFreedom
IraqiFreedom
HomelandDefense
From: SPAWAR brief by Mr. Leonard Coppenrath
Push to a Common Environment
CDL IP TDL
ISR C2
ISRJC2DJC2DCGSNCES
Clients
B2B
Distributed Services
C2 CombatSystems
B2B
B2
C
B2
C
B2
C
B2
C
C2C C2C C2C
GiG JTRS TCIntegrated Networks & CommunicationsGIG-BE
Key Enablers•XML•IP•E2E Information Assurance
B2B = Business to BusinessB2C = Business to ConsumerC2C = Consumer to Consumer(enabling publish/subscribe solutions)
Fn TargetAs - Is
Consumers
Servers Combat Systems
Security Security
Stovepipe Communications
Security
Joint Building Blocks
From: SPAWAR brief by Mr. Leonard Coppenrath
Born Joint and Built on Distributed Services
Distributed Services
C2 Functions
Combat Systems
Functions
ISR Functions
DJC2 – Distributed Joint C2GIG ES – Global Information Grid Enterprise ServicesNCES – Network-Centric Enterprise ServicesNCCT – Network-Centric Collaborative TargetingOA – Open ArchitectureXTCF – eXtensible Tactical C4I Framework From: SPAWAR brief by Mr. Leonard Coppenrath
Web Services; Navy Interoperability• TFW/WEN Architecture
Coordination with Big Navy. We have a Web Services Working Group that is building our
long range WS plans. If NVODS/NOPP wants to play in WS, we will engage If NVODS/NOPP wants to fund WS development, we’re very
interested. DODS/LAS is the closest thing we have to “web services” for
our data. Not the way to go long term – or is it??? We have to go all the way with web services Required by Navy Enterprise Portal policy and FORCEnet. Key to our interest in NVODS in the future
Other misc
• NAVY/NOAA MOA– Defines collaboration btwn NAVOCEANO
and NCDDC– So far: Hosting NGLI assets
• SIS - GIS SW