JMA's Status Report related to WIS
Tatsuya Noyori
JMA
ET-WISC 2-5 February 2010
Contents
WIS VPN Pilot Project in RAs II and V Metadata and Catalog Blog software and related technologies
Internet VPN
Internet VPN
JMA Test SystemJMA Test System
WIS VPN Pilot Project in RAs II WIS VPN Pilot Project in RAs II and Vand V
Internet
JMA Operational SystemJMA Operational System
RTH Tokyo
Met. Sat. Center
Supercomputer System for NWP
RSMCData SV.
VPN
Cloud-I
VPN Pilot Proj.
DMZ
MPLS (OBS)
Frame Relay (BT)
Etc.DDB SV.
Cloud-II(RMDCN)
CMA
BoM
Other PPParticipants
100Mbps(Best effort)
NAS
• Main purpose is to evaluate the availability of VPN
• 17 participants in total• Themes in Advanced Phase
1. NC Application (SATAID)2. Data input support
CMA has implemented Web Input and BUFR Encoding
JMA is evaluating them
Metadata and Catalog
Metadata and Catalog
Design of Catalog/Metadata
What human interface do we need for catalog and metadata?
What element do we need in metadata?
Let’s learn best practice from existing website.
Example: WDCGGJMA World Data Centre for Greenhouse Gases
http://gaw.kishou.go.jp/cgi-bin/wdcgg/catalogue.cgi
Catalog search, Form Search, Map search
WDC (Greenhouse Gasses) There are a lot of domain-specific elements
as metadata, such as parameter and contributor and etc.
The domain-specific elements are used as search key for search functions. Therefore, the use of domain-specific elements are important to search metadata effectively.
Design of Catalog/Metadata
learned lesson Usefulness of multiple search interfaces Usefulness of domain-specific search terms and i
nterface(e.g. "parameter", "station type" in WDCGG)
Do you think we need VolA/VolC-specific features?
Website of Metadata of VolA/VolC
http://www.shiken.kishou.go.jp/roller/tokyometadata/
Catalog search, Map search
Metadata for bulk data like GRIBs
Metadata for bulk data like GRIBs
http://www.ecmwf.int/products/additional/gts_headers_dcpc_essential.html
Website of Metadata of Volume C and A
The way of writing a file name list of a group in a page enable users to understand the relationship between the files of the group.
Therefore, writing a file name list of a group in a page is important.
Website of Metadata of VolA/VolC
http://www.shiken.kishou.go.jp/roller/tokyometadata/http://akira.inmet.gov.br/roller/brasilmetadata/
Feed Aggregator: http://en.wikipedia.org/wiki/Aggregator
Suggestion for Metadata
Atom is one of metadata. KML is also one of metadata. If WMO adopts KML and Atom as one of the
metadata, we could easily build the website that I have shown.
So, I would like to suggest that WMO adopts KML and Atom as metadata.
Website using ISO19139 Metadata
http://server.shiken.kishou.go.jp/testwar/search.jsp
70,000 metadata that are created per each static data files have been stored.
Full-text search, bounding box search, time range search
Website using ISO19139 Metadata
ISO19139 does not permit domain-specific elements and tabular listing.
So, I am not sure how I can use ISO19139 effectively.
But I will keep studying how we can built useful website on ISO19139.
Blog software and related technologies
Blog software and related technologies
Blog software and related technologies
Japan has been investigating blog software and related technologies in cooperation with Brazil and China, since 2008.
I have investigated Notification of priority messages using blog
post File synchronization like podcast
Customization of blog software for test
The blog software has been customized to reply minimized Atom feeds.
The customized blog software has been used for the investigation.
Test Results
Notification of priority messages
It was confirmed that the notification of test tsunami warnings generated on a routine schedule was completed within 20 seconds.
Test Results
File synchronization
The maximum transfer rate was 9Mbps. Messages (SYNOP, SHIP, BUOY, TEMP, TEMP
SHIP and PILOT) generated on a routine basis were synchronized within 60 seconds.
A product of numerical weather prediction (The total size is 70Mbytes, the number of files is 9116) was synchronized within 150 seconds.
A large file of 100Mbytes was synchronized within 150 seconds.
Conclusion
desirable usage scenes
Data providers provide users with data on a near-real-time basis over the Internet.
Data providers provide users with data at intervals over the Internet.
Data providers receive a priority message from the GTS, and then post the priority message to their blog server on the Internet
Suggestion
I would like to suggest using blog technologies in WIS Part B (the Internet)
Suggestion
Timely delivery service can also be implemented by “pull” mechanism using the file synchronization of blog technologies. Therefore, I would like to suggest that the sentence of WIS fundamental services is revised like ”Push or Pull”.
Other test I have done
Atom+KML metadata synchronization
http://www.shiken.kishou.go.jp/roller/tokyometadata/
http://akira.inmet.gov.br/roller/brasilmetadata/
Other test I have done
Decoded Data (HTML 5 Microdata) synchronization
http://www.shiken.kishou.go.jp/roller/tokyomicrodata/
http://akira.inmet.gov.br/roller/brasilmicrodata/
Future Plan
Investigate PubSubHubbub protocol conduct experiment of scalability