Date post: | 18-Dec-2015 |
Category: |
Documents |
View: | 213 times |
Download: | 0 times |
International Data Acquisition for Disaster Prevention and Data Access
Technology
Hyunseung ChooSungkyunkwan University
http://[email protected]
■ Introduction
■ Earth System weather prediction, earthquakes, and environments
■ From Networking to Grid Computing ET over Grid
■ The Proposal Importance Current status Proposed approach Final goals Members and organizations
■ Conclusion
Contents
■ Observations■ Data Collection■ Data Analysis■ Weather Forecasting
Technology for the Weather Forecasting
Global Infrastructure for Earth System
Nature
■ Exponential Growth of Network Technology
Network vs. Computer Performance Computer speed doubles every 18 months Network speed doubles every 9 months Difference = order of magnitude per 5 years
1986 to 2000 Computers: x 500 Networks: x 340,000
2001 to 2010 Computers: x 60 Networks: x 4000
From Networking to Grid Computing (1/2)
■ Definition of GRID Research infrastructure for dynamic collecting and sharing research resources connected by high-speed networks
GRID
Problem solving Experts
Scientific Research Instrument
Large Scale Data
Supercomputer
From Networking to Grid Computing (2/2)
Grid Based Resource Integration
■ Challenge to huge problems that require massive capability over limited resources at multiple sites Grid Computing
Networking of locally distributed high performance (HP) resources HP computers, storages, experimental facilities, etc. IT infrastructure to group systems as a single system Classified into Access Grid, Computational Grid and Data Grid
■ Core applications based on Grid “IT + Application” : Environment Technology (ET), Bio Technology (BT), Nano Technology (NT), Space Technology (ST), Cultural Technology (CT), etc.
■ Investigated HPCN since late 1980 in US, JP, EU Concentrate to Grid Technology since 2000
Pan-Korean Distributed HPC Resources
Daejeon
Kwangju Pusan
Chuncheon
Incheon
Suwon
ChonanChongju
Jeonju
Chang-won
Ulsan
Pohang
Seoul
Daegu
Cheju
• Computers
• Supercomputers• Experimental Facilities
• High Speed Networks
• Databases• Mass Storage
• Visualization
Environment
• Access Grid System
Importance of R&D Project
■KOREN based distributed Grid Computing environments Overcome limitations of the meteorology area through Grid
Limitations on computing, networking and data storing Solve earlier problems based on disaster prevention data Data format for providers ⇒ Data format for consumers Offer common collaborative environments to weather experts Substitute clusters for supercomputers
■Disaster prevention system by forecasting natural disasters RT data transmission, high-speed producing and processing Parallel technology for numerical models on natural disasters
Low-cost RT disaster prediction Severe weather prediction, environments, East Sea earthquake tsunami (a ti
dal wave) Currently depend on GTS in the Japan Meteorological Administration
Final Goals on R&D Project
■ KOREN based Grid system for international disaster prevention
■ KOREN/APII based international joint production of disaster related prevention data■ development of high speed data access and process system model■ parallelization of current SWs and sharing international disaster prevention resources
KMA SKKUSWU PKNU
UCLA(US)
Nagoya U.(JP)
NIED(JP)
Key Elements on R&D Project
■Current year Sharing data for weather prediction with Japan (APII, Nagoya
Univ.) Sharing East Sea seismological information (National Research
Institute for Earth Science and Disaster Prevention of Japan) Numerical models for disaster preventions in Grid environments Access Grid for multicasting based on KOREN
■Current year + 1 Sharing and verifying weather data (UCLA) RT transmission of disaster prevention data Development of applications for disaster preventions (MPICH-
G2)
■Current year + 2 Use of Data Grid for massive data transmission Use of international core technology for disaster preventions
(KOREN, APII)
Data for Disaster Preventions
■ International data collection for weather prediction, climates, earthquakes and environments for disaster predictions RT and distributed collection of weather prediction, climates, earthquakes a
nd environments over the entire earth Access Grid
Collaborating organizations for international data sharing Based on APII-testbed
■Disaster prediction modeling based on the data collection RT locating/allocating distributed computational resources
Computational Grid Data acquisition for analyzing and forecasting global weather prediction
■RT delivery systems for disaster predictions information KOREN + Grid technology => constructing IT infrastructure
Members and Organizations
Collaborative working environmentfor producing disaster prevention data
(PKNU(KR), Nagoya Univ.(JP))
Production of data for weather predictionby using Grid
(PKNU(KR), UCLA(US))
Seismological observation networkbetween Korea and Japan
(KMA(KR), NIED(JP))
KORENAPII-Testbed
Communication infrastructure for disaster prevention(SKKU(KR), SWU(KR))
• Protocols for monitoring seismic activity• Virtual collaboration environment
KOREN & APII-Testbed Based Virtual Collaboration Environment For Disaster Preventions
Approaches (2003)
PKNU(KR)
UCLA(US)
Nagoya Univ.(JP)
NIED(JP)
KMA(KR)
SKKU(KR)
SWU(KR)
RT data exchangefor weather prediction
Analysis & sharing of massive seismological & meteorological data
Policies for sharingdata among parties
- Data authorization- International cooperation- Collecting individual opinions
Production of data forsevere weather prediction
based on AG
Access Grid (AG)
-AG environments throughout six parties-Securing AG technique for KOREN
Access G
rid
Dem
o1 s
t R
ep
ort
Weekly
Sem
inar
Invit
ed
Talk
s
2nd Year
KOREN/APII-Testbed BasedVirtual Collaboration Environments
Approaches (2004-2005)
KOREN, APII-Testbed based data production for international environments, earthquakes and severe weather prediction,
distributed data access techniques and its applications
Combining AG + MPICH-G2 + DG Constructing IT Infrastructure
Inte
rnati
on
al C
on
fere
nce
Fin
al R
ep
ort
s
Resu
lts f
rom
2004
Weekly
Sem
inar
Invit
ed
Talk
s
KOREN, APII-Testbed basedinternational environments, earthquake
and severe weather prediction data
MPICH-G2-Applications in Grid environments
AG based environments, earthquake and severe weather prediction data
Data Grid (DG)
-Integrated management-Management of distributed data
Inte
rnati
on
al C
on
fere
nce
2 nd
Rep
ort
s
Resu
lts f
rom
2003
Weekly
Sem
inar
Invit
ed
Talk
s
PKNU(KR)
UCLA(US)
NagoyaUniv.(JP)
NIED(JP)
KMA(KR)
SKKU(KR)
SWU(KR)
From 1st Year
Current year +1
Current year +2
Research Goal (2003)
■ Access Grid connecting KMA, SKKU, SWU and PKNU by KOREN
■ Seismological observation network between Korea and Japan by APII-testbed Extended TCP/UDP protocols for high-speed communications
■ Data production line for disaster preventions based on MPICH-G2/GQ
■ Problem detections and solutions on operations for collaborative working environment based on KOREN/APII-testbed
■ Proceeding to the next year Tuning among participating organizations
Example: Organization for Access Grid
Example: Applications in Access Grid
■ Establishment of collaborative working environments among parties including universities, laboratories and offices
Restrictions in R&D Project
■ Lack of techniques to establish efficient collaborative working environments Sharing computational resources through high
speed networkssupercomputers, cluster systems, massive storages
Policies through the tuning of management strategies
■ Lack of human resources in Grid environments Need re-education programs Invited talks and international technical forums
Improving National Security by establishing international networks for disaster preventions
Radical pervasive effect through a technology transfer
Create applications using KOREN and APII-testbed
→ Unification Effect on various areas
Applications and Effects
“ET over IT”Construction of co-work environments
based on KOREN and APII-testbed
“α over IT”
Conclusion
■ Production and practical use of data for disaster preventions in temporally and spatially distributed computing environments combining KOREN with Grid computing technology
■ Raising human resources for Grid technology Producing detailed user guide books/manuals and
sharing knowledge through them
■ The synergy effect caused by clustering supercomputers through KOREN
■ Efficient use of world best IT infrastructure