ChinaGrid: National Education and ChinaGrid: National Education and Research InfrastructureResearch Infrastructure
Hai JinHai JinHuazhong University of Science and TechnologyHuazhong University of Science and Technology
[email protected]@hust.edu.cn
22
33
Huazhong University of Science and Technology, located in the central of China, was founded in 1953, and ranks the TOP 10 universities in China.
44
ChinaGrid in a Nutshell• China Education and Research Grid
• Funded by Ministry of Education
• As the pilot grid application supported by China National Grid (CNGrid)
• Based on CERNET (China Education and Research Network)
• First PhaseFrom 2003-200512 key universities as initiative20 key universities now
55
About CERNET• Second largest IP backboned network in China
36 PoPs cover all the province capitalsThe network backbone is 2.5-10Gbps DWDM
• Cover more than 1,500 universities/colleges in about 200 cities
About 20 million usersMany universities have their own campus network in China
66
Network Infrastructure of ChinaGrid CERNET-1
77
88
ChinaGrid (The First Phase)
99
ChinaGrid (till now)
1010
ChinaGrid Mission
• Campus grid platform
•Common platform for ChinaGrid
•Grid application platform and representative grid applications
Image processing grid Bioinformatics grid Course on-line grid Computational fluid dynamic gridLarge scale information processing grid
1111
Architecture of ChinaGrid
1212
Campus Grids and their Computing Power and Storage Capacity
• HUST：0.8Tflops, 5TB
• THU：1.3Tflops, 20TB
• PKU：1.5Tflops, 10TB
• BUAA：0.7Tflops, 10TB
• SCUT：0.9Tflops, 20TB
• SJTU：0.5Tflops, 9TB
• SEU：1.0Tflops, 19TB
• XJTU：0.1Tflops, 2.5TB
• NUDT：0.2Tflops, 5TB
• NEU：0.8Tflops, 5TB
• ZSU：1.3Tflops, 10TB
• SDU：1.3Tflops, 18TB
• NWPU：0.4Tflops, 2TB
• ZJU：0.6Tflops, 3TB
• FUDAN：1.8Tflops, 6TB
• TONGJI：0.2Tflops, 1TB
• USTC：1.2Tflops, 5TB
• UESTC：0.3Tflops, 2TB
• RUC：0.1Tflops, 0.5TB
• LZU：0.3Tflops, 1TB
ChinaGrid：>16Tflops, >180TB
1313
Layered Infrastructure of ChinaGrid
High performance computing environment(campus grid)
ChinaGrid Supporting Platform (CGSP)
NUDT
THU
HUSTZSU
PKU SJTU XJTUNEU
SCUT
BUAA
SEU
SDU
Remoteeducation
gridImage
processinggrid
Fluiddynamics
grid Massiveinformationprocessing gridBioinformatics
grid
1414
What’s CGSP?
• ChinaGrid Supporting Platform, a grid middleware for ChinaGrid
• Follow the WS-Resource Framework (WSRF) and Open Grid Service Architecture (OGSA)
• CGSP 1.0 was released at Jan. 10, 2005
• CGSP 2.0 (beta) was released at April 25, 2006
• Developed by the joint working group from HUST, THU, PKU, BUAA, SJTU, and other universities in ChinaGrid
1515
Status of CGSP• CGSP 1.0 supports four major grid applications of
ChinaGrid
• Installed in all the ChinaGrid universities as campus grid environment
• CGSP 2.0 (beta) download more than 350 times within 2 days after its release
http://www.chinagrid.edu.cn/CGSP/index.htm
1616
CGSP Container
1717
Interoperation between CGSP and UNICORE(GPE) in D-Grid
1818
CGSV (ChinaGrid SuperVision)
1919
Daily Hits
http://www.chinagrid.edu.cn:8080/archive/report/index.htm
2020
Most Active Countries
2121
Most Active Countries
2222
2323
CGSP Architecture
2424
Topology• Tree-like structure
• Peer cooperation
• Autonomous
2525
Main Features of CGSP 2.0• More powerful
Multi-domain cooperationSupport various jobsIntegrate more kinds of resources
• More flexibleConfigurableLoose-coupled
• More stable
• More open, more international
• Easy to install
2626
Building Blocks• CGSP Container• Domain Manager• Information Center• Data Management• Execution Management• Heterogeneous Database• Portal• GridPPI• Security
2727
CGSP 2.0 Container
• Runtime environment for CGSP
• Based on GT4 CoreHot deployAuto deployRemote deployService Monitoring - CGSVCGSP Security
2828
CGSP 2.0 Container Architecture
2929
Information Center• A logical center to publish and
discover all kinds of information of resources in all domains
• FunctionsTo connect all domains
Join/Quit the tree-like topology
To support powerful view of resourcesall kinds of resourcesa global view user-related view
3030
Execution Management
• Enables applications to have coordinated access to underlying resources
• Support three types of jobLegacy binary program execution – atomic jobService invoking – atomic jobWorkflow execution – composite job
• Support four types of job submissionGRS Application Submission (for legacy program)JSDL Submission (for legacy program)Generic Job Submission (for WS/WSRF)Composite Job Submission (for workflow)
3131
Execution Management• Fundamental job management
Job submission , Job monitoring, Job scheduling
• Uniform interface of job creation and monitoringWS, WSRF, JSDL, Workflow Service
• Dynamic WSRF/WS service invocation
• Distributed workflow engine management and workflow load balancing
• Legacy application dynamic deployment and friendly application user interface
• PBS and MPI are supported by GRS
3232
Execution Management
• Workflow SupportFollows BPEL4WS 1.1 specificationWorkflow execution, control and monitoringWorkflow load balancingDynamic workflow deploymentSupport orchestrating WSRF services
• JSDL Support
3333
Execution Management• General Running Service (GRS)
Just a normal WSRF-compliant Web Service, providing computing service
Executing any executable program which can be portably transferred for CGSP.
Supporting MPI Programs with PBS supported cluster
Providing Execution Management and Task SchedulingDeployment & Undeployment
Auto-deployment of Legacy program
One GRS per computing node
3434
Data Management
• Grid File SystemEnable user to have his/her own data space over Grid
Make/Remove directoriesUpload/Copy/Remove/Download filesBrowse/Search files/directories
• Data Storage & Transfer SupportGRSGridPPIHDB
3535
Heterogeneous Database• Functions
Provide an uniform, flexible and service-based interface to access and integrate distributed, heterogeneous and structurally complex data resources
• Virtual TableIt is a logic concept, like the concept of view in DBMSIt is only a mapping relationship between virtual table and physical tableMore than one physical tables can register to the same virtual tableUsers can submit queries performed on virtual table
• Physical TableIt really exists in counterpart databaseMap reference columns to corresponding virtual table columns
3636
GridPPI
• CGSP Programming InterfaceMPI-like API
3737
AG4ChinaGrid：GridAsia 2005
3838
http://www.chinagrid.edu.cn
3939
Bioinformatics Grid
4040
BioGrid Applications•Protein target selection for rice genome
•Multi-sequence alignment for ganodermafamily
•Gene joint for white mice
•Cardiovascular disease research
4141
Image Processing Grid
4242
ImageGrid Applications• Three-dimension reconstruction of digital
virtual human being (HUST)
• Medical image diagnosis (ZSU)
• Remote sensing image processing（NUDT）
4343
CFD Grid
4444
Pilot Applications based on CFD Grid
• Shanhai JiaoTong University: Aircraft genetic optimization design system
• Xi’an JiaoTong University: Parallel algorithm for molecular dynamics
• Southern China University of Technology: Simulation and optimization techniques for metal powder figuration process
• Northeast University: Large scale geological disaster forecasting system
• Southeast University: Computational electromagnetism applications in airplane and automobile design
4545
Course On-line Grid
4646
User IP distribution（2004/08/27-2005/01/16）
12605419370ZS71957696DN8489361358DB125083818TS10383121BH6402552922BY10970264PK2586837615359PK1
Total number of HTTP GET
Independent IP number
Server
64299598HZ705687387HN
6181365101LD1602401318XB265055528SJ6974643981XJ10936579513UST1288161110SD
Total number of HTTP GET
Independent IP number
Server
Numbers of independent IPs：25,807；Total number of HTTP GET：12,569,855
Usage Survey
At least so many people use course-online grid
Total number of access
4747
Second Generation of Course Online Grid
4848
Massive Information Processing Grid
4949
5050
University Digital Museum Grid (UDMGrid)
5151
Grid is now at an important time-it can success greatly, or becoming self-limiting
Greg Astfalk, HP Fellow and Chief Scientist, “What’s next for Grid?”
5252
Hai Jin
Huazhong University of Science and TechnologyWuhan, 430074, China
[email protected]://grid.hust.edu.cn/hjin/
