Fotis KarayannisFotis KarayannisHellasGrid Scientific CoordinatorHellasGrid Scientific Coordinator
GRNETGRNET
HellasGrid – The National Grid Initiative in
Greecewww.hellasgrid.gr
EGI SEE Workshop Athens, 19 April 20062
OutlineOutline
GRNET dual mission: Research Networking and Grid infrastructure
The HellasGrid National Grid initiative Infrastructure Organisation Applications communities
HellasGrid as part of the European efforts Networking and Grid projects
Challenges/Experiences
EGI SEE Workshop Athens, 19 April 20063
GRNET Dual MissionGRNET Dual Mission The EU e-Infrastructure vision: Integrated Networking + Grid
infrastructures
GRNET was one of the first NRENs* in Europe adopting the EU e-Infrastructure initiative: Providing both networking and grid infrastructures * NREN: National Research and Education Network
Being infrastructure-oriented and application-neutral serving all user eScience communities
Expanding its scope to e-Business and e-Government
GÉANT+SEEREN+other
EGEE+ SEE-GRID +other
Pan-European e-Infrastructure
Source: European Commission
Unit F3: Research Infrastructures
EGI SEE Workshop Athens, 19 April 20064
GRNET strategic projects and GRNET strategic projects and fundingfunding Research Network projects
GRNET2 project, 2000-2005, 20 MEuro• 2,5 Gbps leased lambda backbone
network• Pilot dark fiber acquisition projects (15
years lease) + optical equipment• Pilot Grid node @ Demokritos (Isabella)
Access project (called “105”), 2005-2008, 10 MEuro
• 1 Gigabit Access for ~50 institutes GRNET3 project, 2005-2008, 30 MEuro
(recently approved!)• Dark fiber research back-bone network
in Greece• Optical MANs for Athens, Thessaloniki
(the rest to be covered by regional MANs (called “93”)
• Optical equipment RFI already published
PanEuropean connectivity & integration project: GEANT2, 2004-2008
Regional Support Projects: SEEREN-SEEREN2, Eumedconnect
Grid projects Hellasgrid Task Force, 2002-2004,
(support money)• Hellasgrid Strategy Document• Pilot Grid node @ Demokritos (0,5M by
GRNET2) Hellasgrid Project, 2004-2007, ~2
MEuro
• ~800 CPUs, ~ 90TB storage (30TB disks + 60 TB tape libraries), 4 advanced video-
conferencing Access Grid nodes Grid Applications Call, 2006-
2007,~0,5M PanEuropean integration projects:
EGEE Project, 2004-2006, 1,3MEuros EGEE-II, 2006-2008, 1,8M Euros
• Supported operations, training, policies
Regional Support projects: SEEGRID, SEEGRID2, Eumedgrid, EuChinaGrid
Other projects: GridCC, e-IRGSP
EGI SEE Workshop Athens, 19 April 20065
The GRNET NetworkThe GRNET Network
932 km of dark fibre932 km of dark fibre
Backbone is currently based on 2,5 Gbps leased lambdas Dark fiber has been acquired for 3 network spans (pilot phase) Dark fiber tender for the whole backbone on-going (one offer received) International connectivity 2 * 10 Gbps any day (currently 2* 2,5 Gbps)
EGI SEE Workshop Athens, 19 April 20066
The HellasGrid National Grid The HellasGrid National Grid InitiativeInitiative
HellasGrid Task Force appointed by the Ministry of Economy and Finance at the end of 2002 (MNEC is running the national InfoSoc programme) A strategy group supported by a scientific committee
• Produced a strategy document The Task Force prepared the National Integration Proposal The HellasGrid MoU was signed at the end of 2003
Pilot Phase (Phase I): 2003-2004 GRNET Pilot Infrastructure installation
• Isabella site: 64 CPUs, 10 TB SAN, 12 TB Tape Library Participation in EGEE proposal, Coordination of SEE-GRID
Consolidation Phase (Phase II): 2004-2006 HellasGrid project implementation
• Extension of Grid infrastructure (~800 CPUs, 30TB disks, 60TB tape libraries) – (~2 MEuros)
• Integration in EGEE• The HellasGrid MoU was used to form a Joint Research Unit (JRU)• GRNET provided a recognition letter by the Ministry after EC request• Further application support (~0,5M – 1M Euros)• Investigation for further infrastructure support (~1 MEuros)
EGI SEE Workshop Athens, 19 April 20067
The HellasGrid membersThe HellasGrid members Coordinator
National Research and Education Network, GRNET –www.grnet.gr Universities (10)
Aristotle University of Thessaloniki, AUTH www.auth.gr Athens University of Business, AUEB www.aueb.gr National Technical University of Athens, NTUA www.ntua.gr University of the Aegean www.aegean.gr University of Athens, UoA www.uoa.gr University of Crete, UoC www.uoc.gr University of Ioannina, UoI www.uoi.gr University of Macedonia, UoM www.uom.gr University of Patras UPATRAS www.upatras.gr University of Pireus UNIPI www.unipi.gr
Research Centres (8) Research and Academic Computer Technology Institute, CTI www.cti.gr Centre for Research and Technology Hellas, CERTH www.certh.gr Institute of Computer Science – FORTH, www.ics.forth.gr Institute of Accelerator Systems and Applications, IASA www.iasa.gr Institute of Communication and Computer Systems, ICCS
www.iccs.ece.ntua.gr National Meteorology Service, EMYwww.emy.gr National Observatory of Athens, NOA www.noa.gr Research Centre Demokritos, DEMOKRITOS www.demokritos.gr
EGI SEE Workshop Athens, 19 April 20068
HELLASGRID HELLASGRID infrastructureinfrastructure
• HG-01 cluster @ Demokritos: 64 CPU, 10TB FC SAN, 12TB Tape Library, EGEE LCG2 middleware
• HG02-HG06 clusters located in:
•Athens (NDC/EKT, IASA)•Thessaloniki (AUTH)•Crete (ICS-FORTH)•Patras (CTI)
~800 CPUs (x86_64, 2 GB RAM,
80GB HDD, 2x Gbit) ~30 TBytes total raw SAN storage capacity~80TBytes Tape Library
• 4 Access Grid nodes
Leased lambda 2,5 Gbps PoS
Athens MAN (2,5 Gbps PoS)
Dark Fibre (not yet lit)
Patra
Larissa
Heraclion
Syros
Athens
Chania
Rethymnon
Xanthi
Thessaloniki
Ioannina
Leased lambda 1,25 Gbps Gigabit Ethernet
HG-06-AUTH
HG-04-IASA
HG-05-NDC
HG-03- CTI-CEID
HG-01-GRNET Isabella @ Demokritos
HG-02- ICS-FORTH
Hellasgrid Grid Node
http://www.hellasgrid.gr/infrastructure
EGI SEE Workshop Athens, 19 April 20069
HG organisation: Teamwork!HG organisation: Teamwork!
Overall coordination: GRNET headquarters Cooperation with HellaGrid partners:
Main site + ROC operator : HG-01-GRNET (Isabella, cslab@ICCS/NTUA)
HG-02…HG-06 sites + operation centers (NDC, IASA, AUTH, FORTH, CTI)
5 smaller private sites (AUTH, UoM, FORTH, Demokritos, HEP-NTUA)
HG CA and VOMS (GridAUTH, Dept. of Physics, AUTH) HG helpdesk (CTI) Regional monitoring tools (ICS-FORTH) HG user support/apps (Demokritos + all site teams) 4 AccessGRID sites
HG membership: ~18 members (10 Universities + 8 Research Institutes)
6 HellasGrid+5 private sites > 900 CPUs in total
EGI SEE Workshop Athens, 19 April 200610
HG-01-GRNET HG-01-GRNET IsabellaIsabella
EGI SEE Workshop Athens, 19 April 200611
HellasGrid Infrastructure, Phase II, EKT HellasGrid Infrastructure, Phase II, EKT (2/2006)(2/2006)
National Documentation Center (EKT)
EGI SEE Workshop Athens, 19 April 200612
HG Local Users distribution per HG Local Users distribution per DisciplineDiscipline
EGI SEE Workshop Athens, 19 April 200613
CPU Hours per SiteCPU Hours per Site
EGI SEE Workshop Athens, 19 April 200614
HellasGrid CA statistics:HellasGrid CA statistics:HellasGrid CA statistics:HellasGrid CA statistics:
EGI SEE Workshop Athens, 19 April 200615
CPU time: distribution of overall EGEE CPU time: distribution of overall EGEE VOs usage of HG infrastructureVOs usage of HG infrastructure
Normalised CPU Time
28%
10%12%
40%
8% 2% atlas
biomed
cms
lhcb
see
others
EGI SEE Workshop Athens, 19 April 200616
HellasGrid as part of European HellasGrid as part of European effortsefforts
Leased lambda 2,5 Gbps PoS
Athens MAN (2,5 Gbps PoS)
Dark Fibre (not yet lit)
Patra
Larissa
Heraclion
Syros
Athens
Chania
Rethymnon
Xanthi
Thessaloniki
Ioannina
Leased lambda 1,25 Gbps Gigabit Ethernet
HG-03-AUTH
HG-02-IASA
HG-06-EKT
HG-04-CTI-CEID
HG-01-GRNETIsabella @Demokritos
HG-05-ICS-FORTH
Hellasgrid Grid Node(1 Gbps uplink)
Scale> 170 sites in 39 countries> 17 000 CPUs> 5 PB storage> 10 000 concurrent jobs per day> 60 Virtual Organisations
EGI SEE Workshop Athens, 19 April 200617
SEE Europe promoting the NGI/EGI SEE Europe promoting the NGI/EGI modelmodel
NGI: National Grid Initiative Infrastructure oriented & application
neutral• Not driven by applications
GRNET acts as an early champion for the SEE area One partner per country since EGEE
Phase I! EGEE-SEE and SEE-GRID countries
adopted the same model!
EGI SEE Workshop Athens, 19 April 200618
Challenges/Experiences/Challenges/Experiences/ConclusionsConclusions
Building the HG infrastructure proved difficult Housing, SLAs with local institutes are slow, tedious and expensive!
Getting applications /users to exploit the infrastructure is slow! Training/education and dissemination is important Application projects and funding are essential!
• Received 45 proposals in last Grid-Applications call! Sustainability of the infrastructure and services
Equipment will need to be changed after 3-5 years Local “incubators” for GRID technology needed:
Experts in local sites Operators should have appropriate mentality (shifts, support)
Gained a lot from networking experience (NOCs, NOC-ROC cooperation)
Regional, Pan-European and International collaborations are vital Our European friends lead the way: Middleware, VOs, support projects
EGI SEE Workshop Athens, 19 April 200619
www.hellasgrid.gr
www.egee-see.orgmailto:[email protected]
For more: