Managed by
CoreGRID: European Research Network on Foundations, Software Infrastructures and
Applications for large scale distributed, GRID and Peer-to-Peer Technologies
Thierry PRIOLScientific Coordinator
INRIA/ERCIMhttp://www.coregrid.net
European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies
2
CoreGRID objectives
To build a European-wide research laboratory– To avoid fragmentation of Grid research activities in Europe– Create the European “Grid Lighthouse” and be seen as such worldwide – To achieve integration and sustainability
To build solid foundations for GRID and Peer-to-Peer (P2P) technologies – Both on a methodological basis and a technological basis.– Support medium and long term research activities
Achieve and promote scientific and technological excellence within & beyond the Grid research community
Gather and disseminate European research
A think-tank for spin-off projects– EC funded, bilateral projects, international cooperations, …
European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies
3
A clear evidence of fragmentation
Grid National initiatives:• Belgium Be-GRID• Bulgarian BG-Grid• Cyprus CyGrid• Czech Metacenter • French ACI GRID• German D-GRID• Greek Hellas-GRID• Hungarian Grid• Italian GRID.IT• Polish SGIGrid• Scandinavian NORDUGRID• Spanish IRISGrid• Swiss SwissGRID• The Netherlands DAS• UK e-Science
ACI GRID
E-SCIENCE
DAS
BE-GRID
D-GRID
METACENTER
SWISSGRID
HELLAS-GRID
GRID.ITIRISGRID BG-GRID
SGIGRID
H-GRID
NORDUGRID
CYGRID
European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies
4
Network priorities
Excellence– CoreGRID brings together a European critical mass of
well-known experts in GRID and P2P research allowing to compete with research and development in North America and Asia
– An ambitious joint program of activities to deal with well identified challenges
Long-term integration & structuring– Set-up a sustainable European research laboratory with
an associated management• With several Institutes• With research groups assigned to Institutes
European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies
5
A NoE managed by ERCIM
ERCIM is a ERCIM is a consortium consortium of leading research of leading research institutions from institutions from 18 countries (17 18 countries (17 European) European) committed committed to information to information technology technology and applied and applied mathematics.mathematics.
European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies
6
CoreGRID membership
42 partners
18 Countries (1 from S. America)
120 Researchers
165 PhD Students
U. Cyprus
INRIACNRS
ERCIM
CETICUCL
CNR-ISTIINFNU. CalabriaU. LecceU. Pisa
CLPP-BAS
Delft U.Vrije U.
EPFLUASF
FhGFZJUSTUTTU. MuensterUNI DOU. PassauZIB
ICS-FORTH
ICRAL-CCLRCU. BelfastU. CambridgeU. CardiffU. ManchesterU. NewcastleU. Wesminster
KTHSICS
SZTAKI
VTT
U. Coimbra UPC
Masaryk U.
U. Chile PSCCYFRONET
European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies
7
Joint Program of Activities
Joint Programme of ActivitiesJoint Programme of ActivitiesJoint Programme of ActivitiesJoint Programme of Activities
Integrated Integrated ActivitiesActivities
Integrated Integrated ActivitiesActivities
Jointly Executed Jointly Executed ResearchResearch
Jointly Executed Jointly Executed ResearchResearch
Spreading ofSpreading of ExcellenceExcellence
Spreading ofSpreading of ExcellenceExcellence
Knowledge & Knowledge & Data ManagementData Management
Knowledge & Knowledge & Data ManagementData Management
Programming ModelProgramming ModelProgramming ModelProgramming Model
System ArchitectureSystem ArchitectureSystem ArchitectureSystem Architecture
Grid Information andGrid Information andMonitoring ServiceMonitoring Service
Grid Information andGrid Information andMonitoring ServiceMonitoring Service
Resource ManagementResource ManagementAnd SchedulingAnd Scheduling
Resource ManagementResource ManagementAnd SchedulingAnd Scheduling
Coordinated ProgrammingCoordinated Programmingof Partners’ activitiesof Partners’ activities
Coordinated ProgrammingCoordinated Programmingof Partners’ activitiesof Partners’ activities
Coordinated approach to Coordinated approach to prepare project proposalsprepare project proposalsCoordinated approach to Coordinated approach to prepare project proposalsprepare project proposals
Internal Collaboration Internal Collaboration and Disseminationand Dissemination
Internal Collaboration Internal Collaboration and Disseminationand Dissemination
Annual Integration Annual Integration WorkshopWorkshop
Annual Integration Annual Integration WorkshopWorkshop
PSE, tools and PSE, tools and GRID systemsGRID systems
PSE, tools and PSE, tools and GRID systemsGRID systems
Public WebsitePublic WebsitePublic WebsitePublic Website
Technical reportsTechnical reportsTechnical reportsTechnical reports
Workshops & conferencesWorkshops & conferencesWorkshops & conferencesWorkshops & conferences
NewsletterNewsletterNewsletterNewsletter
IndustryIndustryIndustryIndustry
GRID User communityGRID User communityGRID User communityGRID User community
ConferencesConferencesConferencesConferencesCommon UnderstandingCommon UnderstandingTrust & SecurityTrust & Security
Common UnderstandingCommon UnderstandingTrust & SecurityTrust & Security
Grid TestbedGrid TestbedGrid TestbedGrid Testbed
Mobility of researchersMobility of researchersMobility of researchersMobility of researchers
SergeiGorlatch
DomenicoTalia
MarcoDanelutto
ArturAndrzejak
LudekMatyska
RaminYahyapour
VladimirGetov
PierreGuisset
BrochuresBrochuresBrochuresBrochures
Training & EducationTraining & EducationTraining & EducationTraining & Education
European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies
8
Collaboration with other EU Grid projects
CoreGRID is participating to the Collaboration Gateway and leads two activities :
• Roadmaps
• Trainings
Collaboration GatewayCollaboration GatewayCollaboration GatewayCollaboration Gateway
Exploitation of synergies /Exploitation of synergies /technical concertationtechnical concertation
Exploitation of synergies /Exploitation of synergies /technical concertationtechnical concertation
Joint fora for exchangeJoint fora for exchangeand disseminationand dissemination
Joint fora for exchangeJoint fora for exchangeand disseminationand dissemination
Co-ordination of Co-ordination of standardisation effortsstandardisation efforts
Co-ordination of Co-ordination of standardisation effortsstandardisation efforts
ReRepository of reference pository of reference Implementations and GridImplementations and Grid
middlewaremiddleware
ReRepository of reference pository of reference Implementations and GridImplementations and Grid
middlewaremiddleware
Collaboration on researchCollaboration on researchInventories and roadmapsInventories and roadmapsCollaboration on researchCollaboration on researchInventories and roadmapsInventories and roadmaps
Indicators and impactIndicators and impactassessmentassessment
Indicators and impactIndicators and impactassessmentassessment
WolfgangZiegler
Training activitiesTraining activitiesTraining activitiesTraining activities
Leadership
Leadership
European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies
9
A set of well identified research challenges
Knowledge & Data Management– Handling information/data that are required/produced by a wide range
of diverse processing powerProgramming Model
– Making the programming of Grid infrastructures as simple and transparent as possible
System Architecture– Designing the next generation Grid middleware
Grid Information and Monitoring Services– Scalable information service to implement a service view of the Grid
Resource Management & Scheduling– Scheduling jobs/applications/tasks/computation within a Grid
environmentProblem Solving Environments, tools and GRID systems
– Integrating various middleware, tools and applications for problem solving
European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies
10
Knowledge & Data Management
• Integration of data management and knowledge discovery with
GRID technologies for providing knowledge-based GRID services
• Define a unified vision of the data and knowledge management in Grids through a layered approach
• Research activities– Distributed data management
• Based on commodity storage devices and interconnects
– Information and knowledge management• Semantic modeling through metadata
– Data mining and knowledge discovery• Semantic description for service discovery
European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies
11
Programming Model
• Raise the level of abstraction to make the programming of grids easier
– OGSA and WSRF are just the instruction set of grid computing infrastructures
• Definition of a lightweight component model for grid applications– A clear illustration of the research fragmentation
• At least 9 partners are working on component programming– Specific requirements: heterogeneity, dynamicity, scalability– Targeted applications: grid middleware & scientific computing
• Research activities– Application requirements– Communication between components– Component model definition and hierarchical composition– Advanced programming models based on components framework
European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies
12
System Architecture
• Next Generation Grid System Architecture– Implement the “invisible Grid” vision of the NGG report
• Focus on specific deficiencies of present day Grid systems– Today Grid middleware
• centralized or semi-centralized• Short-term prediction models and tools• Fault tolerance mechanisms only for small/medium scale systems
– Specific requirements: scalability, adaptability and dependability• Research activities
– Definition of capabilities and architectural components of Grids– Scalable Grid Services
• follow a P2P approach instead of a client/server approach
– Mechanism for adaptive Grids• tools and models for long-term prediction
– Dependability in Grids• Fault tolerant middleware and runtime
European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies
13
Grid Information & Monitoring Service
• Improve various services such as monitoring, information and user/accounting management
– Avoid centralized management as much as possible
• Research activities– Checkpointing services– Workflow services– Accounting and user management services in large scale system
European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies
14
Resource Management & Scheduling
• Develop generic solution for Grid scheduling and management– Not only able to manage computational resources
• Definition of a pervasive RMS middleware for different application scenarios
– Consider different kind of resources– Common interface and models– Support business models
• Research activities– Grid scheduling architecture– Multi-level scheduling strategies– Workflow scheduling strategies for jobs with temporal dependencies– Fault-tolerance and reliability in scheduling– Coordinating scheduling with data management– Performance prediction for advanced scheduling
European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies
15
Problem Solving Environment, tools and applications for problem solving
• Develop a novel software environments and tools for Grid systems
– Today Grid middleware systems are not component-based although their high-degree of complexity
• Definition of a generic component system to integrate applications, tools and system components
– Based on the CoreGRID components model
• Research activities– Definition of a generic platform– Mediator components– Integrated toolkit– Advanced tools and environments
European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies
16
Organizational Map
ExecutiveCommittee
Scientific Advisory Board Industrial Advisory Board Specific Task Forces
Integration Monitoring CommitteeChair: R. Perrott (U. Belfast)
Collaboration GatewayW. Ziegler (FhG)
Administrative &Financial Co-ordinator
B. Le Dantec (ERCIM)
Scientific Co-ordinator
T. Priol (INRIA)
MembersGeneral
Assembly
Integrated ActivitiesS. Gorlatch (U. Munster)
Spreading ExcellenceP. Guisset (CETIC)
Knowledge & Data Management
D. Talia (U. Calabria)
SchedulingR. Yahyapour (U. Dortmund)
System Architecture
A. Andrzejak (ZIB)CoreGRIDInstitutes Programming
ModelM. Danelutto (U. Pisa)
Grid Information& Monitoring
L. Matyska (U. Masaryk)
PSE, tools and GRID systems
V. Getov (U. Wesminster)
Chair:D. Laforenza(CNR-ISTI)
European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies
17
Scientific Advisory Board (SAB)
Objectives:
– Annual external assessment of the scientific quality of the work
– Provide guidance to the strategic orientations
– Formulate recommendations guard the excellence of the Network
Three senior Network scientists and three external advisors
Internal members:
• Jarek Nabrzyzki (PSNC - Poland)
• Henri Bal (Vrije U. - The Netherlands)
• Uwe Schwiegelshohn (Dortmund U. - Germany)
External members:• Dennis Gannon (Indiana U. - USA)
• Michel Cosnard (Nice U. - France)
• Sato Sekiguchi (AIST - Japan)
European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies
18
Industrial Advisory Board (IAB)
IAB has four primary objectives:
– To communicate to the Network European Industry’s long-term Grid-related technology needs and challenges
– To provide the Network with Grid validation cases– To help identify the market sector(s) to be addressed within the Grid User Community, in
order to ensure a quick adoption of next generation Grid technologies within European industry
– To report to the Scientific Advisory Board its recommendation with respect to future strategic GRID-related research objectives
IAB is composed of 15 members from the European industrial sector
Confirmed members:
• Federico Rossi, DATAMAT (Italy) • Yannis Perros, Algosystems (Greece) • Bernd Kosch, FUJITSU SIEMENS COMPUTER (Germany) • Mark Gilbert, European Microsoft Innovation Center (Germany) • John Easton, IBM Grid Computing (UK)• Anssi Karhinen, Nokia Research Center (Finland)• Igor Klapka, SAMTECH (Belgium)• Guillaume Alléon, EADS (France)
European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies
19
Some of the CoreGRID results
http://www.coregrid.net Newsletter Technical Report
Workshop on Network Centric Operating systemsMarch 16-17, BrusselsInformation available at the CoreGRID web site
Announcement
European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies
20
Conclusion
CoreGRID started in September 1st, 2004– A very active project although it is in its early stage– Funding from the EC: 8.2 M€ for the first 4 years– Involvement of the main European Key players in Grid
computing (both institutions and researchers)– The only one Network of Excellence in Grid funded by the
EU
http://www.ercim.org/publication/Ercim_News/enw59/
