13th EELA Tutorial, La Antigua, 18-19, October 2007

www.eu-eela.org

E-infrastructure shared between Europe and Latin America

FP6−2004−Infrastructures−6-SSA-026409

Introducción a la Tecnología Grid y GILDA

Richard Miguel

SENAMHI - PERU

La Antigua, 18 – 19 Octubre 2007

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409

Agenda

• Introducción• Conceptos de Grid• Beneficios• Seguridad • Gilda

2

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409

Introducción

• Que es Grid?– Grid puede ser comparado con una red eléctrica donde los

usuarios pueden conectar cualquier dispositivo desde cualquier parte de ella sin necesidad de saber de donde proviene la energía.

– Analógicamente, los usuarios de la GRID pueden conectar su computador a una red de recursos computacionales y acceder a la potencia de ellos sin necesidad de saber donde se encuentran estos recursos.

– También se dice que es un “cluster de clusters” donde se agrupan recursos de computo separados geográficamente a través de una red de comunicación para tal fin.

3

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409

GRID

4

Site1Site2

User Interface

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409

Conceptos de GRID

• Recursos Computacionales– Equipos o computadores donde los usuarios puedan ejecutar

“jobs”, aplicaciones, almacenar o recuperar datos sin importar el lugar geografico donde se encuentre dicho recurso.

• Job– Es una tarea computacional, (ejecutable o script) que los

usuarios pueden ejecutar en el GRID con la finalidad de obtener un resultado final de regreso a un recurso al cual tenga acceso.

• Job Submission– Es el acto por el cual un usuario delega al GRID la

responsabilidad de hallar el mejor recurso disponible en cualquier lugar del mundo y enviar el job para ser ejecutado en dicho recurso.

5

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409

Conceptos de GRID

6

• VOs:Individuos u organizaciones que tienen acceso a los recursos de GRID

User Interface

User Interface

Grid services

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 7

Multi-VOs

• Usuarios se unen a VOs

• Una Organizacion Virtual ofrece recursos & negocia accessos

• El middleware de GRID se ejecuta en cada site– “Storage elements”

– “Compute elements”

• Servicios adicionales (tanto usuarios y grid middleware) habilita el GRID

• Efecto:

colaboración

INTERNET

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 8

Requerimientos del GRID

• Heterogéneo• VO Resource Sharing• Uso de Recursos• Job Execution• Data Services• Seguridad• Costos Administrativos• Escalabilidad• Disponibilidad• Requerimientos Específicos

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409

Middleware

• Es la capa intermedia entre las aplicaciones de los Usuarios y los Recursos de Grid.

9

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409

Middleware Grid

10

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409

Beneficios del Grid

• Explotar los recursos no utilizados o sub utilizados.• Capacidad de acceder a grandes recursos de computo.• La tecnología GRID nos proporciona la posibilidad de

colaborar con otro investigadores en distintas partes del mundo y obtener resultados positivos de dicha colaboración.

• Proporciona la posibilidad de balancear recursos.• Confiabilidad.• Seguridad.

11

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409

Seguridad

• Basada en Certificados Digitales X.509

12

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 13

Futuro del GRID

• Incremento del número de usuarios de la infraestructura– Diseminacion de los resultados– Entrenamiento y Educacion– Grids ofrecen nuevas opotunidades para trabajo colaborativo.

• Incremento del numero de aplicaciones para mejorar el soporte de aplicaciones y las funcionalidades del middleware.– Incremento de la estabilidad, escalabilidad y usabilidad.– Mayores esfuerzos son necesarios particularmente sobre la administracion de

un VO, seguridad de la infraestructura, administracion de datos y administraciond e jobs.

– Extensiones del middleware del Grid de alto nivel.

• Incremento de la infrastructure de Grid • Incremento de la administrabilidad de los servicios de GRID.

– Reduciendo el costo de la operacion – Asegurando la interoperatibilidad entre infraestructuras.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409

The GILDA Project – web portal

•https://gilda.ct.infn.it

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409

Por qué t-Infrastructure?

• Evita la interrupción de los sistemas de producción de los proyectos de Grid.

• Prepara participantes para futuras actualizaciones del middleware.

• Fácil punto de entrada para nuevas comunidades y usuarios.

• Proporciona operación garantizada para un Tutorial.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 16•Lima, 12th EELA Tutorial, 24.09.2007

GILDA Test-bed

•~ 20 sites in 4 continents

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 17•Lima, 12th EELA Tutorial, 24.09.2007

Todos los servicios gLite en GILDA

•MIDDLEWARE VERSION: gLite 3.0.0

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 18•Lima, 12th EELA Tutorial, 24.09.2007

GILDA Sponsors (https://gilda.ct.infn.it/sponsors.html)

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 19•Lima, 12th EELA Tutorial, 24.09.2007

Training Strategy (1)

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409

Before trying GILDA…

• First Steps:

•1

•2

•3 •4

1. Ask for a GILDA personal certificate

2. Load the certificate in your browser

3. Accept Use Policy

4. Subscribe to the GILDA Virtual Organisation

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 21

The GILDA Certification Authority(https://gilda.ct.infn.it/CA)

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 22

Training Strategy (2)

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 23

The GILDA VOMS(https://voms.ct.infn.it:8443/voms/gilda/)

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 24

Training Strategy (3)

•Site Managers •Beginners

•Application•Developers

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 25

Tutorial: Beginners•Beginners

•USER INTERFACE

•PLUG AND PLAY

•USER INTERFACE

•VIRTUAL MACHINE

•USER INTERFACE

•REAL (gLite-tutor)

•GENIUS

•WEB PORTAL

•https://glite-tutor.ct.infn.it

•[glite-tutor] /home/giorgio > voms-proxy-init --voms gilda•Cannot find file or dir: /home/giorgio/.glite/vomses•Your identity: /C=IT/O=GILDA/OU=Personal Certificate/L=INFN/CN=Emidio Giorgio/Email=emidio.giorgio@ct.infn.it•Enter GRID pass phrase:•Your proxy is valid until Mon Jan 30 23:35:51 2006•Creating temporary proxy.................................Done•Contacting voms.ct.infn.it:15001 [/C=IT/O=GILDA/OU=Host/L=INFN Catania/CN=voms.ct.infn.it/Email=emidio.giorgio@ct.infn.it] "gilda"•Creating proxy ...................................... Done•Your proxy is valid until Mon Jan 30 23:35:51 2006

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 26

Tutorial: Site Managers

•Site Managers

•HOST

•CERTS

•GILDA TESTBED

•( SERVICES AND

•SITES )

•GILDA VIRTUAL

•SERVICES MACHINES

•GILDA MONITORING

•SYSTEMS

•HOST

•CERTS•HOST

•CERTS

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 27

Tutorial: Application Developers•Application

Developers

•GILDA

•DEMONSTRATOR

•https://glite-demo.ct.infn.it •GILDA USE CASES

•HOW TO USE CLI/API/WEB

SERVICES in gLite

•GILDA TEAM SUPPORT FOR

•APPLICATION INTEGRATION

•(GENIUS ALSO) •Demonstrative

• Applications

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 28

Some of the Applications ported on GILDA

• 8 Virtual Organizations supported: – Biomedicine (Biomed)– Earth Science Academy (ESR)– Earth Science Industry (CGG)– Astroparticle Physics (MAGIC)– Computational Chemistry (GEMS)– Grid Search Engines (GRACE)– Astrophysics (PLANCK)– Computation Archaeology (ARCHAEOGRID)

• Development of complete interfaces with GENIUS for 3 Biomed Applications: GATE, hadronTherapy, and Friction/Arlecore

• Development of complete interfaces with GENIUS for 4 Generic Applications: EGEODE (CGG), MAGIC, GEMS, and CODESA-3D (ESR) (successfull demos of EGEODE and GEMS at EGEE review)

• Development of complete interfaces with GENIUS for 16 demonstrative applications available on the GILDA Grid Demonstrator (https://grid-demo.ct.infn.it)

• Development of complete interface with CLI for NEMO

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 29

The GILDA Training Material(https://grid.ct.infn.it/twiki/bin/view/GILDA/WebHome)

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 30

The GILDA Support System

•http://gilda-support.ct.infn.it

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 31

Ticket Creation (1/2)

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 32

Ticket Creation (2/2)

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 33

Standard tutorial layout

•Local site

•User Interface

•Resource

Broker

•BDII

•Students’Room

•ssh •Worker nodes

•Worker nodes

•CE

•LFC

•SE

•VOMS

•GILDA t-Infrastructure

•User•Desktop

•Virtual•UI

•Virtual•UI

•Virtual•UI

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 39

Stats

• Used in more than 180 tutorials• 7693 certificates issued• > 3 TB of videos and Virtual Grid

services downloaded• Web portal: 768.880 hits in 2006

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 40•Lima, 12th EELA Tutorial, 24.09.2007

Stats

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 41•Lima, 12th EELA Tutorial, 24.09.2007

Non EU countries benefited by GILDA courses

•Basic / user tutorial

•Advanced / sysadmin

•Application Porting

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 42•Lima, 12th EELA Tutorial, 24.09.2007

Non EU countries benefited by GILDA courses

•Basic / user tutorial

•Advanced / sysadmin

•4 •7•1

•Application Porting

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 43

Summary and conclusions

• GILDA is a virtual laboratory for dissemination of grid computing:

– It is a “de facto” standard t-Infrastructure adopted both by EGEE and many EU-FP6 projects (EELA, EUCHINAGRID, EUMEDGRID, EUINDIAGRID, ICEAGE, etc.)

– It is a complete suite of grid elements (test-bed, CA, VO, monitoring system, web portal, user interfaces, support system) and applications fully dedicated to dissemination purposes and pre-porting of new applications to EGEE Infrastructure

– GILDA runs latest production version of the gLite middleware to make the transition from the t-Infrastructure to the e-Infrastructure easy and transparent

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 44

Links• GILDA home page

– https://gilda.ct.infn.it• GILDA Certification Authority

– https://gilda.ct.infn.it/CA/• GILDA Virtual Organization

– https://voms.ct.infn.it:8443/voms/gilda/• GILDA Support System

– http://gilda-support.ct.infn.it• GILDA Form for Bookings

– http://gilda-support.ct.infn.it• GILDA Repository of Training Material

– https://grid.ct.infn.it/twiki/bin/view/GILDA/WebHome • GILDA Virtual Services

– https://gilda.ct.infn.it/VirtualServices.html

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 45

Preguntas