+ All Categories
Home > Documents > 13th EELA Tutorial, La Antigua, 18-19, October 2007 E-infrastructure shared between Europe and...

13th EELA Tutorial, La Antigua, 18-19, October 2007 E-infrastructure shared between Europe and...

Date post: 22-Apr-2015
Category:
Upload: maricruz-renderos
View: 2 times
Download: 0 times
Share this document with a friend
40
13th EELA Tutorial, La Antigua, 18-19, October 2007 www.eu-eela.org E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA-026409 Introducción a la Tecnología Grid y GILDA Richard Miguel SENAMHI - PERU La Antigua, 18 – 19 Octubre 2007
Transcript
Page 1: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

13th EELA Tutorial, La Antigua, 18-19, October 2007

www.eu-eela.org

E-infrastructure shared between Europe and Latin America

FP6−2004−Infrastructures−6-SSA-026409

Introducción a la Tecnología Grid y GILDA

Richard Miguel

SENAMHI - PERU

La Antigua, 18 – 19 Octubre 2007

Page 2: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409

Agenda

• Introducción• Conceptos de Grid• Beneficios• Seguridad • Gilda

2

Page 3: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409

Introducción

• Que es Grid?– Grid puede ser comparado con una red eléctrica donde los

usuarios pueden conectar cualquier dispositivo desde cualquier parte de ella sin necesidad de saber de donde proviene la energía.

– Analógicamente, los usuarios de la GRID pueden conectar su computador a una red de recursos computacionales y acceder a la potencia de ellos sin necesidad de saber donde se encuentran estos recursos.

– También se dice que es un “cluster de clusters” donde se agrupan recursos de computo separados geográficamente a través de una red de comunicación para tal fin.

3

Page 4: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409

GRID

4

Site1Site2

User Interface

Page 5: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409

Conceptos de GRID

• Recursos Computacionales– Equipos o computadores donde los usuarios puedan ejecutar

“jobs”, aplicaciones, almacenar o recuperar datos sin importar el lugar geografico donde se encuentre dicho recurso.

• Job– Es una tarea computacional, (ejecutable o script) que los

usuarios pueden ejecutar en el GRID con la finalidad de obtener un resultado final de regreso a un recurso al cual tenga acceso.

• Job Submission– Es el acto por el cual un usuario delega al GRID la

responsabilidad de hallar el mejor recurso disponible en cualquier lugar del mundo y enviar el job para ser ejecutado en dicho recurso.

5

Page 6: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409

Conceptos de GRID

6

• VOs:Individuos u organizaciones que tienen acceso a los recursos de GRID

User Interface

User Interface

Grid services

Page 7: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 7

Multi-VOs

• Usuarios se unen a VOs

• Una Organizacion Virtual ofrece recursos & negocia accessos

• El middleware de GRID se ejecuta en cada site– “Storage elements”

– “Compute elements”

• Servicios adicionales (tanto usuarios y grid middleware) habilita el GRID

• Efecto:

colaboración

INTERNET

Page 8: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 8

Requerimientos del GRID

• Heterogéneo• VO Resource Sharing• Uso de Recursos• Job Execution• Data Services• Seguridad• Costos Administrativos• Escalabilidad• Disponibilidad• Requerimientos Específicos

Page 9: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409

Middleware

• Es la capa intermedia entre las aplicaciones de los Usuarios y los Recursos de Grid.

9

Page 10: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409

Middleware Grid

10

Page 11: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409

Beneficios del Grid

• Explotar los recursos no utilizados o sub utilizados.• Capacidad de acceder a grandes recursos de computo.• La tecnología GRID nos proporciona la posibilidad de

colaborar con otro investigadores en distintas partes del mundo y obtener resultados positivos de dicha colaboración.

• Proporciona la posibilidad de balancear recursos.• Confiabilidad.• Seguridad.

11

Page 12: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409

Seguridad

• Basada en Certificados Digitales X.509

12

Page 13: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 13

Futuro del GRID

• Incremento del número de usuarios de la infraestructura– Diseminacion de los resultados– Entrenamiento y Educacion– Grids ofrecen nuevas opotunidades para trabajo colaborativo.

• Incremento del numero de aplicaciones para mejorar el soporte de aplicaciones y las funcionalidades del middleware.– Incremento de la estabilidad, escalabilidad y usabilidad.– Mayores esfuerzos son necesarios particularmente sobre la administracion de

un VO, seguridad de la infraestructura, administracion de datos y administraciond e jobs.

– Extensiones del middleware del Grid de alto nivel.

• Incremento de la infrastructure de Grid • Incremento de la administrabilidad de los servicios de GRID.

– Reduciendo el costo de la operacion – Asegurando la interoperatibilidad entre infraestructuras.

Page 14: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409

The GILDA Project – web portal

•https://gilda.ct.infn.it

Page 15: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409

Por qué t-Infrastructure?

• Evita la interrupción de los sistemas de producción de los proyectos de Grid.

• Prepara participantes para futuras actualizaciones del middleware.

• Fácil punto de entrada para nuevas comunidades y usuarios.

• Proporciona operación garantizada para un Tutorial.

Page 16: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 16•Lima, 12th EELA Tutorial, 24.09.2007

GILDA Test-bed

•~ 20 sites in 4 continents

Page 17: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 17•Lima, 12th EELA Tutorial, 24.09.2007

Todos los servicios gLite en GILDA

•MIDDLEWARE VERSION: gLite 3.0.0

Page 18: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 18•Lima, 12th EELA Tutorial, 24.09.2007

GILDA Sponsors (https://gilda.ct.infn.it/sponsors.html)

Page 19: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 19•Lima, 12th EELA Tutorial, 24.09.2007

Training Strategy (1)

Page 20: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409

Before trying GILDA…

• First Steps:

•1

•2

•3 •4

1. Ask for a GILDA personal certificate

2. Load the certificate in your browser

3. Accept Use Policy

4. Subscribe to the GILDA Virtual Organisation

Page 21: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 21

The GILDA Certification Authority(https://gilda.ct.infn.it/CA)

Page 22: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 22

Training Strategy (2)

Page 23: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 23

The GILDA VOMS(https://voms.ct.infn.it:8443/voms/gilda/)

Page 24: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 24

Training Strategy (3)

•Site Managers •Beginners

•Application•Developers

Page 25: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 25

Tutorial: Beginners•Beginners

•USER INTERFACE

•PLUG AND PLAY

•USER INTERFACE

•VIRTUAL MACHINE

•USER INTERFACE

•REAL (gLite-tutor)

•GENIUS

•WEB PORTAL

•https://glite-tutor.ct.infn.it

•[glite-tutor] /home/giorgio > voms-proxy-init --voms gilda•Cannot find file or dir: /home/giorgio/.glite/vomses•Your identity: /C=IT/O=GILDA/OU=Personal Certificate/L=INFN/CN=Emidio Giorgio/[email protected]•Enter GRID pass phrase:•Your proxy is valid until Mon Jan 30 23:35:51 2006•Creating temporary proxy.................................Done•Contacting voms.ct.infn.it:15001 [/C=IT/O=GILDA/OU=Host/L=INFN Catania/CN=voms.ct.infn.it/[email protected]] "gilda"•Creating proxy ...................................... Done•Your proxy is valid until Mon Jan 30 23:35:51 2006

Page 26: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 26

Tutorial: Site Managers

•Site Managers

•HOST

•CERTS

•GILDA TESTBED

•( SERVICES AND

•SITES )

•GILDA VIRTUAL

•SERVICES MACHINES

•GILDA MONITORING

•SYSTEMS

•HOST

•CERTS•HOST

•CERTS

Page 27: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 27

Tutorial: Application Developers•Application

Developers

•GILDA

•DEMONSTRATOR

•https://glite-demo.ct.infn.it •GILDA USE CASES

•HOW TO USE CLI/API/WEB

SERVICES in gLite

•GILDA TEAM SUPPORT FOR

•APPLICATION INTEGRATION

•(GENIUS ALSO) •Demonstrative

• Applications

Page 28: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 28

Some of the Applications ported on GILDA

• 8 Virtual Organizations supported: – Biomedicine (Biomed)– Earth Science Academy (ESR)– Earth Science Industry (CGG)– Astroparticle Physics (MAGIC)– Computational Chemistry (GEMS)– Grid Search Engines (GRACE)– Astrophysics (PLANCK)– Computation Archaeology (ARCHAEOGRID)

• Development of complete interfaces with GENIUS for 3 Biomed Applications: GATE, hadronTherapy, and Friction/Arlecore

• Development of complete interfaces with GENIUS for 4 Generic Applications: EGEODE (CGG), MAGIC, GEMS, and CODESA-3D (ESR) (successfull demos of EGEODE and GEMS at EGEE review)

• Development of complete interfaces with GENIUS for 16 demonstrative applications available on the GILDA Grid Demonstrator (https://grid-demo.ct.infn.it)

• Development of complete interface with CLI for NEMO

Page 29: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 29

The GILDA Training Material(https://grid.ct.infn.it/twiki/bin/view/GILDA/WebHome)

Page 30: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 30

The GILDA Support System

•http://gilda-support.ct.infn.it

Page 31: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 31

Ticket Creation (1/2)

Page 32: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 32

Ticket Creation (2/2)

Page 33: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 33

Standard tutorial layout

•Local site

•User Interface

•Resource

Broker

•BDII

•Students’Room

•ssh •Worker nodes

•Worker nodes

•CE

•LFC

•SE

•VOMS

•GILDA t-Infrastructure

•User•Desktop

•Virtual•UI

•Virtual•UI

•Virtual•UI

Page 34: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 39

Stats

• Used in more than 180 tutorials• 7693 certificates issued• > 3 TB of videos and Virtual Grid

services downloaded• Web portal: 768.880 hits in 2006

Page 35: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 40•Lima, 12th EELA Tutorial, 24.09.2007

Stats

Page 36: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 41•Lima, 12th EELA Tutorial, 24.09.2007

Non EU countries benefited by GILDA courses

•Basic / user tutorial

•Advanced / sysadmin

•Application Porting

Page 37: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 42•Lima, 12th EELA Tutorial, 24.09.2007

Non EU countries benefited by GILDA courses

•Basic / user tutorial

•Advanced / sysadmin

•4 •7•1

•Application Porting

Page 38: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 43

Summary and conclusions

• GILDA is a virtual laboratory for dissemination of grid computing:

– It is a “de facto” standard t-Infrastructure adopted both by EGEE and many EU-FP6 projects (EELA, EUCHINAGRID, EUMEDGRID, EUINDIAGRID, ICEAGE, etc.)

– It is a complete suite of grid elements (test-bed, CA, VO, monitoring system, web portal, user interfaces, support system) and applications fully dedicated to dissemination purposes and pre-porting of new applications to EGEE Infrastructure

– GILDA runs latest production version of the gLite middleware to make the transition from the t-Infrastructure to the e-Infrastructure easy and transparent

Page 39: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 44

Links• GILDA home page

– https://gilda.ct.infn.it• GILDA Certification Authority

– https://gilda.ct.infn.it/CA/• GILDA Virtual Organization

– https://voms.ct.infn.it:8443/voms/gilda/• GILDA Support System

– http://gilda-support.ct.infn.it• GILDA Form for Bookings

– http://gilda-support.ct.infn.it• GILDA Repository of Training Material

– https://grid.ct.infn.it/twiki/bin/view/GILDA/WebHome • GILDA Virtual Services

– https://gilda.ct.infn.it/VirtualServices.html

Page 40: 13th EELA Tutorial, La Antigua, 18-19, October 2007  E-infrastructure shared between Europe and Latin America FP62004Infrastructures6-SSA-026409.

E-infrastructure shared between Europe and Latin America

13th EELA Tutorial, La Antigua, 18-19 October 2007FP6−2004−Infrastructures−6-SSA-026409 45

Preguntas


Recommended