AustrianGrid, LCG & more

Reinhard Bischof

HPC-Seminar April 8th 2005

AustrianGrid Resources

http://agrid.uibk.ac.at/austriangrid/overview.php

AustrianGrid Monitor

LCG Large Hadron Collider Computing Grid

>100 sites, > 1.000 users, > 10.000 CPUsAtlas (LCG experiment) last week : > 10.000 jobs on one dayhttp://lcg.web.cern.ch/LCG/

Atlas production

Data Management Don QuijoteSupervisor WindmillExecutor LCG LexorExecutor Nordugrid DulcineaExecutor Grid2003 Capone

Grid 2003

Grid 2003http://www.ivdgl.org/grid2003at the moment ~4200 CPUsuses Globus-Toolkit, Condor-G

43 sites3570 CPUs

GlobusToolkit + NorduGrid Middleware(Advance Resource Connector)

http://www.nordugrid.org

Grid computing

secure: each user must have a certificate (electronic passport) which • contains a globally unique name e.g. /C=AT/O=AustrianGrid/O=UIBK/OU=ZID/CN=Reinhard Bischof• contains the user's public key• is signed by an accepted Certification Authority

Grid computing is ...

flexible, secure, coordinated resource sharing among dynamic collections of individuals, institutions and resources (virtual organizations).

( The Anatomy of the Grid, Ian Foster, Carl Kesselman ,Steven Tuecke)

flexible, coordinated• grids are dynamic (resources are added/removed) : there is a need for a system

colllecting information on the status of the single sites (Information System), jobs must be distributed to suitable resources (compare to local resource management)

Grid: From local to global resource management

Information System(Top)

Certificate/C=AT/O=AustrianGrid/O=UIBK/OU=HEPG/CN=Nemo

Replica LocationService

Which resources are available ?

Many, many other clusters

Storage

Where are the files I need ?

MapfileC=AT/O=AustrianGrid/O=UIBK/OU=HEPG/CN=Nemo .atlas

job is executed e.g. as local user atlas003

PC

Local resourcemanagement SGE

Cluster 1

Master

PC

Local resourcemanagement condor

Cluster 2

Master Gatekeeper

Information systemGridFTP

Certificate/C=AT/O=AustrianGrid/O=UIBK/OU=HEPG/CN=host/grid.uibk.ac.at

GatekeeperInformation system

GridFTP

AustrianGrid Information Index

http://agrid.uibk.ac.at/austriangrid

AustrianGrid Certification Authority

• https://ca.austriangridca.at/• accepted by EU-GridPMA (European Policy Management Authority for Grid

Authentication in e-Science)• currently 37 CAs are accepted

• how to get certificates:– your group sends a registration form (available on the AustrianGrid CA

webpage) nominating 2 contact persons (who must apply for certificates) to the local Registration Authority (ra@dps.uibk.ac.at), the RA sends a copy to the CA, the group is added on a pull down menu on the certificate request page

– group members can request a certificate using the CA webpage: a script is generated which must be run on your computer, the request file is sent to the RA , a contact person of the group sends a consent via email and you must personally contact the RA (identity card required, will be scanned)

“global“ user management

• 2nd step: Authorisation• LCG:

– apply for membership in a virtual organization (LHC-experiment)– the VO's administrator adds the new user to the VOs ldap-server– on each site a list of members of the supported VOs is generated (mapping

name of certificate -> VO)– each VO has an account pool (e.g. 50 accounts), if a user sends a job to a

site for the first time a free account of the VO is assigned– accounts which aren't used for some time are recycled

• AustrianGrid: at the moment no automatic grid user management (users are manually added at each site)– define VOs ? (e.g. agrid, develop, ..)– static / dynamic mapping to accounts ?

Using the AustrianGrid

• Get the software– globus toolkit rpms e.g. from nordugrid– use software on local netapp-server on /usr/site/grid, nothing to install

locally, source /usr/site/grid/etc/profile.d/globus.sh to set the environment• Create a proxy certificate (new private/public key, short lifetime):

grid-proxy-initYour identity: /C=AT/O=AustrianGrid/O=UIBK/OU=ZID/CN=Reinhard BischofEnter GRID pass phrase for this identity:Creating proxy ..............................................DoneYour proxy is valid until:

• for an interactive usage log in using glogin:glogin agrid1-bash-2.05b$exitlogoutConnection closed by foreign host.

• own resources can be added to the AustrianGrid (as the local load allows it) using the installed software on /usr/site/grid, a certificate for the host is needed

Conclusions

• The time of testbeds is gone, we have production grids, but..– there remains the need for several improvements (especially data

management)

• AustrianGrid– grid middleware (Globus Toolkit) on several resources– currently establishing core services (Information Index ..)– to be decided : automatic user management– advanced middleware will be added (resource broker (DPS-group))– for middleware development : more sites available during normal working

hours would be an advantage (HPC-Cluster ?)– 96 Itanium CPUs on 6 Altix350 machines are waiting for scientific

workload