Bob Jones – Project Architecture - 1 March 2002 - n° 1

Information & MonitoringServices

Antony Wilson

WP3, RAL

a.j.wilson@rl.ac.uk

Antony Wilson –SysMan Meeting- 22 April 2002 - n° 2

Introduction

information systems – LDAP (Lightweight Directory Access Protocol)

Ftree Globus MDS

information providers RPMs configuration

starting ftree

configuration of the GRIS/GIIS registration

starting Globus MDS

example searches

summary

Antony Wilson –SysMan Meeting- 22 April 2002 - n° 3

LDAP Information Systems

2 configuration files /etc/edg/info-mds.conf /etc/globus.conf

info-mds.conf configuration of the information providers

globus.conf configuration of Globus MDS

includes registration details

Antony Wilson –SysMan Meeting- 22 April 2002 - n° 4

Information Providers - RPMs

configuration edg-info-main-*.i386.rpm

computing element information provider CEInformationProviders-*.i386.rpm

netmon information provider edg-info-netmon-*.i386.rpm

storage element information provider edg-info-se-*.i386.rpm

replica catalogue information provider edg-info-rc-*.i386.rpm

Antony Wilson –SysMan Meeting- 22 April 2002 - n° 5

Information Providers - Configuration

configuration via /etc/edg/info-mds.conf generic information site information provider computing element information provider netmon information provider storage element information provider replica catalogue information provider

static data via /opt/edg/info/mds/etc/ldif/*.ldif computing element replica catalogue

Antony Wilson –SysMan Meeting- 22 April 2002 - n° 6

info-mds.conf - Generic

WP3_DEPLOY=/opt/edg/info/mdsFTREE_INFO_PORT=2171FTREE_DEBUG_LEVEL=0

# the default value is "Mds-Vo-name=local,o=grid“SITE_DN=Mds-Vo-name=local,o=grid

Antony Wilson –SysMan Meeting- 22 April 2002 - n° 7

info-mds.conf - Site

Note this is usually combined with computing element

SITE_INFO=yesSITE_NAME=RALSITE_INSTALLATION_DATE=20011115123410ZSITE_SYSADMIN_CONTACT=grid.sysadmin@gridpp.rl.ac.ukSITE_USER_SUPPORT_CONTACT=grid.support@gridpp.rl.ac.ukSITE_SECURITY_CONTACT=grid.security@gridpp.rl.ac.ukSITE_DATAGRID_VERSION=1SITE_NETMON_HOST=gppnetmon.gridpp.rl.ac.uk

# comma separated list with no spacesSITE_SE_HOSTS=gppse05.gridpp.rl.ac.uk

# comma separated list with no spacesSITE_CE_HOSTS=gppce05.gridpp.rl.ac.uk

Antony Wilson –SysMan Meeting- 22 April 2002 - n° 8

info-mds.conf – Computing Element

CE_PRESENT=yesCE_HOST=gppce05.gridpp.rl.ac.ukCE_BATCHSYSTEM=pbsCE_CLUSTER_BATCH_SYSTEM_BIN_PATH=/usr/pbs/bin

# comma separated list with no spacesCE_QUEUE=workq

# comma separated list with no spacesCE_CLOSE_SE_ID=gppse05.gridpp.rl.ac.uk

# comma separated list with no spaces, these values must relate to the corresponding CLOSE_SE_ID

CE_CLOSE_SE_MOUNT_POINT=data

Antony Wilson –SysMan Meeting- 22 April 2002 - n° 9

info-mds.conf – Netmon

This will be changing in the next release

This is also usually combined with computing element

NETMON_PRESENT=yesNETMON_PINGER_HOST=gppnetmon.gridpp.rl.ac.uk

Antony Wilson –SysMan Meeting- 22 April 2002 - n° 10

info-mds.conf – Storage Element

SE_PRESENT=yesSE_ID=gppse05.gridpp.rl.ac.ukSE_SIZE=500000SE_CONTACT=grid.support@gridpp.rl.ac.ukSE_TYPE=disk

# comma separated list with no spaces, this is a list of Vos supported by the SE

SE_VO=alice,atlas,biomedical,cms,earthob,lhcb

# comma separated list with no spaces, values used in df to obtain freespaceSE_FILESYSTEMS=/dev/hda2,/dev/hda4

# comma separated list with no spacesSE_CLOSE_CE=gppce05.gridpp.rl.ac.uk:2119/jobmanager-pbs-workq

# comma separated list with no spacesSE_PROTOCOLS=gridftp,rfio,file

# comma separated list with no spaces, these values must relate to the corresponding SE_PROTOCOLS

SE_PROTOCOL_PORTS=2811,3147,

Antony Wilson –SysMan Meeting- 22 April 2002 - n° 11

info-mds.conf – Replica Catalogue

RC_PRESENT=yesRC_HOST=gpprc05.gridpp.rl.ac.uk

# comma separated list with no spacesRC_VO=alice,atlas,biomedical,cms.earthob,lhcb

Antony Wilson –SysMan Meeting- 22 April 2002 - n° 12

Static Information – Computing Element

makes use of static information /opt/edg/info/mds/etc/ldif/ce-static.ldif

this will be changing to /opt/edg/etc/info/mds/ce-static.ldif

ldif file can be customized for a queue /opt/edg/info/mds/etc/ldif/ce-static-queuename.ldif

Architecture: intelOpSys: RH 6.2MinPhysMemory: 512MinLocalDiskSpace: 24000NumSMPs: 2MinSPUProcessors: 2MaxSPUProcessors: 2AverageSI00: 450MinSI00: 450MaxSI00: 450RunTimeEnvironment: CMS4.2RunTimeEnvironment: ATLAS1.1AFSAvailable: FALSEOutboundIP:TRUEInboundIP: TRUE

The architecture of the hosts composing the CE

The operating system of the hosts composing the CE

The minimum value of the physical memory among the hosts composing the CE

The minimum local disk footprint

Number of SMP hosts

The minimum number of SPU processors (for SMP hosts)

The Maximum number of SPU processors (for SMP hosts

The Average of the SpecInt2000 benchmark of the nodes associated with the CE

The minimum value of the SpecInt2000 benchmark of the nodes associated with the CE

The maximum value of the SpecInt2000 benchmark of the nodes associated with the CE

A List of software/packages installed on this CE

A List of software/packages installed on this CE

Defines if AFS is installed

Defines if outbound connectivity is allowed

Defines if inbound connectivity is allowed

Antony Wilson –SysMan Meeting- 22 April 2002 - n° 13

Static Information – Replica Catalogue

makes use of static information /opt/edg/info/mds/etc/ldif/rc-static.ldif

this will be changing to /opt/edg/etc/info/mds/rc-static.ldif

ldif file can be customized for a virtual organization /opt/edg/info/mds/etc/ldif/rc-static-vo.ldif

Rcport: 2001RCmanagerDN: cn=manager,rc=AliceReplicaCatalogue,dc=eu-

datagrid,dc=orgRcurl:

ldap://grid-vo.nikhef.nl:10389/rc=AliceReplicaCatalog,dc=eu-datagrid,dc-org

Antony Wilson –SysMan Meeting- 22 April 2002 - n° 14

Starting Ftree

/etc/rc.d/init.d/edginfo-mds start stop restart status

use information provided in /etc/edg/info-mds.conf

produces 2 ldif files one for ftree one for Globus MDS both point to the same information providers

starts/stops ftree

Antony Wilson –SysMan Meeting- 22 April 2002 - n° 15

Configuration of the GRIS/GIIS Registration

GRIS Grid Resource Information Server

GIIS Grid Index Information Server

there is a GRIS on any machine running an information provider

there is a GIIS at site level

the GRIS’s register with the site GIIS

the site GIIS registers with the country GIIS/VO GIIS

registration is controlled via /etc/globus.conf

Antony Wilson –SysMan Meeting- 22 April 2002 - n° 16

globus.conf - Resource

GRID_INFO_DEBUG_LEVEL=0

GRID_INFO_USER=infouserGRID_INFO_GRIS=yesGRID_INFO_EDG=yes

GRID_INFO_GRIS_REG_GIIS=ralGRID_INFO_GRIS_REG_HOST=gppce05.gridpp.rl.ac.uk

Antony Wilson –SysMan Meeting- 22 April 2002 - n° 17

globus.conf - Site

GRID_INFO_DEBUG_LEVEL=0

GRID_INFO_USER=infouserGRID_INFO_GRIS=yesGRID_INFO_EDG=yes

GRID_INFO_GRIS_REG_GIIS=ralGRID_INFO_GRIS_REG_HOST=gppce05.gridpp.rl.ac.uk

GRID_INFO_GIIS_1=ral#Register with the country GIISGRID_INFO_REG_GIIS_1=ukGRID_INFO_REG_HOST_1=gppinfo.gridpp.rl.ac.uk

Antony Wilson –SysMan Meeting- 22 April 2002 - n° 18

globus.conf - Country

GRID_INFO_DEBUG_LEVEL=0

GRID_INFO_USER=infouserGRID_INFO_GRIS=yesGRID_INFO_EDG=yes

GRID_INFO_GRIS_REG_GIIS=ukGRID_INFO_GRIS_REG_HOST=gppinfo.gridpp.rl.ac.uk

GRID_INFO_GIIS_1=uk#Register with the top level GIIs for the testbedGRID_INFO_REG_GIIS_1=datagridGRID_INFO_REG_HOST_1=lxshare0225.cern.ch

Antony Wilson –SysMan Meeting- 22 April 2002 - n° 19

Starting Globus MDS

/etc/rc.d/init.d/globus-mds start stop restart status

use information provided in /etc/globus.conf

starts/stops Globus MDS

Antony Wilson –SysMan Meeting- 22 April 2002 - n° 20

Example Searches

Ftree is on port 2171 Globus MDS is on 2135

search a resource:ldapsearch -x -H ldap://gppse05.gridpp.rl.ac.uk:2135-b 'Mds-Vo-

name=local,o=grid‘ objectclass=*

search a site:ldapsearch -x -H ldap://gppce05.gridpp.rl.ac.uk:2135-b 'Mds-Vo-

name=ral,o=grid‘ objectclass=*

search a country/VO:ldapsearch -x -H ldap://gppinfo.gridpp.rl.ac.uk:2135-b 'Mds-Vo-

name=uk,o=grid‘ objectclass=*

or use an LDAP browser such as mapcentre as provided by WP7 http://ccwp7.in2p3.fr/mapcenter/

Antony Wilson –SysMan Meeting- 22 April 2002 - n° 21

Summary

edit /etc/edg/info-mds.conf /etc/globus.conf

/opt/edg/info/mds/etc/ldif/*.ldif this will be changing to /opt/edg/etc/info/mds/*.ldif

produce ldifs and start ftree /etc/rc.d/init.d/edginfo-mds

start Globus MDS /etc/rc.d/init.d/globus-mds

documentation available at: http://hepunx.rl.ac.uk/edg/wp3/