11

Service Composition for LHC Computing Grid Monitoring

Beob Kyun Kim

e-Science Division, KISTI

2008. 09. 09

Service Composition for LCG Monitoring

2

Outline

This talk is to introduce service composition approach as a new way to overcome problems on the use of current LCG monitoring.

current LCG monitoring services’ problem

requirements of integrated monitoring services

an example of abstract integrated monitoring architecture

Service Composition for LCG Monitoring

3

Introduction

LCG is LHC Computing GridGrid 120 institutes, 52 countries, 259 sites (July, 2008) 72,000 CPUs and 20 PB disks 274 VOs, 14,000 users More than 150,000 jobs are being processed

Grid consists of many resources and services too complex to understand and manage if you can not monitor them, you can not manage it.

The purpose of grid monitoring To improve the reliability of resources To help resource providers with abstract views on their resources’

status

Service Composition for LCG Monitoring

4

Example: KISTI ALICE Tier2 Center

Introduction

Computing ResourcesComputing Resources

VOMSVOMSVOMS

VOBOXVOBOXVOBOX

lcg-RBlcg-RBlcg-RB

LFCLFCLFC

FTDFTDFTD

PXPXPX

SE_ DPMSE_ DPMSE_ DPM

BDI I -siteBDI I -siteBDI I -site

R-GMAR-GMAR-GMA

UIUIUIUI

SESESESE

Storage PoolStorage Pool

WNsWNs

WNsWNs

WMS+LBWMS+LBWMS+LBWMS+LB

BDI I -topBDI I -topBDI I -top

lcg-CElcg-CElcg-CElcg-CE

ui-alice.sdfarm.kr

voms.sdfarm.kr

px.sdfarm.kr

vobox-alice.sdfarm.kr

ftd.sdfarm.kr

lfc.sdfarm.kr

ce-alice.sdfarm.kr

bdii.sdfarm.kr

wmslb.sdfarm.kr

rb.sdfarm.krtwn001~6.sdfarm.krtwn001~6.sdfarm.kr--6 node, 48 core6 node, 48 core--Xeon E5405Xeon E5405--2GB RAM / core2GB RAM / core--Dedicated 1GBeDedicated 1GBe--1075 si2k/core AVG1075 si2k/core AVG

twn091~98.sdfarm.krtwn091~98.sdfarm.kr--8 node, 64 core8 node, 64 core--Xeon E5405Xeon E5405--2GB RAM / core2GB RAM / core--InfinibandInfiniband for for chasischasis--1075 si2k/core AVG1075 si2k/core AVG

ce-alice.sdfarm.kr

14node (112core)14node (112core)120 ksi2k120 ksi2k

rgma.sdfarm.kr

hansolo.kisti.re.kr leia.kisti.re.kr

ui-alice.sdfarm.kr

voms.sdfarm.kr

px.sdfarm.kr

vobox-alice.sdfarm.kr

ftd.sdfarm.kr

lfc.sdfarm.kr

ce-alice.sdfarm.kr

bdii.sdfarm.kr

wmslb.sdfarm.kr

rb.sdfarm.krtwn001~6.sdfarm.krtwn001~6.sdfarm.kr--6 node, 48 core6 node, 48 core--Xeon E5405Xeon E5405--2GB RAM / core2GB RAM / core--Dedicated 1GBeDedicated 1GBe--1075 si2k/core AVG1075 si2k/core AVG

twn091~98.sdfarm.krtwn091~98.sdfarm.kr--8 node, 64 core8 node, 64 core--Xeon E5405Xeon E5405--2GB RAM / core2GB RAM / core--InfinibandInfiniband for for chasischasis--1075 si2k/core AVG1075 si2k/core AVG

ce-alice.sdfarm.kr

14node (112core)14node (112core)120 ksi2k120 ksi2k

rgma.sdfarm.kr

hansolo.kisti.re.kr leia.kisti.re.kr

Is there no way to see all these services’ status in one view ?

Service Composition for LCG Monitoring

5

Monitoring services for LCG

Availability testing framework – SAM/RSV Job and Data reliability monitoring – Gridview Grid topology – GOCDB/Registration DB Dynamic view of the grid – BDII/CeMon Accounting – APEL/Gratia Experiment views – Dashboards Fabric monitoring – Nagios, LEMON, … Grid operations tools – CIC Portal

Introduction

Service Composition for LCG Monitoring

6

Monitoring services for LCG

If new monitoring service ?

Introduction

If we need to watch new aspects of resources ?

Service Composition for LCG Monitoring

7

Example: GOCDB

Service Composition for LCG Monitoring

8

Example: Fabric monitoring with Nagios

Service Composition for LCG Monitoring

9

Example: MonALISA Repository for ALICE

Introduction

Service Composition for LCG Monitoring

10

User’s decision rule

Service Composition for LCG Monitoring

11

Requirements for LCG Monitoring Service Platform

Usually, to easily give integrated view of resources and services

Integrated services should be loosely coupled Basically, monitoring services are loosely coupled, except few of them.

Service integration could be performed in distributed

All services should have a standard interface

Service integration process should be flexible to add and to retrieve entities

Entities include monitoring services and authorized users.

Service Composition for LCG Monitoring

12

Introduction to Service Composition

Service Composition for LCG Monitoring

13

Service Composition for Monitoring

Result of service composition Integrated monitoring view that consumer requested

Unit services to be used in service composition Existing monitoring service

(SAM, Gridview, GOCDB, BDII, APEL, Dashboards, Nagios, … )

SAM (page 1)

SAM (page 2)

SAM_total

Nagios

gStat

Service Mon.

APEL

Service Stat.Service Stat.

<example>

Service Composition for LCG Monitoring

14

Service Composition of Monitoring

Security of monitored information LCG users are authorized based on VO.

make it easy to add new users All services that are critical to security should be aware of VO based

authorization. make it easy to add new services

SAM (page 1)

SAM (page 2)

SAM_total

Nagios

gStat

Service Mon.

APEL

Service Stat.Service Stat.

GOCDB

User Cert.

VOMS

<example>

Service Composition for LCG Monitoring

15

Service Composition of Monitoring

Composition rule A kind of service to give flexibility to user-defined integrated service

Decision function

SAM (page 1)

SAM (page 2)

SAM_total

Nagios

gStat

Service Mon.

APEL

Service Stat.Service Stat.

GOCDB

User Cert.

VOMS

Service_CRSAM_CR CR

<example>

Service Composition for LCG Monitoring

16

Service registration and retrieval

Service registration and retrieval are fundamental functions of service composition and execution

GOCDB

VOMS

SAMNagiosAPELgStatGridview New Service

ServiceDescriptions

ServiceRegistry

Query Parser

CompositionRule

Query Engine

Service Composition

Engine

X.509 Athentication & Authorization while using Composited Services

Service Composition for LCG Monitoring

17

Conclusion

To introduce a new way to overcome problems on the use of current LCG monitoring, service composition approach is introduced. To minimize the complexity of the use and management of LCG, new

integrated view of monitoring information is needed.

By the use of service composition approach for LCG monitoring: Users can have flexibility to build their own monitoring view Users can add their own decision factor to their monitoring view with

Composition Rule By the use of LCG’s auth. & authorization scheme,

users can have the flexibility to add new service and new user.

Service Composition for LCG Monitoring

18

kyun@kisti.re.kr