Date post: | 30-Dec-2015 |
Category: |
Documents |
Upload: | lael-potts |
View: | 29 times |
Download: | 0 times |
E-infrastructure shared between Europe and Latin America
Hands-on on Information System
Manuel Rubio del Solar
CETA-CIEMAT
EELA Tutorial, Mérida, 07-10.11.2006
2EELA Tutorial, Mérida, 14-16.11.2006
E-infrastructure shared between Europe and Latin America
lcg-infosites
3EELA Tutorial, Mérida, 14-16.11.2006
E-infrastructure shared between Europe and Latin AmericaExercise 1
Get CE information
$ lcg-infosites - -vo gilda ce
4EELA Tutorial, Mérida, 14-16.11.2006
E-infrastructure shared between Europe and Latin America
$ lcg-infosites --vo gilda ceThese are the related data for gilda: (in terms of queues and CPUs)
****************************************************************
#CPU Free Total Jobs Running Waiting ComputingElement
------------------------------------------------------------------------------------------
4 3 0 0 0 cn01.be.itu.edu.tr:2119/jobmanager-lcglsf-long
4 3 0 0 0 cn01.be.itu.edu.tr:2119/jobmanager-lcglsf-short
34 33 0 0 0 grid010.ct.infn.it:2119/jobmanager-lcgpbs-long
16 16 0 0 0 grid011f.cnaf.infn.it:2119/jobmanager-lcgpbs-long
1 1 0 0 0 grid006.cecalc.ula.ve:2119/jobmanager-lcgpbs-log
[..]
5EELA Tutorial, Mérida, 14-16.11.2006
E-infrastructure shared between Europe and Latin AmericaExercise 2
Get SE information
$ lcg-infosites - -vo gilda se
6EELA Tutorial, Mérida, 14-16.11.2006
E-infrastructure shared between Europe and Latin America
$ lcg-infosites --vo gilda se
**************************************************************These are the related data for gilda: (in terms of SE)**************************************************************
Avail Space(Kb) Used Space(Kb) Type SEs--------------------------------------------------------------------------------------143547680 2472756 disk cn02.be.itu.edu.tr168727984 118549624 disk grid009.ct.infn.it13908644 2819288 disk grid003.cecalc.ula.ve108741124 2442872 disk gildase.oact.inaf.it28211488 2948292 disk testbed005.cnaf.infn.it349001680 33028 disk gilda-se-01.pd.infn.it31724384 2819596 disk cna03.cna.unicamp.br387834656 629136 disk grid-se.bio.dist.unige.it
7EELA Tutorial, Mérida, 14-16.11.2006
E-infrastructure shared between Europe and Latin AmericaExercise 3
Get information about installed software
$ lcg-infosites - -vo gilda tag
8EELA Tutorial, Mérida, 14-16.11.2006
E-infrastructure shared between Europe and Latin America
$ lcg-infosites --vo gilda tag
*************************************************************************Information for gilda relative to their software tags included in each CE*************************************************************************
Name of the TAG: VO-gilda-GEANTName of the TAG: VO-gilda-GKS05Name of the CE:cn01.be.itu.edu.tr
Name of the TAG: VO-gilda-slc3_ia32_gcc323Name of the TAG: VO-gilda-CMKIN_5_1_1Name of the TAG: VO-gilda-GEANTName of the TAG: VO-gilda-GKS05Name of the CE:grid010.ct.infn.it
[..]
9EELA Tutorial, Mérida, 14-16.11.2006
E-infrastructure shared between Europe and Latin Americalcg-infosites options
10
EELA Tutorial, Mérida, 14-16.11.2006
E-infrastructure shared between Europe and Latin America
lcg-info
11
EELA Tutorial, Mérida, 14-16.11.2006
E-infrastructure shared between Europe and Latin Americalcg-info
We can use this command to list which CE and SE satisfies a set of given conditions. We can also show values of a set of given attributes.
Information is taken from BDII especified in LCG_GFAL_INFOSYS variable.
Request sintax is:
attr1 op1 valueN, ... attrN opN valueN
12
EELA Tutorial, Mérida, 14-16.11.2006
E-infrastructure shared between Europe and Latin Americalcg-info options
13
EELA Tutorial, Mérida, 14-16.11.2006
E-infrastructure shared between Europe and Latin AmericaExercise 5
Get supported attributed list
$ lcg-info --list-attrs
14
EELA Tutorial, Mérida, 14-16.11.2006
E-infrastructure shared between Europe and Latin America
$ lcg-info --list-attrs
Attribute name Glue object class Glue attribute name
MaxTime GlueCE GlueCEPolicyMaxWallClockTimeCEStatus GlueCE GlueCEStateStatusTotalJobs GlueCE GlueCEStateTotalJobsCEVOs GlueCE GlueCEAccessControlBaseRuleTotalCPUs GlueCE GlueCEInfoTotalCPUsFreeCPUs GlueCE GlueCEStateFreeCPUsCE GlueCE GlueCEUniqueIDWaitingJobs GlueCE GlueCEStateWaitingJobsRunningJobs GlueCE GlueCEStateRunningJobsCloseCE GlueCESEBindGroup GlueCESEBindGroupCEUniqueIDCloseSE GlueCESEBindGroup GlueCESEBindGroupSEUniqueIDSEVOs GlueSA GlueSAAccessControlBaseRuleUsedSpace GlueSA GlueSAStateUsedSpaceAvailableSpace GlueSA GlueSAStateAvailableSpaceType GlueSE GlueSETypeSE GlueSE GlueSEUniqueIDProtocol GlueSEAccessProtocol GlueSEAccessProtocolTypeArchType GlueSL GlueSLArchitectureTypeProcessor GlueSubCluster GlueHostProcessorModelOS GlueSubCluster GlueHostOperatingSystemNameCluster GlueSubCluster GlueSubClusterUniqueIDTag GlueSubCluster GlueHostApplicationSoftwareRunTimeEnvironmentMemory GlueSubCluster GlueHostMainMemoryRAMSize
15
EELA Tutorial, Mérida, 14-16.11.2006
E-infrastructure shared between Europe and Latin AmericaExercise 6
Show all CEs on BDII satisfiying some given conditions
$ lcg-info --list-ce --query 'TotalCPUs>=30,OS=SL*' --attrs 'RunningJobs,FreeCPUs‘
16
EELA Tutorial, Mérida, 14-16.11.2006
E-infrastructure shared between Europe and Latin America
$ lcg-info --list-ce --query 'TotalCPUs>=30,OS=SL*' --attrs 'RunningJobs,FreeCPUs‘
- CE: grid010.ct.infn.it:2119/jobmanager-lcgpbs-long - RunningJobs 0 - FreeCPUs 33
- CE: grid010.ct.infn.it:2119/jobmanager-lcgpbs-short - RunningJobs 0 - FreeCPUs 33
- CE: grid010.ct.infn.it:2119/jobmanager-lcgpbs-infinite - RunningJobs 1 - FreeCPUs 33
- CE: skurut1.cesnet.cz:2119/jobmanager-lcgpbs-long - RunningJobs 0 - FreeCPUs 26
[..]
17
EELA Tutorial, Mérida, 14-16.11.2006
E-infrastructure shared between Europe and Latin America
R-GMA
18
EELA Tutorial, Mérida, 14-16.11.2006
E-infrastructure shared between Europe and Latin America
• To start R-GMA command line type:
>rgma
• On begin this message appears.
R-GMA – Command line (1)
19
EELA Tutorial, Mérida, 14-16.11.2006
E-infrastructure shared between Europe and Latin America
• To launch a command type it after rgma> prompt and
press “enter”.
• Command history is managed with “up” and “down”
keys.
• For quick access to a command type it’s first
characters and press “CTRL-R”
• Use TAB key to complete the command input.
Command input
20
EELA Tutorial, Mérida, 14-16.11.2006
E-infrastructure shared between Europe and Latin America
• help
Shows general help
• help <command>
Show specific help
• exit or quit
Quit RGMA command line.
• Show tables
Show all table names of the schema. (Schema)
• Describe <tablename>
Show table structure information.
General commands
21
EELA Tutorial, Mérida, 14-16.11.2006
E-infrastructure shared between Europe and Latin America
• To obtain data use SQL SELECT clause:
rgma> SELECT * FROM GlueService
SELECT behaviour is according to the request type. There are three request types of SELECT:
• LATEST. Return most recents rows for each primary key.
• HISTORY. Return all historic rows for each primaty key.• CONTINUOUS Return rows as soon are being inserter.
Querying data (1)
22
EELA Tutorial, Mérida, 14-16.11.2006
E-infrastructure shared between Europe and Latin America
• To change request type use SET QUERY :
rgma> SET QUERY LATEST
or
rgma> SET QUERY CONTINUOUS
• To show current request type:
rgma> SHOW QUERY
Querying data (2)
23
EELA Tutorial, Mérida, 14-16.11.2006
E-infrastructure shared between Europe and Latin America
1. Show all schema tables:
rgma>show tables
2. Show information about GlueSite table:
rgma>describe GlueSite
3. Make a query about GlueSite table:
rgma>set query latest
rgma>show query
rgma>select Name,Latitude,Longitude from GlueSite
Exercises
24
EELA Tutorial, Mérida, 14-16.11.2006
E-infrastructure shared between Europe and Latin America
• Rows max age can be configured. To limit latest or history rows age use SET MAXAGE
rgma> SET MAXAGE 2 minutes
rgma> SET MAXAGE 120
• To show row max age:
rgma> SHOW MAXAGE
• To unable max age:
rgma> SET MAXAGE none
Row max age
25
EELA Tutorial, Mérida, 14-16.11.2006
E-infrastructure shared between Europe and Latin America
• Another property of requests is “timeout”
– We can use timeout to prevent network failure or other situations
– In continuous type, timeout means how long the request will continue returning new rows.
– Default timeout it’s 1 minute.
rgma>SET TIMEOUT 3 minutes or rgma>SET TIMEOUT 180
• To show current timeout rgma>SHOW TIMEOUT
Timeout property
26
EELA Tutorial, Mérida, 14-16.11.2006
E-infrastructure shared between Europe and Latin America
• We can use SQL INSERT to add new data:
rgma>INSERT INTO userTable VALUES (’a’, ’b’, ’c’, ’d’)
• Producer component inserts data on R-GMA. This component manages INSERT clause.
Data production and insertion (1)
27
EELA Tutorial, Mérida, 14-16.11.2006
E-infrastructure shared between Europe and Latin America
• To show the current producer type:
rgma>show producer
• To set the producer type:
rgma>set producer latest
Data production and insertion (2)
28
EELA Tutorial, Mérida, 14-16.11.2006
E-infrastructure shared between Europe and Latin America
1. Insert and select one row using a contiuous producer to support Continuous and historic querys.
rgma>set producer continuous
rgma>insert into userTable values('cod','string',1.4,66)
rgma>set query continuous
rgma>set maxage 1 minutes
rgma>set timeout 5 seconds
rgma>select * from userTable
Exercise
29
EELA Tutorial, Mérida, 14-16.11.2006
E-infrastructure shared between Europe and Latin America
• To set the secondary producer for consume from userTable table:rgma>SECONDARYPRODUCER userTable
• Secondary producer can be set for latest or history request.rgma>SET SECONDARYPRODUCER latest
• To show current secondary producer type: rgma>SHOW SECONDARYPRODUCER
Secondary producer
30
EELA Tutorial, Mérida, 14-16.11.2006
E-infrastructure shared between Europe and Latin America
2. Insert and select data using a secondary producer supporting latest querys.
rgma>set secondaryproducer latest
rgma>secondaryproducer userTable
rgma>show producers of userTable
rgma>set producer continuous
rgma>insert into userTable values ('cod','string',5.2,44)
rgma>set query latest
rgma>select * from userTable
Exercise
31
EELA Tutorial, Mérida, 14-16.11.2006
E-infrastructure shared between Europe and Latin America