10/8/03 1

Jeremy McCormick, Sergey Uzunyan, Guilherme Lima, et al

LCD Computing Setup

Server Specs and Setup

Desktop Cluster Organization

Physics Software Distribution

Plans and Schemes

10/8/03 2

Server Hardware Specs

• Dual-CPU Athlon: 2.133 GHz

• 2 Gb RAM

• HD: 1 master disk, 1 secondary, 4 RAID

• ~1 TB total storage

10/8/03 3

Server Configuration

• Red Hat 9

• kernel 2.4.20-13.9smp

• hostname k2

• IP 131.156.85.141

• accessible via SSH

10/8/03 4

Server Filesystem

Filesystem Size Mount Description

/dev/hda1 13 G / root fs

/dev/hda3 19G /home home dirs

/dev/hdb2 185G /k2bkp backup disk

/dev/lcd/k2dist 9.9G /k2dist physics distribution

/dev/lcd/k2work 145G /k2work project work dirs

/dev/raid0/lcd_data

734G /k2data project data

10/8/03 5

Conceptual Diagram

K2

hius ravanadvk lepton pandorario

Desktops

SSH

Master Node

NFS

10/8/03 6

NFS Structure 

Mount Description

/k2dist physics software distribution

/k2bkp backup

/home/$USERNAME user home directory

/k2work/$USERNAME project work directory

/k2data/$USERNAME project data

/sdisk/$MACHINE workstation shared disks

  

10/8/03 7

Physics Software Distribution 

  

• simulation, analysis & event generation

• shared binaries, libraries, scripts, includes, etc.

• usable from any node in desktop cluster

• common environment & setup scripts

• /k2work/$USERNAME application builds possible

• /k2dist isolates physics apps from Linux fs

10/8/03 8

/k2dist directory structure 

  

Directory Description Contains

apps 

applications directory tree with packages, libs, binaries

bin executables shell scripts, binaries, symlinks to binaries

config configuration info currently contains node list

doc documentation application docs (pdf, html, ps, etc.)

include source includes symlinks to include dirs

install_files installation files install packages (tar.gz) in dirs

lib libraries symlinks to libraries

10/8/03 9

/k2dist/apps 

  

Analysisjas, root

Event Generationpandora-pythia, peg

Librariesaida, boost, cernlib, clhep, freehep, g4phys, geant4, lcio, Mesa, pegs4, xml4c

Simulationlcdg4, mokka, tbeam

Utilitiesdavid, dawn

10/8/03 10

Useful /k2dist/bin Scripts 

  

prjenv.sh• project env• add . /k2dist/prjenv.sh to ~/.bash_profile or ~/.cshrc

appenv.sh• application env• setup java vars, PATH, LD_LIBRARY_PATH, etc.• included by prjenv.sh

g4_5_2_p01env.sh• Geant4 env vars• included by prjenv.sh

nodes.sh• print node names, IPs, host• ex. = for n in `nodes.sh hn`; do ping $n done

10/8/03 11

Simple Remote Job 

  

test_job.sh # set project environment. /k2dist/bin/prjenv.sh# run jobnohup testbeam -m /k2work/jeremy/run10.mac -o /k2data/jeremy/tb-test.txt &> /k2work/jeremy/tb-test.log &

start job on node dvk[jeremy@lepton-physics jeremy]$ ssh rio /k2work/jeremy/test_job.sh

get pid[jeremy@lepton-physics jeremy]$ ssh rio pgrep testbeam22742

kill the job[jeremy@lepton-physics jeremy]$ ssh rio kill 22742

10/8/03 12

k2 + Desktop Cluster 

  

• new user setup

• common development platform

• “standard” NICADD physics apps

• no more desktop installs

• ample storage area

• shared datasets

• centralized authentication

• distributed computing

10/8/03 13

Plans and Schemes 

  

• no more development on nicadd & individual desktops

• setup & packaging scripts

• migrate SIO-Server

• batch computing (fbs, pbs)

• physics software packages

• framework applications

• add more cluster nodes

• world hegemony (or at least Western hemisphere)

10/8/03 14

K2 says “Hello”