LHC Magnet Tests:LHC Magnet Tests:
A challenge A challenge
for anfor an
Operation Operation
TeamTeamV. ChohanV. Chohan
G.H. HemelsoetG.H. Hemelsoet
CernCern
GenevaGeneva
Always set the trail, never follow the path
OutlineOutline
Introduction to SM18 & Magnets Tests Introduction to SM18 & Magnets Tests FacilityFacility
Operational TechniquesOperational Techniques The ChallengeThe Challenge The ActorsThe Actors Some tools set up by operationSome tools set up by operation
– Web serversWeb servers– Magnet Training CriteriaMagnet Training Criteria– Priority HandlingPriority Handling– Online and Real Time reportsOnline and Real Time reports
ConclusionsConclusions
SM18 TestsSM18 Tests
Limited InfrastructureLimited Infrastructure Heterogeneous TeamHeterogeneous Team
– Staff and outside contractorsStaff and outside contractors– Core of test manpower was a Core of test manpower was a
collaboration from Indiacollaboration from India Tight schedule to test 1706 Tight schedule to test 1706
magnetsmagnets– In fact more than 1900 tests (with In fact more than 1900 tests (with
spares and repeats)spares and repeats)
Magnets testedMagnets tested
Current / Current / FieldField
Required for Required for LHCLHC
Total TestedTotal Tested
DipolesDipoles 11850 A/11850 A/
8.33T8.33T12321232 13751375
SSSSSS 11850 A11850 A
233 T/M233 T/M392392 450450
IR SSSIR SSS 8282 9494
1919 Magnets tested on time
Cumulative tested Cumulative tested magnets magnets
Early Performance
With Operational Techniques
Staffing: Various Team Staffing: Various Team of SM18of SM18
Magnet Tests Team OP
Cryogenic Team
Magnet Connect/Disconnect
Team
Magnet Transport
Team
Mainly associates from DAE
India
Industrial Consortia
Equipment
support
Magnet Tests.. Magnet Tests.. What do we do ?What do we do ?
New magnet arrives..
Insulation test, connection to CFB
Preparatory tests (functioning of protection systems & instrumentation, insulation…)
Preparatory tests (tuning DAQ..)
Insulation tests
Functioning of protection systems
Power tests (&Training)
Magnetic measurements
Final insulation tests @cold
Cool down to 1.9K
Final warm tests
Electrical integrity
Resistance measurements..
Final insulation tests
Disconnection from CFB
Warm –up
Test Facility in Test Facility in SM18SM18
12 test benches in SM1812 test benches in SM18 Roughly speaking:Roughly speaking:
– 3 magnets @1.9 ‘k3 magnets @1.9 ‘k– 3 in warm-up or cool-down phase3 in warm-up or cool-down phase– 3 in connection or disconnection phase 3 in connection or disconnection phase – 3 spare &/or dedicated to special use3 spare &/or dedicated to special use– 6 power supplies ( 1 per 2 benches)6 power supplies ( 1 per 2 benches)
Dipoles as well as SSS’s TestingDipoles as well as SSS’s Testing
C2C1
B2B1
A2A1
F2F1
E2E1
D2D1
Web Server (SMTMS)Web Server (SMTMS)
Maintains electronic repository of tests resultsMaintains electronic repository of tests results Links tests results with management toolsLinks tests results with management tools Tracks test progress & test statisticsTracks test progress & test statistics Automatic generation of test reportsAutomatic generation of test reports Automatic filling of the tests doneAutomatic filling of the tests done
E-Traveller E-Traveller
Web based tool with mobile phone interface and video Web based tool with mobile phone interface and video display – alert teamsdisplay – alert teams
Keeps track of electronic, signature based information Keeps track of electronic, signature based information exchangeexchange
Automatic time stamped log of tests activitiesAutomatic time stamped log of tests activities Minimizes verbal communication.. Minimizes verbal communication..
Real Time InformationReal Time Information
Real time Real time status of the status of the facility was facility was displayed on displayed on the web and the web and on TV screens on TV screens around the around the CERNCERN
LHC Dashboard
Training RulesTraining Rules
Earlier, all magnets were trained to Earlier, all magnets were trained to ultimate field (12850A ~9T)ultimate field (12850A ~9T)
3-4 hours recovery time between 3-4 hours recovery time between quenches, Time consuming…quenches, Time consuming…
But… Most of the ‘good magnets’ But… Most of the ‘good magnets’ cross nominal field (11850A ~ cross nominal field (11850A ~ 8.33T) in the second training 8.33T) in the second training ramp.. ramp..
[ year 2003 Observation by OP [ year 2003 Observation by OP Team]Team]
Two-Quench Rule: Accept the Two-Quench Rule: Accept the magnet if it crosses nominal field in magnet if it crosses nominal field in Second training with small margin!Second training with small margin!
Three-Quench Rule: Accept the Three-Quench Rule: Accept the magnet if it crosses 12250 A (~8.66 magnet if it crosses 12250 A (~8.66 T) in third training, even if it had T) in third training, even if it had not passed the preceding rule..not passed the preceding rule..
80% magnets cross nominal in 2nd ramp!
ALL ramp2
10350
10850
11350
11850
12350
12850
13350
1001
-1st
run
3002
- 2n
d ru
n30
02-
3rd
run
3001
-3rd
run
1002
-3rd
run
1006
-1st
run
1008
-ist r
un10
1210
1310
1710
1810
3110
3210
3510
3810
4510
3910
4220
03-1
st r
un30
01-4
th r
un30
02-4
th r
un30
0430
0630
0730
0830
1430
2730
2830
46-2
nd r
un30
5430
7030
01-2
nd r
un10
04-1
st r
un20
0810
10-1
st r
un10
1610
50-2
nd r
un10
07-1
st r
un10
1510
0310
08-2
nd r
un10
09-1
st r
un20
0710
5210
2810
3420
08-2
nd r
un30
4520
0630
3430
4110
2330
4710
29-2
nd r
un20
0420
22-2
nd r
un20
26-2
nd r
un20
0930
4420
2030
1210
11-1
st r
un10
2410
0210
5030
1330
4210
4920
23-2
nd r
un30
1110
2130
3810
1410
2520
01-2
nd r
un20
01-3
rd r
un30
01-1
st r
un30
3930
6530
4310
26-
2nd
run
3002
- 1s
t run
2054
2002
1048
1029
-1st
run
3005
2017
2024
2025
-2nd
run
1027
2012
2029
1022
3046
2018
3055
2026
2001
-1st
run
1026
2010
1019
1020
2025
2021
2023
2024
2022
2027
1005
Magnet Appraisal & Magnet Appraisal & Performance Sheet Performance Sheet (MAPS)(MAPS)
Single page report Single page report on rule based on rule based magnet goodness magnet goodness evaluationevaluation
OP Team OP Team empowerment for empowerment for rapid, round the rapid, round the clock decision taking clock decision taking on first level of on first level of goodness evaluationgoodness evaluation
Mitigates issues of Mitigates issues of magnet storage magnet storage logisticslogistics
Overall & Cryo Priority SettingOverall & Cryo Priority Setting
Ensure that magnets follow the desired Ensure that magnets follow the desired cryogenic phase distribution, within the limits cryogenic phase distribution, within the limits of possibilities due to the varying training of possibilities due to the varying training performance ( a priori not known)performance ( a priori not known)
Rapid On Bench Thermal Rapid On Bench Thermal CycleCycle(ROBTC)(ROBTC)
Earlier, ‘poor magnets’ Earlier, ‘poor magnets’ were disconnected from were disconnected from bench, fitted with bench, fitted with anticryostats, tested anticryostats, tested again at a later date…again at a later date…
Additional Additional disconnection, disconnection, connection, preparatory connection, preparatory tests… time consuming..tests… time consuming..
But.. Quench But.. Quench performance improves performance improves after thermal cycleafter thermal cycle
Rapid On-Bench Rapid On-Bench Thermal Cycle (ROBTC): Thermal Cycle (ROBTC): Rapid thermal cycle of a Rapid thermal cycle of a poor magnet without poor magnet without disconnection from test disconnection from test benchbench
Prototype vs Prototype vs Operation Operation Prototype facilityPrototype facility
– Try to push every Try to push every magnet at the limitmagnet at the limit
– Repair or improve as Repair or improve as they have timethey have time
Operation not Operation not actively involved in actively involved in Software and design Software and design of facilityof facility– Each group has its Each group has its
own idea and own idea and implements its wayimplements its way
– Culture of keeping Culture of keeping control and hiding control and hiding thingsthings
Running acceleratorRunning accelerator– Try to push the whole Try to push the whole
complex at the limitcomplex at the limit– Fast and coordinated Fast and coordinated
repair and repair and improvementimprovement
Operation is central Operation is central about design and about design and software development software development – Advice of operation Advice of operation
before implementationbefore implementation– Open environment with Open environment with
trust of operationtrust of operation
Operation know-how Operation know-how
Before 2002Before 2002– All problems treated All problems treated
the same waythe same way No clear distinction No clear distinction
between magnet between magnet problem and problem and equipment problemequipment problem
– Poor global viewPoor global view Each magnet has its Each magnet has its
own Excel files with own Excel files with redundant redundant informationinformation
After 2003After 2003– Separation for magnet Separation for magnet
and bench problemsand bench problems E-log book for E-log book for
EquipmentEquipment Database for Database for
magnets magnets – Global web generated Global web generated
viewview One data base for all One data base for all
magnet information magnet information and an automatically and an automatically generated Magnet generated Magnet and Test Result and Test Result paper logbook.paper logbook.
ConclusionsConclusions
The tools developed by Operation helped The tools developed by Operation helped a lot to finish the magnet tests on timea lot to finish the magnet tests on time– Identify bottlenecks Identify bottlenecks
To do list To do list StatisticsStatistics
– Real push from the team to gain time Real push from the team to gain time Change of the rules Change of the rules Tracking of down timeTracking of down time
– Real time Management of the facilityReal time Management of the facility PrioritiesPriorities Web DisplayWeb Display
Whether we play a large or small role, by working together we achieve our objectives.
Foreseen TimesForeseen Times
Standard timeStandard time– 12 hrs connection12 hrs connection– 12 hours vacuum 12 hours vacuum
pumpingpumping– 26 hours cooldown26 hours cooldown– 36 hours cold test36 hours cold test– 12 hours warm up12 hours warm up– 12 hours disconnection12 hours disconnection
Total 108 hours per Total 108 hours per magnet magnet – (4.5 days of 24 hours)(4.5 days of 24 hours)
Standard Model
0
12
24
36
48
60
72
84
96
108
Per Any Magnet
disconnect
warm up
cold tests
cooldown
pump down
connection
Ideal situationIdeal situation
To ensure a maximal usage of the To ensure a maximal usage of the facility, a cog-wheeling strategy has to facility, a cog-wheeling strategy has to be set up. be set up.
TB Period n n+1 n+2 n+3 n+4 n+5 n+6 n+7 n+81 Install Setup To 90 K To 1.9 K Test 1.9 K Test 1.9 K Test 1.9 K Warmup Remove2 Test 1.9 K Test 1.9 K Test 1.9 K Warmup Remove Install Setup To 90 K To 1.9 K3 Remove Install Setup To 90 K To 1.9 K Test 1.9 K Test 1.9 K Test 1.9 K Warmup4 To 1.9 K Test 1.9 K Test 1.9 K Test 1.9 K Warmup Remove Install Setup To 90 K5 Warmup Remove Install Setup To 90 K To 1.9 K Test 1.9 K Test 1.9 K Test 1.9 K6 To 90 K To 1.9 K Test 1.9 K Test 1.9 K Test 1.9 K Warmup Remove Install Setup7 Test 1.9 K Warmup Remove Install Setup To 90 K To 1.9 K Test 1.9 K Test 1.9 K8 Setup To 90 K To 1.9K Test 1.9K Test 1.9 K Test 1.9 K Warmup Remove Install9 Test 1.9 K Test 1.9 K Warmup Remove Install Setup To 90 K To 1.9 K Test 1.9 K10 Test 1.9 K Test 1.9 K Test 1.9 K Warmup Remove Install Setup To 90 K To 1.9 K11 Remove Install Setup To 90 K To 1.9 K Test 1.9 K Test 1.9 K Test 1.9 K Warmup12 To 1.9 K Test 1.9 K Test 1.9 K Test 1.9 K Warmup Remove Install Setup To 90 K
In Reality …In Reality …
Operational Operational TechniquesTechniques Web based databaseWeb based database
– SM18 Test Management System (SMTMS)SM18 Test Management System (SMTMS) Links electronic repository of tests results with other Links electronic repository of tests results with other
management toolsmanagement tools Provide real time view of the facility to identify Provide real time view of the facility to identify
bottlenecksbottlenecks– E-travellerE-traveller
Web based, electronic signature based information Web based, electronic signature based information exchange toolexchange tool
Web Server
SM 18 control Room SM 18 Hall
Offices Status
Operational Operational TechniquesTechniques Improved Training rulesImproved Training rules
– Use the last quench of a magnet to help the warming upUse the last quench of a magnet to help the warming up– Modified Magnet Training CriteriaModified Magnet Training Criteria
Two-Quench Rule Two-Quench Rule Three Quench RuleThree Quench Rule
– Rapid On-Bench Thermal Cycle (ROBTC)Rapid On-Bench Thermal Cycle (ROBTC) Thermal cycle of a poor magnet without disconnection from Thermal cycle of a poor magnet without disconnection from
test benchtest bench Time & space optimizationTime & space optimization
– Overall & Cryo priority handlingOverall & Cryo priority handling 24 hour priority decision by OP team for effective & clash-24 hour priority decision by OP team for effective & clash-
free utilization of ALL resources ( Cryo, Power, bench etc)free utilization of ALL resources ( Cryo, Power, bench etc)– MAPSMAPS
Single page record of ‘rule based magnet goodness Single page record of ‘rule based magnet goodness evaluation’evaluation’
