esley Smith, U. Wisconsin, August 22, 2006 DOE Review: Task T: CMS at LHC - 1 Task T - CMS at LHC Task T - CMS at LHC Personnel: •Professors: D. Carlsmith, S. Dasu, M. Herndon, D. Reeder, W. Smith •Senior Scientist: R. Loveless (New) (Retiring) •Senior Electronics Engineer: T. Gorski •Associate Scientist: P. Chumney, Assistant Scientists: M. Grothe, A. Lanaro •Postdoc: Y. Baek •Engineers: D. Bradley, A. Golyash, M. Jaworski, A. Mohapatra, S. Rader •Graduate Students: M. Anderson, K. Grogg, J. Klukas, K. Lazaridis, J. Leonard, M. Weinberg •Technician: R. Fobes •PSL Engineers: F. Feyzi, J. Hoffman, P. Robl, D. Wahl, D. Wenman •PSL Draft/Tech: B. Dana, G. Gregerson, D. Grim, J. Johnson, D. Northacker, J. Pippin, R. Smith Outline/ Activities: •Overview & Trigger Activity -- this talk •Computing & Software & Physics Activity -- Sridhara Dasu •Common & Muon & Tracking Activity -- Dick Loveless •Endcap Muon Alignment Activity -- Duncan Carlsmith
Transcript
Wesley Smith, U. Wisconsin, August 22, 2006 DOE Review: Task T: CMS at LHC - 1
Task T - CMS at LHCTask T - CMS at LHCTask T - CMS at LHCTask T - CMS at LHCPersonnel:•Professors: D. Carlsmith, S. Dasu, M. Herndon, D. Reeder, W. Smith•Senior Scientist: R. Loveless ( New) ( Retiring)•Senior Electronics Engineer: T. Gorski•Associate Scientist: P. Chumney, Assistant Scientists: M. Grothe, A. Lanaro•Postdoc: Y. Baek•Engineers: D. Bradley, A. Golyash, M. Jaworski, A. Mohapatra, S. Rader•Graduate Students: M. Anderson, K. Grogg, J. Klukas, K. Lazaridis, J. Leonard, M. Weinberg •Technician: R. Fobes•PSL Engineers: F. Feyzi, J. Hoffman, P. Robl, D. Wahl, D. Wenman•PSL Draft/Tech: B. Dana, G. Gregerson, D. Grim, J. Johnson, D. Northacker, J. Pippin, R. Smith
• Associate Scientist: Pamela Chumney• 6 yrs on CMS Cal Trig, former HERMES Trig. Coor.
• Assistant Scientist Monika Grothe• 3 yrs on CMS Cal Trig, 2 years ATLAS higher level trig., 3.5 yrs Babar,SVT Commissioner/Run-Coordinator
Engineers:• Tom Gorski -- Lead Engineer & Designer
• 3.5 yrs on CMS Cal Trig, worked at PSL on SDC & Zeus Cal. Triggers
• Replaced J. Lackey, who retired but is available for consulting
• Matt Jaworski -- Design support, Testing• Worked on Zeus Calorimeter Trigger
• Phil Robl -- Copper Link Test/Development • Lead PSL Engineer, Worked on Zeus Trigger, SDC, CMS EMU
Technician: Robert Fobes (Worked on Zeus Trigger)Students: Mike Anderson, Kira Grogg, Kristos Lazaridis, Jessica
Leonard,Marc Weinberg (Trig emulator, Rate Calc.)
Wesley Smith, U. Wisconsin, August 22, 2006 DOE Review: Task T: CMS at LHC - 4
Endcap Muon PersonnelEndcap Muon PersonnelEndcap Muon PersonnelEndcap Muon PersonnelPhysicists (DOE base program support):•Dick Loveless (EMU level 2 manager)•Armando Lanaro (L3 manager for installation)•Yongwook Baek (cabling, low voltage, installation)•A. Lanaro & Y. Baek based at CERN; responsible for day-to-day work on integration and installation
•Duncan Carlsmith (Alignment)• Jim Bellinger, CDF Scientist•Jeff Klukas, Grad Student
Level-1 Trigger Requirements:• Input: 109 events/sec at 40 MHz at full L = 1034
• Output: 100 kHz (50 kHz for initial running)• Latency: 3 sec for collection, decision, propagation• Output direct to computer filter farm (no physical level-2)
Wesley Smith, U. Wisconsin, August 22, 2006 DOE Review: Task T: CMS at LHC - 7
UNIQUE:All system present trigger objects w/location, ET, quality -- topological triggers possible
Wesley Smith, U. Wisconsin, August 22, 2006 DOE Review: Task T: CMS at LHC - 8
Wisconsin CMS Task SupportWisconsin CMS Task Support(over past decade)(over past decade)
Wisconsin CMS Task SupportWisconsin CMS Task Support(over past decade)(over past decade)
UW 95-96 Support of Personnel• J. Lackey, S. Dasu, PSL Engineering
UW Equipment Support• Teleconference Equipment• Video Room Remodeling• CAD Printer
UW CAD support• Purchase of Visula PCB Suite, incl. high speed router
• New version of software used for Zeus triggerUW Computing Support
• > $ 700K• 5 New Servers, 2 TB Disk, 1 GB/s network, Grad. Student RA
• 70 CPU system for simulation with Condor + network upgrade
• Two new Computer Rooms with power & AC• Matching for “GLOW” shared computing facility
Wesley Smith, U. Wisconsin, August 22, 2006 DOE Review: Task T: CMS at LHC - 9
160 MHz point to point backplane• 18 Clock&Control ,126 Electron ID & Receiver Cards -- all validated18 Jet/Summary Cards -- all cards operate @ 160 MHz
• Use 5 Custom Gate-Array 160 MHz GaAs Vitesse Digital ASICs• Phase, Adder, Boundary Scan, Electron Isolation, Sort
Wesley Smith, U. Wisconsin, August 22, 2006 DOE Review: Task T: CMS at LHC - 10
SORTASICs(w/heat sinks)
EISO
EISO
Bar Code
Input
DC-DCConverter
s
Clock delay adjust
Clock Input
Oscillator
DC-DC
Adder
mezzlink cards
BSCANASICs
PHASEASICs
MLUs
BackBar Code
Front
Regional Cal. Trigger CompleteRegional Cal. Trigger Complete- U. Wisconsin- U. Wisconsin
Regional Cal. Trigger CompleteRegional Cal. Trigger Complete- U. Wisconsin- U. Wisconsin
Receiver Card: Electron Isolation & Clock: Jet/Summary:
ReceiverMezz. Card
BSCANASICs
SortASICs
BSCANASICs
PhaseASIC
158/164tested(126)
154/154Tested(126)
23/25tested(18)
23/25tested(18)
(27/28CustomBackplTested)(18)
fractiontested(needed)
EISO
Clock
Front
Back
Five full crates at CERN Rest waiting here
Wesley Smith, U. Wisconsin, August 22, 2006 DOE Review: Task T: CMS at LHC - 11
5 RCT Full Crates Operating at 5 RCT Full Crates Operating at CERNCERN
- U. Wisconsin- U. Wisconsin
5 RCT Full Crates Operating at 5 RCT Full Crates Operating at CERNCERN
- U. Wisconsin- U. Wisconsin
Rear of Full RCT crate fully cabled to HCAL trigger primitive logic
Front of Full RCT crate with Jet Capture Card that continuously samples output, checks on the fly for errors and provides readout of 256 crossingsUsed for integration tests &
board checkout after shipment
Wesley Smith, U. Wisconsin, August 22, 2006 DOE Review: Task T: CMS at LHC - 12
New: Jet Capture CardNew: Jet Capture Card-- Tom Gorski-- Tom Gorski
New: Jet Capture CardNew: Jet Capture Card-- Tom Gorski-- Tom Gorski
Receives 14 Reg. Sums, 8 HF ET’s, 8 e/, and and bits on 6 SCSI type cables
Captures output from Jet Summary Card going to Global Calorimeter Trigger • Being used in final validation of RCT crates, all cards will go through an extended
full crate test with the JCC• Software developed by Pam Chumney & Tom Gorski• Provides calorimeter trigger for CMS Magnet Test & Cosmic Challenge• Provides temporary trigger to Global Trigger while Global Calorimeter Trigger is
being prepared
FPGAs
Translators
DelaysCCCSignals In
SignalsOut
JSC Inputs
Wesley Smith, U. Wisconsin, August 22, 2006 DOE Review: Task T: CMS at LHC - 13
Operate fully functional trigger electronics at CERN•Employed in myriad tests & preparation activities
Tests in Electronics Integration Center•Labs & row of racks for all electronicssubsystems•Test interfaces & integration as much as possible before move to USC55
MTCC in SX5•Test multiple triggercomponents with multipledetector components duringthe magnet test.•Verify trigger functions &interfaces w/detectors onsurface
Crates, Fans, Power Supplies, Monitoring, Controls and other infrastructure installed, validated and passed safety check in July
Ready for card installation
Wesley Smith, U. Wisconsin, August 22, 2006 DOE Review: Task T: CMS at LHC - 15
Tech’n. R. Fobes (l.) & Eng’r. T. Gorski (r.):
Electronics work in Electronics work in 2006-72006-7
Electronics work in Electronics work in 2006-72006-7
Finish & Test Master Clock Crate•Develop detailed timing test system•Use 4-crate test-bed in Madison to produce exact procedures
•Validate Clock Fanout Cards•Multiple crate tests•Check for datasynchronization
Repair & Analysis ofBoard Failures•Spare Parts Inventories
Install,
Commission &
Operate
Final System
in USC55
Wesley Smith, U. Wisconsin, August 22, 2006 DOE Review: Task T: CMS at LHC - 16
Assoc. Scientist P. Klabbers (l.) & Asst. Scientist M. Grothe (r.):(both
resident at CERN)
Cal Trigger Tasks at Cal Trigger Tasks at CERNCERN
- P. Klabbers, M. Grothe & students - P. Klabbers, M. Grothe & students
Cal Trigger Tasks at Cal Trigger Tasks at CERNCERN
- P. Klabbers, M. Grothe & students - P. Klabbers, M. Grothe & studentsRetest RCT Crates arriving at CERN•Comprehensive long term tests with Jet Capture Card performed in RCT lab in electronics integration center
Install RCT Crates in Underground Counting Room•Connect & test 1000+ E,HCAL cables•Connect & test to Global Cal. Trigger
Install & Test Master Clock system•Synchronize all within 4 ns to centraltiming system
Diagnostic & Online Software•Downloading detailed test patterns•Trigger Emulator•Bit-level match to actual electronics
Integration with Trigger Supervisor•Online Monitoring & Control•Configuration of Memory Lookups•Reprogramming•Function Validation
Wesley Smith, U. Wisconsin, August 22, 2006 DOE Review: Task T: CMS at LHC - 17
Trigger Lab Setup at CERNTrigger Lab Setup at CERNTrigger Lab Setup at CERNTrigger Lab Setup at CERNStaging area - Prevessin 904•Receive boards, crates, cables from Wisconsin•Inspect and log in using barcodes and database•Assemble crates for Integration/USC55•Power up and run system tests •Operate in water-cooled rack for extended tests
Integration tests•Racks with cooling on a raised floor nearby
Storage and Repair•Spare Crates and cards also available for use in testing and replacement of suspect cards•Soldering station, scope, and tool storage•Spare component storage
Responsible: P. Chumney & M. Grothe•When collisions start need added personnel so group members can actively pursue physics analysis (task B redirection).
Wesley Smith, U. Wisconsin, August 22, 2006 DOE Review: Task T: CMS at LHC - 18
in Electronics Integration Center in Electronics Integration Center (Pr. 904)(Pr. 904)Large scale
successful integration tests in central racks using common TTC infrastructure involving trigger primitives, regional & global processing:•Calorimeter Trigger•Muon Trigger•Global Trigger
Wesley Smith, U. Wisconsin, August 22, 2006 DOE Review: Task T: CMS at LHC - 19
HCAL HTR to RCT •Used JCC to verify data•6 cables used - all in sync•Latency measurements w/PMTas source of HCAL TPG
ECAL TCC to RCT •Valid link established •Channel number sent as data• 2 channels on 20 m cablessent in sync to RCT
HCAL HTR & ECAL TCC to RCT •28 cables to RCT from 9 TCC & 18 HCAL HTR outputs•Common clocking: LTC, TTCci•28 channels in sync - links stable for >10 hours error free running•“Hydra” link cable checked as an option for two SLB’s to one RCT RMC
ECAL - HCAL Pattern tests•RCT can “lookup” incoming data•LUTs can be programmed to duplicate incoming data•Have ORCA emulation to help predict outputs
HCAL HTRHCAL HTR
ECAL TCCECAL TCC
RCTRCT
Wesley Smith, U. Wisconsin, August 22, 2006 DOE Review: Task T: CMS at LHC - 20
RCT to Local Timing Controller (for MTCC) Tests •Receive 56 HCAL links (448 towers) in Green Barracks•Send trigger out with RCT Jet Capture Card•OR of towers in each half using Quality Bit
•Validated connection with LTC/GT•GT ANDs top & bottom - reduces rate
RCT Jet Capture Card to GT Tests •Backup Global Calorimeter Trigger•JCC in spare VME slot of RCT Crate•Currently sends up to 4 trigger bits•Threshold ET, e/ candidate, MIP
•Tests using RCT pattern successful!•ECAL TCC patterns yield JCC output•Synchronized to Bunch crossing 0
RCT- GCT Source Card•First test with new GCT•Completed successfully in July
Wesley Smith, U. Wisconsin, August 22, 2006 DOE Review: Task T: CMS at LHC - 21
RCT:•Crate fully operational in Green Barracks at Point 5•Cable connections made to HCAL•Full modules above and below connected•Allows for top-bottom coincidence
HCAL crate to RCTRCT input from HCAL
RCT output trigger
Wesley Smith, U. Wisconsin, August 22, 2006 DOE Review: Task T: CMS at LHC - 22
(all from base program)(all from base program)Change trigger as beam conditions changeStudy new trigger configurations
• Test runs, Monte Carlo studies, data studiesTrigger Physics Analysis
• Understand detailed impact of trigger on physics Preparation for luminosity increases
• Monte Carlo studies of new conditions, validate with present data
Respond to changing apparatus• Changes in material, configuration, etc. changes in simulation
Operations - 24x7 support during running• Write, test & maintain electronics test programs• Maintain & update bad channel list & run daily checking programs
• Run Control maintenance• Trigger data validation and calibration
• Online & Offline analysis of rates & efficiencies• Monte Carlo & data trigger simulation maintenance
• Continuous validation of trigger using simulation & readout data
Will need to augment UW personnel to perform tasks & do physics• Propose to redirect personnel from Task B (ZEUS)
Wesley Smith, U. Wisconsin, August 22, 2006 DOE Review: Task T: CMS at LHC - 23
• Extends LHC mass reach by ~ 20-30% • Modest changes to machine• Detector upgrades needed -- especially the trigger & tracker
• Time scale ~ 2015 Trigger: higher luminosity & tracking data
• Double operational frequency from 40 MHz to 80 MHz• Design for much higher rejection power for pileup to retain output rate of 100 kHz -- more sophistication
• Correlation of muon & cal triggers with new tracking trigger
Started in FY04 • Workshops: US CMS in Madison Feb ‘04, CMS at CERN Feb ‘04 & Imperial College Jul ‘04.
• CMS SLHC Level-1 Trigger and Tracker project started. W. Smith & G. Hall (Imperial) chosen to lead effort.
• Workshop at CERN July ‘05 (last week) proposes plan & roadmap
As project ramps up, needs additional personnel• Use redirection of Task B effort
Wesley Smith, U. Wisconsin, August 22, 2006 DOE Review: Task T: CMS at LHC - 24
• Present staff will be saturated w/trigger maintenance & operations
• Will need additional staff to permit physics analysis, use of Wisconsin computing resources.
• Propose to redirect Task B (ZEUS) staff to meet shortfallProject support of Lead Designer/ Expert Engineer: T. Gorski• Vital for commissioning and operations• US CMS project support for M&O supervised by base program• Estimated technical support project needs for M&O:
• Based on Zeus Cal. Trigger M&O 1992-2001• Technician
•Operates, repairs, maintains test facility•Repairs boards & infrastructure under physicist guidance•Total required = 0.5 FTE
• Expert Engineer•~ 5 trips/year for 2-3 weeks to make difficult repairs•Complicated/Subtle problems, Modifications to trigger electronics
• Designer - available for consultation•~ 2 trips/year for 2-3 weeks for review & design issues
Wesley Smith, U. Wisconsin, August 22, 2006 DOE Review: Task T: CMS at LHC - 25
•Production is finished, production testing past halfway point.
•Integration tests w/ECAL,HCAL, Global Calorimeter Trigger are underway with successful results.
Very good progress, but…•Major work from now on:•Production Testing, Shipping, Retesting of > 1500 Boards
•Software Development•Setup of full testing facility/lab at CERN EIC•More Integration Tests •Installation and Commissioning•Operations!•Physics!
Wesley Smith, U. Wisconsin, August 22, 2006 DOE Review: Task T: CMS at LHC - 26
Task T Endcap Muon Task T Endcap Muon ActivitiesActivities
(Talk by R. Loveless)(Talk by R. Loveless)
Task T Endcap Muon Task T Endcap Muon ActivitiesActivities
(Talk by R. Loveless)(Talk by R. Loveless)Project Management: Dick Loveless•Construction, test, integration, installation & commissioning of 496 CSCs, electronics & infrastructure (have to lower all this in 2006!)
Chamber Install., Cabling & Test•Wisconsin responsibility -- led by UW scientist A. Lanaro, assisted by UW postdocY. Baek
Low Voltage System•Wisconsin responsibility for all chambers & crates -- R. Loveless & UW Eng. A. Golyash•Radiation & high magnetic field -- working with commercial vendors
Endcap Alignment•Wisconsin responsibility -- Design & procurement complete•System installation -- A. Lanaro & Y, Baek•Alignment Reconstruction & Corrections -- D. Carlsmith, assisted by J. Bellinger•leverage CDF expertise
Wesley Smith, U. Wisconsin, August 22, 2006 DOE Review: Task T: CMS at LHC - 27
CMS Tracker ManagementCMS Tracker Management(reorganized this year, approved last (reorganized this year, approved last
week)week)
CMS Tracker ManagementCMS Tracker Management(reorganized this year, approved last (reorganized this year, approved last
week)week)
The Tracker Construction Board is:Task Manager DeputyTIB Guido Tonelli Ettore FocardiTOB Joe Incandela Duccio AbbaneoTEC Didier Contardo Stefan SchaelPixels Roland Horisberger Bruno GobbiModule Production Gian-Mario Bilei Francois VaseyTracker Integration Nicola Bacchetta aaaElectronic Integration Sandro Marchioro Patrice SiegristSoftware Integration Ian Tomalin Fabrizio PallaIntegration FacilityIntegration Facility Dick LovelessDick Loveless Patrice Siegrist
The Project Management Board is chaired by:Peter Sharp Project Manager and ChairmanGeoff Hall Deputy Project Manager – Construction Project
Wesley Smith, U. Wisconsin, August 22, 2006 DOE Review: Task T: CMS at LHC - 28
Task T Physics ActivitiesTask T Physics Activities(Talk by S. Dasu)(Talk by S. Dasu)
Task T Physics ActivitiesTask T Physics Activities(Talk by S. Dasu)(Talk by S. Dasu)
Preparation for CMS Physics TDR (2006) & early data analysis•New energy regime rapid discoveries•Need to start with well understood trigger, reconstruction & analysis software
Wide-ranging physics interest & expertise in the group•Analysis efforts to forefront as detector work finishes
•Ensure trigger systems start at full performance•UW is the leading contributor to PTDR trigger chapter
•Simulated Higgs, SUSY, SM EW and QCD datasets •Designed trigger systems that capture all the important physics efficiently while satisfying DAQ bandwidth requirements
•Design triggers for physics channels that are new to CMS +Full simulation and analysis for low mass Higgs•Diffractive Higgs (Hbb), presented at HERA-LHC workshop•Vector boson fusion Higgs (Hbb, H, HWW*), in preparation
•New efforts starting up•Lepton measurement and vector boson self-couplings
Accumulate large physics samples our computing effort
Integrated QCD rate for events with at least two jets
Integrated QCD rate for events with at least two jets and which satisfy the ‘loose’ Roman Pots condition
kH
z
1-4 jet rates 2 x 1033 cm-2 s-1 luminosity threshold values correspond to 95% efficiency
UW Students Creighton Hogg & Jessica Leonard on trigger rate calculations
Wesley Smith, U. Wisconsin, August 22, 2006 DOE Review: Task T: CMS at LHC - 29
UW Computing ActivitiesUW Computing Activities(talk by S. Dasu)(talk by S. Dasu)
UW Computing ActivitiesUW Computing Activities(talk by S. Dasu)(talk by S. Dasu)
Bradley [NSF-ITR] and Rader [DOE Base] Support•A CMS Tier-2 computer center from FY2005•Data-Intensive Science University Network (DISUN)
•Simulation production using local UW resources•The single largest institute producing CMS events 2002-2005
•OSG and Grid3 participation•Develop tools and provide cycles
•Local physics analysis support•Special simulation production•e.g., Produced 10 M events in 2 weeks for muon trigger studies*
•~ 25 world-wide CMS physicists using UW facilities and data •Help desk for using campus grid resources
•GLOW - Grid Laboratory of Wisconsin•Backbone of UW campus grid in collaboration with Ice Cube, Computer Sci., Biology, Chemical Eng., Medical Phys., etc.•Leader in development and implementation•Helped ATLAS group produce 10 M events fully simulated
200 Intel Xeon 2.4-2.8 GHz CPUs50 TB Apple XServe RAID Storagex4 by 2007 for CMS Physics Analysis
* Ten million events in 2 weeks
Wesley Smith, U. Wisconsin, August 22, 2006 DOE Review: Task T: CMS at LHC - 30
DOE Base Program Manpower at Wisconsin•Major effort on trigger software required•Tasks: board testing, monitoring/controls, diagnostics, configuration downloads & documentation, modeling, physics simulation, etc.•In US CMS Plan as base program manpower
•Major effort on testing, installation, integration tests & commissioning•Planned as activity of base program manpower•For Trigger, Computing, Muon Projects (and now Tracker)•Project-supported personnel need base-program supported supervision
•Wisconsin responsibilities are growing with time!
•Long term trigger M&O + Physics Analysis + SLHC•Increase in personnel needed
Needs continued support & eventual growth•Provide growth from Task B redirection
