Greg SullivanUniversity of Maryland

Data Filtering and Software

IceCube Collaboration Meeting

Monday, March 21, 2005

March 21, 2005Data Systems Overview

System Overview

DAQ

Dispatch

P&F Server

Recon WorkerX 50-60?

4-15MB/s1500-2000Hz

Tape

Transient Buffer

DAQ Land

Raw Data

Online Analysis

Online Analysis

Online Analysis

Recon Monitor

Data Handling

Rec/FiltData

ALL: RAW+FILT+REC

FILT:RAW+FILT+REC

ALL:FILT+REC

Expt. Control / Logging

Offline Software/IceTray

March 21, 2005Data Systems Overview

Data Handling• Accomplishments

– South Pole Test System operational since late last year. – South Pole System installed at the Pole in late December. – SPS operational with 1 string! – SPADE installed at Pole and used to transfer drill,

webcam, and TestDAQ data.

• Coming Year Activities – Data ingestion to Data Warehouse to be implemented.– Web interface to Data Warehouse. – Upgrade data storage facilities. – IceCube Metadata standard and data directory structure to

be defined. – Upgrade SPS and SPTS for upcoming season.

March 21, 2005Data Systems Overview

Experiment Control

• Provide system for South Pole operating– Control– Configuration– Monitoring– Logging– JBoss Support

• Based on “JBoss” – Infrastructure in place– Run-Control JMX Console in development

March 21, 2005Data Systems Overview

Filtering

• PnF System– V1.0 Tested at SPTS & deployed at Pole– Currently not in data stream

• Lacking some run information and testing

– New Version of Monolith soon (April)• Test & run PnF at Pole in preparation for next year

• Plans for next year– Integrate with Real DAQ,Exp Ctrl, DAQ Disp,

SPADE at SPTS (August/Sept) • PnF is output stream for Real DAQ• Filtering at South Pole required

March 21, 2005Data Systems Overview

Offline Software• Several incremental releases this past year

– In use by reconstruction and simulation groups.– Many people developing physics modules– Lots of physics to do yet

• Current release:– OFFLINE-SOFTWARE V01-05-00

• There are tools available for all – Event viewer– Script to make histograms for ROOT

• AMANDA muon reconstruction and merging by summer

March 21, 2005Data Systems Overview

Software 1

March 21, 2005Data Systems Overview

Software 2

March 21, 2005Data Systems Overview

Software 3

March 21, 2005Data Systems Overview

Event Viewer

March 21, 2005Data Systems Overview

ATWD Calibration & Feature Extraction

March 21, 2005Data Systems Overview

Simulation

• Version 0.2 released – Implemented in IceTray

• I3Db• Corsika Reader• MMC Propagator• Hit Constructor (Photonics interface)• Noise Generator• ROMEO, ROMEO-AMANDA• DOM Simulator (atwd,fadc,TWR)• Trigger Sim• ATWD Channel Merger• Feature Extraction• Event Viewer

March 21, 2005Data Systems Overview

JULIET

300 PeV

March 21, 2005Data Systems Overview

Simulation Plans

• Version 1.0 of IceCube simulation– Ready Mid April– Generate large set of events for validation

against AMASIM with same Ice properties etc…

• New Photonics tables – Ready April-May

• Finalize metadata specs and production scripts

• Large production run using V1.0– Data set in ware house

March 21, 2005Data Systems Overview

Summary

• Great Progress in the last year– SPADE operating reliably– PnF/DAQ Dispatch tested and running– Experiment Control system defined and providing Jboss

support– Simulation V0.2 running– Broad range of developers in IceTray

• Decision for C++ and data classes 1 year ago

• For Next Year– Systems on track for physics from 30-32 string detector

• Online system integration and testing in Aug/Sep

• Reconstruction and filtering