The ALMA Online Control Software: An Overview and Ways to Improve Data Quality
R. Rosen
Bird’s Eye View
R. HiriartR. Rosen
In More Detail
R. HiriartR. Rosen
DC, TelCal & QuickLook
R. HiriartR. Rosen
DataCapturer
R. Rosen
Archive and Relational Database
ARCHIVE: xml store, binary store Relational database: state database, scheduling working database (swdb), asdm database
Users: pipeline, OT, WebAQUA, anyone retrieving an asdm
Users: Scheduling, QuickLook, WebAQUA
Pros: Can hold large amounts of data Pros: Query-able, lots of configuration options, lots of performance tools
Cons: Not query-able Cons: relies on Oracle, possible performance issues with large databases
R. Rosen
QuickLook
R. Rosen
Scheduling
R. Rosen R. Rosen
SubmissionPhase I
GeneratedSBs
ARPC Meeting
OBSERVED!
Phase IIGenerated
SBs
P2G
Simulation
Simulation
Scheduling
R. Rosen
ARCHIVExml store
StateArchive
SchedulingWorking
Database(SWDB)
SchedulingUpdater
SchedulingData
Model(APDM)
DynamicScheduling
Algorithm (DSA)Scheduling
Panel
ReadyRunningSuspended
ScienceCSVCal
Scheduling
R. Rosen
Software branches
● Trunk: development● Release branch: “staging area” prior to branching● Major releases:
– 2014.6 (Cycle 3)– 2015.8 (Cycle 4)
● Minor releases: (incremental testing)– 2014.4 (subarrays)– 2015.6 (new python version)
R. Rosen
Testing Cycle
● Phase A: testing by us– Modular tests– Jenkins– TFINT
● Phase B: “Verification” by Software Operations● Phase C: “Validation” by EOC/Scientists
R. Rosen
Jenkins
R. Rosen
Release Cycle
Cycle311/04/14: Requirements deadline
12/01/14 – 12/14/14: Implementation Phase
12/15/14 – 01/30/15: Verification Phase
02/17/15: Delivery
Cycle 410/30/15: Requirements deadline
11/30/15 – 12/14/15: Implementation Phase
12/14/15 – 01/22/16: Verification Phase
01/27/16: Deliveryhttps://ictwiki.alma.cl/twiki/bin/view/IRM/ReleasesPlanning
R. Rosen
Telescope Meta Data
ObservedPassed
9/18/15R. Rosen
Telescope Meta Data
9/18/15
Syscal TimesCSV-2555FixplanetNull StateIDInvalid UIDSyscal Missing AntennaTsys Error
R. Rosen
Future Projects
● Short term– QA0 flags– QuickLook
● Middle term– Porting to 64 bit– WebAQUA
● Long term– Migrate to relational database
R. Rosen
Control Team● Ralph Marson (Control lead): ObservingModes, Devices,
everything else● Patrick Brandt: Total power processor, hardware● Alexis Tejeda: Scheduling, TMCDB● Rachel Rosen: DataCapturer, QuickLook, Scheduling● Rodrigo Amestica: Correlator● J. Perez: Correlator
● Jorge Avarias: Scheduling (through 01/01/16)● Rafael Hiriart: TMCDB, Pipeline (through 01/01/16)
R. Rosen
Paths for Improvement
● Communication directly with software team● Advocate for changes in the policies
– Relational database– Continuous development and deployment
R. Rosen
Slide 1Slide 2Slide 3Slide 4Slide 5Slide 6Slide 7Slide 8Slide 9Slide 10Slide 11Slide 12Slide 13Slide 14Slide 15Slide 16Slide 17Slide 18Slide 19