4MOST Operations Walcher - ESO · C. Jakob Walcher (AIP) date “Science Operations” •“Joint...

4MOST – 4m Multi-Object Spectroscopic Telescope

www.4MOST.eu

Science OperationsC. Jakob Walcher (AIP)

date

“Science Operations”

• “Joint Operations Group“ (JOG): A group of people from the consortium who will run 4MOST operations in Europe.

• Separate from, but closely linked to ESO, who will run the instrument, VISTA, a public archive, select proposals, etc.

• The precursor to the JOG is called the “Operations Development Group” (ODG): talking to you now.

4MOST Operations | 06.05.2019 | CJ Walcher 2

Organisational view


Science Team

ESO

4MOST Executive Board

4MOST Principal Investigator

Infrastructure Working Groups

Community Surveys

Consortium Surveys

ESO

Consortium

Community

Operations

Operations System

Science

Operations Manager

Data Management System

Consortium Helpdesk

ESO Archive (SAF)

Non-participating Surveys

Project Scientists

Joint Operations Group

On-mountain Operations

Technical support

Quality Control 1

ESO Instrument Scientist

Exposure Time Calculator Technical support

Policies Board(s)

Science Coordination Board

We are there to serve you!

We

You

Generalities / requirements

• MOS surveys covering a hemisphere in 5 years

• Consortium (“GTO”) and Community surveys

• Integrate into ESO operations model• Parallel survey execution for efficiency • 10s of millions of spectra• Public surveys


Distinction between GTO and other surveys

• ESO requirement: No such distinction shall be made at any operations level.

• We are committed to this requirement.


Requirements analysis for “participating” surveys• Parallel execution means

– Common observation preparations– Common selection function computation– Cross-talk on CCD, sharing of 1D spectra

• Survey sizes and duration mean– Automated observation preparation and data reduction– Accurate survey simulations for planning

• ESO instrument means– Use of ESO procedures (Phase 1,2,3, interfaces,

structure)– ESO oversight must be possible


Principles of operations for participating surveys

• All participating surveys collaborate in the Science Team, also on science infrastructure

• Consortium Operations Group takes over tasks normally carried out by scientists

• Progress reporting and survey strategy parameterization allow ESO to exercise oversight role


Non-participating (NP) surveys

• Some surveys may be able to fill all fibers of 4MOST within their sky area– No need for parallel observing– No common observation preparations– No common selection function computation– No cross-talk on CCD, sharing of 1D spectra– No participation in Science Team activities– Some consortium services not applicable


Will start describing participating surveys, will highlight differences for NP surveys at end of talk.

Data levels

• Level zero (L0): raw data, calibration data, environmental data, log files.

• Level one (L1):1-dimensional, calibrated, science-ready spectra

• Level two (L2) data: products of science analysis of 1D spectra, in particular physical properties – L2 products that are to be delivered to ESO in

Phase 3 are deliverable L2 (DL2) products– Any survey may additionally generate additional L2

(AL2) products.


How it would be if it was normal ESO operations


Phase 3 process:!creation and publication !

of higher level data products!PI

Phase 1 process:!definition of 4MOST survey program!

ESO, community

Phase 2 process:!creation of OBs!

PI

Observing at Paranal!ESO

Target catalogues

Survey strategy OBs

Raw data

VISTA

4MOST

Data flow for participating surveys


Definition of community surveys (ESO, proposals)

IWG work Writing papers

Definition of consortium

surveys

Phase 3 process:!creation of level 1 data products!

Consortium: Data Management System


ESO, consortium, community


Consortium: Operations System

Progress tracking


Phase 3 process B:!creation of level 2 data products!

Surveys, science team

Target catalogues

Survey strategy OBs

Raw data

1D spectra

Calibration strategy

Optimization processes

VISTA

4MOST

Submission to ESO

L2 products

Survey simulations

Creation of level 1 data products

Services for participating surveys





surveys







Progress tracking




Target catalogues

Survey strategy OBs

Raw data

1D spectra



VISTA

4MOST

Submission to ESO

L2 products

Survey simulations


Science input and control





surveys







Progress tracking




Target catalogues

Survey strategy OBs

Raw data

1D spectra



VISTA

4MOST

Submission to ESO

L2 products

Survey simulations


IWG2

Quality Control Scientist

IWG4,7,8,9

Preparing observations

• Operations System with components– 4MOST Facility Simulator (4FS)

• Heavy duty ETC (4FS-ETC)• Operations Simulation (OpSim)

– Observer Support Software (makes OBs)– Target and survey progress database

• IWG2 Survey Strategy– Development of requirements to survey strategy– Survey plan optimization


Talk by R. De Jong

Taking calibration data

• Covered by regular calibration plan and L1 pipeline:– Day-time calibrations– Twilight flats– Night-time wavecal and fiber flat– Sky fibers and telluric standards– Use of Gaia targets for flux calibration

• Quality monitoring fields • Any other calibration (e.g. standard stars) have to be

submitted as (part of) OBs– Twilight calibrations (ca. half hour) are not counted – Night time calibration comes out of science time

(includes attached wavecal and fiber flat)


Running observations

• VISTA+4MOST run by ESO TIO. • Participating surveys do not choose

conditions (e.g. seeing) per target. Exposure time adaptation to conditions, sky coverage according to survey plan.

• Optimal way of picking next OB still being discussed (area, depth, cadence).

• NP-surveys likely to be run in visitor mode


Talk by V. Mainieri

Processing data (L1)

• Data Management System with major components– L1 pipeline– Progress measurement – Operational Repository– Public Archive

• Instrument Scientist / Quality Control Scientist / Survey teams provide QC


Talk by N. Walton

Processing data (L2)

• Advanced pipelines– 4MOST Selection Functions pipeline (4SP)– 4MOST Galactic Pipeline (4GP)– 4MOST eXtragalactic Pipeline (4XP)– 4MOST Classification Pipeline (4CP)

• Instrument Scientist / Quality Control Scientist / Survey teams provide QC


Talk by N. Walton

Processing data (IWGs)

• IWGs are organizationally under operations– close coordination with L1 pipeline– make sure data flow work throughout– apply best practices for heavy duty software

systems• The work is about science analysis and

requires surveys and PSs to take interest • The human resources for IWGs – come from the surveys (e.g. postdocs)– are delegated to operations


Infrastructure Working Groups

Data / work flowlinearly


Observation execution

Consortium surveys preparation

4MOST instrument

software and hardware

Community surveys preparation

Survey selectionSurvey confirmation

Observation preparation

Survey program optimization

Level 1: data reduction

Level 2: data analysis Operational repository

4MOST internal and public archive

Science archive facility

OB database

Quality control

Progress monitoring and scientific exploitation

Targets,scientific

requirements


Worldwide science community

per target progress

Scientific guidance

proposalsproposals

ESO

Science Team

Operations

Legend

executable OBs (sci & cal)

OB to be executed

raw data (sci & cal)


reduced level 1 spectralevel 1 spectra

level 2 productslevel 1 and 2 data

level 1 and 2 datalevel 1 and 2 data

level 1 and 2 data

Merge surveys into Science Team

ESO oversight

Survey parameters, target catalogues, progress monitor

Two main interfaces

Output

Input

Input target catalogue

• Input to simulations and observations is identical (but mock for sims OK)

• Input catalogue contains following information:– Target list with ruleset per object– Template spectra for calculating Texp from ruleset– Overall Figure of Merit for survey success– Merit functions for optimization purposes

• Observations will be run according to survey plan agreed between ESO and all surveys


Output L1 and L2 data


Talk by N. Walton

Feedback loops


Observation execution

Consortium surveys preparation

4MOST instrument

software and hardware

Community surveys preparation

Survey selectionSurvey confirmation

Observation preparation

Survey program optimization

Level 1: data reduction

Level 2: data analysis Operational repository

4MOST internal and public archive


OB database

Quality control

Progress monitoring and scientific exploitation

Targets,scientific

requirements


Worldwide science community

per target progress

Scientific guidance

proposalsproposals

ESO

Science Team

Operations

Legend

executable OBs (sci & cal)

OB to be executed



reduced level 1 spectralevel 1 spectra

level 2 productslevel 1 and 2 data

level 1 and 2 datalevel 1 and 2 data

level 1 and 2 data

Merge surveys into Science Team

ESO oversight

Survey parameters, target catalogues, progress monitor

QC0

Loop 1: QC0, OB validityLoop 2: per target progress Loop 3: survey progress

Services for NP surveys





surveys







Progress tracking




Target catalogues

Survey strategy OBs

Raw data

1D spectra



VISTA

4MOST

Submission to ESO

L2 products

Survey simulations


Services for non-participating surveys

• Provide Observer Support Software (OpSys)– Can be used to create Observation Blocks

(alternative to P2 web interface)– Training by consortium – NP-surveys have to run themselves

• Provide reduced L1 data (DMS)– Exact same data reduction procedures as ST– Assumes calibration strategy is same as ST– L1 data contain all calibration and provenance info– QCS for feedback in case of problems


Service NOT offered to NP-surveys

• Front-end– No operations simulations beyond online 4FS, no

support in survey strategy development – No target and progress database / completion

tracking• Back-end– No processing beyond calibrated spectra per arm,

all additional processing science-specific – No measurement of success per OB or per target

– visitor mode! – No submission of Phase 3 on behalf of NP-survey – No access to Science Team L2 pipelines


How to get help

• ESO USD– Usual level of support as for any other instrument– May use consortium Helpdesk as back-office

• Consortium Helpdesk– Reachable through mail ([email protected]) and

through the website www.4most.eu click on help. – Open to anyone: proposers, accepted surveys and

scientists, archive users, general public.– FAQ page and glossary.– This is the preferred way to address questions from

any science user: monitored, minimizes overheads.


mailto:[email protected]

http://www.4most.eu


Date post:	02-Mar-2021
Category:	Documents
Upload:	others
View:	5 times
Download:	0 times

4MOST Operations Walcher - ESO · C. Jakob Walcher (AIP) date “Science Operations” •“Joint...

Documents