Oct. 2 - 3, 2006

P. Padovani, 1st DCA Board Meeting

1

VO Activities at ESO Paolo Padovani, ESO

Head, VO Systems Department, DMD

EURO-VO Facility Centre Scientist

Oct. 2 - 3, 2006

P. Padovani, 1st DCA Board Meeting

2

ESO Paranal

12 instruments offered at last call (Sept. 29) [+ 2 sub-mm]

Oct. 2 - 3, 2006

P. Padovani, 1st DCA Board Meeting

3

ESO La Silla

8 instruments offered at last call (Sept. 29)

Oct. 2 - 3, 2006

P. Padovani, 1st DCA Board Meeting

4

The ESO archive

Oct. 2 - 3, 2006

P. Padovani, 1st DCA Board Meeting

5

The ESO archive: VO challenges

1. Ground-based: calibrations/observing conditions changing on a nightly basis

2. Varied: 20 different instruments, ranging from imagers and spectrographs to polarizers and interferometers; optical and sub-mm

3. Evolving: 2nd generation VLT instruments

coming + Public Surveys and ALMA

4. Large: currently 100 Tb (compressed),

expected growth x 15 in the next ~ 6

years

Oct. 2 - 3, 2006

P. Padovani, 1st DCA Board Meeting

6

VO-compliant archive

The VO requires data centres to have a “VO-layer” to:

• “translate” any locally defined parameter to the standard (IVOA compliant) ones (e.g., RA can be called in many different ways)

• hide any observatory/telescope/instrument specific detail and work in astronomical units: e.g., wavelength range/band (not grism or filter name), spectral resolution, field of view, limiting magnitude provide the right meta-data (data about data)

The VO will work at best with high level “science-ready” data data centres should make an effort to provide such data

Oct. 2 - 3, 2006

P. Padovani, 1st DCA Board Meeting

7

VO @ ESO VO Systems (VOS) department created in

the Data Management & Operations Division (DMD) Nov. 2004 to formalize ESO VO work. Its tasks:

• make the ESO archive into a real scientific resource for the ESO community by:

creating, ingesting, and publishing “Advanced Data Products” (ADP) [science ready, level 3]

making the archive “VO-compliant” [provide access via VO standards and tools]

• develop VO technology, standards, and tools

• develop the VO Facility Centre with ESA

• take care of all ESO archive interfaces (Jan 2006)

Oct. 2 - 3, 2006

P. Padovani, 1st DCA Board Meeting

8

VOSystemsPaolo Padovani

Advanced Data ProductsPiero Rosati

Facility CentreVO TechnologyMarkus Dolensky

Paul HarrisonJ.-C. MalapertBruno RinoFabien Chereau (Oct. 06)

Nausicaa DelmotteJörg RetzlaffCharles RiteRemco SlijkhuisBenöit VandameMyha Vuong (DFO)NN (DCA funded)14 FTEs, 3 EC funded (2 VO-TECH+ 1 DCA)

Andreas WicenecE. Hatziminaoglou(Dec. 06)

VOS Dept.

Oct. 2 - 3, 2006

P. Padovani, 1st DCA Board Meeting

9

Current ESO VO Work

1. Improved archive interface (http://archive.eso.org) [VO Table format output, prototype SIA service]

2. Science-driven requirements already implemented into ESO metadata repository and data models to serve both the real and virtual observatory (behind the scene)

3. Creation of Advanced Data Products (ADP = “science-ready” data)

4. Preparation well under way for ADP ingestion and publication (metadata extraction and mapping tool)

Oct. 2 - 3, 2006

P. Padovani, 1st DCA Board Meeting

10

ESO Science Archive New Interface

A first step towards a VO-compliant interface

Complex queries by:

• Coordinates, target

name• Input lists• Scheduling info.• Proposal information• Instrument, obs cat.

As of 4 Apr 2005, ESO SAF is open worldwide to the astronomical community

VO Table

Oct. 2 - 3, 2006

P. Padovani, 1st DCA Board Meeting

11

ADP Production

1. Built the ADP/MVM data reduction system for the production of ADP, specifically for ISAAC, WFI, VIMOS, SOFI and other VLT imaging instruments (based on the EIS/MVM software)

2. Released on Sept. 30 2005 the ISAAC/GOODS ADP, reduced with the ADP/MVM (astrometrically calibrated stacked images and mosaics reduced from 11,600 science frames, 10,600 calibration frames, photometrically calibrated using SOFI data)

3. Part of the GOODS/ESO Public Programme in Chandra Deep Field South (PI: Cesarsky)

4. Deepest large nearIR field carried out to date: 160 arcmin2 in J & K, 127 arcmin2 H (J, H, K: 25.5, 25, 25 ABlim at 5s)

ISAAC/GOODS releaseSept. 30 2005

• Extensive use by worldwide community; complements HST and Spitzer data for galaxy evolution studies out to z~7• Users highly satisfied with data quality (0.4-0.6” seeing, good inter-calibration)

Oct. 2 - 3, 2006

P. Padovani, 1st DCA Board Meeting

12

ADP Ingestion & Publication

1. ADP currently scattered around the community will be collected, validated and published into archive (according to detailed guidelines) [paradigm change]

2. ESO now requires ADP from Large Programs and upcoming VST & Vista surveys

3. Science-ready imaging ADP are being produced by ADP/MVM

4. A “VO-compliant” data ingestion interface is being developed

Oct. 2 - 3, 2006

P. Padovani, 1st DCA Board Meeting

13

EURO-VO Projects

• DCA! • VO-TECH: work integrated within ESO

(SED builder [mag. to flux conversion], user certification [Single-Sign-On], VOSpace specification and prototype)

• Facility Centre: a joint ESO/ESA activity, physically located at ESO

Oct. 2 - 3, 2006

P. Padovani, 1st DCA Board Meeting

14

The EURO-VO FC

• An operational organization, that provides the EURO-VO with a persistent, centralized registry for resources, standards and certification mechanisms as well as community support for VO technology take-up and scientific programs (the EURO-VO “public face”)

• At present, resources provided by ESO & ESA at a “best-effort” level (≈ 1 FTE; no EU funding: FP7 proposal!?)

• EURO-VO FC Astronomer, Evanthia Hatziminaoglou, will join VOS on Dec. 1• First Activities: Selection of EURO-VO Science Advisory Committee; held first meeting in April at ESO, second meeting planned for Nov. 22 at ESRIN

New EURO-VO Web pages (http://www.euro-vo.org/) EURO-VO technical workshop (ESO June 2005), with EURO-VO partners (http://www.euro-vo.org/workshop2005)

Oct. 2 - 3, 2006

P. Padovani, 1st DCA Board Meeting

15

120 participants from 47 institutions and 16 different countries

EURO-VOWorkshopJun. 27 - July 12005

Oct. 2 - 3, 2006

P. Padovani, 1st DCA Board Meeting

16

Our Plans

1. More ADP (internal and above all from ESO PIs)

2. Brand new VO-compliant archive interface (based on metadata registry) part of new ESO portal

3. VO tools to enhance archive interface: e.g.,• Visualization of multi-wavelength data

sets/observations building on AVO and AstroVirtel experience

• Integrated browsing of imaging and spectral data

• Flux conversions based on optical element database

• Spectral Energy Distribution building, spectral templates and models

4. Data quality (Quality Control products)5. All this by 2008

Oct. 2 - 3, 2006

P. Padovani, 1st DCA Board Meeting

17

DCA Project

ESO’s interests: 1. WP3, lead with ESA (16 person-months)2. WP6 (2 person-months)

WP3 is the largest WP in terms of FTEs (68/170 p-m) and includes also: CNRS, INAF, INTA, NOVA, LU

Preliminary Data Centre census: first input of “essential VO archives” was given by the SAC at its first meeting. It includes ~ 35 entries