China-VO and LAMOST Database
Chenzhou CUI
NAOC, CAS
Chinese Virtual Observatory
KIAA-Cambridge Workshop
KIAA-Cambridge Workshop
•2001.11 1st VO workshop in China•2002.7 “China-VO” kicked off•2002.10 “China-VO” became a member of the IVOA•2003.9 the 2nd VO workshop•2003.11 IVOA Small Projects Meeting•2004.5 VOFilter 1.0 released•2004.12 China-VO 2004•2005.11 China-VO 2005•2006.12 China-VO 2006•2007.5 IVOA interoperability meeting•2007.11 China-VO 2007•2008.11 China-VO 2008
History and Events
KIAA-Cambridge Workshop
KIAA-Cambridge Workshop
R&D Focuses China-VO Platform
中国虚拟天文台系统平台的开发 Unified Access to On-line Astronomical Resources
and Services 国内外天文研究资源的统一访问
VO-ready Projects and Facilities 支持 VO的项目与观测设施
VO-based Astronomical Research Activities 基于 VO的天文研究示范
VO-based Public Education 基于 VO的天文科普教育
KIAA-Cambridge Workshop
Two XSLT transforms VOFilter
an XML filter for OpenOffice.org Calc to open VOTable files
http://services.china-vo.org/vofilter/ VOTable2XHTML
a stylesheet to transform VOTable data into HTML/XHTML format
http://services.china-vo.org/votable2xhtml/
KIAA-Cambridge Workshop
Touch the sky with your mouse An intelligent client for VO
services A commodity for astronomers and
students
A Smart On-line Astronomical Information Collector
KIAA-Cambridge Workshop
FitHAS: FITS Header Archiving System
An useful assistant tool for FITS providers and managers
Importing FITS keyword records for one or more FITS files under a given directory into a database by several mouse clicks
FITS filesFITS files
User Interface Layer
Wizard
Core Transaction Layer
DatabaseFITS files
Header analysisMetadata Mapping
and Archiving Database controller
Header viewer
Database browser
Config-uration
Configuration filesArchive
moniter
KIAA-Cambridge Workshop
VO Data Access Service (VO-DAS)
An OGSA-DAI based service system to provide unified access to astronomy data, including catalogs, images and spectra.
Goals of VO-DAS Supporting high volume data query Interlinking distributed and heterogeneous archives
catalogs, images, spectrums Providing a software that works for astronomersworks for astronomers
KIAA-Cambridge Workshop
AstroBox A plug-in package for MATLA
B to provide an astronomical data mining application service, supporting VO protocols and tools.
A high-level data analysis environment supporting:PLASTICVOTableLocal DBVO-DAS clientAstronomical algorithms
VO-DAS
MATLAB VO-DAS Client
MA
TL
AB
D
ata
base
Too
lbox
Local DBJa
vaLi
brar
ies
VO
Tab
les
PLASTIC
VO Tools(Aladin, TOPCAT)
AstroBoxAstroBox
KIAA-Cambridge Workshop
First Science Paper from China-VO
Candidate Milky Way satellites in the Galactic halo( Liu et al., 2008, A&A)
SDSS DR5 photometric data were searched for new Milky Way companions or substructures in the Galactic halo.
Data analysis procedures were based on the VO-DAS. Five candidates are identified as over-dense faint stellar sources th
at have color-magnitude diagrams similar to those of known globular clusters, or dwarf spherical galaxies.
KIAA-Cambridge Workshop
Goals of the China-VO
Building the cyber-infrastructure
Leading the e-Science
for Astronomy in China
KIAA-Cambridge Workshop
VO-enabled LAMOST
VO-enabledLAMOST dataLAMOST Spectral Analysis Pipeline
LAMOST Database
KIAA-Cambridge Workshop
SDSS Mirror
KIAA-Cambridge Workshop
LAMOST Obs. Mode and Data Size
4000 / 250 => 16 spectroscopes => red & blue parts =>32 CCD cameras => 4K*4K pixels => 16 bits color deep
For each sky area, 3 times exposure, 30 minutes each. 5 sky area (plate) can be observed for a night (7.5~9 hours)
Scientific data per night: 4K*4K*2*32*5*3= 15.36 (GB)
All the collected data is about 20 GB/night 20*200= 4,000 GB per year (ideal condition) 4*5 year = 20 TB for the LAMOST 5 years life period
KIAA-Cambridge Workshop
Data Products
2-D multi-fiber spectrum images (pravite) 1-D spectra (to the public 18 months later) Catalogs (to the public 24 months later)
No image (in principle)
KIAA-Cambridge Workshop
OCS
TCS
SSS
DHS
ICS
Archive
34
6
8
5
7
11
1
9
10
2
12
WIS
ASS
13
14
16
15
17
LAMOST Dataflow
KIAA-Cambridge Workshop
DB components Tables
scientific data tables metadata tables log tables admin tables
ID System Global unique targetID
sourceID: source catalog ID, for “SDSS” it is “SDSS”, for “GSC 2.3” it is “GSC23”, etc.
sourceTargetID: the original ID for a source in the source catalog targetID: a unique ID for each object of LAMOST observation plateID: telescope pointing ID, i.e. sky area ID runID: exposure ID obsID: observation ID, an observation comprises one plate and multiple exposure spectrographID: spectrograph ID chipID: CCD chip ID fiberID: fiber ID
KIAA-Cambridge Workshop
sci_repository
PK targetID
ID RA DEC GLON GLAT Epoch oType magFK1 sourceID sourceTargetID htmID ...
sci_runsAll
PK runID
IDFK1 plateID startTime endTime expType ...
sci_specBest
PK,FK1 targetID
ID
sci_specAll
PK,FK3 targetID
IDFK3 obsID parameters ...
sci_platesAll
PK plateID
ID WCSinfo ...
sci_spectrographsAll
PK spectrographID
ID ...
sci_chipsAll
PK chipID
IDFK1 spectrographID ...
sci_fits1D
PK targetID
ID filePathFK3 obsID ...
sci_fits2D
ID filePathFK3 obsIDFK3 spectrographIDFK3 chipIDFK3 fiberIDFK3 targetID ...
sci_fibersAll
PK fiberID
IDFK1 chipIDFK1 spectrographID ...
sci_targetSource
PK sourceID
ID sourceName sourceMeta ...
sci_objCross
PK,FK1 targetID
TWOMASS_data GSC_data UCAC_data PanStarrs_data ...
sci_LAMOSTConstants
name value unit description
sci_sppParams
PK,FK5 targetID
FK4,FK5 obsID feha teffa logga rva ...
sci_observationsAll
PK obsID
IDFK2 plateIDFK2 runIDFK1 spectrographIDFK1 chipIDFK1 fiberIDFK3 targetID ...
sci_spec2D
IDFK1 obsID spectrographID chipID fiberID targetID parameters ...
Scientific Data Tables
KIAA-Cambridge Workshop
meta_Columns
FK1 tableName colName dataType unit ucd description
meta_Indexes
indexIDFK1 tableName colList defination type indexGroup
meta_Views
viewName parentTables defination
meta_Glossary
name ucd description
meta_Tables
PK tableName
type engine description
meta_Plugins
pluginName version status type typeVersion library libraryVersion author description license
Metadata Tables
KIAA-Cambridge Workshop
Archive platform and interfaces
Open Source SystemLAMP (Linux+Apache/Tomcat+MySQL+PHP)JavaPerl/C/Python
Web Browser Interface VO service interface
TAPSSASIA
KIAA-Cambridge Workshop
KIAA-Cambridge Workshop
LAMOST archive management VOSpace+iRODS based data m
anagement system
VO compliant VOTable TAP(coneSearch) SAMP (PLASTIC) UCD SSA STC (WCS) RM VOSpace FootPrint ADQL GoogleSky&WWT (KML)
MetaDBSci DB
DB Administration Moduler
Data Query & Retrieving Moduler
Usage Statistic Moduler
Archiving Moduler
AdmDB
DPSUsers & Clients
LogDB
KIAA-Cambridge Workshop
KIAA-Cambridge Workshop
KIAA-Cambridge Workshop
AstroGrid DSA
KIAA-Cambridge Workshop
On-line Collaboration Environments
Collaboration Enviroments
LAMOST DBs
Project Scientists
ObservationDB
SciDB (internal)
SciDB (public)
Scientific WGs
Papers
Public Users
Data Processing
Research Projects
User & Group management Data access Proposal preparation Call for collaborators Mailing lists & Forums Data & Docs Share
KIAA-Cambridge Workshop
Q & A
?http://www. .orgMore information is available at: