BEST Final Presentation - Frascati April 2005
BEST : final presentation
Frascati, 21st April 2005
BEST Final Presentation - Frascati April 2005
1 Welcome (A. Ciarlo)2 DEBAT project short history (A. Ciarlo)3 Applied standards (CCSDS / ISO) (D. Minguillon)4 Tools vs. Data life cycle (F. Berriri, J. Ferreira) -
Demonstration5 XML improvements (D. Minguillon) – Demonstration6 Success story (D.Minguillon)7 Near future (A. Ciarlo, D.Minguillon)8 Contacts9 Conclusion (A. Ciarlo)
BEST : FINAL PRESENTATION CONTENTS
BEST Final Presentation - Frascati April 2005
Welcome
BEST Final Presentation - Frascati April 2005
Applied standards
BEST Final Presentation - Frascati April 2005
Applied standardsEAST (Enhanced Ada subset)
The data description language EAST specification• CCSDS recommendation CCSDS 644.0-B-2 (nov 2002)• ISO standard ISO 15889:2003
Used to describe data structure on its medium Not to be mastered thanks to the description tool Makes I/O software easy to maintain thanks to the
EAST I/O library EAST V3 Standard will include DEBAT evolutions
BEST Final Presentation - Frascati April 2005
Applied standards (2)DEDSL
Data Entity Dictionary Specification Language• XML/DTD Syntax• CCSDS recommendation CCSDS 647.3-B-1(jan 2002)
Used to describe data semantics• Each data field or type is described through
attributes (standard ones or user purpose ones) Based on XML syntax Produced by the same description tool than
EAST
BEST Final Presentation - Frascati April 2005
Applied standards (3)Tools before DEBAT project
EAST
description
DEDSL
description
User application
DATA
EAST
I/O library
Read Write
Document
Editor
ICD
OASIS
V4 or previous
Read/Write
BEST Final Presentation - Frascati April 2005
Tools presentation
BEST Final Presentation - Frascati April 2005
Data life cycleThe data life cycle can be summarised as:
Modelling : syntactic and semantic data description Generating / Simulating : data generation for test or
validation Processing : editing, checking, extracting … Post processing : data transformation Distribution : CDROM, Internet…
BEST Final Presentation - Frascati April 2005
Data life cycle
Modelling
Model
Generating/Simulating
Data
Processing PostProcessing
ProcessedData
Distribution
BEST Final Presentation - Frascati April 2005
BEST
BEST framework offers a direct access to the tools.
Easy way to add plug-ins sharing models and data.
Project managing facilities.
BEST Final Presentation - Frascati April 2005
Modelling
Modelling
Model
Generating/Simulating
Data
Processing PostProcessing
ProcessedData
Distribution
BEST Final Presentation - Frascati April 2005
OASIS ModellerModelling of data through a performing graphical user
interface.A XML internal format.Several output formats :
EAST,
DEDSL (PVL and XML), XML schemas, RTF, PDF and HTML documentation.
Library concept available
BEST Final Presentation - Frascati April 2005
OASIS ModellerMenu
Internal Types of
the Model
Internal Constants
of the Model
Tree-View of the Model
Syntactic and Semantic
Information about the
selected Element
Type Librairies
BEST Final Presentation - Frascati April 2005
Demonstration Modelling from scratch,
using a documentation of CRYOSAT.
Finishing a model : making some fields optional.
File generation : EAST and DEDSL-XML.
OASIS Modeller
BEST Final Presentation - Frascati April 2005
Generating & Simulating
Modelling
Model
Generating/Simulating
Data
Processing PostProcessing
ProcessedData
Distribution
BEST Final Presentation - Frascati April 2005
DPE (Data Producer & Editor)
Displaying the tree-view of the Model
Generation of Data according to a Model : Custom generation : default value, degraded value, computed value and
random value.
Modification of an existing Data
Displaying the Data : Navigation through the Data
Search for particular elements
BEST Final Presentation - Frascati April 2005
DPE (Data Producer & Editor)Tree-View
of the Model
Generation directive
Values of the selected
element
Formula Editor
BEST Final Presentation - Frascati April 2005
DPE (Data Producer & Editor)
Demonstration : Opening existing data product Generating from scratch a new data product
BEST Final Presentation - Frascati April 2005
Processing
Modelling
Model
Generating/Simulating
Data
Processing PostProcessing
ProcessedData
Distribution
BEST Final Presentation - Frascati April 2005
DEQ (Data Extractor & Querying)Displaying the tree-view of the Model
Displaying the Data : Navigation through the Data
Search for particular elements
Extraction : Definition of the extraction made thanks to a wizard
Storage of the extracted Data
Batch processing
BEST Final Presentation - Frascati April 2005
DEQ (Data Extractor & Querying)Same
display as the DPE
Definition of the Query
BEST Final Presentation - Frascati April 2005
DEQ (Data Extractor & Querying)
Demonstration Opening existing data product Extracting subset from the edited data product
BEST Final Presentation - Frascati April 2005
UtilitiesData Checker :
Checks a Data against a Model.
ASCII Dump : Generates an ASCII representation of Data with
possibility of XML structure.
Comparison Tool : Compares two versions of a Model and displays the
difference in a tree-view.
BEST Final Presentation - Frascati April 2005
ASCII Dump
Demonstration Generating a simple text file Generating a flat XML file Generating a hierarchical XML file
BEST Final Presentation - Frascati April 2005
Post Processing
Modelling
Model
Generating/Simulating
Data
Processing PostProcessing
ProcessedData
Distribution
BEST Final Presentation - Frascati April 2005
PPT (Post Processing Tools)
XML TaggingGenerates a XML file from any Data
Quick LookSmart presentation of extracted Data
Visu2dDraws some graphs from Data
BEST Final Presentation - Frascati April 2005
Quick Look
Demonstration Quick visualisation of an image included in
the data
BEST Final Presentation - Frascati April 2005
Distribution
Modelling
Model
Generating/Simulating
Data
Processing PostProcessing
ProcessedData
Distribution
BEST Final Presentation - Frascati April 2005
DistributionPackaging :
Creates an archive for diffusion
WEB services : Model Reading
Data Reading
Data Checking
Data Extraction
XML Tagging
BEST Final Presentation - Frascati April 2005
XML improvements
BEST Final Presentation - Frascati April 2005
XML improvementsJust before the start of DEBAT project
XML became very used As a data format As a data description format (DTD or schemas)
The modeller was very suitable to design data (why not XML ones?)
The output were easy to enhance with schema production
BEST Final Presentation - Frascati April 2005
XML improvements (2)CNES had just issued an internal
recommendation for XML data ICDs
The PLEIADES project (Earth observation) had just decided to have all its interfaces in XML
So, we decided to enhance the modeller with XML schema production facilities and to take some PLEIADES interfaces as use-cases applying the recommendation
BEST Final Presentation - Frascati April 2005
XML improvements (3)2 additional plug-ins based on XML
ALADIN : XML description comparisons SCRIBE : XML post processor transforming
XML data descriptions into ICDs (Word or HTML)
Both are in test in PLEIADES context to produce and compare ICD versions
SCRIBE is already operational on Helios project
BEST Final Presentation - Frascati April 2005
Success story
BEST Final Presentation - Frascati April 2005
Success storyThe list of project using EAST and DEDSL
is now quite long...
SPOT (Earth observation) was the historical first one, describing and checking its metadata with OASIS and EAST Ascii dump tool.
then SSALTO (altimetry) was the first one to use the EAST I/O library in its operational software.
BEST Final Presentation - Frascati April 2005
Success story (2) CDPP (data centre for plasma physics) made
the EAST/DEDSL description mandatory accept the data he hosted. Based on these generic descriptions it offers some extraction facilities.
PHARAO (embedded atomic clock) designed all its telemetry with OASIS, then made a simulation for instrument tests purpose with EAST I/O library and produced its documentation with SCRIBE and ALADIN
BEST Final Presentation - Frascati April 2005
Success story (3) Helios II described all its ground segment
interfaces with OASIS and used te EAST I/O libraries to read and write the corresponding files. The ICDs are managed with SCRIBE. From that experience we learnt a lot comparing with Helios I... The sub-system integration faced much less problems due to the formal definition of the interfaces. That was the initial goal and it was reached.
BEST Final Presentation - Frascati April 2005
Near future
BEST Final Presentation - Frascati April 2005
Near futureEven if we still propose EAST technology
for binary telemetries (most difficult cases of COROT telemetry for instance) we are investing a lot on the XML part of BEST.
Generic XML tools offer an XML grammar but do not support any domain skills.
The modeller could help in designing data and producing the documentation.
BEST Final Presentation - Frascati April 2005
Contacts
BEST Final Presentation - Frascati April 2005
ContactsFor any EAST/DEDSL question there is a
hot-line at : eastcnes.fr
To get BEST version 1.0 and related information : http://debat.c-s.fr
To get the previous versions : logiciels.cnes.fr
BEST Final Presentation - Frascati April 2005
Conclusion