HOMER TASK 3.2: “OVERVIEW ON TECHNICAL ASPECT FOR THE FEDERATION”
Ljubljana, 11 December 2013
CSI Piemonte
Alessandro FranceschettiNives AlciatoSaverino Reale
In this presentation we talk about:
Memorandum of UnderstandingCollection of the signatures and introduction to the MoU light
The requirements to realize the Homer Federation: the situation
The Federated Semantic multi language Search Engine: what has been done in November 2013
The ongoing activities and looking forward
Roadmap for next months
In this presentation we talk about:
Memorandum of UnderstandingCollection of the signatures and introduction to the MoU light
The requirements to realize the Homer Federation: the situation
The Federated Semantic multi language Search Engine: what has been done in November 2013
The ongoing activities and looking forward
Roadmap for next months
Memorandum of UnderstandingThe 9th version has been accepted by all Partners
At 09/12/2013 collection of the signatures from:01 Piedmont Region – ITALY04 Emilia-Romagna Region – ITALY05 Veneto Region - ITALY06 Sewerage Board of Limassol – Amathus SBLA – CYPRUS08 Decentralized Administration of Crete - CRETE14 Local Council Ass. of Malta Gozo – MALTA
For ‘13 Région Provence-Alpes-Côte d'Azur - PACA – France’ the signature will come in the first trimester 2014
Memorandum of Understanding “Light” for new Stakeholders
With the aim to extend the Federation and have a huge number of datasets, it has been thought – as first step to start the activities - the MoU “light”:
is addressed to the Stakeholders who wish to expose their catalogues of open data joining in the Federation
has been created starting from the MoU_V09 accepted and signed and contains only those articles that are strictly necessary to describe what is the federation, how is composed and which are the fulfilments
it will be delivered before the end of December 2013 and it will be possible to propose it to all new stakeholders that are interested in the thematic and in the Homer Federation
In this presentation we talk about:
Memorandum of Understanding Collection of the signatures and the MoU light
The requirements to realize the Homer Federation: the situation The Federated Semantic multi language Search Engine: what has been done in November 2013
The ongoing activities and looking forward
Roadmap for next months
The requirements to realize the Homer Federation: the situation
To be inside the federation each open data portals have to meet:
data side requirements
technical side requirements
The requirements to realize the Homer Federation: summarizing the Requirements
A. Data requirements
Documentation provided
A.1 have open data or data to be opened related to the 5 Homer categories
A.2 have an open data portal or an url that exposes these data
A.3 have a metadata structure that meets the “metadata common fields”
A.4 use the labels of EuroVoc to insert the tags as keywords in datasets
A.1 Preparatory table for Open Portals SoA_v03.xls
A.2 ODP State 2013 10_sent.xls
A.3 Metadata Common Fields_v06.xls
A.4 EuroVoc labels and Homer Tags.xls, Homer_EuroVoc_CSI Piemonte.ppt
The requirements to realize the Homer Federation: summarizing the Requirements
A.1 5 Homer
categories
A.2OPD
or URL
A.3Metadata common fields
A.4EuroVoc
Yes all Partners Yes all Partners
Yes for: Piedmont, Sarga, E-R, Veneto, SBLA, AGAPA, PACA, DAC, Malta, Slovenia, Corse, Montenegro
Yes for:Piedmont, E-R, Veneto, SBLA, PACA, DAC, Malta, Slovenia, Corse, Montenegro
Work In Progress for Sardinia Work In Progress for SARGA, Sardinia, AGAPA
13/13 13/13 12/13 10/13
The requirements to realize the Homer Federation: summarizing the Requirements
B. Technical requirements
Documentation provided
B.1.1 datasets are exposed with API set interface CKAN compliant (or)B.1.2 datasets are exposed with Catalogue Services for the Web protocol (or)B.1.3 datasets are exposed with Web Services like ‘www.dati.piemonte.it’
B.2 interoperability with the Federated Index
B.3 a page to access at the federated search and to expose the result of the federated search
B.1,2,3 Federation_technical specific_CSI_V03.doc
B.1,2,3 Glossary_V01.doc
The requirements to realize the Homer Federation: summarizing the Requirements
B.1.1CKAN
B.1.2.CSW
B.1.3Dati.piemonte.it
B.2Fed Index
B.3Page for search
Veneto, SBLA, DAC, Montenegro
none Piedmont, Emilia-Romagna,Slovenia
Piedmont, Veneto, SBLA, DAC, Montenegro, E-R, Slovenia
none
Work In Progress for Sarga, Sardinia, AGAPA, PACA, LCA Malta, Corse
Work In Progress for Sarga, Sardinia, AGAPA, PACA, LCA Malta, Corse
Work In Progress for all Partners
7/13 7/13 0/13
In this presentation we talk about:
Memorandum of UnderstandingCollection of the signatures
The requirements to realize the Homer Federation: the situation
The Federated Semantic multi language Search Engine: what has been done in November 2013
The ongoing activities and looking forward
Roadmap for next months
The Federated Semantic multi language Search Engine: what has been done in November 2013
To check that all the metadata cards are in the Federated-Index
Look at this symbol: it represents the metadata catalogue
The Federated Semantic multi language Search Engine: test the search engine at 3 levels involved
To test the search engine have been identified testcases to cover all possibilities at the levels:
• EuroVoc level• Multi language level• EuroVoc level and multi language level combined
This because it has been necessary to verify that a semantic multi language search provides the right result
1. Testcases At EuroVoc level:
a)a) InsertionInsertion in metadata cards of labels from EuroVoc that refers at different levels of the tier hierarchical structure (domain, microthesauris, top concepts, narrower terms, related terms inside or outside)
b)b) CheckCheck that the result of the different kinds of searches contains / or not contains, the tree or the sub-tree of the domain involved (for this look also at the example of search in the slide-show about EuroVoc)
2. Testcases At multi language level:
Id_card Field_01 tag lang Field_n
000123 xxx FreshWater en zzz
000124 yyy Agua dulce es xxx
000125 kkk Eau douce fr yyy
000126 zzz Acqua dolce it kkk
000127 xxx γλυκόνερό
el zzz
000128 yyy слаткавода
sr xxx
000129 kkk Sladka voda sl yyy
text Lang input Lang output # cards
Water En blank 7 (all)
Eau Fr En 000123
Acqua It It 000126
Agua blank blank 000124
Translation of a concept in all languages Translation from lang input different to lang output
Identification in the same language Identification of a term without specification of the language
a)a) InsertionInsertion in the metadata cards of labels from EuroVoc that refers at the same concept in all different languages involved in Homer
b)b) CheckCheck that the result of the different kinds of searches contains / or not contains the metadata cards expected
3. Testcases At EuroVoc level and at multi language level combined:
Field_a)a) InsertionInsertion in metadata cards of labels from EuroVoc that refers at different levels of the
tier hierarchical structure and in all languages involved in Homer
b)b) CheckCheck that the result of the different kinds of searches contains / or not contains, the tree or the sub-tree of the domain involved in the languages used
The Federated Semantic multi language Search Engine: what has been done in November 2013 – Technical Side
Urls received from:
Field_0
Emilia-Romagna Region http://www.dati.emilia-romagna.it/index.php?option=com_rd&view=pceli_list&format=xml&layout=xml
Veneto Region http://opendata.collaudo.regione.veneto.it/dataset
SBLA Cyprus http://opendata-cy.datacenter.uoc.gr/dataset/tto1ot1ka-xapaktnp1ot1ka-tou-avakukjwuevou-vepou
DAC Crete http://84.205.229.31/api/2/rest/package
Geodetic Institue of Slovenia http://www.open-homer.si/data/package_list.xml
Mediterranean University of Montenegro
http://www.open-data.me/api/rest/package
The Federated Semantic multi language Search Engine: what has been done in November 2013 – Technical Side
Field_0
API
API dati.piemonte.it compliant
API CKAN compliant
The Federated Semantic multi language Search Engine: what has been done in November 2013 http://www.dati.piemonte.it/homer/test/#
The Search:
The Federated Semantic multi language Search Engine: what has been done in November 2013 http://www.dati.piemonte.it/homer/test/#The Result:
In this presentation we talk about:
Memorandum of UnderstandingCollection of the signatures and the MoU light
The requirements to realize the Homer Federation: the situation
The Federated Semantic multi language Search Engine: what has been done in November 2013
The ongoing activities and looking forwardRoadmap for next months
The ongoing activities and looking forward
The federation is born
The federation is in progress
Achievement for all Partners of the requirements Data Side & Technical Side
The ongoing activities and looking forward
New stakeholders in the Federation
A huge number of datasets available for theHackathon on 17th May 2014
In this presentation we talk about:
Memorandum of UnderstandingCollection of the signatures and the MoU light
The requirements to realize the Homer Federation: the situation
The Federated Semantic multi language Search Engine: what has been done in November 2013
The ongoing activities and looking forward
Roadmap for next months
Roadmap for next monthsWhen What StateOctober 2013 Implementation and Test phase of the Federated
Semantic Multi Language Engine
November 2013 Configuration of the Federated Index to call Open Data portal API’s that has been ready to be federated
December 2013 The Engine is built and 7 Partners are federated
From now to 2014 The Federation is in progress: it is possible to add new Open Data and to configure new Open Data Portals and to add new Stakeholders
THANKS Ευχαριστίες
HVALA Хвала GRACIASMERCI GRAZIE
CSI PiemonteAlessandro FranceschettiNives AlciatoSaverino Reale