+ All Categories
Home > Software > Data Management and Integration with d:swarm (Lightning talk, ELAG 2014)

Data Management and Integration with d:swarm (Lightning talk, ELAG 2014)

Date post: 08-May-2015
Category:
Upload: jan-polowinski
View: 486 times
Download: 0 times
Share this document with a friend
Description:
d:swarm is a middleware for data integration and management currently developed by the Saxon State and University Library Dresden in cooperation with Avantgarde Labs.
14
SLUB Dresden and Avantgarde Labs June 13, 2014 Lightning Talk at ELAG 2014, Bath, England d:swarm - a Data Management and Integration Platform http://dmp.slub-dresden.de Jan Polowinski et al.
Transcript
Page 1: Data Management and Integration with d:swarm (Lightning talk, ELAG 2014)

Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de© Creative Commons Attribution 3.0

SLUB Dresden and Avantgarde Labs

June 13, 2014Lightning Talk at ELAG 2014, Bath, England

d:swarm - a Data Management andIntegration Platformhttp://dmp.slub-dresden.de

Jan Polowinski et al.

Page 2: Data Management and Integration with d:swarm (Lightning talk, ELAG 2014)

Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de© Creative Commons Attribution 3.0

d:swarm is an an Open Source Middleware for Data Integration

June 13, 2014

Integrated Library System

ERM Backend System A

ERM Frontend

d:swarm – Middleware for Data Integration

Frontend XDiscovery System

Web

, LO

D

LOD

Page 3: Data Management and Integration with d:swarm (Lightning talk, ELAG 2014)

Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de© Creative Commons Attribution 3.0June 13, 2014

d:swarm will serve as a middle ware for the linked-data-based ERM system AMSL (UB Leipzig, AKSW)

Page 4: Data Management and Integration with d:swarm (Lightning talk, ELAG 2014)

Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de© Creative Commons Attribution 3.0

d:swarm – Some More Details

June 13, 2014

„Data Hub“

GUI

Configurations, Mappings,

Transformations ...

providesub-graphs

as RDF

(e.g. the current internal model)

Page 5: Data Management and Integration with d:swarm (Lightning talk, ELAG 2014)

Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de© Creative Commons Attribution 3.0

d:swarm as a Flexible Data Storage

June 13, 2014

d:swarm achieves the lossless integration of data from heterogeneous data sources in a flexible, graph-based data model.

Page 6: Data Management and Integration with d:swarm (Lightning talk, ELAG 2014)

Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de© Creative Commons Attribution 3.0

d:swarm as a Flexible Data Storage

June 13, 2014

„Data Hub“ –graph database (neo4j)

• 1 sub-graph per imported source

• special sub-graph: the internal model

• versioning and provenance information are handled

Page 7: Data Management and Integration with d:swarm (Lightning talk, ELAG 2014)

Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de© Creative Commons Attribution 3.0

Inspecting the Graph with the neo4j-Browser

June 13, 2014

Page 8: Data Management and Integration with d:swarm (Lightning talk, ELAG 2014)

Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de© Creative Commons Attribution 3.0

d:swarm as a Provider for RDF data

June 13, 2014

„Data Hub“ –graph database (neo4j)

(e.g. the current internal model)

provide sub-graphs as RDF

Page 9: Data Management and Integration with d:swarm (Lightning talk, ELAG 2014)

Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de© Creative Commons Attribution 3.0

d:swarm for Increasing Data Quality

June 13, 2014

d:swarm increases the quality of library data by way of deduplication, merging, FRBRization, semantic enrichment and its publication as LOD.

FRBRization ...Deduplication

Page 10: Data Management and Integration with d:swarm (Lightning talk, ELAG 2014)

Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de© Creative Commons Attribution 3.0

d:swarm as a Data Modelling Tool

June 13, 2014

d:swarm is a data modeling tool with a graphical and easy-to-use interface that poses no obstacles to non-programming librarians

Page 11: Data Management and Integration with d:swarm (Lightning talk, ELAG 2014)

Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de© Creative Commons Attribution 3.0

Graphical User Interface – Modeling Perspective

June 13, 2014

Page 12: Data Management and Integration with d:swarm (Lightning talk, ELAG 2014)

Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de© Creative Commons Attribution 3.0

Internal Model and Internal Schema

June 13, 2014

Can be freely constructed from concepts of multiple vocabularies

May be shared with other libraries

Page 13: Data Management and Integration with d:swarm (Lightning talk, ELAG 2014)

Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de© Creative Commons Attribution 3.0

d:swarm – Sharing Features

June 13, 2014

GUI

• import configurations• mappings,

transformations• internal schema

usefulmappingfor reuse

sharing with the swarm

Source: http://commons.wikimedia.org/wiki/File:Fish_swarm_Loro_Parque.JPG

Page 14: Data Management and Integration with d:swarm (Lightning talk, ELAG 2014)

Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de© Creative Commons Attribution 3.0

Alpha release was published end of May –Help test the software

June 13, 2014ELAG 2014, Bath, England

d:swarmhttp://dmp.slub-dresden.de/en/interesse/http://dmp.slub-dresden.de/

Jan Polowinski et al.


Recommended