Dataset Quality Ontology - An Engineering Experience

transcript

DatasetQualityOntology:Anengineeringexperience

JeremyDeba*staUniversityofBonn/FraunhoferIAIS

Germany

…whoamI

•  PhDStudentattheUniversityofBonn•  OriginallyfromMalta(EnyislandintheMediterraneanbetweenItalyandLibya)

deba*s@cs.uni-bonn.de 2

…whoamI

•  B.Sc(Hons)inComputerScience–UniversityofMalta– Thesis:CollaboraEveEdiEngandExpertFinding

•  M.AppScinComputerScience–DERI(nowInsight),NaEonalUniversityofIreland,Galway– Thesis:Ontology-basedrulesforUser-ControlledSupportinUbiquitousEnvironments

…myPhD–thebigpicture

•  WorkrelatedtoDataQuality(inLD)–  represenEngqualitymetadata(daQ)– assessingdataquality(Luzzu)–  idenEfyingnewmetricsfromstandardvocabularies(likePROV-O)usingdifferenttechniquesforscalability.

…agenda•  DefiniEonsofQuality

•  Lookatsomequalityaspectsre:OntologyEngineering

•  OurexperienceindevelopingdaQ–  contribuEonstowardsaW3Cvocab

•  VoCoLasatoolforcollaboraEvevocabularydevelopment

•  VOWLasatoolforvisualrepresentaEonofontologies

…quality?

Robert PirsigJoseph Juran

Phillip Crosby

Robert Pirsig

… the result of care Zen and the Art of Motorcycle Maintenance (1974)

7deba*s@cs.uni-bonn.de

… fitness for use Quality Control Handbook (1974)

Joseph Juran

… conformance to requirements

Quality is Free : The Art of Making Quality Certain. Mentor book. (1979)

Joseph JuranPhillip Crosby

…whatisqualityforyou?

…QualityasdefinedinadicEonary

D1.howgoodorbadsomethingis

D2.acharacteris1corfeaturethatsomeoneorsomethinghas

D3.ahighlevelofvalueorexcellence

…defini1onsfromh9p://www.merriam-webster.com

…dereferenceability“AnyHTTPURIshouldbedereferenceable,meaningthatHTTPclientscanlookuptheURIusingtheHTTPprotocolandretrieveadescrip1onoftheresourcethatisiden1fiedbytheURI.”–TomHeath,ChrisBizer:LinkedDataBook

(LDEvol)

?303SeeOther 200OK

…theprocessthatretrievesarepresenta/onoftherequestedresource

…unknownexternalontologyused

•  Usageofontologiesthatcannotbedereferenced.–  rdfs:domain–  rdfs:range–  rdfs:subClassOf– …

•  UsageofdeprecatedClasses(classestaggedwithowl:deprecatedClass)

…licencing“Specifyanappropriateopendatalicense.Data(inourcaseontology)reuseis

morelikelytooccurwhenthereisaclearstatementabouttheorigin,ownershipandtermsrelatedtotheuseofthepublisheddata”–BPfor

publishingLinkedData(hjps://www.w3.org/TR/ld-bp/)

•  Awaytodefineclearboundaries

•  InclusionofMachineandHumanReadableLicensetoontology’smetainformaEon

…ontologydecleraEon

•  Describinganontologyusingowl:Ontology(andvoaf:Vocabulary–forLOVinclusion)– Metadataincludes:creator,datemodified,descrip1on,versioninfo,preferrednamespaceuri,preferredprefix…

– otherprovenanceinformaEonsuchashistoryofchangesetc…

…domainandrangedefiniEon

•  Opendomain-rangeisnotrecommended

•  Reducesinteroperabilityandthus“understanding”ofresources’properEes

…ontologyhijacking

•  RedefiniEonofclassesandproperEesinavocabularythatitisnotinitsnaturalnamespace.– e.gredefiningfoaf:PersoninyourownontologytobeasubclassofanewlydefinedPersonconcept.

…consistencychecking

•  Possibleproblemswhenusingaxiomssuchas:– owl:inverseFunc1onalProperty– owl:disjointClass– owl:disjointWith– owl:inverseOf– …

…otherpossiblemeasures•  MulElingualism

•  Humanreadablelabelsandcomments

•  Interlinkingwithsimilarterms/concepts

•  ValidSyntax

•  Un-typedclassesandproperEes

•  …others?

…thedaQmeta-model

…daQ–History

•  DescribingQualityMetadatainastandardisedmanner

•  Startedaroundtheendof2013

•  FormsthebasisoftheupcomingW3CDataQualityVocabulary(DQV)standard

…daQ–TheFirstVersion

…daQ–SubsequentVersions

•  Alwayspen,paperandasimpletexteditor– GITasaversioningcontrolsystem

•  4versionsbeforethecurrentversion

•  UseCaseiteraEontesEng

…daQ–2ndVersion

•  Introduced:QualityGraph,and3levelsofAbstrac1on(BasedonZaverietal.categorisaEon)

rdfg:Graph QualityGraphA

Category Dimension Metric

rdfs:Resource

hasDimension hasMetric

dateComputed requires

xsd:dateTime

computedOn rdfs:Resource

…daQ–AbstracEon•  HidingComplexity

•  DisEncEonbetweendaQconceptsandtangiblequalitymeasureconcepts

•  Abstractclassescannotbetyped(rdf:type),butinsteadshouldbesub-classed(rdfs:subClassOf)

•  ThereisnowaytocheckforabstractclassviolaEonunlessthereisanapplicaEonthatcheckssuchsyntaxerrors.

…daq–WhyAbstractProperEes?

•  BestPracEcetoavoiddoubtandambiguity:– Ametricisajachedtoonedimensiononly.– Adimensionisajachedtoonecategoryonly.

•  UnifiedviewalsopresentedinZaverietal.DataQualitySurvey

…daQ–3rdVersion

•  Introduced:TheDataCubeVocabulary

rdfg:Graph QualityGraph

Aqb:DataSet

definesQBDataSet

rdfs:Resource

dateComputedrequires

valuexsd:dateTime

qb:ObservaDon

hasObservaDon

rdfs:Resource

computedOn

metric

qb:dataSet

…daQ–4thVersion

•  Modified:QualityGraph;Introduced:expectedDataType;Added:datetoObserva1on

Aqb:DataSet

rdfs:Resource

expectedDataType

requires

valuexsd:anySimpleType

qb:ObservaBon

hasObservaBon

rdfs:Resource

computedOn

metric

qb:dataSet

dc:date

…daQ–canametricreturnavalueotherthanasimpledatatype?

“ThispropertyfromDAQisdefinedtohaverangexsd:anySimpleType.Whileitseemsusefultodefinetheexpecteddatatypeforametric,asimpletypemaytoonarrow:inmanycasesametricwillbedeterminedonadatarecordorasubgraph.”–[BailerWarner28/10/2015]W3CDWBPPublicCommentsList-h9ps://lists.w3.org/Archives/Public/public-dwbp-comments/2015Oct/0019.html

…daQ-5thVersion

•  Introduced:isEs1mate,computedBy

Aqb:DataSet

rdfs:Resource

expectedDataType requires

xsd:anySimpleType qb:ObservaBon

hasObservaBon

rdfs:Resource

computedOn

metric

qb:dataSet

dc:date

xsd:boolean

isEsBmate

prov:Agent

computedBy

…daQ–CurrentVersion

•  Removed:computedBy,qb:Observa1onAdded:daq:Observa1on

Aqb:DataSet

rdfs:Resource

expectedDataType requires

xsd:anySimpleType daq:ObservaBon

hasObservaBon

rdfs:Resource

computedOn

metric

qb:dataSet

sdmx-dimension:BmePeriod

xsd:boolean

isEsBmate

xsd:dateTime

qb:ObservaBon

prov:EnBty

…involvementinW3C

•  W3CWorkingGroup–DataontheWebBestPracEces–  developopendataecosystem–  provideguidancetopublishers–  fostertrustindata

•  3Deliverables:–  BestPracEces– DataQualityVocabulary(DQV)– DataUsageVocabulary

…involvementinW3C-DQV

•  Ameta-modeltocovermanyqualityaspectsofadataset(linkeddataornot)

•  ThecorecomponentdescribingquanEtaEvemeasuresisinspiredbydaQ

•  Notableissues(204,205)betweendaQandDQV(hjps://www.w3.org/2013/dwbp/track/issues/xxx)-wherexxxis204or205

– UsageofabstractclassesandproperEes– DefiningCategory-Dimension-Metricassubclassofskos:Concept

…collaboraEveframework•  VoCoL–anIDEforcollaboraEvevocabularydevelopment

withVCSintegraEon

•  A(exchangeable)componentbasedsystem–  HumanReadableDocumentGeneraEon–  IntelligentTurtleEditor–  EvoluEonTracker–  OntologyVisualisaEon–  SPARQLEndpointService–  Client-SidevalidaEonbeforecommittoVCS

•  OnlineDemo:hEp://buEerbur06.iai.uni-bonn.de/

…visualisingontologies-VOWL

•  VOWL–AvisualnotaEonforOWL–  IntuiEve

–  Self-explaining

–  Comprehensible

– Well-specified

–  Complete

– Device-independent

hjp://vowl.visualdataweb.org

…VOWLimplementaEons

ProtégéPlugin

WebVOWL

…daQinVOWL

…ReferencesandLinks•  (daQ)-RepresenEngdatasetqualitymetadatausingmulE-

dimensionalviews–J.Deba*sta,C.Lange,S.Auer•  (DQV)-hjps://www.w3.org/TR/vocab-dqv/•  (VoCoL)-hjps://github.com/vocol/vocol•  (Zaverietal.)-QualityAssessmentforLinkedData:A

Survey•  (LDEvol)-hjp://linkeddatabook.com/ediEons/1.0/•  (VOWL)–hjp://vowl.visualdataweb.org

AnySuggesJons?PossibleCollaboraJons?debaMs@cs.uni-bonn.de

Dataset Quality Ontology - An Engineering Experience

Presentations & Public Speaking