Incorporating Blockchain into RDF Store at The Lightweight Edge Devices

Anh Le-Tuan, Darshan Hingu, Manfred Hauswirth and Danh Le Phuoc | Technische Universitat Berlin

RDF4LED - An RDF Engine for Edge Devices

Incorporating Blockchain into RDF4Led

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 2

Why Edge Devices ???

Edge Computing - Internet of Things

– reduce network overhead.

– reduce latency for real-time applications.

– improve scalability.

– better privacy control.

Linked Data

– enable data integration of heterogeneous sources.

– enable data federation over edge nodes.

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 3

Missions

Moving semantic data processing task away from centralised cloud for the IoT

– How much semantic data on small devices ?

– How to scale data federation over small devices on edge systems ?

– How to encourage people sharing the data from their edge devices ?

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 4

RDF4LED - An RDF Engine for Edge Devices

System Design

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 5

RDF4LED (cont.)

Physical RDF Organisation: Two-Layers Index

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 6

RDF4LED (cont.)

Targeted Small Devices

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 7

Incorporating Blockchain into RDF4Led

System Overview

Smart Contract Manager

Distributed RDF Storage 

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 8

Incorporating Blockchain into RDF4Led

System Workflow

Smart Contract Manager  

SPARQL Query Processor

Validation  Service

SmartContracts 

Storage

Trip

le P

atte

rn

 Req

uest

Smart  Contracts

2

Payment

 Request  P

aym

ent

Con

firm

atio

n

Trigger Contracts

Index  Entries

Index  Entries

Distributed RDF Storage 

 Req

uest

with

In

dex

Entr

ies

Matched

 Triples

3

45

1

6

7

8

9

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 9

Incorporating Blockchain into RDF4Led

Physical Organisation

            . . .Transaction N: {Owner: ClientN  Price: 0.1  IPFS:hashN}

Transaction 2: {Owner:ClientB  Price: 0.1  IPFS:hash2}

          . . .IPFS:hash1s1  p1  o1 o2 o3; p2 o4  o5p3 o6.

IPFS:hash2s2 p1 o5;  ....    ..   ..    ....    ..   ..    ..

IPFS:hashNs3 p3 o2; ....   ..  ..    ....   ..  ..    ..

Transaction 1:{Owner: ClientA  Price: 0.1  IPFS:hash1}

           . . .s2p1o5:{ Transaction 2}

s3p3o2:{ Transaction N}

s1p1o1:{ Transaction 1}

Distributed RDF Storage

Blockchain

Smart Contracts Storage

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 10

Incorporating Blockchain into RDF4Led

System Deployment

ValidationService

Client A

Distributed Storage System Cluster

Miner Nodes

Geth Clients

Client B Client N

....

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 11

Incorporating Blockchain into RDF4Led

Evaluation - Input (1) Acc. Throughput on Static Cluster Sizes

0 200 400 600 800 1,0001,000

1,500

2,000

2,500

DatasetSize (in millions)

Thro

ughp

ut(tr

iple

s/se

c)10 nodes Inserting

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 12

Incorporating Blockchain into RDF4Led

Evaluation - Input (2) Acc. Throughput on Varying Cluster Sizes

2 4 6 8 10

10

20

30

40

No of Nodes

Thro

ughp

ut(tr

iple

s/se

c)in

thou

sand

s100 Million triples Dataset

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 13

Incorporating Blockchain into RDF4Led

Evaluation - Query

0.5

5

3060

350

1000

1 10 50 100 500 1000

seco

nd

(in

log

sca

le)

Number of blocks return in query patterns

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 14

Thank You !!!

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 15

RDF4LED (cont.)

Write Management (1): Clustering example

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 16

RDF4LED (cont.)

Write Management (2): Cache Management

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 17

RDF4LED (cont.)

Push-based Join Algorithm

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 18

RDF4LED (cont.)

Evaluation Results - Input (1)

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 19

RDF4LED (cont.)

Evaluation Results - Input (2)

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 20

RDF4LED (cont.)

Evaluation Results - Input (3)

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 21

RDF4LED (cont.)

Evaluation Results - Query (1)

1

10

100

F1 F2 F3 F4 F5 L1 L2 L3 L4 L5 S1 S2 S3 S4 S5

seco

nd

(in

log s

cale

)

Queries

(a) Query response time on Intel Galileo Gen II

VIRTUOSORDF4LedJENA TDB

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 22

RDF4LED (cont.)

Evaluation Results - Query (2)

1

10

100

F1 F2 F3 F4 F5 L1 L2 L3 L4 L5 S1 S2 S3 S4 S5

seco

nd

(in

log s

cale

)

Queries

(b) Query response time on Raspberry Pi Zero

VIRTUOSORDF4LedJENA TDB

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 23

RDF4LED (cont.)

Evaluation Results - Query (3)

1

10

100

F1 F2 F3 F4 F5 L1 L2 L3 L4 L5 S1 S2 S3 S4 S5

seco

nd

(in

log s

cale

)

Queries

(c) Query response time on Beagle Bone Black

VIRTUOSORDF4LedJENA TDB

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 24

RDF4LED (cont.)

Evaluation Results - Query (4)

1

10

F1 F2 F3 F4 F5 L1 L2 L3 L4 L5 S1 S2 S3 S4 S5

seco

nd

(in

log s

cale

)

Queries

(d) Query response time on Beagle Bone Black (20 mil)

VIRTUOSORDF4Led

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 25

RDF4LED (cont.)

Evaluation Results - Memory (1)

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 26

RDF4LED (cont.)

Evaluation Results - Memory (2)

Incorporating Blockchain into RDF Store at The Lightweight Edge Devices | Anh Le-Tuan |

Seite 27