+ All Categories
Home > Documents > A Memory-optimized Bloom Filter using An Additional Hashing Function Author: Mahmood Ahmadi, Stephan...

A Memory-optimized Bloom Filter using An Additional Hashing Function Author: Mahmood Ahmadi, Stephan...

Date post: 14-Dec-2015
Category:
Upload: rory-marvel
View: 218 times
Download: 2 times
Share this document with a friend
Popular Tags:
14
A Memory-optimized Bloom Filter using An Additional Hashing Function Author: Mahmood Ahmadi, Stephan Wo ng Publisher: IEEE GLOBECOM 2008 Presenter: Yu-Ping Chiang Date: 2009/04/29
Transcript
Page 1: A Memory-optimized Bloom Filter using An Additional Hashing Function Author: Mahmood Ahmadi, Stephan Wong Publisher: IEEE GLOBECOM 2008 Presenter: Yu-Ping.

A Memory-optimized Bloom Filter using An Additional

Hashing Function

Author: Mahmood Ahmadi, Stephan WongPublisher: IEEE GLOBECOM 2008Presenter: Yu-Ping ChiangDate: 2009/04/29

Page 2: A Memory-optimized Bloom Filter using An Additional Hashing Function Author: Mahmood Ahmadi, Stephan Wong Publisher: IEEE GLOBECOM 2008 Presenter: Yu-Ping.

Outline

Related workRegular bloom filterPruned bloom filter

BFAH

(bloom filter with an additional hashing function)

Performance

Page 3: A Memory-optimized Bloom Filter using An Additional Hashing Function Author: Mahmood Ahmadi, Stephan Wong Publisher: IEEE GLOBECOM 2008 Presenter: Yu-Ping.

Regular bloom filterAddress

0

2

1

6

3

5

4

8

7

10

9

11

Bit-array

1

1

0

1

0

1

1

1

0

1

0

0

R0

R2

R3

R1

H1(R1)

H2(R1)H3(R1)

R0

R1

R0

R0

R1

R1 R2

R3

R2

R2

R3

R3

R0

Page 4: A Memory-optimized Bloom Filter using An Additional Hashing Function Author: Mahmood Ahmadi, Stephan Wong Publisher: IEEE GLOBECOM 2008 Presenter: Yu-Ping.

Regular bloom filter - searchAddress

0

2

1

6

3

5

4

8

7

10

9

11

Bit-array

1

1

0

1

0

1

1

1

0

1

0

0

Input: X

H1(X)

H3(X)

R0

R1

R0

R0

R1

R1 R2

R3

R2

R2

R3

R3

H2(X)R0

NO match any rule !!

Disadvantages:‧Can’t delete rule‧Duplicate rules in memory

Page 5: A Memory-optimized Bloom Filter using An Additional Hashing Function Author: Mahmood Ahmadi, Stephan Wong Publisher: IEEE GLOBECOM 2008 Presenter: Yu-Ping.

Pruned bloom filterBit-array

1

1

0

1

0

1

1

1

0

1

0

0

Address

0

2

1

6

3

5

4

8

7

10

9

11

R0

R2

R3

R1 R0

R1

R2

R3

2

3

0

1

0

2

1

2

0

1

0

0

Counter

‧After set bit-array for all rules, save rule only in smallest counter position.

Page 6: A Memory-optimized Bloom Filter using An Additional Hashing Function Author: Mahmood Ahmadi, Stephan Wong Publisher: IEEE GLOBECOM 2008 Presenter: Yu-Ping.

Outline

Related workRegular bloom filterPruned bloom filter

BFAH

(bloom filter with an additional hashing function)

Performance

Page 7: A Memory-optimized Bloom Filter using An Additional Hashing Function Author: Mahmood Ahmadi, Stephan Wong Publisher: IEEE GLOBECOM 2008 Presenter: Yu-Ping.

BFAH

Determine which place will use to insert item.

Address

0

2

1

6

3

5

4

8

7

10

9

11

Bit-array

1

1

0

1

0

1

1

1

0

1

0

0

R0

R2

R3

R1

H1(R1)

H2(R1)H3(R1)

Additional hash function

Page 8: A Memory-optimized Bloom Filter using An Additional Hashing Function Author: Mahmood Ahmadi, Stephan Wong Publisher: IEEE GLOBECOM 2008 Presenter: Yu-Ping.

BFAH - example

Address

0

2

1

6

3

5

4

8

7

10

9

11

Bit-array

1

1

0

0

0

0

1

0

0

0

0

0

R0

H1(R1)

H2(R1)H3(R1)

Additional hash functionrule_num mod 3Input : 0 Output : 0

R0

Page 9: A Memory-optimized Bloom Filter using An Additional Hashing Function Author: Mahmood Ahmadi, Stephan Wong Publisher: IEEE GLOBECOM 2008 Presenter: Yu-Ping.

BFAH - example

Address

0

2

1

6

3

5

4

8

7

10

9

11

Bit-array

1

1

0

0

0

1

1

0

0

0

0

0

R0

R1

Additional hash functionrule_num mod 3Input : 1 Output : 1

R0

R1

Page 10: A Memory-optimized Bloom Filter using An Additional Hashing Function Author: Mahmood Ahmadi, Stephan Wong Publisher: IEEE GLOBECOM 2008 Presenter: Yu-Ping.

BFAH - example

Address

0

2

1

6

3

5

4

8

7

10

9

11

Bit-array

1

1

0

1

0

1

1

1

0

1

0

0

R0

R2

R3

R1

Additional hash functionrule_num mod 3

R0

R1

R3

R2

Page 11: A Memory-optimized Bloom Filter using An Additional Hashing Function Author: Mahmood Ahmadi, Stephan Wong Publisher: IEEE GLOBECOM 2008 Presenter: Yu-Ping.

Outline

Related workRegular bloom filterPruned bloom filter

BFAH

(bloom filter with an additional hashing function)

Performance

Page 12: A Memory-optimized Bloom Filter using An Additional Hashing Function Author: Mahmood Ahmadi, Stephan Wong Publisher: IEEE GLOBECOM 2008 Presenter: Yu-Ping.

Performance

R.B : Regular Bloom filterP.C.B : Pruned Counting Bloom filterM.B : BFAH

k = # of hash functionsm = size of bit arrayn = # of items (rules)

Page 13: A Memory-optimized Bloom Filter using An Additional Hashing Function Author: Mahmood Ahmadi, Stephan Wong Publisher: IEEE GLOBECOM 2008 Presenter: Yu-Ping.

Performance

R.B : Regular Bloom filterP.C.B : Pruned Counting Bloom filterM.B : BFAH

k = # of hash functionsm = size of bit arrayn = # of items (rules)

Page 14: A Memory-optimized Bloom Filter using An Additional Hashing Function Author: Mahmood Ahmadi, Stephan Wong Publisher: IEEE GLOBECOM 2008 Presenter: Yu-Ping.

Performance Average number of collisions for all rule-set.


Recommended