5 Redis Use CasesThat Power the Datorama Query API

Gur Dotan

Platform Team Leader

- Datorama R&D -

About Me

@gurdotan

Datorama is

Intelligence for Marketing

Everyperformance,outcome&investmentacrossthecustomerjourney– allinoneplace.

Daily Stats

5 Billion 3.5Million 40,000Rows

ProcessedRedis

Calls/SecondQueriesExecuted

The Datorama Query API

- Core Service -

IO Intensive

CPU Intensive

RAM Intensive

Distributed Nature => Driven By Redis

A Distributed Swiss Army Knife

Caching

Queueing

Locking

Throttling

PubSub’ing

Query API Backend

WebServer

QueryWorker

WebServer

1. Caching

CacheWebServer

QueryWorker

Speed Less Compute

QueryWorker

2. Queueing

Queue

CacheWebServer

QueryWorker

Decentralization Auto-Scaling

3. Locking

Queue

LockCacheWebServer

QueryWorker

Resilience no “Noisy Neighbor”

4. Throttling

LockCacheWebServer

Queue

QueryWorker

Congestion Mgmt.

Queue

5. PubSub’ing

PubSub

Queue

LockCacheWebServer

QueryWorker

Immediate Feedback

One Flow – Five Use Cases

Caching

Queueing

Locking

Throttling

PubSub’ing

WE’RE HIRING

engineering.datorama.com

Thank You!