#redisconf17

Redis Enterprise: Continuous Availability, Unlimited Scaling, Secure

and Cost-Effective RedisLeena Joshi

Guy Lubovitch

2

Enterprise..

3

When it comes to using a product you want the simplicity of..

4

But the robustness & security like..

5

Who We Are

Open source. The leading in-memory database platform, supporting any high performance operational, analytics or hybrid use case.

The open source home and commercial provider of Redis Enterprise (Redise) technology, platform, products & services.

6

Redise Cloud Private

Redis Labs Products Are Where You Are

Redise Cloud Redise Pack ManagedRedise Pack

DBaaS SOFTWARE

Fully managed, serverless scaling Redise

service in VPCs within AWS, MS Azure, GCP &

IBM Softlayer

Fully managed, serverless Redise service

on hosted resources within AWS, MS Azure,

GCP, IBM Softlayer, Heroku, CF & OpenShift

Downloadable Redise

software for any enterprise datacenter or

cloud environment

Fully managed Redise

Pack in private data centers

or or or

7

Available since mid-20137,100+ enterprise customers

Available since early-2015200+ enterprise customers

Proven in Production

DBaaS SOFTWARE

250,000 databases managed worldwide

8

Financial Services

Customers From All Verticals

AdvertisingMedia

Technology Communications EducationGaming

Banks Retail/E-commerce

Business Services

Social

Travel

9

Mature and Stable Technology & Products

250K+ 600

150 + 1350+

2,000+DATABASES RUN OVER 3

YEARSNEW DATABASES CREATED

EVERY DAY

MAN-YEARS OF REDIS ENTERPRISE TECHNOLOGY DEVELOPMENT

CLOUD NODE FAILURE AND OUTAGES EVENTS SURVIVED WITH

NO DATA LOSS

GRANTED AND PENDING PATENTSDEDICATED REDIS ENGINEERS

10

Redise enhancements

SecurityFlash

memory

Manageability Extensions

Scaling Availability

11

Redise - Open Source & Proprietary Technology

Redise Node

Cluster Manager

Redise Cluster• Shared nothing cluster architecture

• Fully compatible with open source

commands & data structures

Enterprise Layer

Open Source Layer

REST APIZero latency proxy

12

Redise - Shared Nothing Symmetric Architecture

ClusterManagementPath

ProxiesNode WatchdogCluster Watchdog

Node 1 Node 2 Node N (odd number)…

Redis Shards

Unique multi-tenant “Docker” like architecture enables running hundreds of databases over a single, average cloud instance without performance degradation and with maximum security provisions

Data Path

Distributed ProxiesSingle or Multiple Endpoints

Scaling

14

Scaling – Simple, Efficient, Automated

Applications Single endpoint to interact with

Scaling

15

Scaling – Simple, Efficient, Automated

ApplicationsRedis Enterprise scales out by adding additional Redis instances, on the same server or across a cluster of servers, with no disruption or downtime

Scaling

High Availability

17

High Availability

Point and Click to enable high availability across racks/zones/regions..

Availability

Redise Pack Redise Cloud

18

Redise: The Only True HA Redis18

Type of outage

Esse

nti

al f

eatu

res

for

hig

h a

vaila

bili

ty

*Auto-failover should run on same nodes as Redis deployment

Redis Labs provides all the essential HA features that protect against every type of outage

Process failure Node Failure Multi-node failure Network Split Zone/Rack failure Region/Cloud failure

In-memory replication Instant recovery* Instant recovery* Instant recovery*

Multi-DC/Zone replication Instant recovery* Instant recovery*

Auto-failover Instant recovery* Instant recovery* Instant recovery* Instant recovery* Instant recovery*

AOF Data Persistence Slower recovery Slower recovery

Backup(using snapshots) Slower recovery Slower recovery

Multi-region/Cloud replication Fast recovery Fast recovery

Availability

19

Redis Labs: Fastest Recovery, No Data Loss

% o

f ti

me

s d

ata

was

lost

Ave

rage

tim

e to

rec

ove

r in

se

con

ds

Redis Labs recovers in 5 seconds and does not lose data.All other vendors lose data and take many minutes to recover

Vendors evaluated include(not in order)• Heroku Redis• AWS ElastiCache• Microsoft AzureCache• Compose.io

Redise

Availability

20

Coming Soon : Multi-Master Redis

GEO DISTRIBUTED SESSION MANAGEMENT

X

BIDDING/POLLING

LEARN MORE : Multi-Master Redis –A Deep DiveElad Ash -6/1, 3:15 pm

Availability

21

Redise : State-of-the Art Database

• Multi-model, can support all popular database models and modern use cases

• ACID compliant with support for multi command/operation transactions

• Geographically distributed, “active-active”, multi-master architecture, with “strong eventual consistency”, based on CRDT (Conflict-free Replication Data Type) technology

Availability

22

DEMO

Redis Enterprise Flash

24

Redise Flash

• Near-RAM performance at 70%+ lower costs

• Technology treats Flash as a RAM replacement

(or extension)

• RAM/Flash ratio can be easily configured

• Pluggable storage engine

• Available on SATA-based SSD, NVMe-based

SSD, NVDIMM like 3D XPoint/SCM on x86 and

P8 platforms

2048 GB RAM

204 GB RAM

1844 GB Flash

10% 90%

Keys & hot values Cold values

Flash Memory

25

Redise Flash - 10TB Redis Deployment on EC2

Redis on RAM Redise Flash

Dataset size 10 TB 10 TB

Database size with replication 30 TB 20 TB

AWS instance type x1.32xlarge i3.16xlarge

Actual instance size (RAM, and RAM+Flash)

1.46 TB 3.66 TB

# of instances needed 21 6

Persistent Storage (EBS) 154 TB 110 TB

1 year cost (reserved instances) $1,595,643 $298,896

Savings - 81.27%

*

* Redis Enterprise only needs 1 copy of the data because quorum issues are solved at the node level

Flash Memory

LEARN MORE : Building Large High Performance DatabasesCihan/Frank- 2 pm

Security

27

Secure Redis Enterprise Deployments- Defense in Depth

Layers of Security• Secure data center – top level switches

and firewalls• Perimeter network – web servers and

internal firewalls• Internal network – Redise cluster nodes

Added Security with SDLC• Automated Security Scans in Dev Cycle• Regular penetration testing

Security

Datacenter – Edge Defense

Perimeter Network – Perimeter Defense

Internal Network – Cluster Defense

28

Data Center Network

Remote Data CenterSecurity At Multiple Levels

Perimeter Network

Cluster Internal Network

AdministratorsEncrypted Communication

Password Based AuthenticationRole Based Authorization (RBAC)

Cluster Internal Network

Cross Cluster Replication

Encrypted Communication

AppsEncrypted Communication

Certificate & Password Based Authentication

Security

29

Simplified ComplianceSecurity

Authentication

• Identity management

• Factors for authentication

Authorization

• Role-based security controls

• Identity and tenant isolation

Auditing

• Admin action logging

• Monitoring and alerting for forensics

Encryption

• Encrypted Communication For Apps and Administration

• Encrypted Communication Cross Clusters Across WAN

Extensibility

31

Modules : A Revolutionary ApproachAdapt your database to your data, not the other way around

Linux pluggable authentication module for Redis

Top k elements Graph

Topk elements in a stream counter

Pam-auth

Graph database on Redisbased on Cypher language

Based on Generic Cell Rate Algorithm (GCRA)

Rate Limiter

ReJSON

Secondary Index/RQL

JSON Engine on Redis.Pre-released

Indexing + SQL -like syntax for querying indexes.

Pre-released

Neural Redis Redis-ML RediSearch

Full Text Search Engine in RedisMachine Learning Model Serving

Simple Neural Network Native to Redis

Extensions

32

Redise – Integrated in Every Environment

IaaS PaaS Micro-services

BOSH

Extensions

Manageability

34

Redise – Automation and Multi-Tenancy

Maximizing infrastructure utilization and flexibility

• Customer B

• Customer A

• Customer N

• Shard isolation/protection

• Noisy-neighbor cancellation

• Minimizing CPU consumption of inactive customers

Manageability

35

Redise in Containers (preview)

• Faster time to market with continuity between dev/test and

production environments that use Redise Pack

• Greater cost-savings with the ability to use Redise Flash,

technology that uses a combination of RAM and Flash to

deliver near-RAM performance

• Highly available, easier to scale, simpler to manage Redis

technology, integrated with container orchestration tools

such as Swarm, Kubernetes, Mesosphere..

• Maximize resource utilization with the built-in multi-tenancy

of Redise

Run Redise Pack clusters on single or multiple nodes

Manageability

DEMO