Polyglot Persistence and Database Deployment

Brief introduction to Emerging world of Polyglot Persistence using open source database ecosystem.

Sandeep Khuperkar

CTO and Director

Till recent past...

Only considerations were –

• Consistency

• Integration

• Expressiveness

• Stability

7/12/2017 Tech Insights – The Digital Transformation Series

3

Disparate Data Storage Needs

Today we are additionally facing –

• Volume, variety and Velocity of data

• Rapid expansion of data-driven business

• Application landscape is changing with distributed system like social media, IoT, microservices

• Impedance mismatch : A lot of effort is spent on mapping data between in-memory data structures and a relational database.

7/12/2017 Tech Insights – The Digital Transformation Series

4

…capitalize open source database ecosystem

Key-value store - stores data as a collection of key/value pairs.

Document store - store each record and its associated data within a single document.

Columnar store - stores data using a column oriented model.

Graph store - is a type of database that uses graph theory to store, map and query relationships.

7/12/2017 Tech Insights – The Digital Transformation Series

5

Polyglot Persistence

Key Advantages

• You get best of both worlds – strict enforcement of data integrity from RDBMS, and the scalability and flexibility provided by NoSQL

• Allows you to use best tool depending on your use case.

• Helps your App to scale well.

• Rich Experience .

7/12/2017 Tech Insights – The Digital Transformation Series

6

Service Wrapping –Possibility to look at

This possibility if feasible in your setup may allow databases inside the services to evolve without you having to change the dependent applications.

7/12/2017 Tech Insights – The Digital Transformation Series

7

Enhancing the Functionality

Adding functionality to existing legacy applications and data storage.

Ex – adding indexing engine to enhance search capability.

Care should be taken that in this case we need to update the indexed data as the application data changes.

7/12/2017 Tech Insights – The Digital Transformation Series

8

Polyglot Persistence with EDB Postgres

7/12/2017 Tech Insights – The Digital Transformation Series

9

Key Factors

Few factors to be consider when deploying Polyglot Persistence –

• Identifying the right database

• At application level need to know –• How to interface with each databases

• How to map results back to application’s object model.

• Handling queries across databases.

• How will you plan the backup policy

• Manage and control changes to the config. of each databases.

7/12/2017 Tech Insights – The Digital Transformation Series

10

Polyglot Persistence is not something which can be used as an out of the box product, but instead needs to be designed for each individual enterprise for its unique Data Architecture.

7/12/2017 Tech Insights – The Digital Transformation Series

11