+ All Categories
Home > Documents > Building an Enterprise-grade PostgreSQL Server using Open ... › sites › default › files ›...

Building an Enterprise-grade PostgreSQL Server using Open ... › sites › default › files ›...

Date post: 09-Jun-2020
Category:
Upload: others
View: 2 times
Download: 0 times
Share this document with a friend
23
© 2018 Percona 1 Building an Enterprise-grade PostgreSQL Server using Open Source tools Webinar Avinash Vallarapu (Avi) Jobin Augustine Fernando Laudares 10th October, 2018
Transcript
Page 1: Building an Enterprise-grade PostgreSQL Server using Open ... › sites › default › files › ...2 © 2018 Percona Usual Myths Security is not free Cannot take a full backup that

© 2018 Percona 1

Building an Enterprise-grade PostgreSQL Server using Open Source toolsWebinar

Avinash Vallarapu (Avi) Jobin Augustine Fernando Laudares

10th October, 2018

Page 2: Building an Enterprise-grade PostgreSQL Server using Open ... › sites › default › files › ...2 © 2018 Percona Usual Myths Security is not free Cannot take a full backup that

© 2018 Percona 2

Usual Myths

▪ Security is not free ▪ Cannot take a full backup that is good for PITR (Point-in-time-recovery) ▪ High Availability is a concern ▪ Not scalable ▪ Less options for Database maintenance

Page 3: Building an Enterprise-grade PostgreSQL Server using Open ... › sites › default › files › ...2 © 2018 Percona Usual Myths Security is not free Cannot take a full backup that

© 2018 Percona 3

▪ Satisfy enterprise features such as - ▪ Encryption ▪ User Management ▪ Ability to tune ▪ Connection pooling/load balancing ▪ Logging and auditing ▪Monitoring ▪Durable Replication methods ▪High Availability and automatic failover ▪ Reliable Backups ▪ Tools for routine database maintenance tasks ▪ Partitioning ▪ Continuous bug fixes ▪ Fixing security vulnerabilities and many more …

Enterprise-grade PostgreSQL using Open Source Solutions

Page 5: Building an Enterprise-grade PostgreSQL Server using Open ... › sites › default › files › ...2 © 2018 Percona Usual Myths Security is not free Cannot take a full backup that

© 2018 Percona 5

Security in PostgreSQL

Page 6: Building an Enterprise-grade PostgreSQL Server using Open ... › sites › default › files › ...2 © 2018 Percona Usual Myths Security is not free Cannot take a full backup that

© 2018 Percona 6

▪ Authentication ▪Host based authentication ▪ SCRAM-SHA-256, PAM/LDAP, Kerberos, SSL

▪ Authorization ▪ User Management ▪ Row level security ▪Data security using Encryption

▪ Accounting and Auditing ▪ Logging ▪ Auditing

▪ Security Bug Fixes ▪ Please subscribe to our blog posts

Security in PostgreSQL

Page 7: Building an Enterprise-grade PostgreSQL Server using Open ... › sites › default › files › ...2 © 2018 Percona Usual Myths Security is not free Cannot take a full backup that

© 2018 Percona 7

Backup Strategy

Page 8: Building an Enterprise-grade PostgreSQL Server using Open ... › sites › default › files › ...2 © 2018 Percona Usual Myths Security is not free Cannot take a full backup that

© 2018 Percona 8

▪ PostgreSQL ▪ pg_basebackup - Consistent Online backup - helps achieve PITR ▪ pg_dump/pg_restore - Logical Backups ▪ Archiving on WAL’s in Archive Mode.

▪ PostgreSQL Umbrella projects ▪ pgBackRest ▪ BARMAN ▪WAL-g (previously WAL-e) ▪More on each of these solutions in our future blog posts …

Backup Strategy

Page 9: Building an Enterprise-grade PostgreSQL Server using Open ... › sites › default › files › ...2 © 2018 Percona Usual Myths Security is not free Cannot take a full backup that

© 2018 Percona 9

Connection Pooling and Load Balancer

Page 10: Building an Enterprise-grade PostgreSQL Server using Open ... › sites › default › files › ...2 © 2018 Percona Usual Myths Security is not free Cannot take a full backup that

© 2018 Percona 10

▪ PostgreSQL Connections ▪ Process-based (each connection is a process) ▪Native application connection pooler (preferred) ▪ External Connection Poolers

▪Open Source tools for Scaling PostgreSQL ▪ External Connection Poolers ▪ pgBouncer ▪ pgPool-II

▪ Load Balancer ▪HAProxy

Connection Pooling & Load Balancing

Page 11: Building an Enterprise-grade PostgreSQL Server using Open ... › sites › default › files › ...2 © 2018 Percona Usual Myths Security is not free Cannot take a full backup that

© 2018 Percona 11

High Availability and Automatic Failover

Page 12: Building an Enterprise-grade PostgreSQL Server using Open ... › sites › default › files › ...2 © 2018 Percona Usual Myths Security is not free Cannot take a full backup that

© 2018 Percona 12

▪ PostgreSQL - Replication methods

▪ Streaming Replication (preferred for HA) ▪ Cascaded Replication ▪ Synchronous and Asynchronous Replication ▪Warm Standby and Hot Standby

▪ Logical Replication ▪ Cascaded Replication

▪ Open Source Contributions for Automatic Failover ▪ Patroni ▪ REPMGR ▪ Stolon ▪ PostgreSQL Automatic Failover (PAF) ▪ pglookout ▪ pgPool - II

High Availability & Automatic Failover

Page 13: Building an Enterprise-grade PostgreSQL Server using Open ... › sites › default › files › ...2 © 2018 Percona Usual Myths Security is not free Cannot take a full backup that

© 2018 Percona 13

Patroni

Page 14: Building an Enterprise-grade PostgreSQL Server using Open ... › sites › default › files › ...2 © 2018 Percona Usual Myths Security is not free Cannot take a full backup that

© 2018 Percona 14

PostgreSQL Extensions

Page 15: Building an Enterprise-grade PostgreSQL Server using Open ... › sites › default › files › ...2 © 2018 Percona Usual Myths Security is not free Cannot take a full backup that

© 2018 Percona 15

▪ PostgreSQL ▪ Feature-rich and Community driven ▪Capability of adding Extensions

▪ A few extensions among hundreds of extensions ▪ pg_stat_statements - Query stats ▪ pg_repack - Online table reorg ▪ pl/profiler - Profiling of Stored procedures ▪Orafce - Oracle functions to port applications on Oracle to PostgreSQL easily ▪ Language extensions like - PL/PGSQL, PL/Python, PL/Perl, PL/Java, PL/R, etc .. ▪ Foreign Data Wrappers like - mysql_fdw, mongo_fdw, postgres_fdw, etc …

PostgreSQL Extensions

Page 16: Building an Enterprise-grade PostgreSQL Server using Open ... › sites › default › files › ...2 © 2018 Percona Usual Myths Security is not free Cannot take a full backup that

© 2018 Percona 16

PostgreSQL Detailed Logging and Analyzer

Page 17: Building an Enterprise-grade PostgreSQL Server using Open ... › sites › default › files › ...2 © 2018 Percona Usual Myths Security is not free Cannot take a full backup that

© 2018 Percona 17

▪ PostgreSQL ▪ Enable detailed logging of activity. ▪Customizable logging ▪ Log DDLs ▪ Log statements running for more than log_min_duration_statement time.

▪Open Source Log Analyzer ▪ pgBadger ▪ PMM QAN (Query Analytics) - Under development

PostgreSQL Detailed Logging and Analyzer

Page 18: Building an Enterprise-grade PostgreSQL Server using Open ... › sites › default › files › ...2 © 2018 Percona Usual Myths Security is not free Cannot take a full backup that

© 2018 Percona 18

Monitoring

Page 19: Building an Enterprise-grade PostgreSQL Server using Open ... › sites › default › files › ...2 © 2018 Percona Usual Myths Security is not free Cannot take a full backup that

© 2018 Percona 19

▪Monitoring methods

▪Open Source tools ▪Munin ▪ Zabbix ▪ Cacti ▪ Nagios ▪ Grafana ▪ PMM ▪ PGObserver ▪ pgCluu

Monitoring

Page 20: Building an Enterprise-grade PostgreSQL Server using Open ... › sites › default › files › ...2 © 2018 Percona Usual Myths Security is not free Cannot take a full backup that

© 2018 Percona 20

Final Architecture of our Webinar Demo

Page 21: Building an Enterprise-grade PostgreSQL Server using Open ... › sites › default › files › ...2 © 2018 Percona Usual Myths Security is not free Cannot take a full backup that

© 2018 Percona 21

Page 22: Building an Enterprise-grade PostgreSQL Server using Open ... › sites › default › files › ...2 © 2018 Percona Usual Myths Security is not free Cannot take a full backup that

© 2018 Percona 22

Percona Live - PostgreSQL track

https://www.percona.com/live/e18/

Page 23: Building an Enterprise-grade PostgreSQL Server using Open ... › sites › default › files › ...2 © 2018 Percona Usual Myths Security is not free Cannot take a full backup that

© 2018 Percona 23

Questions ???


Recommended