+ All Categories
Home > Documents > WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC...

WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC...

Date post: 05-Sep-2020
Category:
Upload: others
View: 2 times
Download: 0 times
Share this document with a friend
33
LOXODATA @l_avrot WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata
Transcript
Page 1: WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata LOXODATA @l_avrot WHO Lætitia Avrot PostgreSQL

 LOXODATA

@l_avrot

WHY ARE DBAS SO GRUMPYALL THE TIME ?

NORDIC PGDAY 2018-03-12

Lætitia AVROT Loxodata

Page 2: WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata LOXODATA @l_avrot WHO Lætitia Avrot PostgreSQL

 LOXODATA

@l_avrot

WHO

Lætitia Avrot

PostgreSQL consultant and teacherDBA PostgreSQL for more than 10 years (and also Oracle and SQL Server)@l_avrot

Page 3: WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata LOXODATA @l_avrot WHO Lætitia Avrot PostgreSQL

 LOXODATA

@l_avrot

LOXODATA

Company built on 3 essential pillars

PostgreSQL DevOps Cloud

Page 4: WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata LOXODATA @l_avrot WHO Lætitia Avrot PostgreSQL

 LOXODATA

@l_avrot

Why are DBAs so grumpy all the time ?

Messing up from the beginningWorst developper's practicesOps can mess up too!

Page 5: WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata LOXODATA @l_avrot WHO Lætitia Avrot PostgreSQL

 LOXODATA

@l_avrot

THE DESIGN

Page 6: WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata LOXODATA @l_avrot WHO Lætitia Avrot PostgreSQL

 LOXODATA

@l_avrot

Remove potential interferences

Don't tell people about your projectDon't tell "ops" about your projectKeep your DBA busy (with production)

Page 7: WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata LOXODATA @l_avrot WHO Lætitia Avrot PostgreSQL

 LOXODATA

@l_avrot

The more complex, the more fun!

Replication (multimaster, synchronous, logical...)Authentication (AD, LDAP)External data sources (Datalinks, FDW, ETL...)

Page 8: WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata LOXODATA @l_avrot WHO Lætitia Avrot PostgreSQL

 LOXODATA

@l_avrot

Complexity by example

A simple websiteShows the company canteen menu each day

Page 9: WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata LOXODATA @l_avrot WHO Lætitia Avrot PostgreSQL

 LOXODATA

@l_avrot

Complexity by example

Adding external authenticationAdding synchronous replicationAdding "0 administration architecture"Adding Backup and Monitoring tools

Page 10: WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata LOXODATA @l_avrot WHO Lætitia Avrot PostgreSQL

 LOXODATA

@l_avrot

Complexity by example

Adding Elastic search for full text searchAdding data from old applicationAdding logical replication for BI App

Page 11: WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata LOXODATA @l_avrot WHO Lætitia Avrot PostgreSQL

 LOXODATA

@l_avrot

Cost reduction

Mutualization50+ instances running on the same serverOne database per instance

Page 12: WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata LOXODATA @l_avrot WHO Lætitia Avrot PostgreSQL

 LOXODATA

@l_avrot

Docker is the new black

Does everything!Composing ? What for ?Backing up ? What for ?

Page 13: WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata LOXODATA @l_avrot WHO Lætitia Avrot PostgreSQL

 LOXODATA

@l_avrot

"Bad" docker by example

2 dockers on same VM1 PostgreSQL instance per containerWith streaming replication : call it hight availability!

Page 14: WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata LOXODATA @l_avrot WHO Lætitia Avrot PostgreSQL

 LOXODATA

@l_avrot

APPLICATION DEVELOPMENT

Page 15: WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata LOXODATA @l_avrot WHO Lætitia Avrot PostgreSQL

 LOXODATA

@l_avrot

ORMs

Let your ORM choose which model you needActivate indexing

Page 16: WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata LOXODATA @l_avrot WHO Lætitia Avrot PostgreSQL

 LOXODATA

@l_avrot

Model

1st Normal FormDrop constraints, your app can handle it!Don't normalize : call it denormalization!

Page 17: WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata LOXODATA @l_avrot WHO Lætitia Avrot PostgreSQL

 LOXODATA

@l_avrot

Be trendy : try schemaless!

Easier, faster, lighter!Mongo can do it!Store a lot : call it Big Data!You can fake a model too: Entity, Attribute, Value

Page 18: WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata LOXODATA @l_avrot WHO Lætitia Avrot PostgreSQL

 LOXODATA

@l_avrot

Time series

Store current and archive data on same tableNo partitioning, of course!No purge ever : you need all your data!

Page 19: WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata LOXODATA @l_avrot WHO Lætitia Avrot PostgreSQL

 LOXODATA

@l_avrot

Joins

Grab list of ids from �rst tableLoop on it and query on the second tableIf it's slow, blame the database!

Page 20: WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata LOXODATA @l_avrot WHO Lætitia Avrot PostgreSQL

 LOXODATA

@l_avrot

Transactions, commits, locks and so on

Open transactions and leave it openAsk for explicit commit and never commitPostgres can't manage correct locks : use explicit locks!

Page 21: WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata LOXODATA @l_avrot WHO Lætitia Avrot PostgreSQL

 LOXODATA

@l_avrot

OPS

Page 22: WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata LOXODATA @l_avrot WHO Lætitia Avrot PostgreSQL

 LOXODATA

@l_avrot

Backups

Don't need (replication, disk miroring, VM snapshots)Only logicalHome made!No testing required

Page 23: WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata LOXODATA @l_avrot WHO Lætitia Avrot PostgreSQL

 LOXODATA

@l_avrot

Monitoring

Graphs are for weaklings!Provide graphs without unit or legendTake one measure per day, it's quite enough!

Page 24: WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata LOXODATA @l_avrot WHO Lætitia Avrot PostgreSQL

 LOXODATA

@l_avrot

"Cleaning" $PGDATA

pg_xlog/pg_walpg_cloguse pg_resetwal

Page 25: WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata LOXODATA @l_avrot WHO Lætitia Avrot PostgreSQL

 LOXODATA

@l_avrot

RDBMS are magic!

No DBA neededNothing to understand: it's just magic!No maintenance needed!

Page 26: WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata LOXODATA @l_avrot WHO Lætitia Avrot PostgreSQL

 LOXODATA

@l_avrot

Autovacuum

Setting it offautovacuum_*_scale_factor=0autovacuum_*_threshold=100000

Page 27: WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata LOXODATA @l_avrot WHO Lætitia Avrot PostgreSQL

 LOXODATA

@l_avrot

Hide behind ITIL!

Strip the DBA off any permissionOne change per month, no more6-months validation process for a minor update

Page 28: WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata LOXODATA @l_avrot WHO Lætitia Avrot PostgreSQL

 LOXODATA

@l_avrot

CONCLUSION

Page 29: WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata LOXODATA @l_avrot WHO Lætitia Avrot PostgreSQL

 LOXODATA

@l_avrot

If you're a DBA...

Improve your communicationSmileAppease others

Page 30: WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata LOXODATA @l_avrot WHO Lætitia Avrot PostgreSQL

 LOXODATA

@l_avrot

If you're not a DBA...

Improve your communicationSmileDon't let fear take control of you!

Page 31: WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata LOXODATA @l_avrot WHO Lætitia Avrot PostgreSQL

 LOXODATA

@l_avrot

All we need is love!

: last friday of July : 256th day of the year

: �rst friday of July

Sysadmin appreciation dayDay of the ProgrammerDBA appreciation day

Page 32: WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata LOXODATA @l_avrot WHO Lætitia Avrot PostgreSQL

 LOXODATA

@l_avrot

Questions ?

Thanks to Paul S Randall for the inspiration

Thanks to Freepik and Pixabay for illustrations and photos

Page 33: WHY ARE DBAS SO GRUMPY ALL THE TIME - PostgreSQL · WHY ARE DBAS SO GRUMPY ALL THE TIME ? NORDIC PGDAY 2018-03-12 Lætitia AVROT Loxodata LOXODATA @l_avrot WHO Lætitia Avrot PostgreSQL

 LOXODATA

@l_avrot

Don't forget to leave feedbackhttps://2018.nordicpgday.org/feedback


Recommended