The New MariaDB Offering: MariaDB 10, MaxScale and More

© SkySQL Corporation Ab. Company Confidential.07/04/2023 1

The new MariaDB offeringMariaDB 10, MaxScale, and more

Serge Frezefond, Cloud Solution Architect, SkySQL


MariaDB intro

© SkySQL Corporation Ab. Company Confidential.

What is MariaDB?

• A free fork of MySQL with extra features• features, requested by the users

• Backward compatible• file formats, replication, configuration files• aim at 100% drop-in replacement

• Community developed• 50% of maria-captains are from the community• no hidden agenda


Who’s using it?


Where to get it

• Distributions:• RedHat Enterprise Linux (default in RHEL 7), Debian, Ubuntu (since

14.04), Fedora, Mageia (default), openSUSE (default), Gentoo, Slackware (default), Arch (default), ALTLinux, TurboLinux, Chakra Project (default), Kdu, …

• FreeBSD, OpenBSD• Mac OS X with MacPorts or Homebrew

• From MariaDB.org• sources, binaries in .tar.gz or .zip (Windows)• Windows MSI installer• MariaDB apt and yum repositories


Before MariaDB 10.0

• MariaDB 5.1 – 17 releases since Oct 2009• Aria, XtraDB, PBXT, FederatedX• table elimination, pool of threads,

• MariaDB 5.2 – 15 releases since Apr 2010• OQGraph, SphinxSE• virtual columns, pluggable auth, segmented key cache, extended statistics,

• MariaDB 5.3 – 13 releases since July 2011• major optimizer improvements• replication: group commit, checksums• HandlerSocket, dynamic columns, Windows performance improvements,

microsecond support, GIS precise operations, progress reporting, …


Before MariaDB 10.0

• MariaDB 5.5 – 20 releases since Feb 2012• new thread pool• non-blocking client API• extended keys optimization• dynamic replicate_do_*, replicate_ignore_*,

replicate_wild_* variables


Other MariaDB projects

• MaxScale• MariaDB Galera Cluster• Connectors/Drivers

• MariaDB C Client Library (LGPL)• MariaDB JDBC driver (LGPL)• MariaDB ODBC driver (LGPL)

• MariaDB Audit Plugin

07/04/2023 9© SkySQL Corporation Ab. Company Confidential.

Community activity

• Past month (March 2014):• Added/Changed Articles in the KB: 123• On Freenode IRC #maria, 550 people wrote 10173

lines• Source code (Launchpad):

• 25 active branches• 395 commits

MariaDB is now on GitHub:

https://github.com/MariaDB/server/




Community Contributions

MariaDB 10.0 major contributions:• Per thread memory counting and usage

• Base code and idea by Lixun Peng, Taobao

• Multi-source replication• Base code by Lixun Peng, Taobao

• GET_LOCK• Code by Konstantin "Kostja" Osipov,

mail.ru

• CONNECT storage engine• Code by Olivier Bertrand

• Spider storage engine metadata_lock_info Information schema

• Code by Kentoku Shiba, Spiral Arms

• Roles• Code by Vicentiu Ciorbaru, Google

Summer of Code 2013

• PCRE Regular Expressions• Code by Sudheera Palihakkara, Google

Summer of Code 2013

• Global Transaction IDs• Some patches by Pavel Ivanov, Google

https://mariadb.com/kb/en/log-of-mariadb-contributions/

https://mariadb.com/kb/en/log-of-mariadb-contributions/


Community Ongoing Dev Projects• WebScaleSQL patcheshttps://

mariadb.atlassian.net/browse/MDEV-6039• LevelDB/RocksDB storage engine (persistent key-value

store for fast storage)https://mariadb.com/kb/en/leveldb-storage-engine/

• Fusion-IO page compressionhttps://blog.mariadb.org/significant-performance-boost-with-new-mariadb-page-compression-on-fusionio/

• Kerberos authentication pluginhttps://mariadb.atlassian.net/browse/MDEV-4691

• Mroonga storage engine (fast fulltext search) https://mariadb.atlassian.net/browse/MDEV-5222

• Statistically optimize mysql-test runs by running less tests, Pablo Estrada, Google Summer of Codehttps://mariadb.atlassian.net/browse/MDEV-5776

• CREATE OR REPLACE, CREATE IF NOT EXISTS, DROP IF EXISTS, Sriram Patil, Google Summer of Codehttps://mariadb.atlassian.net/browse/MDEV-5359

• Self-Tuning Optimizer, Anshu Avinash, Google Summer of Codehttps://mariadb.atlassian.net/browse/MDEV-350

• Support of UseServerPrepStmts to MariaDB Java Connector, Puneet Dewan, Google Summer of Code

https://mariadb.atlassian.net/browse/MDEV-6039



https://mariadb.com/kb/en/leveldb-storage-engine/

https://mariadb.com/kb/en/leveldb-storage-engine/

https://blog.mariadb.org/significant-performance-boost-with-new-mariadb-page-compression-on-fusionio/














MariaDB 10.0

© SkySQL Ab. Company Confidential.

MariaDB 10

● MariaDB 10.0 GA launched March 31st, 2014.

● Application-compatible withMySQL.

● Includes significant unique new features in scalability, replication, performance, NoSQL, operations, security.

● Available under the GPL v2.


MariaDB 10 Scalability:Parallel Slave Replication

● Sponsored by Google.● Allows slaves to

process update eventsin parallel.

● Uses MariaDB 10’simproved GlobalTransaction ID (GTID).

● MariaDB unlike MySQLcan process multipleupdates for a single database in parallel. Much better throughput.

● Preliminary benchmarks: almost 10x faster at 12 threads.Improves scalability, reduces slave lag,

making slaves more consistent.

MySQL MariaDB

✘Single threaded per database.

✔in 10.0.


Parallel Slave Benchmark

sysbench OLTP single database slave tps relative to master


MariaDB 10 Scalability:Multi-Source Replication

● Collects data foranalytics usingbuilt-in replication.

● Aids in administrationexample: consolidatedbackups of multiple databases.

● Uses MariaDB 10’s improvedGlobal Transaction ID (GTID).

Easier analytics, more insight,simpler administration, fewer headaches.

Online E-Commerce Application

Master S S S S

Content Management

System

Click-stream data

Data WarehouseSlave ETL

Master S S S S

Master S S S S

MySQL MariaDB

✘ ✔in 10.0.


MariaDB 10 Scalability:Sharding with Spider

● Contributed by a 3rd party developer.● Storage engine partitions large tables

across multiple DBs.● No changes to the client application.● Developers aren’t aware, can keep

applications simple.● Allows for more

parallelism, scale-out.● Transactional storage

engine.

Web-scale, without the development hassle.

Application

Customers

A-HI-PQ-Z

Spider

Customers

A-H

Shard 1

Customers

I-P

Shard 2

Customers

Q-Z

Shard 3

MySQL MariaDB

✘optional 3rd party install

✔in 10.0.

Technology Preview

Ivan Zoratti

Simply add extra cylinders to the shards, like shadows. so you keep everything in one slide.

Rich Sands

Good idea - will add this to a future revision.

Ralf Gebhardt

We should add a second slide for Spider, which is showing also Sharding including high availability (two servers for Shard1, Shard2, Shard3). Why? We are more or less showing the MySQL Cluster in that case, but the use partitioning gives us full control. At DTAG they found this approach very interesting

Ivan Zoratti

Beware Spider is not GA


MariaDB 10 Performance:TokuDB Storage Engine

● 3rd party partner - TokuTek.● Drop-in replacement for

InnoDB/XtraDB.● Advanced indexing and

compression algorithms.● Transactional.● Up to 20x performance gain

for inserts/updates.● Up to 90% less disk storage.● Online schema changes.● Reduces or eliminates slave lag.● Best when DB doesn’t fit in memory,

and SSD longevity is important.

MySQL MariaDB

✘optional 3rd party install

✔in 10.0.


MariaDB 10 Performance:Optimizer Improvements

● Of 29 distinct enhancements noted,28 are in MariaDB 10. Just 1 only inMySQL 5.6.

● Enhancements include:○Disk access optimizations.○JOIN optimizations.○Subquery optimizations.○Optimized derived tables and views.○Execution control.○Optimizer control.○EXPLAIN improvements.

Less I/O, CPU, memory requirements. Faster execution.

Ivan Zoratti

You should give hints in the presenter comment to identify which are in the list and the one that is not...


MariaDB 10 Performance:More Enhancements and Features

● Fusion-io Atomic Writes - improvesperformance on popular SSD hardware.✔ exclusive to MariaDB 10

● XtraDB storage engine - enhanced from InnoDB.● Improved InnoDB storage engine - based on MySQL

5.6.● Performance schema - real-time performance

management.● Improved thread pool - better concurrent user

performance.✔ exclusive to MariaDB 10

● More optimizer improvements - higher efficiency in I/O accesses. ✔ exclusive to MariaDB 10

Faster performance, lower cost.

Ivan Zoratti

Atomic writes are not exclusive to mariadb10

Ivan Zoratti

thread pool is not exclusive - persona and mysql enterprise have a similar features. the one from percona provides better performance


Fusion-IO page compression

https://blog.mariadb.org/significant-performance-boost-with-new-mariadb-page-compression-on-fusionio

• Atomic writes gives a performance increase of about 30%. By enabling fast checksum for XtraDB it’s 50%

• By using page compression the compression ratio is leading to better performance and there are less writes to disk.

• Multi-threaded flush provides better throughput and decreases operation latencies delivering a performance boost




MariaDB 10 Interoperability:CONNECT Storage Engine

● From 3rd party developer.● Maps diverse data

to tables.● JOIN mapped data

to DB tables.● Flat files including CSV.● Tables in external DBs.● Generated tables

(PIVOT etc.)● Plug-in API for your own mappings.

Powerful tool for data integration, federation.

Application

Spider

MariaDB Parser/Optimizer/Connection Pool

CONNECTEngine

OtherEngines

MySQL MariaDB

✘ ✔in 10.0.

Technology Preview

Database

Tables

.log

XML

CSV

Rich Sands

maybe a zigzag "lightning bolt" graphic instead of solid line? Or dashed lines?

Ralf Gebhardt

we need to find a different image. looks like we import the data. We need to find a symbol that we "access" data


MariaDB 10 Interoperability:Cassandra Storage Engine

● Window into a Cassandra ring:read/write like a table in MariaDB.

● Use standard SQL queries.● JOIN Cassandra data

to MariaDB tables.● Use a MariaDB cluster

for high-availabilityaccess.

● Bring data fromCassandra into OLTPapplications.

Interoperate with Cassandra.Use Cassandra data in OLTP applications.

Application

Spider

DatabaseTables

MariaDB Parser/Optimizer/Connection Pool

CassandraEngine

OtherEngines

MySQL MariaDB

✘ ✔in 10.0.

Technology Preview

Rich Sands

Yes - need a different graphic for "storage engine"

Ralf Gebhardt

Again, we access data. We do not import it. Another image could be used. Maybe we can find a symbol for a storage engine (disk + cogged wheel?)


MariaDB 10 NoSQL Features:Dynamic Columns

● Store unstructured data in MariaDB tables with a simple API.

● Use MariaDB’s indexing and transactions to manipulate“document” style data fast and consistently.

● Nest sets of dynamic columns inside of other dynamic columns - hierarchical structuring.

● Include multiple rows with dynamic columns in transactions.Process unstructured data in the same way as

NoSQL,but with the power of MariaDB.

Cust ID Account Balance

Dyn_Col_BLOBs

2035 $154.04 NAME: John Smith|LOC: 45.35243, -74.98348|IMAGE: x27A8B8C ...

2036 $929.10 NAME: Jane Doe|LOC: 45.35243, -74.98348|AGE: 32| GENDER: F...

2037 $377.53 NAME: Carol Jones|AGE: 43|GENDER: F||IMAGE: xA9674DE678 ...

MySQL MariaDB

✘ ✔in 10.0.

Ralf Gebhardt

Ok. Datatypes are listed here - https://mariadb.com/kb/en/dynamic-columns/#datatypes. No BLOB Type listed. A reference to a blob in another table could still be added where needed. With the advantage that not always the full BLOB data is read when you only need some values from the dynamic column.

Rich Sands

No time to update this example for tomorrow but will change it for a future update.Wow - BLOBs aren't a valid type for fields? That seems like a giant limitation, no?

Ralf Gebhardt

Why the example in the KB - long ago but I think the reason was just that there would be somehow a link to the KB. Your Example would need to be changed to be correct, I think. Showing that an image can be part of a Dynamic Column would mean that a blob type can be used as type. As I know this is not possible. Your Example (if the idea is to use a real example) should show COLUMN_JSON(Dyn_Col_BLOBS) as header for the second column and the values should be shown in JSON Format.

Rich Sands

The named column thing seems like a talking point.Why do you prefer the example in the KB? I found it unrealistic and a little odd, which is why I switched to putting a "user profile" into the dynamic columns. Can you explain why the KB example is better? Thx.

Ralf Gebhardt

New for MariaDB 10 is 1) that the reference to a column can be done based on a item text, not only a number (position). 2) that the output can be in JSON formatNot sure if we should add this or if it is too detailed.As an example it would be better to use products like in https://mariadb.com/kb/en/dynamic-columns


MariaDB 10 NoSQL Features:HandlerSocket Plugin

● Simple, low-overheadAPI direct to thestorage engine.

● Bypasses SQLstatement processing.

● Less CPU, memory,I/O, network demands.

● Batches requests foreven less I/O operations.

● Building block for applicationlevel NoSQL processing.

Mix RDBMS applications with high performance NoSQL applications. Leverage MariaDB’s storage engine architecture

for both.

Transactional Application

DatabaseTables

NoSQL Application

Spider

Connection Pool

InnoDB/XtraDB and Spider Storage Engines

SQL Interface

Parser

Optimizer HandlerSocket Plugin

SQL Statements

Simple CRUD API

MySQL MariaDB

✘ ✔in 10.0.

Ivan Zoratti

Consider that mysql provides the memcache plugin: http://dev.mysql.com/doc/refman/5.6/en/innodb-memcached.html


Thread Time

27 .003761

28 34.2529

29 .000713

Why is this so slow? Lets find out… SHOW EXPLAIN FOR 28;

ID select_type

table

possible_keys

rows

1 SIMPLE tbl NULL 1855174

Oh! Sequential scan of a 18M row table… no wonder! I’ll let the team know...

MariaDB 10 Operations:SHOW EXPLAIN Command

To: DevOps Team

From: DBA Debby

Subj. Slow Queries

Hey guys, figured out those blocking queries. The new reservation app is looking for the shortest route but that column has no index - we need one! I’ll add it now. Debby

MySQL MariaDB

✘ ✔in 10.0.

And it works in the slow query log too!Also for UPDATE and DELETE.


MariaDB 10 Operations:More Enhancements and Features

● Improved Table Discovery - less work for DBAs;integrates storage engines. ✔ exclusive to MariaDB 10

● SHOW PLUGINS SONAME - dynamic report oninstalled components. ✔ exclusive to MariaDB 10

● SHUTDOWN Command - apps can shutdown the databaseprogrammatically. ✔ exclusive to MariaDB 10

● Kill Query by Query ID - fix performance blocks .● Online ALTER TABLE - schema changes without

downtime.● Per-thread Memory Statistics - easier tuning and

problem diagnosis. ✔ exclusive to MariaDB 10

● Improved Error Messages - faster problem solving.✔ exclusive to MariaDB 10

Manage larger configurations with lower cost, less downtime.


DatabaseTables

MariaDB 10

Role: DBA

Permissions:● Update Schema● View Statistics● Create DatabaseDBA

Developer

Sysadmin

MariaDB 10: Security:Role-Based Access Control

MySQL MariaDB

✘ ✔in 10.0.


MariaDB 10 Security:More Enhancements and Features

● Audit Plugin - Identify and correct potentialsecurity breaches. Comply with auditabilityrequirements. ✔ included with MariaDB 10, supported by SkySQL

● PAM Authentication Module - delegate authenticationto the popular Unix single-signon authentication API.✔ exclusive to MariaDB 10

Integrate the database with your security policies.Simplify administration and compliance.

Rich Sands

No time to do this for tomorrow, sorry. Will do it for a future update.

Ralf Gebhardt

Two separate slides for Audit Plugin and Authentication Plugin. Customers want to get more details here


MariaDB Audit Plugin 2.0 Roadmap

● Audit Plugin 1.1 includes table event logging such as triggers and stored procedure calls, unique to its integration with MariaDB.

● Building on these capabilities, V2.0 of the Audit Plugin is planned to include:○ Optional field substitution of placeholders in query logs to

improve privacy and security.○ Integration with MariaDB 10 Role-based Access Control -

filtering audit logs by role.○ Recording of privilege changes as audit-able events.○ Log rotation.

Confidential


MariaDB 10 Roadmap

10.0.X Releases - updates to 10.0 over 2014.• Merge additional MySQL 5.6 changes.

• Improvements to Fusion-io SSD atomic write support.

• More thread pool improvements including Percona enhancements.

• SHOW EXPLAIN support for PARTITIONS and EXTENDED attributes.

• CONNECT engine improvements.

• Perform extensive replication testing between MySQL 5.6 and MariaDB 10.0 to establish a more complete supportability matrix.

• Open Query Graph (OQGRAPH) engine improvements.

• Experimental Mroonga storage engine - full-text for Asian languages.

Confidential

Ivan Zoratti

The point is not to compile it with or without Galera, it is to have Galera that can be switched on or off in the conf file


MariaDB 10 Roadmap10.1.X Preliminary Major Feature List (all dot.dot versions):• Integration of Galera multi-master clusters into MariaDB

• Switch on/off Galera support in conf file• Merged features from MySQL, Percona, WebscaleSQL:

• All functions visible from SQL in 5.6.• Character set and collation changes.• default_tmp_storage_engine.• Optimizer features including semi-joins+outer-joins, optimizer trace, EXPLAIN JSON, EXPLAIN FOR

CONNECTION.• Percona features: per-query variables, userstat improvements, SHOW ENGINE INNODB STATUS improvements,

NUMA improvements.• Selected 5.7 features: UNION ALL without temporary tables, multiple triggers on table, new InnoDB, new

Performance Schema instruments, MDL improvements, multiple triggers per table, new InnoDB/XtraDB.• Merge WebscaleSQL improvements and integrate stress-test.

• Kerberos authentication support• GIS improvements - full support for OGC compliance• Windowing functions

Confidential

Sergey Petrunya

Nobody promised or was going to port optimizer_trace.

Sergey Petrunya

You can also include "ANALYZE stmt" (MDEV-406)


MariaDB 10 Roadmap

10.1.X Preliminary Major Feature List, continued:• Performance boosts: thread management, 16K InnoDB buffers, remote and portable

tablespaces, optimizer enhancements, temporary table improvements, InnoDB persistent auto-increment, query timeouts.

• Performance tuning Parallel Replication and GTID, row-level PR enhancements, slave execution of triggers, more benchmarks.

• Setting to force InnoDB tables to have a primary key.• Role-based access control: features and performance improvements.• Progress report on mysqldump• Memory engine varchar and BLOB types• Community: move version control to GitHub (DONE).

Confidential


MariaDB 10 Roadmap

10.1 and following - additional feature ideas under investigation:• Transactional DDL• Indexes on expressions• Field/Column type plug-in

• JSON/BSON• YAML• IPv6/IPv4• UUID• Own datatype for Dynamic

Columns

Confidential

• More storage engines and interoperability with other DBs - potentially:• RocksDB/LevelDB• InfiniDB• MongoDB• Hadoop/HDFS• HBase/Honeycomb

• Message queues• Global DDL lock


MariaDB Enterprise

36© SkySQL Corporation Ab. Company Confidential.

MariaDB Enterprise: Integrating the Complete Solution

MariaDB EnterpriseSubscriptions

DevOpsAdminNoSQL

ShardingClustering

Innovation

SupportConsultin

gTraining

RDBAPortal

NRE

Customer Care

Partner Products


MariaDB Enterprise: What’s In A Subscription?

Benefit What you get beyond the core MariaDB server binaries

Documentation Customer portal includes subscription-only material beyond KnowledgeBase.

Connectors Tested by SkySQL, certified with ISVs.Product Roadmaps

Roadmaps shared with subscribers, who have stronger influence on direction.

Upgrades, Patches

Subscribers receive proactive upgrade push, with release notes and advice.

Helpdesk Support

Subscribers receive consultative support and hot-fixes, beyond break/fix.

Bundled Partner Tools

Selected partner tools offered as part of subscription.

Date post:	28-Aug-2014
Category:	Software
Upload:	skysql-ab
View:	451 times
Download:	0 times

The New MariaDB Offering: MariaDB 10, MaxScale and More

Software