+ All Categories
Home > Documents > Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger,...

Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger,...

Date post: 06-Aug-2020
Category:
Upload: others
View: 6 times
Download: 0 times
Share this document with a friend
18
Peter Schwaller, Senior Director Server Eng. (Percona) Taco Scargo, Senior Solution Engineer (Mesosphere) Mesosphere and Percona Server for MongoDB
Transcript
Page 1: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica

Peter Schwaller, Senior Director Server Eng. (Percona)Taco Scargo, Senior Solution Engineer (Mesosphere)

Mesosphere and Percona Server for MongoDB

Page 2: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica

PHYSICAL INFRASTRUCTURE

MICROSERVICES, CONTAINERS, & DEV TOOLS

VIRTUAL MACHINES PUBLIC CLOUDS

DATA SERVICES, MACHINE LEARNING, & AI

Security & Compliance

Application-Aware Automation

MultitenancyHybrid Cloud Management

100+ MORE

DatacenterEdge

Datacenter and Cloud as a Single Computing Resource Powered by Apache Mesos

20+ MORE

Unified hybrid cloud operationsSecurely manage cloud, datacenter, and edge infrastructures from a single control plane

4

Mesosphere DC/OS

Intelligent resource poolingOptimize workload density for highest utilization with resource guarantees

3

Broad workload coverage

Run today & tomorrow’s applications including traditional J2EE, containers, analytics & ML

1

Application-aware automationAutomate workload-specific operating procedures to “as-a-Service” anything from Kubernetes to data services

2

Page 3: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica

Mesos Architecture

3 3

Mesos Master

Mesos Master

Mesos Master

Mesos AgentMesos Agent Service

Cassandra Executor

Cassandra Task

Cassandra Scheduler

Container Scheduler

Spark Scheduler

Spark Executor

SparkTask

Mesos AgentMesos Agent Service

Docker Executor

DockerTask

Spark Executor

SparkTask

Two-level Scheduling

1. Agents advertise resources to Master2. Master offers resources to Framework3. Framework rejects / uses resources4. Agent reports task status to Master

Page 4: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica

Stateful Problems

4

● Preparation before the main task

● Runtime execution against state

○ once

○ scheduled

○ user-defined arguments

○ maintenance

Page 5: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica

Stateful Problems

5

● Conditional recovery scenarios

○ Cassandra: replacing a dead node or dead seed node

○ HDFS: replacing a dead name node

○ HDFS: replacing a dead journal node

● Conditional deployment scenarios

○ HDFS: deployment

Page 6: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica

DC/OS Commons SDK

6

DC/OS

Documentation

Tools and Utilities

Apache Mesos API

Platform Feature Integration

Mongo Kafka Elastic

Finite State MachineExecution PlansAutomated Recovery

Universe PackagingApp ConfigurationNetworking & DiscoveryStorageSecurityMonitoring

Offer EvaluationResource AccountingTask Reconciliation

Developer EnvironmentIntegration Test Framework

Developer GuideTutorials & Code SamplesAPI Reference

Best Practices

Services

SDK

Platform

Page 7: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica

7

DC/OS SDK

● A declarative orchestration abstraction for Apache Mesos and DC/OS.

● An Apache Mesos scheduler factory.

Use Cases● MongoDB! ● Kubernetes● Kafka● Cassandra ● Elastic● HDFS● EdgeLB● many more...

Page 8: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica

8

DC/OS SDK Features

● Rolling configuration / software updates

● Separate deployment / update plans

● Easy Mesos feature consumption

○ CNI, rlimits, readiness checks, running and finished

goal states, discoverability of dns, persistent volumes,

security features (proprietary) …

Page 9: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica

9

DC/OS SDK Features

● Horizontal scale out● Vertical scaling● Service discovery● Virtual Networks (CNI)● Readiness checks● Health checks● Custom recovery● Persistent volumes● Resource sets● Operator friendly tools (API)

● Sidecars● Placement constraints● Configuration templating● Rolling updates (configuration)● Rolling upgrades (binaries)● GPUs● Fine-grained plan control● Secrets (EE)● Security (EE)● TLS provisioning (EE)

Page 10: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica

10

Percona Server for MongoDB

COMMUNITY EDITIONFree and open source

ENTERPRISE

MongoDB Community Edition plus:● Red Hat identity management

certification● Kerberos & LDAP authentication● Auditing● SNMP support● Encrypted storage engine● In-memory storage engine● Platform certifications: Windows,

RedHat/CentOS, Ubuntu, Amazon Linux

● Commercial licenses, warranty, and indemnification

Subscription ($)Free and open source

Percona Memory Engine

Hot Backups

LDAP Authentication

Database Auditing

Log Redaction

COMMUNITY EDITION

Page 11: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica

11

Percona Server for MongoDB on DC/OS

● Simple installation of MongoDB via UI or CLI

● Single-command installation for rapid provisioning

● Multiple MongoDB Replica Sets within a single DC/OS cluster

● Storage volumes for enhanced data durability, known as Mesos Dynamic Reservations and Persistent Volumes

● Support for all Percona Server for MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines

● Auto-configuration of MongoDB Replica Set Configuration

● Auto-configuration of system-level users for backups and user management

● CLI actions for Add/Update/Remove of MongoDB Users

● Logical backup support with Amazon Web Services S3 remote upload

● Support for auto-deploy of Hidden Replica Set Member for zero-impact backups

● Percona Server for MongoDB Auditing support

Page 12: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica

12

Page 13: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica

13

Page 14: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica

14

Page 15: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica

15

Use PSMDB on DC/OS!

1.Install DC/OS (https://dcos.io/install) or contact [email protected] an evaluation license for the DC/OS Enterprise edition

2.Search the DC/OS Catalog for percona-server-mongodb

3.Install the percona-server-mongodb package

4.Provide feedback to [email protected]

NOTE: Replica sets today, sharding in the future

Page 16: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica

16

Resources

Documentation:

https://docs.mesosphere.com/services/percona-mongo

SDK

https://github.com/mesosphere/dcos-commons

https://mesosphere.github.io/dcos-commons/developer-guide/

https://docs.mesosphere.com/services/ops-guide/

Page 17: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica

18

Thank You Sponsors!!

Page 18: Mesosphere and Percona Server for MongoDB · MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines Auto-configuration of MongoDB Replica

Thank You!


Recommended