Peter Schwaller, Senior Director Server Eng. (Percona)Taco Scargo, Senior Solution Engineer (Mesosphere)
Mesosphere and Percona Server for MongoDB
PHYSICAL INFRASTRUCTURE
MICROSERVICES, CONTAINERS, & DEV TOOLS
VIRTUAL MACHINES PUBLIC CLOUDS
DATA SERVICES, MACHINE LEARNING, & AI
Security & Compliance
Application-Aware Automation
MultitenancyHybrid Cloud Management
100+ MORE
DatacenterEdge
Datacenter and Cloud as a Single Computing Resource Powered by Apache Mesos
20+ MORE
Unified hybrid cloud operationsSecurely manage cloud, datacenter, and edge infrastructures from a single control plane
4
Mesosphere DC/OS
Intelligent resource poolingOptimize workload density for highest utilization with resource guarantees
3
Broad workload coverage
Run today & tomorrow’s applications including traditional J2EE, containers, analytics & ML
1
Application-aware automationAutomate workload-specific operating procedures to “as-a-Service” anything from Kubernetes to data services
2
Mesos Architecture
3 3
Mesos Master
Mesos Master
Mesos Master
Mesos AgentMesos Agent Service
Cassandra Executor
Cassandra Task
Cassandra Scheduler
Container Scheduler
Spark Scheduler
Spark Executor
SparkTask
Mesos AgentMesos Agent Service
Docker Executor
DockerTask
Spark Executor
SparkTask
Two-level Scheduling
1. Agents advertise resources to Master2. Master offers resources to Framework3. Framework rejects / uses resources4. Agent reports task status to Master
Stateful Problems
4
● Preparation before the main task
● Runtime execution against state
○ once
○ scheduled
○ user-defined arguments
○ maintenance
Stateful Problems
5
● Conditional recovery scenarios
○ Cassandra: replacing a dead node or dead seed node
○ HDFS: replacing a dead name node
○ HDFS: replacing a dead journal node
● Conditional deployment scenarios
○ HDFS: deployment
DC/OS Commons SDK
6
DC/OS
Documentation
Tools and Utilities
Apache Mesos API
Platform Feature Integration
Mongo Kafka Elastic
Finite State MachineExecution PlansAutomated Recovery
Universe PackagingApp ConfigurationNetworking & DiscoveryStorageSecurityMonitoring
Offer EvaluationResource AccountingTask Reconciliation
Developer EnvironmentIntegration Test Framework
Developer GuideTutorials & Code SamplesAPI Reference
Best Practices
Services
SDK
Platform
7
DC/OS SDK
● A declarative orchestration abstraction for Apache Mesos and DC/OS.
● An Apache Mesos scheduler factory.
Use Cases● MongoDB! ● Kubernetes● Kafka● Cassandra ● Elastic● HDFS● EdgeLB● many more...
8
DC/OS SDK Features
● Rolling configuration / software updates
● Separate deployment / update plans
● Easy Mesos feature consumption
○ CNI, rlimits, readiness checks, running and finished
goal states, discoverability of dns, persistent volumes,
security features (proprietary) …
9
DC/OS SDK Features
● Horizontal scale out● Vertical scaling● Service discovery● Virtual Networks (CNI)● Readiness checks● Health checks● Custom recovery● Persistent volumes● Resource sets● Operator friendly tools (API)
● Sidecars● Placement constraints● Configuration templating● Rolling updates (configuration)● Rolling upgrades (binaries)● GPUs● Fine-grained plan control● Secrets (EE)● Security (EE)● TLS provisioning (EE)
10
Percona Server for MongoDB
COMMUNITY EDITIONFree and open source
ENTERPRISE
MongoDB Community Edition plus:● Red Hat identity management
certification● Kerberos & LDAP authentication● Auditing● SNMP support● Encrypted storage engine● In-memory storage engine● Platform certifications: Windows,
RedHat/CentOS, Ubuntu, Amazon Linux
● Commercial licenses, warranty, and indemnification
Subscription ($)Free and open source
Percona Memory Engine
Hot Backups
LDAP Authentication
Database Auditing
Log Redaction
COMMUNITY EDITION
11
Percona Server for MongoDB on DC/OS
● Simple installation of MongoDB via UI or CLI
● Single-command installation for rapid provisioning
● Multiple MongoDB Replica Sets within a single DC/OS cluster
● Storage volumes for enhanced data durability, known as Mesos Dynamic Reservations and Persistent Volumes
● Support for all Percona Server for MongoDB storage engines, including the WiredTiger, MongoRocks, InMemory, and MMAPv1 storage engines
● Auto-configuration of MongoDB Replica Set Configuration
● Auto-configuration of system-level users for backups and user management
● CLI actions for Add/Update/Remove of MongoDB Users
● Logical backup support with Amazon Web Services S3 remote upload
● Support for auto-deploy of Hidden Replica Set Member for zero-impact backups
● Percona Server for MongoDB Auditing support
12
13
14
15
Use PSMDB on DC/OS!
1.Install DC/OS (https://dcos.io/install) or contact [email protected] an evaluation license for the DC/OS Enterprise edition
2.Search the DC/OS Catalog for percona-server-mongodb
3.Install the percona-server-mongodb package
4.Provide feedback to [email protected]
NOTE: Replica sets today, sharding in the future
16
Resources
Documentation:
https://docs.mesosphere.com/services/percona-mongo
SDK
https://github.com/mesosphere/dcos-commons
https://mesosphere.github.io/dcos-commons/developer-guide/
https://docs.mesosphere.com/services/ops-guide/
18
Thank You Sponsors!!
Thank You!