Date post: | 06-Jan-2017 |
Category: |
Technology |
Upload: | karl-isenberg |
View: | 367 times |
Download: | 0 times |
© 2016 Mesosphere, Inc. All Rights Reserved. 2
KARL ISENBERG
WHERE?- Mesosphere- Pivotal- Williams-Sonoma
WHAT?- DC/OS- Kubernetes- CloudFoundry- BOSH- Spring Ecommerce Platform
- github.com/karlkfi
- twitter.com/karlkfi
- linkedin.com/in/karlkfi
- karl.isenberg.us
© 2016 Mesosphere, Inc. All Rights Reserved. 4
INFRASTRUCTUREEVOLUTION
ONLINE
AWS Simple IconsBy Amazon Web Services, Inc., CC BY-SA 3.0
© 2016 Mesosphere, Inc. All Rights Reserved. 5
INFRASTRUCTUREEVOLUTION
ONLINELOAD BALANCED
AWS Simple IconsBy Amazon Web Services, Inc., CC BY-SA 3.0
© 2016 Mesosphere, Inc. All Rights Reserved. 6
INFRASTRUCTUREEVOLUTION
ONLINELOAD BALANCED
DATA REPLICATION
AWS Simple IconsBy Amazon Web Services, Inc., CC BY-SA 3.0
© 2016 Mesosphere, Inc. All Rights Reserved. 7
INFRASTRUCTUREEVOLUTION
ONLINELOAD BALANCED
DATA REPLICATIONMULTI-REGION
LATENCY ROUTEDAUTO-SCALEDMULTI-CLOUD
HYBRID CLOUD
AWS Simple IconsBy Amazon Web Services, Inc., CC BY-SA 3.0
© 2016 Mesosphere, Inc. All Rights Reserved. 8
INFRASTRUCTURE EVOLUTION
MAINFRAME PHYSICAL (x86) VIRTUAL HYPERSCALEMACHINE
© 2016 Mesosphere, Inc. All Rights Reserved. 10
CLOUD- Internet-connected datacenters- Shared systems management- On-demand resource allocation- Risk tolerance zones- Data collocation controls- Node-based cost controls
HYBRID/MULTI CLOUD- Internet-connected clouds- Federated systems management- On-demand load relocation- Increased risk tolerance- Data privacy controls- Cloud-based cost controls
INFRASTRUCTURE EVOLUTION
© 2016 Mesosphere, Inc. All Rights Reserved. 12
MAINFRAME PHYSICAL (x86) VIRTUAL HYPERSCALEMACHINE
hardware
LAYERS
?FUTURE TECH
CLI/GUI
MICROSERVICES
MOBILE
COMPONENTS
WEARABLE
APPS DEVICES
IOT
software
human
social
environmentARCHITECTURE EVOLUTION(Credit Mark Richards)
© 2016 Mesosphere, Inc. All Rights Reserved. 13
DATA PROCESSING AT HYPERSCALE
EVENTS
Continuous data streams from connected devices
INGEST
Apache Kafka
STORE
Apache Spark
ANALYZE
Apache Cassandra
ACT
Akka
Ingest millions of events per second
Distributed & highly scalable database
Real-time and batch process data
Visualize data and build data driven applications
Sensors
Devices
Clients
© 2016 Mesosphere, Inc. All Rights Reserved. 14
CONTAINER ORCHESTRATIONMarathon, Kubernetes, ECS
STREAMING DATA PIPELINESKafka, MapR, Spark, Flink
SELF-HEALING SYSTEMSApplication level, System level, Hardware level
FUNCTION AS A SERVICEAWS Lambda, Google Cloud Functions, Azure Functions, Iron.io, IBM OpenWhisk
CUSTOM SCHEDULERSCassandra, Kafka, Spark
DAY-TWO OPERATIONSRolling upgrades, Audits, Flow control, Permission Management, Chargeback
FUTURE TECH
© 2016 Mesosphere, Inc. All Rights Reserved. 15
FUTURE TECH PLATFORM
SERVICES, JOBS, FUNCTIONS, PIPELINES
PLATFORM
INFRASTRUCTUREPhysical and/or virtual machines, networks, and hardware
Distributed kernel, orchestration, and systems management
User tasks managed as higher order abstractions
© 2016 Mesosphere, Inc. All Rights Reserved.
Plat
form
Machine Machine Machine
Infrastructure
17
Services, Jobs, Functions, Pipelines
Container Orchestration
System Manager
Custom Schedulers, FaaS, PaaS
CONTAINERPLATFORM
System Agent System Agent
Container Runtime Container Runtime Container Runtime
© 2016 Mesosphere, Inc. All Rights Reserved.
Machine OS Machine OS Machine OS
Machine Machine Machine
18
User Services
Container Orchestration
System Manager
System Services
DATACENTEROPERATING SYSTEM
System Agent System Agent
Container Runtime Container Runtime Container Runtime
Data
cent
er O
S
© 2016 Mesosphere, Inc. All Rights Reserved. 19
DISTRIBUTED OPERATING SYSTEM- Custom microkernel- Distributed system management- Resource invisibility- Native workloads- Rewrite your applications- Custom programming language- UNIX-like, POSIX-like- Application self-healing
DATACENTER OPERATING SYSTEM- BYO container & machine OSs- Centralized system management- Resource transparency- Native & Containerized workloads- Containerize your applications- BYO Programming Language- POSIX machines- Application & system self-healing
DISAMBIGUATION
© 2016 Mesosphere, Inc. All Rights Reserved.
Container Orchestration
System Manager
System Services
System Agent System Agent
Container Runtime Container Runtime Container Runtime
Data
cent
er O
S
20
User ServicesDATACENTEROPERATING SYSTEMINTERFACE
Standard Client Library
System Call Interface
DOSI
X
© 2016 Mesosphere, Inc. All Rights Reserved. 21
FROM POSIXTO DOSIX
POSIX ® is a registered Trademark of The IEEE.
© 2016 Mesosphere, Inc. All Rights Reserved. 22
- Shells (scripting interface)- Tools (awk, echo, etc)- I/O (file, terminal, network)- Streams (stdout/stderr/stdin)- Pipes- Signals- Files & Directories- Errors & Exceptions
- System Call Interface- C standard library- Clocks & Timers- Scheduling (priority)- Shared memory- Message queues- Regex (BRE, ERE)- cgroups
PORTABLE OPERATING SYSTEM INTERFACE (POSIX)
© 2016 Mesosphere, Inc. All Rights Reserved. 23
GNU C LibraryBy Shmuel Csaba Otto Traian, CC BY-SA 3.0
© 2016 Mesosphere, Inc. All Rights Reserved. 24
- IEEE Std 1003.1-1988- IEEE Std 1003.1b-1993- IEEE Std 1003.1c-1995- IEEE Std 1003.2-1992- IEEE Std 1003.1-2001- IEEE Std 1003.1-2004- IEEE Std 1003.1-2008- IEEE Std 1003.1, 2013 Edition
POSIX EVOLUTION
© 2016 Mesosphere, Inc. All Rights Reserved. 25
STANDARDS
StandardsBy Randall Munroe, CC BY-NC 2.5
© 2016 Mesosphere, Inc. All Rights Reserved. 26
DESIGN BY COMMITTEE- Suboptimal traits- Political feasibility > technical quality
COMPROMISE- Literal bias- Conceptual inarticulation
INCREASED COMPETITION- Lower barrier to entry- Wasted effort
SCOPE CREEP- If you give a mouse a cookie- Lack of change control
PLURALISTIC IGNORANCE- Bystander apathy- Commitment ambiguity
BIG DESIGN UP FRONT- Agile conflict- Analysis paralysis
THE STANDARD DILEMMA
© 2016 Mesosphere, Inc. All Rights Reserved. 27
INTEROPERABILITY- Plug and play- Investment security
RELIABILITY- Testability- Maintainability
SAFETY- Level of rigor- Known failure modes
CUSTOMER SATISFACTION- Quality- Consumer choice
MARKET ACCESS- Uncultivated users/integrations- Certification
ECONOMIES OF SCALE- Lower production costs
INNOVATION ENGAGEMENT- Diversification- New layers
SHARED ADVOCACY- Bigger loudspeaker- Marketing boost
THE STANDARD RETURN
© 2016 Mesosphere, Inc. All Rights Reserved. 28
- ISO time and date format- ISO country codes- ANSI/ISO C++- IETF TCP/IP- IETF HTTP- W3C HTML 4, XHTML, HTML 5- JCP JDBC, JMS- IEEE VHDL- IEEE POSIX
THE STANDARD STANDARDS
ISO 8601By Randall Munroe, CC BY-NC 2.5
© 2016 Mesosphere, Inc. All Rights Reserved. 29
DATACENTER OPERATING SYSTEM ARCHITECTURES
KUBERNETES DOCKER DATACENTER DC/OS
© 2016 Mesosphere, Inc. All Rights Reserved. 35
CLUSTER MANAGEMENTNodes, Components, Version, Capabilities, Namespaces, Admin Proxy
CONTAINER ORCHESTRATIONApps, Pods, Services, Jobs, Tasks
PACKAGE MANAGEMENTCreate/Delete, Install/Uninstall, Search/Filter, Templates, Deployment Groups, Dependencies
CUSTOM SCHEDULERSPlacement, Replication, Scaling, Resurrection, Rolling Updates, Daemons, Stateful, Stateless
IAM & SECURITYUsers, Groups, Permissions, Roles, Permission Sets, Hierarchy, Revocation, Access Requests, Image Signing
STORAGE & VOLUMESEphemeral Volume, Persistent Volume, Host Mount, Storage Classes, Volume Drivers
VIRTUAL NETWORKINGDNS, Overlay, Subnets, Isolation Groups, IP-per-task, VIPs
LOGGING & METRICSPush, Pull, Stream, Tail, Aggregation Pipelines
DOSIX API CONCEPTS
© 2016 Mesosphere, Inc. All Rights Reserved.
Container Orchestration
System Manager
System Services
System Agent System Agent
Container Runtime Container Runtime Container Runtime
Data
cent
er O
S
36
User ServicesUSEREXPERIENCE EVOLUTION
Standard Client Library
System Call Interface
DOSI
X
© 2016 Mesosphere, Inc. All Rights Reserved. 37
USEREXPERIENCE EVOLUTION
Standard Client Library
System Call Interface
DOSI
X
© 2016 Mesosphere, Inc. All Rights Reserved.
USEREXPERIENCE EVOLUTION
Standard Client Library
System Call Interface
DOSI
X
Operators Developers
© 2016 Mesosphere, Inc. All Rights Reserved. 39
USER EXPERIENCE EVOLUTION
APIS CLIENT LIBS STDLIB SDK
© 2016 Mesosphere, Inc. All Rights Reserved. 42
Use an open platform
Do your due diligence
Expect interoperability
Contribute
Participate in standardization
WHAT CAN I DO?