+ All Categories
Home > Technology > Unix in the Cloud — Ignorance, Stagnation, Obsolescence

Unix in the Cloud — Ignorance, Stagnation, Obsolescence

Date post: 16-Jun-2015
Category:
Upload: andrew-pantyukhin
View: 525 times
Download: 0 times
Share this document with a friend
Description:
A partial video is available at http://www.youtube.com/watch?v=9XhGEWg5HQk
Popular Tags:
24
Unix in the Cloud Ignorance, Stagnation, Obsolescence
Transcript
Page 1: Unix in the Cloud — Ignorance, Stagnation, Obsolescence

Unix in the CloudIgnorance, Stagnation,

Obsolescence

www.princexml.com
Prince - Non-commercial License
This document was created with Prince, a great way of getting web content onto paper.
Page 2: Unix in the Cloud — Ignorance, Stagnation, Obsolescence

Synopsis▪ cloud in the broad sense of ideology

▪ not quite about running BSD on EC2

▪ very limited to skills and experience of yourshumbly

Page 3: Unix in the Cloud — Ignorance, Stagnation, Obsolescence

Multi-core▪ installation?

▪ configuration management?

▪ load balancing?

Page 4: Unix in the Cloud — Ignorance, Stagnation, Obsolescence

Multi-node▪ installation?

▪ configuration management?

▪ load balancing?

▪ why multi-node?

Page 5: Unix in the Cloud — Ignorance, Stagnation, Obsolescence

Large ComputingNeeds

▪ Facebook, Google, ...

▪ more than any OS can provide

Page 6: Unix in the Cloud — Ignorance, Stagnation, Obsolescence

Happy Hardware Vendor LawThe amount of nodes needed to solve a given task doubles every now and again.

Page 7: Unix in the Cloud — Ignorance, Stagnation, Obsolescence

OS Scalability Limit▪ 1 node only

▪ multi-socket and stacks approaching NUMA

▪ E25K, z10, etc — fail for most purposes

Page 8: Unix in the Cloud — Ignorance, Stagnation, Obsolescence

Operating System — ?▪ traditional definition no more relevant

▪ the notion itself on the brink of obsolescence

▪ field heavily eroded by current distributed apps

Page 9: Unix in the Cloud — Ignorance, Stagnation, Obsolescence

DistributedApplications

▪ forced to be an OS unto themselves

▪ huge overlap

▪ huge opportunity for sharing and consolidation

Page 10: Unix in the Cloud — Ignorance, Stagnation, Obsolescence

Anti-Patterns▪ virtualization

▪ chefs and puppets

▪ thick abstraction

Page 11: Unix in the Cloud — Ignorance, Stagnation, Obsolescence

Attempts▪ z/OS

▪ Plan 9, Inferno

▪ Clustrx, E1, DYSEAC, ...

▪ OpenStack (~~)

Page 12: Unix in the Cloud — Ignorance, Stagnation, Obsolescence

Species Survival PlanFreeze the bodies and leave them for future generations to fix.

Page 13: Unix in the Cloud — Ignorance, Stagnation, Obsolescence

Don't Panic:Incremental

▪ perfection v. done

▪ still a decade or more till a good AI

▪ no practical need for POSIX over a cloud

Page 14: Unix in the Cloud — Ignorance, Stagnation, Obsolescence

Mindful Approach▪ immediate practicality

▪ long-term perspective

▪ sustained, integrally rich effect

Page 15: Unix in the Cloud — Ignorance, Stagnation, Obsolescence

Operating System▪ major abstraction repository

▪ overlapping code distillery

▪ pre-production architecture research

Page 16: Unix in the Cloud — Ignorance, Stagnation, Obsolescence

Increments

Page 17: Unix in the Cloud — Ignorance, Stagnation, Obsolescence

Machine GeneratedData

▪ logs, error messages, status monitors

▪ meant for humans... no more

▪ rethinking for better aggregation and analysis

Page 18: Unix in the Cloud — Ignorance, Stagnation, Obsolescence

Identity andAuthentication

▪ YP, LDAP outdated and poorly supported

▪ no distributed model

▪ passwd in git as a first stab

Page 19: Unix in the Cloud — Ignorance, Stagnation, Obsolescence

Remote Procedure Call▪ ssh losing relevance, HPN or not

▪ all-mighty agent daemon worse than rsh

▪ capabilities, RBAC, WoT

Page 20: Unix in the Cloud — Ignorance, Stagnation, Obsolescence

Hardware Failures▪ no culture for low-level fault-tolerance

▪ watchdogd as state-of-the-art self-healing

▪ focus on self-diagnostics: disk error counters, etc

Page 21: Unix in the Cloud — Ignorance, Stagnation, Obsolescence

DistributedConfiguration

▪ current anti-patterns worsen the problem

▪ role-aware configuration

▪ / in git as a second stab

Page 22: Unix in the Cloud — Ignorance, Stagnation, Obsolescence

Storage▪ intra-node redundancy irrelevant

▪ no appropriate local multi-disk FS

▪ no fast path for data exchange

▪ nginx + curl + dispatcher

Page 23: Unix in the Cloud — Ignorance, Stagnation, Obsolescence

Error Handling▪ cf MGD and hardware failures

▪ software is 10x more prone to failures

▪ serious problem at scale

Page 24: Unix in the Cloud — Ignorance, Stagnation, Obsolescence


Recommended