33
Breaking Things on Purpose Kolton Andrus CEO and co-founder, Gremlin
Breaking Things on PurposeKolton AndrusCEO and co-founder, Gremlin
Chaos Engineering?What is
Inject something harmful, in order to build an immunity
Thoughtful, planned experiments designed to reveal the weakness in our systems.
Chaos Engineering:
We test proactively, instead of waiting for an outage.
NOT Chaos Engineering?What is
CHAOS
What’s in a name?
ExcitingMischievous
ENGINEERINGDisciplinedRespectable
ENGINEERING
What’s in a name?
CHAOS
Why now?
Data Center Internet Data Center
Web Server Business Logic Database
Planning a GameDay
“What could go wrong?”
“How likely is this to occur?”
“What is the cost of being wrong?”
$150M
$100M
$700B
S3
Delta
US Annually
Running an Experiment
Communicate
Validate
Practice
Those unwilling to test in production aren't yet confident that the service will continue operating through failures.
And, without production testing, recovery won't work when called upon.
James HamiltonDistinguished Engineer, AWS
Real World Scenarios.Prepare for
Region Evacuation
“What is Tier 1?”
Finding the Critical Services
Reduce Toil
Increase Reliability
Prepare for the outages that WILL occur
Thanks!@[email protected]
