Konrad Hosemann DevOpsDays Berlin 2016-11-16

Infrastructure as a Microservice

Konrad Hosemann DevOpsDays Berlin 2016-11-16

Lead Software Engineer at ImmobilienScout

konrad.hosemann@gmail.com

www.linkedin.com/in/konrad-hosemann

@k0nr8d

Konrad Hosemann DevOpsDays Berlin 2016-11-16

Monolith vs Microservices

Infrastructure Services in the Cloud

Implementation

Learnings

Konrad Hosemann DevOpsDays Berlin 2016-11-16

Microservices

Konrad Hosemann DevOpsDays Berlin 2016-11-16

implement a single business function

small

dedicated interface

replaceable

need automation

need scalable infrastructure

Daniel Tenerife - Own work, GFDL, https://commons.wikimedia.org/w/index.php?curid=9478114

Konrad Hosemann DevOpsDays Berlin 2016-11-16

Monoliths

Konrad Hosemann DevOpsDays Berlin 2016-11-16

hard to change

lots of implicit dependencies

painful maintenance

hard to take responsibility + ownership for

unique

hard to scale

Daniel Steger (Lausanne, Switzerland) - http://openphoto.net/download/index.html?image_id=6987, CC BY-SA 2.5, https://commons.wikimedia.org/w/index.php?curid=3129314

Konrad Hosemann DevOpsDays Berlin 2016-11-16

State of Infrastructure Services: Monolithic

Konrad Hosemann DevOpsDays Berlin 2016-11-16

1,5 million metric updates / minute 4 * (24 cores, 72 GB RAM, 360 GB HDD)

Konrad Hosemann DevOpsDays Berlin 2016-11-16

150.000 write requests / second 1,5 TB ingestion / day

10 * (1,5 TB SSD, 15 TB HDD, 20 cores, 128 GB RAM)

Konrad Hosemann DevOpsDays Berlin 2016-11-16

Konrad Hosemann DevOpsDays Berlin 2016-11-16

built for „measure everything!“ 👍

efficient 👍

clients brake it – single point of failure 👻👺

achieving reliability at scale 😪

responsible usage 🤔

Konrad Hosemann DevOpsDays Berlin 2016-11-16

Next Step: ImmobilienScout to the

Cloud

Konrad Hosemann DevOpsDays Berlin 2016-11-16

benefit from external innovation

autonomous teams

no side effects

you build it – you run it

cost transparency + cost awareness

Konrad Hosemann DevOpsDays Berlin 2016-11-16

Self-Service Infrastructure

Elasticsearch, Logstash, Kibana, Kinesis

Konrad Hosemann DevOpsDays Berlin 2016-11-16

Delivery

Konrad Hosemann DevOpsDays Berlin 2016-11-16

CloudFormation Template

access rights function def event source output stream

Code.zip

Konrad Hosemann DevOpsDays Berlin 2016-11-16

How to Build

Konrad Hosemann DevOpsDays Berlin 2016-11-16

Support your users – make it easy to setup

Automate integration testing

Zero bug policy

Design for cost-efficiency

Do Open Source

Konrad Hosemann DevOpsDays Berlin 2016-11-16

Challenges

Konrad Hosemann DevOpsDays Berlin 2016-11-16

Who owns these infrastructure services?

No unified view

Distributing updates

Avoiding fragmentation

Konrad Hosemann DevOpsDays Berlin 2016-11-16

Inspirations from the Microservices approach

Konrad Hosemann DevOpsDays Berlin 2016-11-16

more engineering

less operations

bounded context

small size

automation

ready to use building blocks

more autonomy

responsibility for the complete stack