Ik in action

Post on 10-May-2015

8,887 views 0 download

Tags:

transcript

ik in actionMoriyoshi Koizumi <mozo@mozo.jp>

who am I?

•Freelance Engineer using Python for the job.

•maintainer of several OSS projects including notorious PHP

•Also a Go contributor

•http://www.mozo.jp/

•Developed a fluent-protocol compatible log collector in Go

•Deployed it over a number of embedded Windows 8 boxes in production environment

•Managed to get it working quite easily thanks to Go’s cross-compilation feature.

ik [ai-kay]

•A humble alternative implementation of fluentd that I am developing with @stanaka

•https://github.com/moriyoshi/ik

•fluentd is a versatile log collector developed by folks at TreasureData Inc.

ik [ai-kay]

Record Router

Goroutine Supervisor

Scorekeeper

Engine

Input Plugin

Output Plugin

Input Plugin

Input Plugin

Output Plugin

Output Plugin

goroutine goroutine goroutine goroutine goroutine goroutine

features of ik

•Small memory footprint comparing to the bare fluentd set-up

•Built-in scoreboard feature

•Can run on Windows out-of-the-box

Scoreboard

Windows

In the Real World

•A bunch of Windows tablets running a .NET application embedded in consoles

•Needed to see how it is going remotely

•fluentd was already being used in production, wanted to stick to it

In the Real Worldfluentd

stunnel

Internet

stunnel

ik

.NET application

stunnel

ik

.NET application

stunnel

ik

.NET application

stunnel

ik

.NET application

Components

•fluentdfor log collection

•stunnelfor secure connection

•ikas a log transfer agent

•NLog-Targets-Fluentdto stream application logs to the server in fluent protocol

Thank you for listening...