Fluentd, Docker and All That: Logging Infrastructure 2015 Edition

As software becomes less monolithic and more service-oriented, log collection becomes a real problem. How can we stop hacking together brittle log parsing scripts and start building a unified logging layer?

Fluentd is a data collector written in Ruby to solve this problem. Unlike other log management tools that are designed for a single backend system, Fluentd aims to connect many input sources into several output systems.

This talk surveys Fluentd's architecture and shows real-world use cases of how different users extend it to do more with their logs with less code.

Also, I will give a demo of the brand-new Docker Logging Driver integration for Fluentd!

About the speaker

Kiyoto is a maintainer of Fluentd, the open source data collector to unify log management.

He spends much of his day at Treasure Data as a developer marketer/community manager for Fluentd. He also is a math major turned quantitative trader turned software engineer turned open source community advocate and cherishes American brunch and Japanese game shows.