Signavio Tech Talk #4: "ContainerManifesto and qcollect-ng"

Guest Speaker: Christian Kniep

Christian started as a SysOps trainee back in 2002 and since then iterated through the automotive industry, doing Ops and R&D in the High Performance Computing space and moved to Berlin in 2014 to get an understanding of the StartUp world. Mid 2015 he joined Gaikai (the Sony arm powering Playstation Now) leading the containerisation effort.He is passionate about tinkering with new technologies and finding the holy grail of IT. His current favourites are Linux Container and all the fuzz around it (orchestration, service discovery, tiny containers), monitoring, logging and inventory stacks as well as random finding in ‘the interweb’

More information: Christian Kniep | LinkedIn (https://www.linkedin.com/in/christian-kniep-3004b053/)

The Topic:

Metrics processing with qcollect-ng

I recently started a new iteration on my approach to metrics collection and this time I am pretty happy with what I came up with so far. I externalised an ETL framework (qnib/qframe) which I dubbed 'A framework that allows to model generic ETLs inspired by Logstash'.

The first spin-of is qnib/qcollect-ng which spins of collectors, filters and handlers in the context of metrics. One of which is a pretty slick container-stats collector which provides metrics as close to real-time as the docker-engine allows. Container Manifesto: DO's and DON'ts when building and running a container
In this section I am going to iterate through some rules I came up for myself in order to create sane container images, which allows to iterate towards a better would by not falling into the usual pitfalls.
It builds on top of RedHat's "10 things to avoid in docker containers".