Varnish structured logger in Rust

Hi,

For the last two months I was busy hacking in Rust. I would like to present what I was working on: Varnish structured logger.

Varnish HTTP accelerator is a very important component of WhatClinic.com infrastructure. We use it to cache dynamic content of the website for optimised delivery around the globe.

Daily our fleet of Varnish instances is producing over 6 million access log entries that need to be parsed and indexed. Unfortunately tooling that comes with Varnish is quite limited and log parsing is not as robust as I would like. To meet my logging needs I have created a logger that parses stream of Varnish binary logs (VSL) and produces rich JSON records.

During the presentation I will talk about:
• design and implementation of the logger,
• techniques and optimisations that I have used to make it run fairly fast,
• strength and weaknesses of Rust and crates that I have worked with.

This meetup will be hosted on my home ground thanks to courtesy of WhatClinic.com. I hope this is convenient location for most of you. As always there will be pizza and beer!

Thanks for joining and see you at the meetup!

BTW: If you would like to present at one of this meetups please feel free to PM me!

Jakub Pastuszek