NewsWhip and Confluent talk Kafka

Join us for our next Dublin Apache Kafka® meetup on October 30th from 6:00pm, hosted by NewsWhip. The agenda, venue and speaker information can be found below. See you there!

-----

Agenda:
6:00pm: Doors open
6:00pm - 6:30pm: Pizza, Drinks and Networking
6:30pm - 7:oopm: Mic Hussey, Confluent
7:00pm - 7:30pm: Gabriel Broilo and Bruno Rossi, NewsWhip
7:30pm - 8:00pm: Hugh O’Brien
8:00pm - 8:15pm - Additional Q&A & Networking

------

Speaker:
Gabriel Broilo (Technical Architect), Bruno Rossi (Software Engineer)

Bio:
Gabriel and Bruno work on data ingestion and processing technology at NewsWhip

Title:
Kafka and NewsWhip

Abstract:
Over the past year NewsWhip have been migrating our core data ingestion systems to rely on Kafka as core component. This talk will focus on our experience at NewsWhip with the Kafka and Confluent ecosystem, particularly Kafka itself, Schema Registry/Avro, and Kafka Connect.

------

Speaker:
Mic Hussey

Bio:
Mic is a Systems Engineer at Confluent, the company founded by the creators of Apache Kafka.
He started out his career as a Civil Engineer in Dublin but fell into IT and moved to Stockholm at the height of the dot com boom.
He's been architecting and building event based distributed systems for most of the time since, with a short detour into API Management along the way.

Title:
Apache Kafka and KSQL in Action : Let’s Build a Streaming Data Pipeline!

Abstract:
Hopefully you're already familiar with Apache Kafka - the massively scalable technology which allows you to build robust data pipelines. And have come across the plethora of Kafka Connectors that make it easy to join the ends of your data pipeline to other systems such as DBs or Big Data. But what do you do in the middle? Would you like to be able to transform, enrich and filter the data as it moves along the pipeline? Just break out your compiler!
Only kidding, using KSQL it's possible to achieve all this without opening Eclipse at all....

-----

Speaker:
Hugh O’Brien

Bio:
Hugh is an engineer at Jet.com and Walmart.com increasingly specialising in data systems and performance tuning. He claims responsibility for KAFKA-6134 (a nasty one) and ZOOKEEPER-3041 (the world’s most trivial bug). When bored he abuses ZFS: https://github.com/hughobrien/zfs-remote-mirror. Check out Jet’s from scratch F# Kafka client https://github.com/jet/kafunk.

Title:
Kafka on ZFS: Better Living Through Filesystems

Abstract
You’re doing disk IO wrong, let ZFS show you the way. ZFS on Linux is now stable. Say goodbye to JBOD, to directories in your reassignment plans, to unevenly used disks. Instead, have 8K Cloud IOPS for $25, SSD speed reads on spinning disks, in-kernel LZ4 compression and the smartest page cache on the planet. (Fear compactions no more!)

Learn how Jet’s Kafka clusters squeeze every drop of disk performance out of Azure, all completely transparent to Kafka.

Striping cheap disks to maximize instance IOPS
Block compression to reduce disk usage by ~80% (JSON data)
Instance SSD as the secondary read cache (storing compressed data), eliminating >99% of disk reads and safe across host redeployments
Upcoming features: Compressed blocks in memory, potentially quadrupling your page cache (RAM) for free
We’ll cover:

Basic Principles
Adapting ZFS for cloud instances (gotchas)
Performance tuning for Kafka
Benchmarks
Session Speakers

---

Don't forget to join our Community Slack Team !
https://launchpass.com/confluentcommunity

If you would like to speak or host our next event please let us know! community@confluent.io
NOTE: We are unable to cater for any attendees under the age of 18. Please do not sign up for this event if you are under 18.