Big Data Madison promotes the understanding and adoption of technologies used to acquire, store, and analyze data in all its forms. This spans everything from data engineering to data science.
Everyone is encouraged to attend, no level of experience is too basic to join and learn.
We will focus on some of the technologies used in the Big Data ecosystem (Hadoop, Spark, streaming data and data processing, etc), as well as topics in Data Science (machine learning, data visualization, analytics and more). We will try to balance the topics between technology talks, use cases, and demos.
Data integration in architectures built on static, update-in-place datastores inevitably end up with pathologically high degrees of coupling and poor scalability. This has been the standard practice for decades, as we attempt to build data pipelines on top of databases that do a poor job modelling the fundamental objects that drive our businesses and systems: events.
Events carry both notification and state, and form a powerful primitive on which to build systems for developers and data engineers alike. Developers benefit from the asynchronous communication that events enable between services, and data engineers benefit from the integration capabilities. Everyone gains from using the standards-based, scalable and resilient streaming platform.
In this talk, we’ll discuss the concepts of events, their relevance to both software engineers and data engineers and their ability to unify architectures in a powerful way. We’ll see how stream processing makes sense in both a microservices and ETL environment, and why analytics, data integration and ETL fit naturally into a streaming world.
Brian Likosar (“Liko” pronounced lick-OH) is an open source geek with a passion for working at the intersection of people and technology. He has spoken on security topics at Kafka Summit, which is one of the top viewed recordings from that session. Prior to joining Confluent, he spent 10 years at Red Hat helping folks with Linux, OpenShift, and Ansible. He’s based in the Chicago area and enjoys sports, live music, and theme parks.
I would like to thank Confluent for the presenter and Zendesk for the meetup support.