DFW Data Engineering Meetup

This month's meetup will be focus around Apache Airflow. Abstract: Learn how data engineers/data analysts/business analysts at leading organizations are using Apache Airflow as an intelligent scheduler to simplify automation of their daily workflows,data pipelines, data analysis and analytical reports. As we know, finding one smart scheduler to meet all workflow patterns is very difficult. We now have a python based open source Apache Airflow solution that has scheduling support for different job family requirements. We will demonstrate our new architecture patterns built out of Apache Airflow. We will talk about how to set up scalable, distributed and industry standard Airflow platform. Finally, we will talk how we leveraged Airflow to schedule our workflows. Speaker: Abdul Jaleel Dudekula is a data engineer at Capital One with over 8+ years of experience. Abdul has worked on multiple platforms, languages and environments delivering large scale data applications to production. He is an AWS certified solutions architect and AWS certified SysOps Administrator. He has broad expertise in working with Go, Python, Java with Kubernetes, Mesos, Docker, Spark, Cassandra, Hive, etc., Schedule: 6:00 pm - 6:30 pm: Networking over snacks and drinks 6:30 pm - 6:35 pm: Welcome and speaker intro 6:35 pm - 7:30 pm: Presentation 7:30 pm - 8:00 pm: Q&A, discussion and more networking