AppsFlyer's Architecture for Real-Time and Batch Big-Data Analytics

Target Audience: Architects, Senior Developers and Senior Dev-Ops Engineers

Growing from 200 million events per day to 3 billion was more architecture challenge than anything else. In this talk, we will be presenting how we modelled and designed our services in AppsFlyer:

1. How Micorservices work for us, how we deal with deployment, service discovery, SOC, storage etc.
2. How the data that is sent to AppsFlyer is modelled as a stream of events which is delivered over Kafka and how using Kafka allows us to easily deploy new services, keeps us resilient and even helps us test our code.
3. How using Clojure changed how we reason about code and data and actually changed the way we develop and deploy services
4. Next steps - Tiered data architecture from exploration to real-time dashboards

Presenters:
Nir Rubinstein, System Architect - https://il.linkedin.com/pub/nir-rubinstein/17/725/691
Arnon Rotem-Gal-Oz, Chief Data Officer - https://il.linkedin.com/in/arnonrgo