/ Beyond Tables and Bottlenecks: How We Joined High Volumes of Data in Real Time

Description

Today, data is being generated at an unprecedented scale, and the ability to process and analyse it in real time has become fundamental. Joining large volumes of data in real-time poses significant challenges due to the limitations of relational databases. In this talk, we will discuss our experience in overcoming those while exploring how we leveraged distributed architectures to process data beyond those bottlenecks, and highlight some of the key approaches that were critical to us. By sharing our insights and learned lessons, we hope to provide some real life examples for those looking to perform data processing at low latencies.

Session 🗣 Intermediate ⭐⭐ Track: AI, ML, Bigdata, Python