DevConf.cz 2021

Using large amounts of continuously incoming data to make better decisions is a tricky task. The challenges start with ingesting data streams coming with thousands of clusters into a single place and end with a properly scalable tool to display the information extracted from the data. But there are also many components in between that ensure proper stability and scalability of the data processing pipeline. As a cherry on top, this all needs to be orchestrated so that the data is processed timely and no data is lost in the process. In this presentation, we will analyze the anatomy of OpenShift-based infrastructure for large-scale data processing that backs Red Hat Insights, a program to process, analyze and present customer analytics data.