O’CoderFest #3 – Facing BIG Challenge

The third meeting of the O’CoderFest series took place on August 29th at our office in Katowice. We challenged interesting topic in cooperation with an external guest. msales had the pleasure to host Krzysztof Zarzycki, an expert on Big Data technologies.

Krzysztof is a Big Data geek working with those technologies, HPC, distributed systems and machine learning for over 7 years. He likes to work full-stack going from architecting solution through engineering down to installing, troubleshooting and monitoring. Now specializes in scalable real-time analytics solutions.

The presentation has been based on real-life use case: building a real-time data analytics platform for telco events. This platform has been jointly built by GetInData and a leading telco operator in just a few months and it currently runs in production at the scale of 10M subscribers and 160K events per second on a still small cluster. It’s used as a backbone for personalized marketing campaigns, detecting frauds, cross-sell & up-sell by following the behavior of millions of users in real-time and reacting to it instantly. The lecture shared how the platform was built using current best of breed open-source projects like Flink, Kafka, and Nifi.

Besides, the attendees had the chance to learn what challenges were faced during development along with tips what one should pay attention to when developing similar solutions, not only for telco, but also for banks, e-commerce, IoT and other industries.
Keeping up the O’CoderFest tradition, the session ended up having beer & pizza in a relaxed atmosphere.