What is stream processing and why do we need it? A short overview Streaming data is a powerful concept that allows organizations to process large amounts of data in real-time. …

Introductory for new starter about CI/CD Do you recognize yourself…? You just got your university degree in computer science (or whatever) and start working in a tech company. Soon you realize that despite all the theoretical knowledge and few group projects you don’t even know the basic tools and workflow…

Creating a Hub- and Satellite-Table for master data — In my previous posts, I wrote about building a data lake and obsolete data mindsets in corporations. Well…recently, we decided to evaluate Data Vault models in Google BigQuery for my employer. In doing so, we have our little success stories that I would like to share. …

Why do many data projects fail or even not start? — Many view data science initiatives and the advancing application of artificial intelligence as a movement that is ushering in a cultural transformation. But the result of this transformation is the digital society that already exists today. Living together is naturally influenced by these digital innovations and the targeted analysis of…

Introduction to a reference architecture for building a Data Lake — At work, I am currently building a data lake on the Google Cloud Platform. While working, you really realize how much data a medium-sized company can already have. I work in the energy sector. In many articles and blogs, there is already a lot of talk about large amounts of…

A simple setup and template to manage, develop and deploy your Google Cloud Functions — I would like to describe here how I and my teammate Crosi found a way for us to develop Google Cloud Functions locally and then deploy them in an automated way using the Google Build service. We have read through countless documentations and would now like to compile our findings…