Data Engineering Components: dbt Explained
Note: This article is based on my personal understanding of the dbt courses I’ve completed, including Data Engineering Zoomcamp’s Week 4: Analytical Engineering, DataCamp’s…
Series · 5 parts
Data Engineering Components
I came to data engineering with no prior experience. While learning it, I wrote one plain-language explainer for each tool I used, with my own hand-drawn notes, so the next beginner has an easier start.
Every tool here ended up in a real pipeline: see Safe Biking in Paris, where Terraform, dbt and Docker power an analysis of bike accidents.
Data Engineering Components: Docker Explained
Imagine you have developed a shopping web application, including a React-based frontend, a Python + Flask backend, and a PostgreSQL database, and you want to deploy it in a…
Data Engineering Components: Terraform Explained
In summary, Terraform is a tool used to manage your cloud services.
Data Engineering Components: Kubernetes Explained
Note: Kubernetes is a tool for orchestrating Docker containers. If you're not familiar with Docker, I recommend you read this article first.
Data Engineering Components: Apache Kafka Explained
It’s quite common to buy items online. But what processes are handled behind the scenes once an order is placed?
