Notes from
production.

8 years of data-engineering notes — Python, dbt, AWS, and the quiet habits that keep pipelines boring. No filler, no sponsored posts, no SEO bait.

70

posts · updated monthly

Category

All70 🤖 ML/AI4 🔌 API4 ⚙️ DE21 ☁️ Cloud/DevOps8 🔀 GIT3 🖥️ Hardware2 📦 Others2 🐍 Python11 🛠️ Tools/Utils11 🌍 Web4

All posts

Page 5 of 8 · newest first

Java UDF with pyspark

⚙️ DE

Java UDF with pyspark

03 Nov 2020 · 04 Mins read

Setting up a Python environment

🐍 Python

Setting up a Python environment

20 May 2020 · 03 Mins read

Using Pre-commit to automate tasks

🛠️ Tools/Utils

Using Pre-commit to automate tasks

14 May 2020 · 01 Min read

Poetry python package manager

🛠️ Tools/Utils

Poetry python package manager

08 May 2020 · 03 Mins read

Cmder terminal for windows

🛠️ Tools/Utils

Cmder terminal for windows

29 Feb 2020 · 02 Mins read

Luigi orchestrator

🛠️ Tools/Utils

Luigi orchestrator

06 Jan 2020 · 05 Mins read

PySpark example with parquet

⚙️ DE

PySpark example with parquet

24 Dec 2019 · 04 Mins read

Databricks intro

⚙️ DE

Databricks intro

23 Dec 2019 · 04 Mins read

H2O AutoML

🤖 ML/AI

H2O AutoML

22 Dec 2019 · 03 Mins read