#107 · Data engineering and pipelines · 6.9 minData Contracts: Stop Breaking Downstream
In a made-up feed, a renamed column broke the dashboard; a contract check found 10 problems before any load.
Python 3.12.1510 videos tagged "data quality".
#107 · Data engineering and pipelines · 6.9 minIn a made-up feed, a renamed column broke the dashboard; a contract check found 10 problems before any load.
Python 3.12.15
#115 · Data engineering and pipelines · 6.7 minThree changes to a made-up feed: a positional reader loaded all 8 rows without an error, and 4 were wrong.
Python 3.12.15
#127 · SQL and analytics · 6.6 minSix made-up orders total 220, but two joins make the same SUM say 505, with no error.
Python 3.12.15
#139 · Python for data · 6.8 minSix made-up CSV rows through Pydantic: 3 valid, 3 rejected, with 6 named errors in one pass.
Python 3.12.15 | annotated-types==0.8.0, pydantic==2.14.1, pydantic-core==2.50.1, typing-extensions==4.16.0, typing-inspection==0.4.4
#146 · Python for data · 6 minSix pytest tests pass, and one catches a column that came back float64 instead of int64.
Python 3.12.15 | numpy==2.5.4, pandas==3.1.0, pytest==9.1.1
#203 · Data governance · 5.6 minA glossary in a file, and four checks that find its four faults in a second.
Python 3.12.15 | PyYAML==6.0.3
#254 · Data modelling · 6.8 minWithout constraints SQLite loaded all 8 rows, 5 of them bad; with constraints only 3 got in.
Python 3.12.15
#263 · Data modelling · 6.8 minA messy CSV summed straight from raw says 99 pounds; after bronze, silver and gold it is 86.
Python 3.12.15
#307 · Forward deployed engineer interviews · 6.2 minA guessed fix for a changed export made two totals 100 times too big, with no error.
Python 3.12.15
#309 · Forward deployed engineer interviews · 6.3 minMy data profile said 275 blank amounts. The file had 363. Here is why.
Python 3.12.15 | duckdb==2.0.0