A Data Quality Scorecard That Shows a Hidden Failure
Orders averaged 97.7 percent, amber. One critical check made it red.
Video #210 ยท Data governance
Steps in the video
Files
- checks.py (18 lines)
- data.py (14 lines)
- run.py (10 lines)
- scorecard.py (27 lines)
Tested with
Python 3.12.15
What this does not show
Three made-up tables with planted faults; the colour limits are one vendor's example, the critical rule is my own, and a pass rate says nothing about impact.
Sources
- https://docs.decube.io/dashboard/health-score
- https://docs.elementary-data.com/cloud/features/collaboration-and-communication/data-health
- https://learn.microsoft.com/en-us/purview/unified-catalog-reports-data-quality-health
- https://www.basedash.com/blog/data-quality-metrics-what-to-measure-and-how-to-track-it
- https://www.pedowitzgroup.com/how-do-you-create-data-quality-scorecards
Learning IT by Example.