Audit Evidence From Pipeline Logs in Python (SHA-256)
Six made-up pipeline runs, three gaps: an evidence report built straight from the logs.
Video #216 ยท Data governance
Steps in the video
Files
- controls.py (60 lines)
- report.py (40 lines)
- run.py (24 lines)
- runs.jsonl (16 lines)
Tested with
Python 3.12.15
What this does not show
Made-up runs and invented controls. This is evidence, not compliance: the hash shows the log did not change after hashing, not that it was true.
Sources
- https://csrc.nist.gov/glossary/term/audit_log
- https://csrc.nist.gov/pubs/sp/800/92/final
- https://docs.python.org/3/library/hashlib.html
- https://ico.org.uk/for-organisations/uk-gdpr-guidance-and-resources/accountability-and-governance/documentation/what-is-documentation/
- https://ico.org.uk/for-organisations/uk-gdpr-guidance-and-resources/accountability-and-governance/guide-to-accountability-and-governance
- https://linfordco.com/blog/soc-2-type-2-report/
Learning IT by Example.