learning-it by example

Back to the video

Govern AI Training Data: Provenance, Consent, Dataset Card

Ten records, five used. A dataset card says why the other five were left out.

Video #213 ยท Data governance

Steps in the video

  1. 0:00 Ten candidate records, five used, and a dataset card that says why the others were not
  2. 0:33 The idea
  3. 1:09 Setup
  4. 1:32 The records
  5. 2:06 The rules
  6. 2:35 The card
  7. 3:04 Run it
  8. 3:42 What this does not show
  9. 4:13 Mistakes to avoid
  10. 4:37 My take and next steps
  11. 5:03 Recap

Files

  • curate.py (34 lines)
  • records.py (16 lines)
  • run.py (11 lines)

Download the code (zip)

Tested with

Python 3.12.15

What this does not show

Ten made-up records and my own rules; whether a licence or consent covers training is a legal question, the fingerprint covers record ids only, and this is not legal advice.

Sources

Learning IT by Example.