AI Coding Assistant Workflow: Copy, Test, Read the Diff
I let an AI fix three bugs: one fix passed its tests, two failed, and every fix changed five lines. The copy, test and diff workflow that caught it.
Video #20 ยท AI coding and productivity
Steps in the video
Files
- assist.py (60 lines)
- chunks.py (6 lines)
- discount.py (6 lines)
- leap.py (6 lines)
- test_chunks.py (9 lines)
- test_discount.py (9 lines)
- test_leap.py (13 lines)
Tested with
Python 3.12.15 | ollama==0.6.3, pytest==9.2.0
What this does not show
One small local model standing in for an assistant, three tiny planted bugs, one run. Not a comparison of any named tool. The run prints pass or fail and the diff size; the description of each edit comes from reading the diffs during preparation and the replies were not saved. The survey was run by Sonar, which sells verification tools, and the review guide is from crystl, which sells a coding terminal.
Sources
Learning IT by Example.