Distillation: Teach a Small Model From a Big One (Python)
A small model trained on 12 hand labels got 149 of 200 right; trained on a teacher's labels, 188.
Python 3.12.152 videos tagged "logistic regression".
A small model trained on 12 hand labels got 149 of 200 right; trained on a teacher's labels, 188.
Python 3.12.15
#200 · Machine learning and data science · 6.6 minA plain model caught 8 of 39 made-up frauds; class weights, a tuned threshold and resampling each caught 30 to 34.
Python 3.12.15 | numpy==2.5.4, scikit-learn==1.9.1, scipy==1.18.1, joblib==1.6.0, narwhals==2.27.1, threadpoolctl==3.7.0, cloudpickle==3.1.2