#57 · LLM engineering and evals · 5 minLLM as Judge: I Swapped the Order and It Changed
I swapped the order of two answers and my judge changed its mind on half the questions in one test.
Python 3.12.15 | ollama==0.6.31 video tagged "verbosity bias".