#61 · LLM engineering and evals · 5.3 minCount Tokens Before You Send: Context Limits
I sent 1,086 tokens into a 1,024-token context on purpose. No error, and the first rule was not followed.
Python 3.12.15 | ollama==0.6.32 videos tagged "llm engineering".
#61 · LLM engineering and evals · 5.3 minI sent 1,086 tokens into a 1,024-token context on purpose. No error, and the first rule was not followed.
Python 3.12.15 | ollama==0.6.3Routing cost 19.1 made-up cents instead of 40, and got one more of 20 questions wrong.
Python 3.12.15