#61 · LLM engineering and evals · 5.3 minCount Tokens Before You Send: Context Limits
I sent 1,086 tokens into a 1,024-token context on purpose. No error, and the first rule was not followed.
Python 3.12.15 | ollama==0.6.32 videos tagged "token counting".
#61 · LLM engineering and evals · 5.3 minI sent 1,086 tokens into a 1,024-token context on purpose. No error, and the first rule was not followed.
Python 3.12.15 | ollama==0.6.3In a made-up day, a 40-cent user cap and a 60-cent daily cap each refused a call before it ran.
Python 3.12.15