#53 · RAG and vector search · 5.4 minSemantic Cache for LLM Apps: Pick the Threshold (Python)
With a loose threshold, a semantic cache answered 'Do you ship to Norway?' with the answer for Ireland.
Python 3.12.15 | ollama==0.6.31 video tagged "semantic caching".