admin/basicmachines-co-basic-memory
1
0
Fork 0
mirror of https://github.com/basicmachines-co/basic-memory synced 2026-06-21 13:47:35 +00:00
Code Issues Packages Projects Releases Wiki Activity

fix(core): scope LiteLLM dimension requests

Browse Source 
Signed-off-by: phernandez <paul@basicmachines.co>
This commit is contained in:
phernandez
2026-05-28 20:14:44 -05:00
parent 8270405a1c
commit a3739fa72e
3 changed files with 36 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/semantic-search.md
+4
View File
@@ -151,6 +151,10 @@ export COHERE_API_KEY=...
Basic Memory creates vector tables before the first embedding call, so non-default LiteLLM models must set `BASIC_MEMORY_SEMANTIC_EMBEDDING_DIMENSIONS`. The LiteLLM OpenAI default (`openai/text-embedding-3-small`) uses 1536 dimensions automatically.
For fixed-size LiteLLM models, dimensions are used as Basic Memory's local vector schema and
validation size. Basic Memory only sends dimensions as a provider-side output-size request for
`text-embedding-3` model strings, where LiteLLM/OpenAI support reduced output dimensions.
Some retrieval models are asymmetric: indexed passages and search queries must be embedded with different provider parameters. Basic Memory automatically sets LiteLLM `input_type` for known asymmetric model families:
- Cohere v3: documents use `search_document`, queries use `search_query`