Skip to content

Switching embedding model makes localrecall stop working with key error #26

@johndev168

Description

@johndev168

I'm using LocalRecall from sources with the latest upstream 03f36d6 on Mac T8132 MacOS 15.5

It does work fine when using the default embedding model granite-embedding-107m-multilingual but as soon as I switch to another model it starts failing. I tried to use qwen3-embedding-8b and after re-running localrecall it stops working when uploading a file with the following error:

"ERROR","msg":"Failed to store file","!BADKEY":"failed to store file: couldn't add document '101': couldn't create embedding of document: error getting keys: error, status code: 500, status: 500 Internal Server Error, message: rpc error: code = InvalidArgument desc = Input content cannot be empty","source":{"filename":"/******/localrecall/routes.go","lineno":247}}

When searching the vector stores the same error gets thrown:

{"error":"Failed to search collection: couldn't create embedding of query: error getting keys: error, status code: 500, status: 500 Internal Server Error, message: rpc error: code = InvalidArgument desc = Input content cannot be empty"}

Afaik the qwen model should do the same as the granite one. I tried switching to it because the granite model produces very inaccurate results for me in German. I thought a larger model could probably do better finding the right embeddings to my queries. Regardless of that, I think localrecall should work with the qwen embedding model if it's available in localai so I opened this issue.

Switching back to granite model makes localrecall work fine.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions