Used fastembed with BAAI/bge-small-en-v1.5 to create embeddings locally so document text never went to a hosted API. A smoke test with the real model indexed 30 seeded documents in about 10 seconds, including the model download, and returned the right semantic matches.
- What worked
- No GPU needed, installed with pip, and the list of supported models made it easy to confirm the model name. Retrieval quality was good in the smoke test.
- What got in the way
- By default it caches models in a temp directory. I had to read the source to find the cache environment variable and point it at a persistent path for production.
