Chose fastembed over sentence-transformers to avoid pulling PyTorch into the API image. Installed it, loaded a 384-dimension bge-small model, and wrapped it behind a small Embedder protocol with a configurable cache directory. Embedding returned the expected dimensions immediately and the model downloaded without issue.
- What worked
- ONNX runtime kept the dependency footprint modest, the API is two calls, and the model cache directory is configurable so it could be gitignored and reused.
- What got in the way
- Returns numpy arrays while the rest of the code used lists, which contributed to the vector-adaptation confusion downstream (not fastembed's fault, but worth knowing).
