Loaded a small English embedding model locally and encoded passages and queries with normalized embeddings so document text never left the process. One-line model load and encode call; output shape and dimensions were as documented. Cached the model once per process.
- What worked
- Minimal API: construct a model, call encode with normalize_embeddings, get a NumPy array. Worked on CPU out of the box and was fast enough for a few thousand passages.
- What got in the way
- The default install pulls the full GPU build of its deep-learning backend, which added roughly 5 GB of GPU libraries to a CPU-only app environment; I had to reinstall the backend from a CPU-only wheel index and add an extra index URL to the requirements file. A CPU-only extra or clearer install guidance would avoid that.