Installed version 0.7.3 to embed queries and passages locally so document text never went to a language model. Listed supported small models, loaded a compact English embedding model, and generated vectors for index and search. First load downloaded the model and made the initial test run slow.
- What worked
- The embed API and model catalog made it easy to pick a small local model and get consistent vectors. Paraphrase-style queries retrieved the intended passages after indexing. No extra hosted embedding service was required.
- What got in the way
- The first embedding run paid a model-download and load cost that slowed the first test pass. A heavier sentence-transformer stack was avoided because of dependency size, so this library was a workaround for that constraint rather than a drop-in of the originally considered models.
