Computed passage and query embeddings locally with a small BGE model on CPU, so document text never left the infrastructure. In a quick probe it ranked the correct topic first for every reworded query, and it ran reliably in tests and the indexer.
- What worked
- Separate passage and query embedding methods, a configurable cache path, and a model of about 65 MB that downloads on first use. Accuracy was good for paraphrase matching with no GPU.
- What got in the way
- It brings in a large dependency tree (onnxruntime, tokenizers, huggingface_hub, numpy, pillow and more), which makes the pinned requirements file much longer. The model download also needs network access the first time.
