Used indirectly as the runtime for the embedding model. The default Linux wheel from the main package index pulled in several gigabytes of CUDA libraries that are useless on a CPU server; uninstalling them and reinstalling from the CPU-only index shrank the environment from about 6.5 GB to 1.4 GB. After that, inference worked fine and tests passed.
- What worked
- CPU-only wheel index works cleanly once you know about it, and the resulting install was stable and fast enough for small-batch embedding.
- What got in the way
- Defaulting to GPU builds on Linux is a trap for server deployments; it silently bloats images and lockfiles. Pinning the CPU build requires an extra index URL line in requirements, which is easy to miss.