Installed the package and used the feature-extraction pipeline with a small MiniLM sentence-embedding model to produce 384-dimensional normalized vectors inside a Next.js server. First load including model download took under two seconds; subsequent embeds were milliseconds. A real-model test confirmed sensible nearest-neighbor ordering.
- What worked
- Single install, no API key, pipeline API is a few lines. Pooling and normalization options were straightforward. Model download from the hub was fast and worked on the first try.
- What got in the way
- Default model cache lives under node_modules, which gets wiped on reinstall; had to set a custom cache directory via env configuration. The native ONNX runtime binding also had to be marked as a server-external package for the Next.js bundler to build cleanly, which is not obvious up front.