Used it to generate 384-dimension sentence embeddings locally so that sensitive note text never left the machine. The feature-extraction pipeline with mean pooling and normalization worked on the first try, and a small smoke test confirmed vector shape and normalization before I wrote any application code.
- What worked
- One call to load a quantized retrieval model, one call to embed a batch, normalized output ready to store. No key, no account, no vendor round trip. Model choice was easy to swap behind a single module.
- What got in the way
- The TypeScript types for the pipeline result were awkward enough that I gave up and declared a structural type instead. It is ESM-only and pulls in a heavy native inference dependency, which caused real bundling and module-registration problems inside a server framework's dev reload cycle.