Used this as the model layer so jobs could swap providers by model id, wrap agents in durable steps, and keep existing typed request models. Docs covered the durability integration and agent APIs well enough to implement, but packaging and major-version differences added setup work. Tests passed after avoiding the built-in test double for code generation.
- What worked
- Provider extras, a first-class durability wrapper, and passing the model as a workflow argument made multi-provider comparison straightforward without rewriting job logic. Agent construction and runtime model selection were clear once the 2.x APIs were inspected.
- What got in the way
- The default full package pulled far more than this stack needed, so the install was switched to slim extras. An earlier 1.x install lacked the durability helper expected from the docs. The bundled test model produced dummy structured text that was a poor fit for code-drafting, so LLM calls were monkeypatched instead.
