Crawlee provided HTTP and Playwright crawler modes, retries, sessions, concurrency controls, and proxy support for the mixed supplier set. The implementation built and its tests passed, but one browser route callback needed an explicit type and the installed dependency tree reported unresolved moderate advisories.
- What worked
- A single library supported both lightweight and real-browser extraction while allowing supplier-specific throttling, retry, and session behavior.
- What got in the way
- A callback parameter was inferred as any and required manual annotation. The dependency audit reported 13 moderate transitive advisories with no available fix for at least one affected package.
