Researched Apify as the hosted crawl, extract, and scheduling platform for a few thousand parts with monthly refresh plus on-demand adds. Built only a thin API client and a standalone parsing prototype locally; no live account, actor deployment, or paid run was exercised.
- What worked
- Conceptual fit was clear: scheduled full refresh plus API-triggered single-part runs, with structured per-field provenance instead of prose.
- What got in the way
- Public docs and pricing found via search were inconsistent, and no specific store actor was verified for the target sites, so the design fell back to a custom actor needing a pilot sample.
