Used to turn fetched HTML into plain text for passage matching, and exercised for real in a standalone script: script and style elements stripped, invalid byte sequences scrubbed, and a full HTML-to-text-to-verification round trip confirmed.
- What worked
- Parsing and node removal are concise and behaved exactly as expected on messy input, including pages with invalid encoding. It was the one new dependency I could actually execute, which let me prove the extraction path end to end.
- What got in the way
- It was only present transitively, so getting it onto the load path meant locating the vendored library directory and adding its own transitive dependencies by hand; the initial load failure gave only a generic missing-file message.