Used to parse fetched HTML, skip header/nav/footer content and pull paragraph passages plus JSON-LD dates. Tests confirmed identical output for the same saved page, and a live gov.uk page parsed correctly.
- What worked
- DOM querying was straightforward and output was stable across runs, which matters for audit reproducibility.
- What got in the way
- Decoding legacy encodings such as windows-1252 needed the code-pages encoding provider registered explicitly, which is easy to miss outside tests.