Test Crawls – Reviewing for crawler traps and missing data:
How to Run your Test Crawl
How to Review your Test Crawl
Saving (or not) your crawl
Recommendation: re-run as a one-time crawl, and save. This may not be possible with time sensitive crawls, i.e. where a website might change (after an election) or go down (after an event). In this instance, save the test crawl.
Next step: Quality Assurance (QA)