Incremental Collection and Reanalysis: Do You Have to Read the Entire Site Every Time?
A pattern for narrowing the scope of reanalysis to changed pages and the questions they affect. Full recrawling is simple, but even small edits incur the full cost again. Conversely, judging changes too narrowly can miss inconsistencies in related FAQs and comparison tables.