How do I avoid scanning duplicate web pages? Using duplicate threshold, you can avoid scanning duplicate web pages, making your scan faster. More information will come when this feature is released later in 2026.