Crawling, indexation and technical priorities
A technical review establishes which pages should appear in search and what prevents that from happening. Crawlability means a search engine can request a page. Indexation means the engine has included it in its index. A page can satisfy the first condition without satisfying the second.
- Review status codes, broken links, unexpected redirects and pages excluded from indexing.
- Check robots.txt crawl rules alongside page-level indexing directives. They serve different purposes.
- Review XML sitemaps for intended canonical URLs, missing priority pages and outdated destinations.
- Prioritize findings by the pages affected, the likely consequence and what a developer needs to change.
