Redirect Map Bloated to Thousands of Lines, Slowing Builds
A 3,000-line _redirects file slows builds, makes crawlers chase chains, and silently drops rules past your host's cap. How to audit, collapse chains, and prune safely.
Articles tagged with #Crawl budget
A 3,000-line _redirects file slows builds, makes crawlers chase chains, and silently drops rules past your host's cap. How to audit, collapse chains, and prune safely.
Every URL in your sitemap reports today's `lastmod`. Googlebot crawl rate falls instead of rising, because Google now ignores the field as unreliable.
Search Console crawls your homepage daily but article pages stay at "Discovered — currently not indexed." Split discovery vs. crawl-budget failures and fix the right one.
Crawl Stats shows Googlebot fetching hundreds of URLs a day, but the Performance report stays flat. Here is why crawling is not indexing, and how to unclog the middle.
Thousands of pages, only a fraction indexed. How to tell if it's really crawl budget, and what actually moves the needle in 2026.