Internal Search Result Pages: Index or Noindex?
Internal search result pages should almost always be kept out of Google's index. Here is the rule, the two real exceptions, and how to deindex thousands of leaked /search?q= URLs cleanly.
#Technical SEO
Articles tagged with #Technical SEO
Noindex vs Nofollow vs Disallow: When to Use Each
Three SEO controls, three different jobs. Pick the wrong one and you leak pages into the index, waste crawl budget, or hide content so thoroughly Google can never drop it.
Astro SEO Basics: Title, Meta, Canonical, Hreflang
The minimum-viable SEO setup for an Astro site: the exact head tags every page needs, the pixel limits that matter, and patterns that hold at 500+ articles.
Astro Sitemap Setup: hreflang, Exclusions, lastmod
Generate, validate, and submit sitemap.xml in Astro with @astrojs/sitemap — hreflang pairs, filter exclusions, lastmod, and what Google actually does with it (June 2026).
How to Design Content-Site Sections So They Scale
Taxonomy and URL design for content sites: 4-8 hubs, an Astro 5 content schema, hub-page templates, and sitemap config that scales from 50 to 1000 articles without a refactor.
Generate a Technical SEO Checklist with AI (Tailored to Your Stack)
Skip the generic 80-point list. Have AI build a 30-60 item technical SEO checklist for your stack (Astro / Next / Hugo / WordPress), each item with a verification command, in 20 minutes.
Avoid Content Duplication When Scaling a Content Site Fast
Past a few hundred articles, duplication quietly kills indexing. Here is the script-driven workflow to catch it before Google does — with real embedding costs and Search Console signals.
Canonical URLs Explained — What to Set and What to Avoid
A practical guide to canonical tags: what they do, Google's signal hierarchy, and the mistakes that quietly break indexing — verified against Google docs, June 2026.
Will Changing Domains Hurt SEO? 301 Redirect Migration Playbook
A domain change costs short-term ranking but is recoverable. Use this 301 redirect playbook, Search Console Change of Address steps, and verification commands.
hreflang for Bilingual Sites — The Parts That Actually Matter
A practical guide to `hreflang` for English/Chinese (or any two-language) sites: exactly what goes in `<head>`, what generators get wrong, and how to verify it in 2026 now that Search Console's old report is gone.
New Content Site: A 30-Day Plan That Gets You Indexed
A specific 30-day plan for a brand-new content site: get indexed in Search Console, lock your URL structure, ship 15-20 clustered articles, and skip what doesn't matter yet.
Next.js Content-Site SEO: The Footguns to Check First
Next.js does not break SEO, but Next.js 16 has real footguns: async params, streaming metadata, dynamic routes. Use this metadata, sitemap.ts, and view-source checklist before you ask Google to crawl.
Next.js Image Optimization: The 16 Upgrade Checklist
next/image is the biggest free performance win you get — but Next.js 16 deprecated priority, made qualities required, and dropped the cache default to 4 hours. Here's what to fix.
Next.js Sitemap and robots.txt: The App Router Way (2026)
A correct sitemap and robots.txt decide whether Google indexes your Next.js site. Here are the App Router idioms for both, verified against Next.js 16.
Pillar and Cluster Pages: The Site Structure Google and AI Search Reward
Encode pillar/cluster relationships in your content schema, not your head. Includes a Zod schema, auto-generated link blocks, an orphan-audit script, and 2026 anchor-text targets.
robots.txt — What to Put, What to Never Put (2026)
A surgical guide to robots.txt for indie sites: the working default, the rules that quietly deindex you, robots.txt vs noindex, and the AI-crawler tokens (GPTBot, ClaudeBot, Google-Extended) that matter in 2026.
Run a Site-Wide Content Audit: A Repeatable Quarterly Process
A scripted quarterly content audit: URL inventory, Search Console join, dead-page and near-ranker flags, duplicate scanner, linkinator broken-link check, and a diff-able decision log.
SEO Review of Your Site With Codex: Exact Prompts
Run a technical SEO review with Codex using copy-paste prompts for canonical, hreflang, title/meta, sitemap, and JSON-LD checks — plus shell commands that verify every finding.
Should Your Category Pages Be Indexed?
A decision framework for indexing category / hub pages: when they earn rankings, when they cannibalize articles, and how to turn empty categories into real landing pages.
Should Tag Pages Be Noindex? (For Most Sites, Yes)
When tag archives help SEO and when they hurt — plus the exact noindex pattern, the robots.txt mistake to avoid, and copy-paste code for WordPress, Astro, and Next.js.
Site QA with AI: Broken Links, Missing Alt, Thin Pages
A reproducible site-QA pass with copy-paste AI prompts, exact shell verifiers, and a CI gate that fails the build on broken internal links and missing tags.
Structured Data for Content Sites: The 3 Types Still Worth Shipping in 2026
A no-jargon JSON-LD guide for content sites: the three schema types still earning rich results in 2026, the ones Google retired (FAQ, HowTo, sitelinks search box), and how to validate.
Subdomain vs Subdirectory for SEO: Which Google Prefers in 2026
`blog.yoursite.com` or `yoursite.com/blog`? The data, the AI-citation angle, and the exact Vercel/Next/Cloudflare rewrite to keep authority on one domain.
What a Sitemap Actually Is (and the Fields Google Ignores)
A plain-English explainer for sitemap.xml as of June 2026 — what it does, what it does not do, and the fields most generators stuff in that Google never reads.
When (and How) to Refresh Old Articles for Traffic
Refresh only what's worth it: the Search Console query that surfaces position 8-20 pages, a refresh template, and the 2026 re-indexing flow that actually works.
Title Tags and Meta Descriptions That Earn the Click (2026)
Write `<title>` and `<meta name="description">` that survive Google's rewrite: real pixel limits, the 61% rewrite study, intent matching, and a 6-step audit.