nextjs-seo-indexing

Fixes Next.js App Router indexing issues: canonical and generateMetadata, noindex leaks, sitemap/robots routes, static rendering, internal linking, and Search Console coverage. Use when a Next.js site wastes crawl budget or shows discovered-not-indexed URLs. Not for site-wide SEO audits of non-Next stacks (seo-audit), schema-markup chairs, or programmatic keyword-page factories.

仓库: Kayforkind/skill-slice
最近来源活动: 2026年8月14日 23:32
检测到的 SKILL.md 语言: 英语
星标: 0
分支: 0

安装方式

默认使用会先检查来源的 Prompt；你也可以切换为直接命令，或下载本地副本。

检查来源文件

决定是否安装前，请先阅读 SKILL.md，以及 SkillsMP 当前展示的配套文件。

返回搜索返回安装

name	nextjs-seo-indexing
description	Fixes Next.js App Router indexing issues: canonical and generateMetadata, noindex leaks, sitemap/robots routes, static rendering, internal linking, and Search Console coverage. Use when a Next.js site wastes crawl budget or shows discovered-not-indexed URLs. Not for site-wide SEO audits of non-Next stacks (seo-audit), schema-markup chairs, or programmatic keyword-page factories.
version	1.0.1
category	seo
risk	safe
source	self
source_type	self
date_added	2026-05-31
tags	["seo","indexing","nextjs","search-console","crawl-budget","canonical","sitemap","robots","noindex","redirects"]
tools	["claude","cursor","gemini","claude-code"]

Next.js SEO Indexing & Crawl Budget Skill

Fix Google Search Console coverage issues, canonical problems, sitemap errors, and crawl budget waste in Next.js apps. This skill walks through a full seven-step audit covering canonical tags, noindex leaks, sitemap health, static rendering, internal linking, redirects, and robots.txt.

When to Use

A Next.js site shows Google Search Console coverage issues: duplicate canonicals, accidental noindex, crawl waste, or "discovered – not indexed" URLs.
You are auditing sitemap, robots.txt, redirect chains, internal-linking, or static-rendering problems before an SEO release.
You need framework-specific examples for Next.js App Router metadata, generateMetadata, robots.js, and sitemap routes.
A client or stakeholder reports dropped indexed page counts or coverage report regressions.

Prerequisites

Runtime: Node.js 18+ and Next.js 13+ (App Router) project locally.
Access: Codebase read/write access, deployed URL, and ideally Google Search Console property access.
Windows host (primary): Commands below are PowerShell-first. Where a Unix equivalent is useful (e.g., curl on WSL), it is noted. PowerShell aliases: curl maps to Invoke-WebRequest unless curl.exe is explicitly called.
Tools: ripgrep (rg) recommended for fast code search. Install via winget install BurntSushi.ripgrep.MSVC or use Select-String as fallback.
No live secrets: All URLs and keys in examples use yourdomain.com / YOUR_KEY placeholders.

Procedure

Understanding Search Console Coverage States

Before fixing anything, map the Search Console report to the correct state:

Status	Meaning	Fix
Crawled – not indexed	Google crawled but chose not to index	Improve content quality + canonical + internal links
Duplicate without canonical	Multiple URLs serve same content, no canonical	Add explicit canonical to the preferred URL

# PowerShell — find all canonical references
rg -n --glob '*.{js,ts,jsx,tsx}' 'canonical|alternates' app pages

# Fallback without ripgrep
Get-ChildItem -Recurse -Include *.js,*.ts,*.jsx,*.tsx app pages | Select-String -Pattern 'canonical|alternates'

// app/blog/my-post/page.js
export const metadata = {
  title: 'My Post Title',
  alternates: {
    canonical: 'https://www.yourdomain.com/blog/my-post',
  },
};

export async function generateMetadata({ params }) {
  return {
    alternates: {
      canonical: `https://www.yourdomain.com/blog/${params.slug}`,
    },
  };
}

// ❌ WRONG — relative URL
canonical: '/blog/my-post'

// ❌ WRONG — missing trailing slash inconsistency
// (pick one and stick with it sitewide)

// ✓ CORRECT — absolute URL, consistent scheme + subdomain
canonical: 'https://www.yourdomain.com/blog/my-post'

# PowerShell — fetch the page and extract canonical link
curl.exe -s https://www.yourdomain.com/blog/my-post | Select-String 'rel="canonical"'

# WSL / Unix
curl -s https://www.yourdomain.com/blog/my-post | grep -i 'rel="canonical"'

# PowerShell with ripgrep
rg -n --glob '*.{js,ts,jsx,tsx}' 'noindex|robots.*noindex' app pages

# Fallback
Get-ChildItem -Recurse -Include *.js,*.ts,*.jsx,*.tsx app pages |
  Select-String -Pattern 'noindex|robots'

Select-String -Path app\layout.js -Pattern 'robots'

// app/layout.js — only set robots if you need sitewide control
export const metadata = {
  // ✓ Allow indexing
  robots: { index: true, follow: true },
  // ❌ This would noindex the entire site:
  // robots: { index: false }
};

# Check HTTP headers
curl.exe -sI https://www.yourdomain.com/blog/my-post | Select-String 'x-robots|noindex'

# Check meta tags in HTML
curl.exe -s https://www.yourdomain.com/blog/my-post | Select-String 'noindex'

# PowerShell — check headers
curl.exe -sI https://www.yourdomain.com/sitemap.xml

# Check first 20 lines of XML
curl.exe -s https://www.yourdomain.com/sitemap.xml | Select-Object -First 20

# WSL / Unix
curl -sI https://www.yourdomain.com/sitemap.xml | grep -i "content-type\|status"
curl -s https://www.yourdomain.com/sitemap.xml | head -20

// app/sitemap.js
export default async function sitemap() {
  const baseUrl = 'https://www.yourdomain.com';

  // Static pages
  const staticPages = [
    { url: baseUrl, lastModified: new Date(), changeFrequency: 'daily', priority: 1.0 },
    { url: `${baseUrl}/about`, lastModified: new Date(), changeFrequency: 'monthly', priority: 0.8 },
  ];

  // Dynamic pages (fetch from DB or CMS)
  const posts = await getPosts(); // your data fetch
  const dynamicPages = posts.map(post => ({
    url: `${baseUrl}/blog/${post.slug}`,
    lastModified: new Date(post.updatedAt),
    changeFrequency: 'weekly',
    priority: 0.7,
  }));

  return [...staticPages, ...dynamicPages];
}

// app/sitemap-tools/sitemap.js
// app/sitemap-blog/sitemap.js
// Each returns an array of URL entries

npm run build 2>&1 | Select-String '○|●|λ|/blog|/tools'

○  /about             (static)
●  /blog/[slug]       (SSG)  ← good
λ  /api/data          (serverless) ← expected for APIs

// app/blog/[slug]/page.js
export async function generateStaticParams() {
  const posts = await getPosts();
  return posts.map(post => ({ slug: post.slug }));
}

npm run build 2>&1 | Select-String '/blog'

# PowerShell — search for references to a slug across all files
Get-ChildItem -Recurse -Include *.js,*.ts,*.jsx,*.tsx,*.md |
  Select-String -Pattern '/blog/my-orphan-post' |
  Where-Object { $_.Path -notmatch 'sitemap|my-orphan-post' }

# WSL / Unix
grep -r "/blog/my-orphan-post" --include="*.{js,ts,jsx,tsx,md}" . | grep -v "sitemap\|the-page-itself"

Select-String -Path next.config.js -Pattern 'redirects' -Context 0,10

# PowerShell — follow redirects and show each hop
curl.exe -sIL https://www.yourdomain.com/old-url

# WSL / Unix
curl -sI https://www.yourdomain.com/old-url | grep -i location

// next.config.js — keep redirects flat (no chains)
async redirects() {
  return [
    {
      source: '/old-url',
      destination: '/new-url', // Must NOT itself redirect
      permanent: true, // 308 for SEO
    },
  ];
}

curl.exe -s https://www.yourdomain.com/robots.txt

# ✓ Good
User-agent: *
Allow: /
Sitemap: https://www.yourdomain.com/sitemap.xml

# ❌ Bad — disallows crawling of important content
Disallow: /blog/
Disallow: /tools/

// app/robots.js (Next.js App Router)
export default function robots() {
  return {
    rules: { userAgent: '*', allow: '/' },
    sitemap: 'https://www.yourdomain.com/sitemap.xml',
  };
}

curl.exe -s https://www.yourdomain.com/robots.txt

# 1. Canonical check on a live page
curl.exe -s https://www.yourdomain.com/blog/my-post | Select-String 'rel="canonical"'

# 2. Noindex check on a live page
curl.exe -s https://www.yourdomain.com/blog/my-post | Select-String 'noindex'

# 3. Sitemap returns 200
curl.exe -sI https://www.yourdomain.com/sitemap.xml | Select-String '200'

# 4. robots.txt is accessible
curl.exe -s https://www.yourdomain.com/robots.txt

# 5. Build output shows static pages
npm run build 2>&1 | Select-String '○|●|λ'

# 6. No redirect chains
curl.exe -sIL https://www.yourdomain.com/old-url