Google indexing issues: diagnose and fix them fast

Pages are live but not showing in Google. Coverage says Crawled currently not indexed or Duplicate without user-selected canonical. Every day stuck here costs traffic.

Use this compact playbook to find the cause fast and ship a fix. If you want it handled for you, RankGoat runs weekly indexation checks, validates sitemaps and canonicals, repairs orphan pages, manages parameters and pagination, and secures a vetted dofollow backlink for every post it writes and publishes.

Find the cause in Search Console

Confirm what Google sees before you change anything.

• URL Inspection. Inspect the exact URL. Note Last crawl date, Selected canonical, and Indexing status. If Google picked a different canonical, you have duplication or mixed signals. Use Test live URL to compare the rendered HTML with your source.
• Page indexing report. Filter by status and look for patterns like Soft 404, Alternate page with proper canonical, or Discovered – currently not indexed. A single pattern usually points to one root cause.
• Crawl Stats. Open Settings → Crawl stats. Check host status, average response time, and the breakdown by response code. Spikes in 5xx or timeouts slow down recrawls.
• Server responses. Spot-check with your dev tools or curl. Example: curl -I -L https://example.com/path. You want a clean 200 OK on the canonical URL, not a chain of 301s or a 302 to a near-duplicate. Check for X-Robots-Tag: noindex headers you did not intend.
• Discovery signals. Make sure the URL is in an XML sitemap and linked from at least one indexed page. Orphaned URLs often sit in Discovered for weeks.

RankGoat automates this first pass. Weekly checks surface non-indexed pages, map them to their sitemap entries and canonicals, and flag duplicate or soft 404 patterns so you do not chase one-off fixes.

Fix sitemaps, robots, and canonicals

Your sitemap, robots.txt, and canonical tags should point to the same URL for each piece of content. Any disagreement slows or blocks indexing.

Tune your XML sitemaps

• Include only 200-status, canonical URLs. Exclude parameters, redirects, noindex pages, and session IDs.
• Keep each file under 50,000 URLs and 50 MB uncompressed. Use a sitemap index for big sites.
• Update lastmod only when content meaningfully changes. Do not auto-bump timestamps.
• For multilingual sites, add hreflang alternates and ensure each locale self-references. Include an x-default when appropriate.

Verify robots.txt and meta robots

• Do not Disallow paths you expect to rank. If a path is Disallowed, Google cannot see a page-level noindex on it.
• Allow access to CSS and JS so Google can render pages correctly. Example:
  Allow: /wp-includes/*.css
Allow: /wp-includes/*.js
• Use meta robots or an X-Robots-Tag only when you truly want a page dropped. Remove noindex on pages you want indexed.

Clean up canonical signals

• Set a single, absolute rel="canonical" per page. Match scheme, host, and trailing slash to the real canonical and to your sitemap.
• Self-reference on unique pages. Point near-duplicates to the best version or consolidate content.
• Avoid cross-domain canonicals unless you want the other domain to rank.

RankGoat validates sitemaps, robots, and canonicals during its weekly checks and fixes mismatches before they snowball into sitewide indexing issues.

Control parameters, pagination, duplicates, and orphans

Filters, sorts, calendars, and tag pages can explode your crawl footprint and bury the canonical version. Clean structure and clear signals keep Google focused on the right URLs.

Parameters and facets

• Stabilize the canonical. For sorts and filters, point variants to a single canonical unless the variant has distinct content and search demand. Example: ?sort=price canonicals to the base category.
• Noindex thin facets. Internal search results and endless filter combos rarely deserve indexing. Keep them crawlable if rendering needs it, but add noindex,follow so link equity still flows.
• Prevent crawl traps. Cap pagination depth server-side, avoid calendar loops, and strip tracking parameters from internal links. If you block parameters in robots.txt, do it only for URLs you never want indexed.

Pagination and collections

• Provide clear next and previous links and a view-all page if it loads quickly. Google no longer uses rel="next/prev", but logical linking still helps discovery.
• Do not canonical every paginated page to page 1 unless you also offer a view-all canonical target. Each page should usually self-canonical.

Typical duplicate clusters

• Protocol and host: force HTTPS and a single host (www or non-www) with 301s. Align canonicals to match.
• Trailing slash and case: pick one version and redirect the rest.
• UTM and tracking params: never include them in sitemaps. Canonical to the clean URL and avoid linking to the tagged version internally.

Orphan pages and soft 404s

• Fix orphans with internal links. Link every new post from at least one indexed hub using descriptive anchor text placed in the body copy, not only in nav or footer.
• Resolve soft 404s. If a page is too thin to satisfy intent, enrich it or remove it. Return 404/410 for dead endpoints, or 301 to the most relevant live page. Avoid redirect chains.
• Align all signals. After consolidation, make sure the canonical, sitemap, and internal links all point to the kept URL.

Example: we helped the team behind an alcohol tracker app with on-device privacy figure out why a batch of blog posts would not index. The posts had no internal links from features or help pages, so Google discovered them but never prioritized them. We added two links from high-traffic pages and fixed a mismatched canonical. All posts indexed within two weeks.

RankGoat’s technical cleanup covers crawl parameters, pagination, soft 404s, and orphan repair. It also places a contextual dofollow backlink for each post and replaces dropped links to keep signals intact.

Revalidate, request indexing, and monitor

After you push fixes, confirm them and nudge Google on priority URLs.

1. Use URL Inspection on the fixed page and click Request indexing. Save this for high-value URLs.
2. Resubmit your sitemap index to reflect lastmod updates. You can also ping the sitemap URL.
3. Watch Page indexing and Crawl stats for a week. Expect fresh crawls and shrinking Duplicate or Soft 404 buckets.
4. Check whether Google accepts your canonical. If it keeps choosing a different URL, look for stronger internal links pointing to the wrong version or content that is still too similar.

If you want less manual work, RankGoat writes and auto-publishes helpful posts, secures a vetted dofollow backlink per post, and handles the unglamorous technical fixes. It runs weekly indexation checks, validates sitemaps and canonicals, fixes orphan pages, and manages crawl parameters and pagination. Posts ship with titles, meta tags, headers, alt text, internal links, and Article and FAQ schema so you can rank in Google and show up in AI answers.

Key takeaways

• Start with data. Use URL Inspection, Page indexing patterns, and Crawl stats before you change anything.
• Align sitemaps, robots, and canonicals so each piece of content has one clear URL.
• Tame parameters and pagination to cut crawl waste and prevent duplicate clusters.
• Fix orphan pages with internal links and resolve soft 404s by improving, redirecting, or removing.
• Revalidate, request indexing on priority URLs, and monitor for a week to confirm the fix.

Do the steps above once, document them, then automate. Consistency is what gets stubborn pages indexed.