Duplicate Content: Causes, Impact, and How to Fix It

Duplicate content confuses search engines. Which URL should rank? They may choose none, or the wrong one. Here’s how to find it and fix it.

Google does not issue a “duplicate content penalty” for ordinary site issues. It picks a canonical and may ignore the rest.

You still lose: split links, wasted crawl budget, and rankings on a URL you do not control.

Common Causes

• URL parameters. ?sort=, ?filter=, ?session=, ?utm_. Same HTML, many URLs. Faceted nav on ecommerce and resource libraries is the usual source.
• WWW vs. non-WWW, HTTP vs. HTTPS, trailing slash. Two (or four) hosts for every page. Pick one. 301 the others at the server.
• Print, PDF, and “view full” URLs. Same article, extra path. Canonical or noindex the extra format unless the PDF is the asset you want ranked.
• HTTP copies from staging or a leftover subdomain. staging. or www2. indexed next to production. Password-protect or noindex staging. 301 the leftover host.
• Thin location or tag pages. “Location: City A” with 50 words of boilerplate. Near-duplicates of each other. Consolidate or noindex.
• Manufacturer or syndicated copy. Product descriptions reused across the web. Google already has that text. Rewrite or add original specs, applications, and data.
• Scrapers. Other sites copy you. You cannot stop all of it. Make sure your URLs are first, canonical, and in the sitemap so Google sees you as the source.

How to Diagnose

Search Console → Indexing → Pages. Check “Alternate page with proper canonical tag,” “Duplicate without user-selected canonical,” and “Duplicate, Google chose different canonical than user.” Those three tell you whether Google agrees with your tags.

Screaming Frog. Crawl. Export near-duplicates (exact and fuzzy title/H1/content). Sort by URL pattern — parameters cluster fast.

site: search. site:yoursite.com "a unique sentence from a page". Multiple hits means you have copies.

Manual check. View source on a filter URL and the clean URL. If the canonical is missing or points at itself on the parameter version, that is the bug.

Solutions

Pick one signal per duplicate set.

Mixing them creates noise.

• Canonical tags. Point the duplicate at the preferred URL.

<link rel="canonical" href="https://yoursite.com/category/pumps/" />

Use this when the extra URL must stay live (filters, tracking, sort). The canonical target should be the clean, indexable URL. Details in technical SEO foundations.

• 301 redirects. If the extra URL has no user need, redirect it. Host mismatches, old CMS paths, and retired thin pages belong here.
• Noindex. For pages that must exist (thank-you, print, filtered views you cannot redirect) but should not rank. Do not noindex and canonical to another URL at the same time.
• Consolidate. Merge thin pages into one strong page. 301 the rest. This is the right move for city pages that only change the H1.

Parameter Handling

• Canonical first. The HTML on ?sort=price should canonical to the parameter-free URL. Never put the parameter URL in the sitemap.
• robots.txt. You can Disallow known junk patterns (/*?sort=) to save crawl budget. Google may still find those URLs via links; canonical and sitemap still matter.
• Search Console URL parameters. The old Parameters tool is limited and mostly retired for many properties. Do not rely on it. Fix the templates.
• Internal links. Navigation, facets, and “share” buttons should point at clean URLs. Stop minting duplicates from your own HTML.

After the Fix

Resubmit the sitemap. Request indexing on the canonicals you care about.

Expect 2–4 weeks for “Duplicate without user-selected canonical” to shrink.

If Google keeps choosing a parameter URL, you still have internal links or a sitemap entry pointing there.

---

We audit for duplicate content in every technical SEO review. Start a search audit or see the technical SEO audit checklist.