Crawled, currently not indexed: why Google skips a page

Why did Google crawl the page but leave it out?

Google does two separate jobs. First, it crawls your URL, which means its software visits the page and reads what's there. Then it decides whether to index it, meaning keep it available for search results. Getting through the first step doesn't guarantee the second.

Say you've published a new boiler repair page on Monday. It loads, appears in your sitemap and has already been visited by Google. By Friday, it's still missing from search. That's frustrating, but the status confirms Google reached the URL. It doesn't explain why Google left it out.

On the small business sites we audit, similar service pages are worth checking first. A plumber might have separate pages for drain cleaning, blocked drains and emergency drain unblocking. If each repeats the same services, areas and paragraphs, Google has little reason to index all three. It may select one or leave several out.

Town pages often follow the same pattern. An electrician creates pages for every town within a 30-minute drive, changing only the location name. The photographs, services and contact details stay identical. Customers opening those pages learn almost nothing different.

Your pages can also compete. A heating contractor might have one URL for "boiler repair" and another for "boiler repairs". If both answer the same question, Google must choose which deserves a place in its index. Neither may have a clear enough purpose.

These are possible causes, not confirmed diagnoses. Google doesn't provide a specific explanation for every URL with this status. Check the evidence before rewriting anything.

Where can you find the pages Google did not index?

Open Google Search Console and select your website. In the left menu, click Indexing, then Pages. Under "Why pages aren't indexed", find "Crawled, currently not indexed" and click it. You'll see examples of affected URLs.

Download the examples if the list is long. Group similar addresses together. Perhaps you've got 12 town pages, four older service pages and several blog posts. Those groups are easier to investigate than a mixed list of addresses.

Now copy an affected address into the URL Inspection bar at the top of Search Console. Look at the indexing status, last crawl and canonical information. These details tell you what Google recorded when it checked that URL.

A canonical URL is the main version you want Google to use when several pages are identical or very similar. Search Console may show the version you declared and the one Google selected. If they differ, compare the pages. Check whether your links and canonical settings point toward the same preferred address.

Click "Test Live URL" as well. Perhaps your web developer fixed an empty page yesterday, but Google's last crawl happened before that repair. The live test checks the current version. Passing it means Google can access the page during the test, not that indexing is guaranteed.

Before editing content, rule out separate technical problems. Blocked URLs, bad redirects and sitemap issues are covered in our guide to the usual reasons a website stays invisible. You don't want to rewrite a perfectly useful service page when the actual problem sits elsewhere.

What should you change before asking Google again?

Start with pages customers genuinely need. Your boiler repair page should explain the faults you handle, what someone can safely check before calling and what details you need when booking. A generic paragraph about friendly service won't tell a customer much about boiler repairs.

Town pages need their own useful information. Include the neighbourhoods you cover, relevant access or travel details and services people request there. Explain genuine differences in how you serve that town. Don't invent completed jobs, testimonials or office addresses. If several towns have nothing distinct to say, one service-area page may do the job better.

For pages covering nearly identical subjects, choose the approach that makes the website clearer:

• Keep separate pages when customers need different answers. Make that difference obvious in their titles, headings and actual content.
• Combine pages that repeat the same information. Put the useful details on the page you keep, then redirect the old URL when appropriate.
• Use a canonical tag when duplicate URLs must remain accessible. Point it to your preferred version and check that internal links agree.

Next, check the technical settings. The page should return HTTP 200, the normal response for a successfully loaded page. Make sure robots.txt doesn't block it, there's no noindex instruction telling Google to exclude it, and the canonical tag points to the intended URL. A page can look fine in Chrome while sending conflicting instructions to Google.

Look at internal links too. If your emergency plumbing page appears only in the sitemap, add a useful link from your service overview, navigation or related pages. Use ordinary link text that tells customers where they're going.

You can usually improve thin content, remove unnecessary duplication and add links yourself if you're comfortable editing the site. Ask whoever built or maintains it to handle unfamiliar redirects, canonical tags, robots.txt rules or indexing settings. One careless change can affect several pages.

Should you request indexing after making changes?

Yes, once you've improved the page and confirmed Google can access it. Open URL Inspection, enter the address and click "Request Indexing". Google can queue the URL for another crawl and consider it for indexing. The button doesn't force Google to include it.

Don't keep pressing it. Repeated requests don't give a URL extra priority. Nor will changing a heading, replacing a few words or updating the publication date necessarily solve the problem. Fix the actual content or technical issue first.

Give Google time. There's no guaranteed deadline for indexing. Check the Pages report again later, then inspect the URL to see whether Google has crawled it since your changes and which canonical version it recognises.

Still excluded? Compare the page with similar URLs again. Look for missing customer information, competing pages or technical settings that weren't corrected. Another indexing request without a meaningful change won't address those problems.

How can you tell if several pages have the same problem?

One excluded page may be a small issue. Twenty excluded pages with nearly identical titles and paragraphs suggest a bigger problem with how the site was organised. This happens on contractor websites that have grown over several years. New services get their own pages, old versions remain online and more town pages appear without anyone comparing the content.

Open a spreadsheet. Record each affected URL, its page type, main service or topic, declared canonical and closest competing page. Add one sentence about what makes it different. You'll soon see which pages need better content and which might belong together. Don't delete a useful page merely because it shares some wording with another.

If you can't work out which pages overlap, FixGuider can audit your website from the outside. We provide a free SEO audit with desktop and phone screenshots of your own pages. Problems are circled, numbered and explained plainly. We check indexing, content, titles, headings and links, along with other parts of the site. You keep the report even if you don't hire anyone. We don't ask for passwords or website access.

Start with Search Console today. Open Indexing, click Pages, select "Crawled, currently not indexed" and download the affected URLs. Choose three similar service or town pages. Read them side by side, identify what each customer actually needs to know and make those changes before requesting indexing again.