Indexing Definition
Indexing is the process by which a search engine analyzes a crawled page, understands its content and stores it in its index, a huge database from which search results are built.
Only indexed pages can appear in search results. Crawling a page does not guarantee indexing: search engines decide which pages deserve a place in the index, and many URLs are left out.
What Is Indexing?
After crawling a page, a search engine processes it: it reads the text, headings, links, images and structured data, identifies the language and the topics, and compares the page with others. If the page is judged useful and not a duplicate, it is added to the index with all this information.
The index works like the index of a book on a gigantic scale: instead of reading the web for each query, the engine looks up the terms and entities in its index and retrieves the matching pages in a fraction of a second.
Synonyms: indexation, getting indexed. The opposite is deindexing, when a page is removed from the index.
- How Google Indexes a Page
- Why a Page Is Not Indexed
- Why Indexing Matters for SEO
- How to Get a Page Indexed
- Fixing "Crawled, Currently Not Indexed"
How Google Indexes a Page
- Rendering: the page is processed like in a browser, including JavaScript, to see its final content.
- Content analysis: text, title, headings, images, video, structured data and links are extracted.
- Canonicalization: duplicates are grouped and one URL is chosen as canonical, see the canonical tag definition.
- Directives: a noindex instruction keeps the page out.
- Quality decision: Google decides whether the page adds enough value to be stored.
- Storage: the canonical page and its signals are saved in the index.
Google uses the mobile version of a page for indexing (mobile-first indexing), so content missing from the mobile version may be ignored.
Why a Page Is Not Indexed
| Search Console status | Usual meaning |
|---|---|
| Excluded by ‘noindex’ tag | The page asks not to be indexed |
| Blocked by robots.txt | Google could not crawl the content |
| Not found (404) | The URL does not exist anymore |
| Page with redirect | The URL redirects; the target is indexed instead |
| Duplicate without user-selected canonical | Google sees a copy and chose another URL |
| Alternate page with proper canonical tag | Normal: the variant points to the main page |
| Discovered, currently not indexed | Known but not crawled yet, often a crawl priority issue |
| Crawled, currently not indexed | Crawled but not judged worth indexing for now |
| Soft 404 | The page looks empty or like an error page |
Many exclusions are normal and intended. The problem starts when important pages appear in these lists.
Why Indexing Matters for SEO
- Visibility: a page outside the index generates no organic traffic, however good it is.
- Quality perception: a site where a large share of pages are “crawled, not indexed” often has thin or duplicate content.
- Right version in results: indexing decisions determine which URL represents your content in the SERP.
- Speed of results: new pages and updates only count once they are indexed.
How to Get a Page Indexed
- Make it crawlable: not blocked in robots.txt, returning a 200 status, with no noindex.
- Link to it from relevant pages that are already indexed and visited, especially your home page or popular articles.
- Add it to the XML sitemap with an accurate last modification date.
- Request indexing through URL Inspection in Search Console for new or updated pages.
- Make it worth indexing: unique, useful content that is not a copy of another page.
- Keep signals consistent: self-referencing canonical, same URL in links and sitemap.
For WordPress sites, this step-by-step guide explains how to get a WordPress site indexed by Google.
Fixing "Crawled, Currently Not Indexed"
This status is one of the most common and most frustrating. Google has seen the page but decided not to index it, at least for now. Typical causes and fixes:
- Thin content: very short pages, empty categories, tag pages. Enrich them or remove them from the index.
- Near-duplicates: city pages or product variants with almost the same text. Make each page genuinely different or merge them, see duplicate content.
- Weak internal links: pages linked only from deep archives look unimportant. Link to them from strong pages.
- New site: young domains with few links are indexed more slowly. Patience and a few quality backlinks help.
After improving a page, request indexing again and monitor the status over the following weeks.
How to Check Indexing
- URL Inspection in Google Search Console: the exact status of one URL, its canonical and the last crawl.
- Page indexing report: the number of indexed and non-indexed pages, with reasons, for the whole site or for each sitemap.
- The site: operator (
site:example.com/page/) gives a quick, approximate check, not a complete count. - Bing Webmaster Tools offers similar reports for Bing, which also supports the IndexNow protocol for instant URL notifications.
Common Indexing Mistakes
- Leaving a noindex on a template or on the whole site after launch.
- Blocking pages in robots.txt to remove them from the index (they can stay indexed without content).
- Publishing hundreds of similar pages and expecting all of them to be indexed.
- Requesting indexing repeatedly instead of improving the page.
- Relying on the Indexing API: Google limits it to job postings and livestream video pages.
- Confusing “indexed” with “ranking”: an indexed page can still be invisible on the queries you target.
Indexing: Key Takeaways
Indexing is the moment a search engine decides to store a page and make it eligible for results. Make important pages crawlable, linked, listed in the sitemap and free of noindex, keep canonicals consistent, and give every page a reason to exist. Use the Page indexing report to separate normal exclusions from real problems, and treat “crawled, not indexed” as a quality signal to act on.
From theory to indexed pages
Knowing what indexing is is the first step. The next is finding which of your important pages Google leaves out of its index, and why.
- An action plan adapted to your situation
- Clear explanations, no needless jargon
- Direct application to your sector
From diagnosis to results, step by step
Here is how I handle indexing issues on client sites, and what my clients say about my work.
What Is Indexing?
After crawling a page, a search engine processes it: it reads the text, headings, links, images and structured data, identifies the language and the topics, and compares…
How Google Indexes a Page
Rendering: the page is processed like in a browser, including JavaScript, to see its final content.Content analysis: text, title, headings, images, video, structured…
Why a Page Is Not Indexed
Search Console statusUsual meaningExcluded by 'noindex' tagThe page asks not to be indexedBlocked by robots.txtGoogle could not crawl the contentNot found (404)The URL…
FAQ: Indexing
What is indexing in SEO?
The process by which a search engine analyzes a crawled page and stores it in its index, making it eligible to appear in search results.
How long does it take for Google to index a page?
From a few hours to several weeks. It depends on the site's authority, internal links, sitemap and the quality of the page.
How do I know if a page is indexed?
Use URL Inspection in Google Search Console. The site: operator gives a quick but approximate answer.
Why is my page crawled but not indexed?
Google judged it not valuable enough for now, often because of thin content, near-duplicates or weak internal links.
Can I force Google to index a page?
No. You can request indexing in Search Console, but Google decides. Improving content and internal links is the lasting solution.
What is mobile-first indexing?
Google uses the mobile version of a page's content for indexing and ranking, so the mobile version must contain the important content.
Do you want to work with me?
I am SeoYass, an SEO expert with over 17 years of experience. I have worked with small and medium-sized businesses, successfully completing more than 350 projects.
Passionate about local SEO, I continue to learn and refine my strategies to deliver the best performance for my clients.

