How search engines actually crawl and index a Shopify store

"Why doesn't this page rank?" is usually the wrong first question. Ranking is step three of three. Before a page can rank, it has to be crawled (Google visited it) and indexed (Google kept it). A surprising share of ecommerce visibility problems live in those first two steps - and they're the most fixable.

Step one: crawling - can Google find and reach it

Googlebot discovers pages by following links and reading your sitemap. Shopify handles the plumbing: a sitemap.xml is auto-generated at yourstore.com/sitemap.xml with every product, collection, page, and blog post, and robots.txt sensibly blocks cart, checkout, and admin paths.

What Shopify can't do for you is internal linking. A product in the sitemap but linked from nowhere - no collection, no navigation path - is technically discoverable but signals "unimportant." Crawlers allocate attention roughly the way customers do: pages well-linked from important pages get visited often; orphans get visited rarely or never. Your Phase 1 architecture work is, it turns out, crawl strategy.

Step two: indexing - did Google keep it

Crawled doesn't mean indexed. Google evaluates every crawled page and keeps the ones it judges worth serving. The GSC Page indexing report (Phase 3) itemizes the rejects, and for ecommerce two reasons dominate:

"Duplicate without user-selected canonical" / "Alternate page with proper canonical tag": Google found multiple URLs with the same content - variant URLs, collection-path product URLs, filtered pages - and picked one. Mostly this is the system working as intended; it becomes a problem when Google picks a different URL than you would.

"Crawled - currently not indexed": Google visited and declined. On product pages this is very often a thin-content verdict - a supplier description shared with forty other stores, three specs and no substance. Google saw it, had it already, kept someone else's. This is where your Phase 2 data work becomes ranking infrastructure: unique, complete product data is what makes a page worth indexing at all.

Step three: ranking - the part everyone skips to

Only after both steps does the familiar game begin - relevance, content quality, links, experience. The rest of this phase lives there. But the sequencing is the lesson: check indexed-versus-exists before debating title tags. A store with 40% of its catalog unindexed doesn't have an optimization problem yet. It has an admission problem.