Blog

How to find the sitemap of any website

Most sites publish their sitemap in one of a handful of predictable places. Here is where to look, in the order that finds it fastest.

The fastest way

Enter the domain in a sitemap finder. It runs every check below at once: it reads robots.txt, tries the standard locations, and opens each candidate to confirm it really is a sitemap rather than a page that happens to load.

If you'd rather check by hand, these are the places to look.

1. Check robots.txt

Open https://example.com/robots.txt in your browser and look for lines that start with Sitemap::

User-agent: *
Disallow: /checkout/

Sitemap: https://example.com/sitemap_index.xml

This is the most reliable source, because it's where search engines look first, and it's the only place that can point to a sitemap on a different domain or path. A site can list several Sitemap: lines.

2. Try the standard URLs

If robots.txt doesn't list one, add these to the end of the domain, one at a time:

One catch: many sites answer any unknown URL with their homepage and a 200 status. If a URL loads a normal web page rather than a page of XML, it isn't a sitemap.

3. Look up the platform's default

PlatformWhere the sitemap is
WordPress 5.5 and later/wp-sitemap.xml
WordPress with Yoast SEO or Rank Math/sitemap_index.xml, which replaces the built-in one
Shopify/sitemap.xml
Wix/sitemap.xml
Squarespace/sitemap.xml
Webflow/sitemap.xml, once enabled in the SEO settings
Astro with @astrojs/sitemap/sitemap-index.xml

4. Look in the page source

A few sites link their sitemap from the homepage's HTML. Open the page source (Ctrl+U, or ⌘+Option+U on a Mac) and search for sitemap. You may find a <link rel="sitemap"> tag or a link to an HTML sitemap page in the footer.

5. Check Search Console or Bing Webmaster Tools

For a site you own, the Sitemaps report in Google Search Console lists every sitemap that has been submitted, and when Google last read it. Bing Webmaster Tools has the same report. These are the only places that show sitemaps submitted directly to a search engine without being listed anywhere public.

Searching site:example.com filetype:xml sometimes turns up a sitemap that has been indexed. It's hit and miss, because most sitemaps aren't indexed as pages, but it can reveal sitemaps at unusual paths.

7. When there is no sitemap

Not every site has one, and small sites with good internal links can be crawled fine without one. If it's your site, add one:

Then add a Sitemap: line to robots.txt and submit it in Search Console, so every search engine can find it.

Questions

What is the difference between a sitemap and a sitemap index?

A sitemap lists page URLs. A sitemap index lists other sitemaps. Large sites use an index because one sitemap can hold at most 50,000 URLs and 50 MB. Open the index and each sitemap inside it to get the pages.

How do I see all the URLs in a sitemap?

Open it in the Sitemap URL Extractor. It follows sitemap indexes all the way down and lists every URL, which you can export to CSV.

Is it OK to look at a competitor's sitemap?

Yes. Sitemaps are public files published for search engines. Looking at one is a common way to understand how a site is organised and how much content it has.