Sitemap generator that only lists the pages you want indexed
A sitemap full of redirects, duplicates and noindex pages sends search engines mixed signals. This prompt has your todo.is agent crawl your site, keep only live, canonical pages, and build a valid sitemap.xml you can upload to your site's root and submit in Google Search Console, plus a readable list to check.
The prompt
- Create an XML sitemap for [WEBSITE]. Crawl the site from the homepage (up to [NUMBER OF PAGES] pages) and include only pages that return 200, are not noindex, and are their own canonical URL. Leave out [PAGES TO EXCLUDE], redirects, URLs with tracking parameters and duplicate http/www versions. Use the lastmod date from the page if shown. Split into several sitemaps with a sitemap index if there are more than 50,000 URLs or the file is over 50 MB. Validate the XML. Give me sitemap.xml, an Excel list of included and excluded URLs with the reason for each exclusion, and the line to add to robots.txt.
What to change
- [WEBSITE]: Your site with https, e.g. "https://www.kilnandcoast.com".
- [NUMBER OF PAGES]: e.g. "2,000" or "all".
- [PAGES TO EXCLUDE]: e.g. "/cart, /account, /search and tag pages", or "nothing extra".
Example result
- sitemap.xml · kilnandcoast.com (example)
- What the file looks like
- <?xml version="1.0" encoding="UTF-8"?>
- <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
- <url>
- <loc>https://www.kilnandcoast.com/</loc>
- <lastmod>2026-10-01</lastmod>
- </url>
- <url>
- <loc>https://www.kilnandcoast.com/workshops/wheel-throwing</loc>
- <lastmod>2026-09-18</lastmod>
- </url>
- ...
- </urlset>
- Included: 214 URLs
- • Homepage and 6 main pages
- • 41 workshop and product pages
- • 167 blog posts
- Excluded: 61 URLs
- • 22 redirects, e.g. /classes → /workshops (the final URL is included instead)
- • 16 tag and archive pages set to noindex
- • 9 URLs with ?utm_ tracking parameters
- • 8 http:// and non-www duplicates
- • 4 pages returning 404, listed so you can fix the links
- • 2 pages whose canonical points to another URL
- Not used
- • priority and changefreq tags: Google ignores them, so they were left out to keep the file clean
- Add to robots.txt
- Sitemap: https://www.kilnandcoast.com/sitemap.xml
- Next steps
- • Upload sitemap.xml to your site's root folder
- • Submit it in Google Search Console under Sitemaps
- • Re-generate after adding many new pages, or ask for a monthly run
How to do it with todo.is
- Copy the prompt and add your website address and anything to leave out.
- Paste it into todo.is or send it to your agent on WhatsApp or Slack.
- Your agent crawls the site, filters the URLs and validates the XML file.
- Download sitemap.xml, upload it to your site's root and submit it in Search Console.
Tips for a better result
- Only list URLs you want in search results. A sitemap is a hint, so keep it clean.
- Use the exact version of your domain that your site uses (https, with or without www).
- Many platforms (WordPress with an SEO plugin, Shopify, Wix) already make a sitemap. Compare it with this one to spot errors.
- For big sites, ask for separate sitemaps for products, blog posts and pages so you can see indexing per type in Search Console.
sitemap generator: FAQ
- What is an XML sitemap? A file that lists the pages on your site you want search engines to find, with optional last-modified dates. It usually lives at /sitemap.xml.
- Do I need a sitemap for a small site? Not always, if every page is linked well. It still helps new sites and pages with few links get discovered faster.
- How many URLs can a sitemap have? Up to 50,000 URLs and 50 MB uncompressed per file. Larger sites use a sitemap index that points to several sitemaps.
- Can you upload the sitemap to my site for me? No. Your agent gives you the file and the robots.txt line, and you upload it through your host or CMS.
JavaScript is required to use the todo.is app.