Back to Tools

Advanced Sitemap XML Generator

Paste URLs manually or use the Live Auto-Crawler to scan your website and generate a Sitemap.

Auto Crawler

Manual Entry

Website URL to Crawl

Sitemap Configuration

Change Freq

Default Priority

Include Last Modified (Today) Strip Query Parameters (?id=1)

Max Crawl Limit

Build a sitemap.xml from a crawl or a URL list

A sitemap tells search engines which pages on your site you want discovered. This generator offers two ways to make one: an Auto Crawler that follows links from your home page, and a Manual Entry mode where you paste URLs yourself. The output is standard sitemap XML with the usual urlset header, ready to save as sitemap.xml and upload to your site root.

Using the Auto Crawler

Stay on the Auto Crawler tab and enter your site address in Website URL to Crawl, starting with http:// or https://.
Choose a Max Crawl Limit from 20 up to 1000 pages.
Set the Sitemap Configuration options (below), then press Start Crawling.
Watch the console log and the XML fill in live. Press Stop if you have collected enough.
Use Copy or Download XML.

Using Manual Entry

Switch to the Manual Entry tab and type or paste one URL per line. If some lines are relative paths such as /about, fill in the Base Domain field; relative lines are skipped when no domain is given. Click Generate Sitemap. Duplicate URLs are collapsed and trailing slashes are removed.

Configuration options

Change Freq: Auto (based on URL depth) or a fixed value from always to never.
Default Priority: Auto, 1.0, 0.8, 0.5 or 0.1. In Auto, the home page gets 1.0 and deeper pages get lower values.
Include Last Modified (Today): adds a lastmod date to each entry.
Strip Query Parameters: removes anything after a question mark.

The finished XML sits in an editable box, so you can delete unwanted lines before copying.

When it is useful

Creating a first sitemap for a small static or hand-built site with no plugin.
Turning an exported list of URLs from a spreadsheet into valid XML.
Auditing which pages are reachable by links from the home page.
Refreshing a sitemap after a redesign.

Know the crawler's limits

The crawl runs in your browser and fetches each page through public third-party proxy services, so page contents pass through those services and some sites will block or fail to load. It waits half a second between requests, follows only same-domain links, skips common file types such as images, PDFs and zips, and does not read robots.txt or run JavaScript, so links created by scripts will be missed. The lastmod value is simply today's date for every URL, not the real edit date. Pages that fail to load may still be listed, so review the results. For large or frequently changing sites, a server-side generator is a better fit.

Related Articles

Robots Meta Tags Explained: Control How Google Crawls

Related Tools

Frequently Asked Questions

Does the crawler work on any website?

Not always. It fetches pages through public proxy services, which some sites block or rate-limit. It also cannot see links that only appear after JavaScript runs. If the crawl fails, use Manual Entry with a list of your URLs instead.

Are my pages sent to a third party during crawling?

Yes, the crawler requests each page through public CORS proxy services rather than directly, so those services handle the request. Avoid crawling private or staging sites you would not want passing through a third party.

Is the lastmod date accurate?

No. When Include Last Modified is ticked, every entry gets today's date and time. It does not read real modification dates from your pages. Untick the option if you would rather leave lastmod out than publish inaccurate dates.

How do I handle relative URLs in Manual Entry?

Enter your domain, for example https://example.com, in the Base Domain field. Lines starting with a slash or a bare path are then joined to it. Without a base domain, relative lines are skipped and do not appear in the sitemap.

What do I do with the generated file?

Click Download XML, save it as sitemap.xml, upload it to your site's root folder, and submit its address in Google Search Console or reference it in robots.txt. Check the file for any error pages first.