Technical SEO
Sitemap
An XML sitemap is a structured file that lists the important URLs of a website along with optional metadata (last modified date, change frequency, priority) to help search engines discover and crawl content more efficiently. While not a mandatory requirement, sitemaps are strongly recommended for large sites, new sites, and sites with complex or dynamic content.
Sitemaps are submitted through Google Search Console's Sitemaps report, where submission status and indexing coverage can be monitored. They are generated by CMS plugins (Yoast SEO, Rank Math), Screaming Frog, or XML-Sitemaps.com. Ahrefs and SEMrush audit sitemaps for errors such as non-200 status URLs, noindexed URLs, and missing pages.
Authority Links
Related Terms
Technical SEO
Crawl Budget
The number of URLs a crawler will fetch on a site within a given timeframe — a function of server capacity (crawl rate limit) and content popularity/freshness (crawl demand).
Technical SEO
HTML Sitemap
Sitemaps specially designed for users are called HTML sitemaps.
Technical SEO
Sitemap Command
Refers to the Robots.txt command that shows bots the path to the sitemap.
Technical SEO
Robots.txt File
A plain-text file at the root of a domain that uses the Robots Exclusion Protocol to tell compliant crawlers which paths they may or may not request.