Skip to content

What Is a Sitemap and What Is It For?

A sitemap is a file that lists a website's important pages for search engines. It makes crawling easier, but it does not guarantee indexing. The article explains the limits of an XML sitemap, how to create one, and how to submit it to Google Search Console.

Nurullah Okatan · Content Writer
· Updated: · 14 min read

What Is a Sitemap and What Is It For?

A sitemap (site map) is a file that lists the addresses of a website's important pages for search engines. It helps pages get discovered faster and more completely; on most sites it is generated automatically and its address is submitted through Google Search Console.

What is a sitemap?

According to the Conductor guide, an XML sitemap is a special document that lists the pages of a site and gives search engines an overview of its current content. Search Engine Journal also defines it as a file listing a site's URLs. In short, it is an inventory telling crawlers "this site has these pages."

The Effects of Using a Sitemap on SEO

What does an XML sitemap file contain?

The file is written in a tagged structure that resembles HTML, but it is addressed to machines rather than visitors. At the very top is the urlset tag. Each page opens with a url tag. Inside it, the loc tag giving the page's full address is mandatory. The lastmod tag, which shows the date the page was last changed, is optional, but if it is kept accurate it tells crawlers which page should be re-crawled.

Does sitemap.xml become a single file or several files?

On a small site a single file is enough. When the number of pages grows, or when content is to be separated by type, the map is split into several files. Articles, products and categories are kept in separate files. These files are gathered by a parent file called a sitemap index.

AI assistant for this topic

Türk Bilişim AI answers your questions instantly
Online
  1. Hi! Ask whatever you're curious about.

What does a sitemap give search engines?

A sitemap makes it easier for a search engine to find the pages of a site. A crawler normally moves from page to page following links. A recently published page, or one with weak internal links or missing from the menu, may be found late this way. The addresses in the map, however, are given to the crawler directly.

Does a sitemap guarantee that a page is indexed?

No. According to LetterCounter data, sitemaps help search engines discover URLs but do not guarantee indexing. Google crawls a page listed in the map and evaluates its content. It may not index a page it considers thin, duplicate or low quality. The map ensures a page is found; the content itself determines whether it ranks.

How does crawl efficiency work together with robots.txt?

The two files complement each other. robots.txt tells bots which sections they should not enter. The sitemap shows the pages that should be crawled. The bot spends its limited crawl budget on real content pages rather than admin panels, search result pages or filter URLs.

If two files conflict, the bot is left uncertain. When an address blocked by robots.txt is also listed in the sitemap, Search Console reports it as a warning. Consistency between these two files is among the first technical issues examined in search engine optimization audits. The sitemap's address can also be written at the end of the robots.txt file with a "Sitemap:" line, so that search engines that do not use Search Console can also find the file.

Looking for Automatic SEO Article Generation?

URL and size limits of an XML sitemap

According to LetterCounter data, the official Sitemaps.org protocol and Google guidelines limit an XML sitemap file to 50,000 URLs and 50MB uncompressed. The Conductor guide also says that no more than 50,000 URLs should be listed in a single file. Whichever of the two limits is reached first, the file should be split at that point.

LimitValue
Maximum URLs in a single file50.000
Maximum size of a single file (uncompressed)50MB
Size limit before 201610MB
Number of maps an index file can reference50.000
Theoretical maximum URLs with an index2.5 billion

How do large sites that exceed the limits use a sitemap index file?

An index file does not list URLs; it lists the addresses of the other map files. According to LetterCounter data, one index file can reference 50,000 separate maps. Theoretically this comes to 2.5 billion URLs. In practice, a large e-commerce site places products, categories and blog posts in separate files. Only the index address is submitted to Search Console.

When did the file size limit change?

According to LetterCounter data, the file size limit was raised from 10MB to 50MB in 2016. Both limits have stayed the same since then. The URL limit has been 50,000 from the beginning.

How is a sitemap created and submitted to Google?

Most content management systems generate the sitemap themselves; writing it by hand only makes sense for static and very small sites. First check whether the site already has a ready-made map, then submit its address to Google.

Sitemap Creation and Management Methods

Where is the sitemap located on a WordPress site?

The WordPress core generates a sitemap automatically. The map is usually opened by appending /wp-sitemap.xml to the domain name. If an SEO plugin is installed on the site, the plugin may disable the core map and publish its own. In that case the address is set in the plugin's settings. To avoid submitting a wrong address, first try opening it in a browser.

What problems come up with an automatically generated map?

The automatic method is easy, but wrong URLs may end up in the map. Tag and author archives, empty categories, attachment pages or drafts opened for testing may appear in the list. If two different plugins generate maps at the same time, two separate files result. For this reason, after the initial setup the map should be read through line by line once.

What are the steps to add the sitemap address in Search Console?

  1. Select the property of your site in Google Search Console.
  2. Open the Sitemaps page under Indexing in the left menu.
  3. In the "Add a new sitemap" field, enter the part of the map address that comes after the domain name.
  4. Press the Submit button.
  5. In the Status column, check for the word "Success" and the number of URLs found.

After a map is submitted once, Google reads it regularly. Türk Bilişim, which calls itself Türkiye's best AI Chatbot & Customer Assistant firm, provides maintenance, updates and support after publication. The firm has been working as a digital agency since 1998. Monitoring the sitemap and Search Console reports falls within the scope of the Performance, Security & SEO service.

Common mistakes in sitemaps

The most common mistake is including addresses you do not want indexed. A sitemap should contain only the final, directly accessible addresses you want indexed.

Which URLs should not be added to the sitemap?

  • Pages carrying a noindex tag
  • Addresses that redirect to another page
  • Deleted pages returning a "Not found" or "permanently removed" error
  • Sections blocked by robots.txt
  • Duplicate pages whose canonical tag points to another address
  • Addresses carrying filter, sort and session parameters
  • The http and https, or www and non-www, second versions of the site

How can you notice wrong URLs getting into the sitemap?

Search Console's Pages report separately filters the addresses that come from the sitemap. Rows such as "Submitted URL marked 'noindex'" or "Page with redirect" show addresses that should not be in the sitemap. If the URL count in the sitemaps report is much higher than the site's actual page count, the sitemap has become bloated. After correcting it, the sitemap is resubmitted and the count in the reports drops within a few crawls. Other articles on technical SEO are gathered under the SEO and search engine optimization category.

Looking for Google Ads & Performance Marketing?

Frequently asked questions

Can a site appear on Google without a sitemap?

Yes. Google also finds pages through external and internal links. A sitemap prevents pages that are hard to reach through links from being overlooked.

Does a small site with few pages need a sitemap?

On a small site where all pages are connected through the menu it is not mandatory. A sitemap is still harmless and speeds up discovery when new pages are added.

How often should a sitemap be updated?

Whenever a page is added, deleted or its address changes. Sitemaps generated by content management systems do this automatically; for a hand-written sitemap, changes must not be forgotten.

Should the sitemap address be written in the robots.txt file?

It can be, and it is recommended. The line starts with "Sitemap:" and contains the full address of the sitemap; if there is an index file, only its address is enough.

Have a project?

Türk Bilişim · Free Quote

Get a free quote for your SEO (Search Engine Optimization) project

Leave your number and we will get back to you right away. The call is free.

Read the privacy notice

Nurullah Okatan Content Writer

The editorial desk of a team delivering websites, e-commerce and software projects since 1998.

LinkedInInstagramFacebook

Share this article

Comments

Comments

No comments yet.

Write a comment

Your rating (optional)

Privacy notice

We will send a confirmation link to your email so that your comment can appear.

Regional Services

Looking for SEO & Search Engine in your city?

We also provide this service in your region. Related regional pages:

See all regional services

Türk Bilişim · Digital Transformation Advisor

Online
Hi! Tell us the project or idea on your mind and let’s begin together.
Ask anything, Türk Bilişim AI answers instantly.