Google sitemap

[aleppax]

I've enabled the Google xml sitemap in the root page of my site, (sitemap.xml), and I expect that all the pages of my website will be included in the sitemap. This doesn't happen: the content of the sitemap consists only of the news reader and the (currently fisrt and only) news item (called website):

<?xml version="1.0" encoding="UTF-8" ?> 
- <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.sitemaps.org/schemas/sitemap/0.9 http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd">
- <url>
  <loc>http://www.example.net/0/news-reader.html</loc> 
  </url>
- <url>
  <loc>http://www.example.net/0/news-reader/items/website.html</loc> 
  </url>
  </urlset>

the page

http://www.example.net/0/news-reader.html

has identical settings to other pages that are not included in the sitemap. I don't understand how Contao choose which page to include in the google sitemap.

[aleppax]

a solution came from the Italian forum: the Robots tag in the Meta information section of the editor of a page must be set to: index (ie: the crawler is allowed to index the page).

[nortski]

Also; if you have any of your internal links set to "nofollow" then some automated sitemap generators may not crawl all your pages.

[nortski]

Just a quick tip for you regarding sitemaps. Give it a different name other than sitemap.xml, otherwise your competitors can easily access it.

[Ben_360fusion]

I've just had the exact same problem with the same site one on 2.10.4 and another copy of the site which I then updated to 2.11.

I tried the index, follow meta data but this was already set to to be indexed, so I've tested, and changed settings and tested for a couple of hours but no joy.

I then uninstalled Isotope RC 1.3 from the modules and it works fine now. Just to double check I did this again on the other copy of the site and it worked there too.

My site maps now work, this site didn't need a shop so no worries there.