Sitemaps
There is no limit on how many sitemaps you can use for your website and there is no limit on how many urls each sitemap contains.
If a valid XML sitemap is detected in your robots.txt file, our indexing robots will not follow links in your website and will only retrieve links from your sitemap file.
Sitemaps should contain links to all of the products in your online shop.
Our indexing robots will decompress any XML files that have been compressed with gzip.
For better control over when the Start Shopping bots process your sitemap files use the lastmod tag in your sitemap index file. Our bots will then only re-process your sitemap files when the lastmod date changes.
For better control over when the Start Shopping bots process your website pages that are in your sitemap files use the lastmod tag in your sitemap files. Our bots will then only re-index your website pages when the lastmod date changes.
If the lastmod date has not changed in 12 months, then your sitemap files will be checked or re-processed as a yearly check and website pages will be checked or re-indexed as a 6 monthly check.
If you have created an XML sitemap for your website add the following line to your robots.txt file for each sitemap:
Sitemap: http://www.yourwebsite.com.au/sitemap.xml
Your XML sitemap must have the following node structure and must follow the XML specification:
         <?xml version="1.0" encoding="UTF-8"?>
         <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
          <url>
           <loc>http://www.yourwebsite.com.au</loc>
           <product:title>![CDATA[Website Page Title]]</product:title>
           <product:description>![CDATA[Product Description]]</product:description>
           <product:price>29.99</product:price>
           <product:currency>AUD</product:currency>
           <product:image:url>http://www.yourwebsite.com.au/images/product_image1.png</product:image:url>
           <lastmod>2018-04-02</lastmod>
          </url>
          <url>
           <loc>http://www.yourwebsite.com.au/products</loc>
           <product:title>![CDATA[Website Page Title]]</product:title>
           <product:description>![CDATA[Product Description]]</product:description>
           <product:price>29.99</product:price>
           <product:currency>AUD</product:currency>
           <product:image:url>http://www.yourwebsite.com.au/images/product_image1.png</product:image:url>
           <lastmod>2018-04-02</lastmod>
          </url>
         </urlset>
Sitemap Optional Tags
Additional optional tags:
  • product:title
  • product:description
  • product:price
  • product:currency (product:currency must be included if using product:price)
  • product:image:url
  • These tags for the sitemap xml file are an optional extra you can use to help streamline the indexing of pages in your website.
    By including these optional tags for each url in the sitemap file all of the pages in your website that you submit to the Start Shopping search engine will be available for searching immediately, thus eliminating the need for the indexing bots to hit each page in your website to have the pages included in our search engine.
    Each time in future when the sitemap files are re-processed these optional tags of the urls already in our search engine will be updated, thus providing a faster way to update the pages of your website in our search engine.
    In future when the indexing bots hit each of the urls that you have provided through the sitemap files that are using these optional tags the indexing bots will perform a HEAD request, instead of a GET request, to determine whether the url is still a valid url in your website. This helps to reduce the amount of data our indexing bots download from your website.
    Sitemap Index Files
    Our indexing robots also support sitemap index XML files. These are XML files that contain one or more links to sitemaps for your website.
    Your XML sitemap index must have the following node structure and must follow the XML specification:
             <?xml version="1.0" encoding="UTF-8"?>
             <sitemapindex xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
              <sitemap>
               <loc>http://www.yourwebsite.com.au/sitemap1.xml</loc>
               <lastmod>2018-04-02</lastmod>
              </sitemap>
              <sitemap>
               <loc>http://www.yourwebsite.com.au/sitemap2.xml</loc>
               <lastmod>2018-04-02</lastmod>
              </sitemap>
             </sitemapindex>