Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Warning

This feature is NOT supported for: Robots.txt, the capability to prevent search engine crawling on some of all shop pages is not available in any version prior to 3.0.

Key Terms

Excerpt

Robots.txt

Definition from Google

The robots meta tag lets you utilize a granular, page-specific approach to controlling how an individual page should be indexed and served to users in Google Search results. Place the robots meta tag in the <head> section of a given page…

The robots meta tag instructs search engines not to show the page in search results. The value of the name attribute (robots) specifies that the rule applies to all crawlers.

No Index Rules

Definition from Google

noindex is a rule set with either a <meta> tag or HTTP response header and is used to prevent indexing content by search engines that support the noindex rule, such as Google. When Googlebot crawls that page and extracts the tag or header, Google will drop that page entirely from Google Search results, regardless of whether other sites link to it.

Feature Description

Many resorts use hidden categories and products that they do not want publicly available to guests that don’t have exclusive access. Additionally, many resorts want to first route customers through the marketing site in their research before directing them to shopping pages, for these reasons, it can be helpful to block the shop from search engine crawling and indexing.

...