Meta Tag Robots: noindex & nofollow
Our indexing robots use the meta tag robots and will not included pages in the search that are tagged with noindex and will not follow links in pages that are tagged as nofollow.
The nofollow part of the robots meta tag is essentially out of date and you should be using the Anchor Tag NoFollow instead.
Examples:
        <meta name="robots" content="noindex, nofollow">
        <meta name="robots" content="noindex">
        <meta name="robots" content="nofollow">