Meta Tags

MetaExtension robots

Is used to tell crawler-robots of search engines which sites to index. We recommend using a robots.txt-file (opens in a new tab) insteads of those meta-extensions or a combination of both.


<meta name="robots" content="noindex,nofollow">

content may be:

allStandard: No restrictions, indexes all pages, doesn't need to be specified
index,followEquivalent to all
noindexPage will not be shown in search results
nofollowDo not follow (internal) links on this page
noneEquivalent to noindex, nofollow
noarchiveDo not cache the page, do not show a "Show in cache"-link in search results
nosnippetDo not show a text/video snippet in search results
notranslateDo not offer translation of this page in search results
noimageindexDo not index images on this page, do not show images in search results
unavailable_after: [date/time]Do not show this page in search results after [date/time]

Usage samples

<meta name="robots" content="index,nofollow">
<meta name="robots" content="index,follow">
<meta name="robots" content="noindex,nofollow,noarchive">
<meta name="robots" content="index,follow,nosnippet">
<meta name="robots" content="index,unavailable_after: 2021-08-18">


  • nosnippet:

    FEN MetaTag DocumentationNo description available
  • noarchive & notranslate:

    FEN MetaTag DocumentationFEN MetaTag Documentation for HTML and popular Meta Tags

Read more about the MetaExtension robots at Google Search Central (opens in a new tab). Read more about robots.txt at Google Developers Docs (opens in a new tab).

Also see revisit and revisit-after.