Meta robots tag, n.

What is the meta robots tag?

An HTML meta tag in the page head that tells search engines whether to index the page, follow its links and how to show its snippet.

Filed under crawling and indexing in the SEO glossary

Try the free meta tag & open graph checker

What the meta robots tag is

The meta robots tag is placed in a page's <head> as <meta name="robots" content="...">. It gives page-level instructions to every search engine. Replace robots with a crawler name, such as googlebot, to target one engine only.

With no tag, the default is index, follow, so you only need the tag when you want to change that behaviour.

The directives

noindex keeps the page out of results. nofollow asks crawlers not to follow the links on the page. none equals noindex, nofollow. nosnippet hides the text snippet, max-snippet:[n] limits it to n characters, max-image-preview:large allows large image previews and max-video-preview:[n] limits video previews. noimageindex stops images on the page being indexed, and unavailable_after:[date] removes the page after a date.

Directives can be combined with commas, for example noindex, nofollow. If directives conflict, Google applies the most restrictive one.

Meta robots versus robots.txt and headers

Robots.txt controls crawling for whole paths; the meta robots tag controls indexing for a single page, and the crawler must be allowed to fetch the page to read it. For non-HTML files such as PDFs, send the same directives in an X-Robots-Tag header.

Example

Meta robots examples:

<!-- Keep out of results, still follow links -->
<meta name="robots" content="noindex, follow">

<!-- Allow large image previews and full snippets -->
<meta name="robots" content="max-image-preview:large, max-snippet:-1">

<!-- Google only -->
<meta name="googlebot" content="nosnippet">
Check it on your site: Meta tag & Open Graph checkerPreview your Google snippet and social card, and fix missing tags. Free, no signup.
Questions

Frequently asked questions

Do I need a meta robots tag on every page?

No. Without one, search engines index the page and follow its links. Add it only where you want different behaviour.

Does Google support noarchive?

Google retired its cached pages in 2024 and no longer uses noarchive. Other search engines may still respect it.

What does max-image-preview:large do?

It allows Google to show a large image preview from the page, which can help in Discover and image-rich results.

Related terms

Keep learning

Full SEO glossary

More free tools

Check the rest of your SEO

All free SEO tools

Find every issue like this across your site

Fix it automatically, then see what the fix earned.

  • The AI drafts the fix for every issue like this across your site, ranked by impact
  • Approve it and the free WordPress plugin publishes it, with one-click undo
  • 28 days later, the clicks each fix earned, from your own Search Console
Fix my site free Free plan, no card · not on WordPress? Copy each fix in