Why use robots meta tags?

They control how a specific page appears in search results: whether it can be indexed, whether links can be followed, and how snippets or previews may be shown. This is better for page-level control than robots.txt.

How is noindex different from robots.txt Disallow?

noindex is a signal found after the page is crawled. Disallow blocks crawling, which can prevent crawlers from reading noindex. If search removal is the goal, make sure the page can be accessed enough for noindex to be seen.

Do I need a Googlebot-specific tag?

Most pages only need the general robots tag. Add a Googlebot or Bingbot tag when one search engine needs different snippet or preview rules from the general rule.

Are my settings uploaded?

No. Robots meta tag generation runs inside your browser. Selected directives and generated HTML are not sent to or stored by berryfy.

Robots meta tag generator

Choose page-level indexing, link following, snippet, image preview, and video preview rules, then generate robots meta tags for your HTML head.

Robots meta settings

Choose indexing, link, and preview directives for each search crawler target.

Crawler targets

robotsApplies to most search enginesgooglebotGoogle Search crawler onlybingbotBing Search crawler only

IndexingLink following

SnippetMax snippet length-1 means no limit. 0 means no text snippet.

Image previewMax video preview-1 means no limit. 0 allows only a static image preview.

Extra restrictions

noarchiveLimit cached page linksnoimageindexLimit image indexing from this pagenotranslateLimit translation links

Generated result

1 tags, 3 directives

<meta name="robots" content="index, follow, max-image-preview:large">

indexfollowmax-image-preview:large

This keeps normal search visibility while allowing rich previews.

Control page-level search indexing

robots.txt gives crawlers site path hints, while a robots meta tag controls how an individual page should appear in search. Use directives such as noindex and nofollow when a specific page should stay out of results or should not pass link signals.

You can generate a general robots tag and optional Googlebot or Bingbot tags at the same time. Snippet length, image preview size, video preview time, cache, image indexing, and translation restrictions are combined into one clean tag set.

Paste the generated tags into the HTML head of the page. If you want search engines to see noindex, the page must still be crawlable enough for the tag to be read. Everything is generated in your browser, and your settings are not sent to berryfy.

Continue with tools that fit the same task flow.

DeveloperCSV to JSONConvert CSV tables into readable JSON locally, with header handling, delimiter detection, row warnings, and copy-ready outputOpen DeveloperCSV to Markdown tableConvert CSV rows into a clean Markdown table locally, with delimiter detection, header handling, alignment, and copy-ready outputOpen DeveloperJSON formatterPretty-print or minify JSON and locate parse errors by line and columnOpen