Robots.txt Generator - Create Robot Rules

Generate robots.txt files for your website. Allow or block crawlers, set crawl delay, add sitemap URL. Visual builder.

Robot Rules

Crawl-delay: sec Sitemap:

Block AI crawlers (GPTBot, CCBot, Anthropic) Block all crawlers

Generated robots.txt

About robots.txt

robots.txt tells search engine crawlers which pages they can and cannot access. It is placed at the root of your website (e.g., https://example.com/robots.txt).

Related Tools

Meta Tag Generator
SSL Checker
DNS Lookup