Robots.txt Generator

Create a robots.txt file to control how search engines crawl your website. Specify which pages to allow or disallow.

Configure Robots.txt

User Agent Name

Rules

Crawl Delay (seconds, optional)

Sitemap URL (optional)

Configure your settings and click generate