Robots.txt Generator

Create robots.txt file for your website

Default Crawl Delay (seconds)

Sitemap URL

Directories to Block (one per line)

Allow all search engines to crawl

About Robots.txt

Controls which pages search engines can crawl
Place in root directory of your website
Helps prevent duplicate content issues
Can specify crawl delay to reduce server load

IT Grow Hub Support

Online • Typically replies instantly