Robots.txt Generator

Create and Customize Your Robots.txt File to Control How Search Engines Crawl Your Site.

Leave blank if you don't have.

Google
Google Image
Google Mobile
MSN Search
Yahoo
Yahoo MM
Yahoo Blogs
Ask/Teoma
GigaBlast
DMOZ Checker
Nutch
Alexa/Wayback
Baidu
Naver
MSN PicSearch

The path is relative to the root and must contain a trailing slash "/".

Robots.txt Generator is an best online tool that helps website owners create a proper robots.txt file for their sites.

How to use Robots.txt Generator tool:

1 step: Enter your website’s URL into the tool.

2 step: Select which sections of your site should be accessible to search engines and which should remain restricted.

3 step: The tool generates a custom robots.txt file based on your selections.

4 step: Downloaded the file and upload it to the root directory of your site.

Example www.abc.com/robots.txt