How can Setup Robots txt in Blog

Robots txt Setup process

 

Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol.

It works likes this: a robot wants to vists a Web site URL, say http://www.example.com/welcome.html. Before it does so, it firsts checks for http://www.example.com/robots.txt, and finds:

Blogger has Provided the Option to Edit and Customize the robots.txt file. This is a Key file for Search Engine Robots.
Using this robots.txt You can Allow or Block the Search Engine Robots to Crawl/Index the pages.

Usually every website has a robots.txt. You can access the robots.txt file using the url  

http://yourblogname.blogspot.com/robots.txt

To Customize the robots.txt file visit this page for Instructions, please be-careful while editing the robots.txt file. 

Enjoy Blogging