How can Setup Robots txt in Blog

pcvision | 1:15 AM | | |

Robots txt Setup process
 
Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol.
It works likes this: a robot wants to vists a Web site URL, say http://www.example.com/welcome.html. Before it does so, it firsts checks for http://www.example.com/robots.txt, and finds:

Blogger has Provided the Option to Edit and Customize the robots.txt file. This is a Key file for Search Engine Robots.
Using this robots.txt You can Allow or Block the Search Engine Robots to Crawl/Index the pages.

Usually every website has a robots.txt. You can access the robots.txt file using the url  


http://yourblogname.blogspot.com/robots.txt


To Customize the robots.txt file visit this page for Instructions, please be-careful while editing the robots.txt file. 





Enjoy Blogging

No comments:

Post a Comment

Twitter Delicious Facebook Digg Stumbleupon Favorites More

Search

Blogroll

Blogger Widgets
Google Translation
Powered by Blogger.

BLOG

Free Backlinks