Robot Text File (Spider)|search engine optimization | SEO tutorials | SEO optimization

Robot Text File (Spider)

What is Robot.txt file?

The robots.txt file is a set of rules for visiting robots (spiders) that index the content of your web site pages on the search engines linke google and etc.. For those spiders that obey the file, it provides a index for what they can do, and cannot index. The file must reside in the root directory of your web on search engines. This is known as Robot.txt file.


search engine marketing tips or tutorials

0 comments: