» W3Exchange
   http://www.w3exchange.com/index.html
» Web Site Promotion
   http://www.w3exchange.com/view_forum-id-10.html
» robot.txt - Do I need them?
   http://www.w3exchange.com/view_topic-id-180.html

159timer - 2006-09-19 03:06:42

Is robot.txt recommended to be on my web space?

If so, can somebody post me the most common robot.txt script?

(they are short, right?)

Or is it something I don't need to have on my server?

Thank you.

» Print this topic