Robots.txt Folder?

[signatures]

Just a question on this robots.txt folder?

here is an example of some of my stats, i know the + are the hits for the folder, now is this good or bad....? what's the difference if i don't have the robots.txt folder? it's really just empty, right? thanks in advance, dave

 

 

Robots/Spiders visitors (Top 25)

11 different robots* Hits Bandwidth Last visit

Inktomi Slurp 250+189 821.08 KB 21 Mar 2005 - 22:50

Unknown robot (identified by hit on 'robots.txt') 0+61 0 21 Mar 2005 - 09:22

Googlebot 15+10 40.90 KB 20 Mar 2005 - 04:40

Unknown robot (identified by 'crawl') 7+11 4.42 KB 19 Mar 2005 - 18:06

AskJeeves 10+7 52.38 KB 20 Mar 2005 - 20:52

Unknown robot (identified by 'spider') 10+4 16.92 KB 18 Mar 2005 - 13:39

MSNBot 8+4 42.78 KB 20 Mar 2005 - 17:28

Alexa (IA Archiver) 5+6 21.58 KB 18 Mar 2005 - 14:10

Walhello appie 3+3 13.67 KB 19 Mar 2005 - 23:43

Voila 3+3 16.64 KB 16 Mar 2005 - 16:46

Scooter 2+2 13.00 KB 13 Mar 2005 - 23:09

[TCH-Andy]

Hi Dave,

 

It depends if you want to control where those robots / spiders go to.

 

If you are happy for them to follow all links, then yes, a blank file is fine.

[signatures]

Hi Dave,

 

It depends if you want to control where those robots / spiders go to.

 

If you are happy for them to follow all links, then yes, a blank file is fine.

<{POST_SNAPBACK}>

 

 

great, then i will leave it as is for now.....dave