Guest twelves Posted September 27, 2003 Posted September 27, 2003 This is some of the links to the stats. I don’t know how to read stats. Sure it’s a great page. But not that great. I am appearing in the top 4 spot on google for guitar related search phrases. At times Google is spending an hour indexing my page. At times I have 4 spiders indexing my pages. I can see that only 3,000 hits come from Spiders this month. So can you help me before I get booted off this server? My web page means everything to me. I don’t want any problems and I have all PHP code updated to the latest version and all security patches current. http://www.12string.net/modules.php?name=S...month=9&date=27 I need this issue fixed if I am getting hammered by spiders. I know that can have problems with the server CPU. SHEESE>>>>>>> Thanks! Jay! Quote
Wilexa Posted September 27, 2003 Posted September 27, 2003 twelves, It might be a bit early to panic! Having said that, I took a quick look at your robots.txt file and can see that it excludes all "nice" spiders (that follow rules) from many administrative areas of your site. But there is probably a lot more that they can get to. You might want to beef up your robots.txt file to exclude spiders from other areas as well. Or allow googlebot and disallow everyone else. The choice is yours. If you are new to robots.txt, see: ***http://www.robotstxt.org/wc/exclusion-admin.html Good luck. ...dave Quote
Deverill Posted September 27, 2003 Posted September 27, 2003 It looks like something mechanical was happening from midnight to 7am. Do the numbers after 7 seem reasonable for your site? If so I would suspect either a renegade googlebot process went nuts or someone was doing a denial of service attack or something like that. Make sure you submit a helpdesk ticket - the gurus there can track a lot of things with their logs and tools. Best wishes! Quote
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.