lfedje Posted July 21, 2005 Posted July 21, 2005 I have 2 sites on Total Choice both with a relatively small number of visits, 20-30 for 1 site and 40-60 for the other per day. The page loads have been coming in at about 160 and 200 respectively for these sites, however yesterday, with relatively the same number of visits I had 5 times the normal page loads, both in at about 1,000. (these sites are 30 and 40 pages respectively) The only change that I made was to insert the new Google sitemap.xml to both of the sites. Is it possible that Google came in 4 times, looked at all of my pages, but didn't show up as a spider visitor, or is it possible that Google plus a few more engines came in and used the same file, again not showing up as spider visitors. The 3 major engines came to the site last night but show only very minor acitivity. For one one of the sites Inktomi looked at 5 pages and .13MB, MSN 0, and Google 4 pages and 11k. On the other site Inktomi looked at 15 pages at .59MB, MSN 1 page and .06MB and Google 5 pages and .07MB. The only other possibility that I can think of is that someone came in and just started flipping pages, but to do that to both sites would seem very coincidenal. Any ideas? Regards: Loren Quote
TCH-Bruce Posted July 21, 2005 Posted July 21, 2005 Welcome to the forums Loren It's possible that Google is the culprit. Quote
lfedje Posted July 21, 2005 Author Posted July 21, 2005 (edited) Thanks for the Welcome. It could be, but I would expect to have seen some Google results if they looked at an estimated 30 MB of download. Loren Edited July 21, 2005 by lfedje Quote
TweezerMan Posted July 21, 2005 Posted July 21, 2005 Welcome to the forums, Loren! If you want to know for sure who requested all of the pages, I'd suggest downloading and examining the access logs for your sites. Quote
lfedje Posted July 21, 2005 Author Posted July 21, 2005 Thanks for the Welcoming remarks everyone. To this point all I have done from the cPanel is use the File Manager, Password Protect and a couple of minor other things. There is a lot there and as usual with anything, a lot to learn. I downloaded my access log, as suggested by David, for one of my sites and when I try to open it with WinZip I get the following error: Error reading header after processing. I know that WinZip handles .tar files so I am a at a bit of a loss here. Loren Quote
TCH-Bruce Posted July 21, 2005 Posted July 21, 2005 I usually download the raw log file right from the main cpanel page. It gives you a .gz tar file that I open with Winzip. Inside that will be a file the same name as your domain which is a text file. You can open it with Notepad or any other text file editor. Try redownloading it. Quote
lfedje Posted July 21, 2005 Author Posted July 21, 2005 When I download it I get .tar file when it should be .tar.gz, I think. I change the name to .tar.gz and Winzip opened it and inside is a file called domainname.com and you say it should be a .txt file. I must be doing something wrong. Loren Quote
TCH-Bruce Posted July 21, 2005 Posted July 21, 2005 No, it will have a .com extension (or what ever your domain extension is) but it is a text file. Quote
lfedje Posted July 21, 2005 Author Posted July 21, 2005 I got it open by renaming the file .tar.gz and the file was domainname.com. I right clicked on it and opened it with notepad. Now I have to try to figure out how to read the info. 21 days of site activity is something to behold. Once I narrow it down to the 20th and 21st, I may be able to work with it. It looks like each line starts with a date and time so that should help. Thanks for the assistance, I'm sure I will be back. Regards: Loren Quote
TCH-Bruce Posted July 21, 2005 Posted July 21, 2005 Notepad is probably treating it all as one long line. If you use a program like Wordpad or programming editor it will be easier to read. In fact the internal viewer of Winzip works better than Notepad. Quote
lfedje Posted July 22, 2005 Author Posted July 22, 2005 Thanks Bruce I used the Winzip internal viewer and then copied all of the line items for the date in question over to Excel. I couldn't really find anything unusual. This could be a simple error in the stats. As an example, I will use the site that I did not modify on the 20th. 19th - 40 visitors, 166 Page views, 2730 hits, 12.89 MB 20th - 43 visitors, 914 Page views, 3324 hits, 30.35 MB 21st - 27 visitors, 126 Page views, 2238 hits, 10.32 MB If there were in fact 914 Page views on the 20th, I would think that the hits would go up in direct relationship to the page views. The stats that I recorded for the 20th do not show any hits on the new sitemap.xml file, however, Google hit on this file several times on the 21st. My initial comment therefore doesn't hold water. Interesting, isn't it. Loren Quote
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.