Large Log Files

[Guest helpbytes]

Basically I happened to notice about 0000 (GMT i'm on UK1 server) that the processing time for my pages was about 0.8 seconds, its usually in the 0.002 region. It occured to me that the stats update at this time.

 

I downloaded my access logs, it was a 10MB gzipped download, which extracted to 188MB on my PC, from what I understand of awstats, it notes where it left off in the file and doesn't process those lines, but as this is 10 days worth, thats 20MB a day still on this domain. (I get about 3 500 visitors a day, each takes about 10 hits

 

Anyway, I notice the stats begin to update at 2350 and my stats didn't actually update in cpanel until 0035 did it really take this long to process? Awstats benchmark says that for my monthly visits (about 42 000) it will take about 10-50minutes if processed daily with dns lookup.

 

I would have thought as this could be processor intensive, a better time would be along 0800GMT when american time this is about 0000 which is rather late, its early UK, its early (GMT+1) in the EU, obviously it's not so great further east.

 

Is it allowable to edit the config files for awstats in directory(i.e. will changes take effect), there is no mention of this being permittable; I could set it to allow a browser update and to allow it to purge my logs each run too, as well as perhaps disable DNS lookup, this would speed things up considerably too.

[TCH-Dick]

Yes you can modify the config file for Awstats. which is located in the tmp directory and don't forget to change the permissions (chmod 444). If you don't doe this the server will overwrite your changes on the next update.

[TCH-Andy]

Hi helpbytes,

 

Welcome to the family

 

Log files will run overnight (GMT) for European servers, since the load is lowest then. If loads were primarily caused by Amercans connections, then it would be best to host that site on an American server, and not a European server.

 

Remember that it is the stats for all sites bring updated, so it does take a while to update the stats for the whole server. This is also why we run it once per day, overnight.

[Guest helpbytes]

Of course when I said 42 000 a month, I actually meant 110 000 (30 days in a month, not 12 ), dont try and do things that late.

 

Thank you for the information, I think I will see how it goes on UK1 for now, and I put in a ticket for the status pages so maybe I can learn more

[TCH-Bruce]

Welcome to the forums helpbytes