Jump to content

What Is Its A Pic Web Crawler About?


Recommended Posts

I notice that a new web crawler, its a pic dot com, is pulling message posts repeatedly from my SMF forums. Every hour pulling data at a rate 2 times my normal daily traffic. (I submitted a ticket to support already).


It looks like it changes the message every minute. (Pulling the same message about 20 times per minute.


I don't know if anyone else is experiencing the same issue or not but a quick look at my bandwidth report was a shocker.


Does anyone have any info about this thing?

Link to comment
Share on other sites

You could try contacting the owner of the crawler if it's misbehaving:




itsapic.com crawler is designed to respect the robots.txt exclusion directives and META robots tags, and collect material at a measured, adaptive pace unlikely to disrupt normal website activity.


Our crawler identification includes itsapic.com_crawler.


If you notice our crawler behaving poorly please send us email at the address as indicated in crawler identification string.

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.


  • Create New...