Jump to content

Robots, Php And The Txt File


thedesignstudent
 Share

Recommended Posts

I have a site with 6 php includes. header,footer,right menu, left menu, sales menu, content. Sometimes more for a special menu.

 

Do I need a robots.txt in every .php include for it to be effective? I don't necessarily want the robot crawling all of my headers if my bandwidth is suffering from anything unecessary.

 

I'm doing a php include of a robots.txt file so that way I can universally update it across the platform.

 

 

Yeah, maybe nobody should have clued me in on the basics of php. Even though I haven't started programming as a programmer would, the doors have been opened and I'm using this knowledge everyday.

 

Is 6 php includes for a robots.txt file in every include overkill, or smart use?

I understand it's open to interpretation and I highly value your opinions.

 

 

 

If anyone else is doing something similar, it would be fun to hear what you're up to;definitely participate.

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

 Share

×
×
  • Create New...