Subdomains And Robots.txt

[okok]

Do subdomains need to have robots.txt files of their own, or is there a way to include instructions about them in the base domain name's robots.txt file?

 

Thanks

[DarqFlare]

Each subdomain needs to have its own robots.txt if it is going to be accessed as a subdomain, ie sub.domain.com

 

If you're accessing it using www.domain.com/sub then it doesn't need one and can use the base domain's robots.txt

 

But the whole point of a subdomain is to be used as a sub, so yes. It needs its own.

[okok]

Thanks

[Boojum]

I'm sure this question has been answered somewhere and I'm just missing it, but:

 

What exactly is a robots.txt file?

[TCH-Thomas]

Have a look here. <_>