Overriding robots.txt

**Stevo** · 25-05-2012, 11:35

Hi

I've read in old BP forum threads that there's no way to edit robots.txt. Can anyone confirm if this is still the case?

Assuming it is, here's another question. If I add something like this to the <head> tag (via Template Editor > Site > Head section)...

HTML Code:

<meta name="robots" content="index, follow, archive, noimageindex, noimageclick" />

...would that override any pre-existing settings in robots.txt at the site root?

Thanks

Steve

**Dave** · 25-05-2012, 14:47

Hi Steve,

Originally Posted by Stevo

I've read in old BP forum threads that there's no way to edit robots.txt. Can anyone confirm if this is still the case?

Yes that's correct.

Originally Posted by Stevo

HTML Code:

<meta name="robots" content="index, follow, archive, noimageindex, noimageclick" />

...would that override any pre-existing settings in robots.txt at the site root?

Yes it would.

**Stevo** · 25-05-2012, 16:13

Thanks Dave.

On a related note, I was hoping there would be a way to exclude the contents of a certain folder from being indexed (the categories thumbnails), but of course that's one that would require access to robots.txt. I'm sure most people don't need access to it beyond what they can do in the meta robots tag, but it would be nice if editing of the .txt file was something that could be carried out from the admin interface in a future BP release - it would enable us to do a bit more than the meta tag allows.

Thread: Overriding robots.txt

Thread Tools

Overriding robots.txt

Similar Threads

robots.txt

robot.txt file - where?

Overriding backorder prevention via remote control

Posting Permissions