- Compatible XF Versions
- 1.2 , 1.3 , 1.4 , 1.5
- Visible Branding
- No
Description:
Disallows robots from indexing your site unless explicitly allowed.
(Robots link in Visitors tab)
Features:
Set the Administrative user group permissions to Allow. This allows Admin to see the Robots link under the Visitor tab.
Questions and Answers:
Q: What is the purpose of this add-on?
A: Lots of robots crawling your forum will slow it down.
Q: I noticed a robot crawling my site but it's identified as a guest.
A: You need to add the name to the Blacklist field in the Options page.
Q: What happens when a robot is blocked?
A: It receives a blank page.
Q: Why not use the robots.txt file to restrict robots?
A: Because robots ignore this file.
Database modifications:
This add-on will create a table called xf_robots in your database.
Disallows robots from indexing your site unless explicitly allowed.
(Robots link in Visitors tab)
Features:
- All phrases start with robots_ for your convenience.
- Download robots_v2.2.zip and unzip it.
- Upload the Andy folder to your server. The correct location is library/Andy.
- From your Admin Control Panel, go to the "Install Add-on" page.
- Upload the addon-Robots_v2.2.xml file.
- Click the Install Add-on button.
Set the Administrative user group permissions to Allow. This allows Admin to see the Robots link under the Visitor tab.
Questions and Answers:
Q: What is the purpose of this add-on?
A: Lots of robots crawling your forum will slow it down.
Q: I noticed a robot crawling my site but it's identified as a guest.
A: You need to add the name to the Blacklist field in the Options page.
Q: What happens when a robot is blocked?
A: It receives a blank page.
Q: Why not use the robots.txt file to restrict robots?
A: Because robots ignore this file.
Database modifications:
This add-on will create a table called xf_robots in your database.