[RSS Feed/News] Google Indexing /goto/ links

Status
Not open for further replies.

XenForo

Administrative
  • Thread starter
  • Admin
  • #1
I noticed a jump in my indexation last week. Despite having /goto/ blocked in robots.txt, Google indexed 20K URLs. I looked here at XenForo and the same has happened.

Searching Google with site:xenforo.com inurl:/goto/ reveals over 6K URLs.

You can remove these using directory removal, but your indexation numbers will be incorrect.

Thoughts?

ادامه مطلب...
 
Status
Not open for further replies.
Back
Top Bottom