xenforo robots.txt guide – how to use it

Step 1 : Having a robots.txt is extremely important for your XenForo forum. It tells search engines which pages to crawl and which pages to skip. This is your chance to build out a proper structure for the robots.txt file so that it will exclude non-important pages Step 2 : When you install...