XenForo XenForo Robots.txt Guide – How to Use It

[AynaZ]

Step 1 :

Having a robots.txt is extremely important for your XenForo forum. It tells search engines which pages to crawl and which pages to skip. This is your chance to build out a proper structure for the robots.txt file so that it will exclude non-important pages​

​

داشتن یک robots.txt برای انجمن XenForo بسیار مهم است . آن به موتورهای جستجو گفته می‌شود که صفحاتی را کاوش می‌کنند که باید از آن عبور کنند و کدام صفحات را حذف کنند . این شانس شما برای ساخت یک ساختار مناسب برای فایل robots.txt است به طوری که صفحات غیر مهم را حذف کند

Step 2 :

When you install XenForo onto your hosting server, robots.txt is not be included in the package. However, creating one takes less than 30 seconds​

​

زمانی که XenForo را بر روی سرور میزبان خود نصب می‌کنید , robots.txt در بسته گنجانده نخواهد شد . با این حال , ایجاد یک فرد کم‌ تر از ۳۰ ثانیه طول می‌کشد

Step 3 :

​

Here is our recommended robots.txt file for XenForo​

​

در اینجا فایل robots.txt پیشنهادی برای XenForo آورده شده‌است

User-agent: *
Disallow: /find-new/
Disallow: /account/
Disallow: /login/
Disallow: /admin.php
Disallow: /search/
Disallow: /whats-new/
Allow: /
Sitemap: https://domain.com/sitemap.xml

 

[orimex]

Thank you

 

[saeedmo79]

Thank you,

 

[ngbaze]

Step 1 :

Having a robots.txt is extremely important for your XenForo forum. It tells search engines which pages to crawl and which pages to skip. This is your chance to build out a proper structure for the robots.txt file so that it will exclude non-important pages​

​

Step 2 :

When you install XenForo onto your hosting server, robots.txt is not be included in the package. However, creating one takes less than 30 seconds​

​

Step 3 :

​

Here is our recommended robots.txt file for XenForo​

​

User-agent: *
Disallow: /find-new/
Disallow: /account/
Disallow: /login/
Disallow: /admin.php
Disallow: /search/
Disallow: /whats-new/
Allow: /
Sitemap: https://domain.com/sitemap.xml

where should I'll add the robot txt please?

 

[XenForo]

where should I'll add the robot txt please?

public_html
(On your hosting)