XenForo Robots.txt and NoIndex Rule

El Bana

Active member
Registered
Joined
Jul 25, 2024
Messages
142
Reaction score
131
Points
43
Step 1 :

One misconception that we see often is the use of robots.txt for noindexing of content

Please, Log in or Register to view quote content!

Step 2 :

Disallowing search engines to crawl a specific directory on your site does not mean search engines will not index it. The best practice for this case is to use the meta robot tags

Please, Log in or Register to view quote content!

Step 3 :

For example, a forum owner would like Google not to index any of their XenForo member’s pages. This can be achieved by placing the following meta tag right before the closing </head> tag inside of the member_view template

Please, Log in or Register to view quote content!

Step 4 :


Code:
<xf:head option="metaNoindex"><meta name="robots" content="noindex" /></xf:head>
 
Back
Top