- Joined
- Jul 25, 2024
- Messages
- 142
- Reaction score
- 131
- Points
- 43
Step 1 :
One misconception that we see often is the use of robots.txt for noindexing of content
Step 2 :
Disallowing search engines to crawl a specific directory on your site does not mean search engines will not index it. The best practice for this case is to use the meta robot tags
Step 3 :
For example, a forum owner would like Google not to index any of their XenForo member’s pages. This can be achieved by placing the following meta tag right before the closing </head> tag inside of the member_view template
Step 4 :
One misconception that we see often is the use of robots.txt for noindexing of content
Step 2 :
Disallowing search engines to crawl a specific directory on your site does not mean search engines will not index it. The best practice for this case is to use the meta robot tags
Step 3 :
For example, a forum owner would like Google not to index any of their XenForo member’s pages. This can be achieved by placing the following meta tag right before the closing </head> tag inside of the member_view template
Step 4 :
Code:
<xf:head option="metaNoindex"><meta name="robots" content="noindex" /></xf:head>