When ever Googlebot tries to access any topic or a category page on my nodebb forum, it encounters a 404. This doesn't happen on browser .. Does anyone else face the same issue ? (NodeBB version is latest 1.8.2).
Yes, the settings the ACP are default settings for the web crawler .. Nodebb is basically giving a session mistmatch error when crawler is trying to access a url. due to which it attempts to redirect to /login and then to /user(which is an undefined route and hence keeps showing 404 on every page).
Go to Manage -> Privelleges. The spiders dont have view access by default. Please give them view access and it will be all fine.
@chdrealtor Thank you!
When creating a new category, in my opinion spiders should have the same access privileges of guests by default, because in most cases people expect their forums to be public and indexed by Google, etc. They can change the settings when creating a private category.
@faizanzahid Those in the screenshot are the global privileges. You want to change the category privileges, selecting each category (see up to the right), at least the root ones. There is also a button to copy privileges to the children categories.
