Part of us dragging our heels on that one is a sense of it not being broken, so there's no need to fix, heh.
There is a certain wisdom there, too oft reserved for unix grey beards... Heh....
When ever Googlebot tries to access any topic or a category page on my nodebb forum, it encounters a 404. This doesn't happen on browser .. Does anyone else face the same issue ? (NodeBB version is latest 1.8.2).
Do spiders have the proper permissions in the ACP?
Yes, the settings the ACP are default settings for the web crawler .. Nodebb is basically giving a session mistmatch error when crawler is trying to access a url. due to which it attempts to redirect to /login and then to /user(which is an undefined route and hence keeps showing 404 on every page).
Can confirm that, same happens to me.
Wasted 3 days already for that.
Go to Manage -> Privelleges. The spiders dont have view access by default. Please give them view access and it will be all fine.
@chdrealtor Thank you!
When creating a new category, in my opinion spiders should have the same access privileges of guests by default, because in most cases people expect their forums to be public and indexed by Google, etc. They can change the settings when creating a private category.
@baris Wow, thank you!
@writehow I only see this in my ACP i dont see any way to give them view access.
@faizanzahid Those in the screenshot are the global privileges. You want to change the category privileges, selecting each category (see up to the right), at least the root ones. There is also a button to copy privileges to the children categories.