@pitaj That makes sense.
Thank you, I think that answers my question.
I am getting a lot of HTTP
HEAD requests against some of the endpoints on my NodeBB instance, here are a few of them:
I wonder why I am getting these requsts with the
HEAD method, and given there are no handlers for these requests? Can anybody help? Thanks
Hey @julian, can you please help with the above? Thanks
Seems likely that this would be due to spiders/bots crawling the site.
Whoever it is, it's not us... as @pitaj suggests it could be bots issuing
HEAD requests to determine site availability before crawling? Who knows... I am looking at some of them coming in our logging system now, but they have no user agent either, so