Why I am getting HTTP Head requests against my NodeBB installation?

[Muhammad Saqib]

I am getting a lot of HTTP HEAD requests against some of the endpoints on my NodeBB instance, here are a few of them:

head /category/:category_id/:slug?
head /topic/topic_id/:slug/:post_index?

I wonder why I am getting these requsts with the HEAD method, and given there are no handlers for these requests? Can anybody help? Thanks

[Muhammad Saqib]

Hey @julian, can you please help with the above? Thanks

[PitaJ]

Seems likely that this would be due to spiders/bots crawling the site.

[julian]

Whoever it is, it's not us... as @pitaj suggests it could be bots issuing HEAD requests to determine site availability before crawling? Who knows... I am looking at some of them coming in our logging system now, but they have no user agent either, so