Hi Baris,
thanks for help. We finally figured it out. It was a simple error in our plugin that caused restarting NodeBB.

We are running the latest version - v3.7.1 and the forums runs in multiple nodebb processes.

I created a bug report here: https://github.com/NodeBB/NodeBB/issues/12449