problem is fixed:
I uptated nodejs.
A few users received this error message while trying to login:
It looks like the memory leak has been here longer:
Jan. 24 is when I upgraded from 1.16 to 1.19
I've never had memory issues with NodeBB
Login spawns a process for the password hashing so it doesn't block the main thread.
Does your system have swap configured? How many nodebb processes are being used?
@djensen47 Also for what it's worth, MongoDB also tends to allocate as much memory as is free, for its own use, so it might not actually be NodeBB (although it doesn't hurt to check)
It doesn't usually cause issues with running out of memory, but occasionally can. This is warded off with swapfile usage.
@julian Swap won't solve a memory leak though. In fact, it'll just hide the issue until the server is unmanageably slow, no?
Also, this is new behavior that started sometime between version 1.17 and 1.19 (no issues on 1.16).
I'm replying because we ran into the issue again.
top show? How much traffic is there when it goes down.
Today the node processes are at 32% and 30% of memory.
Redis is steady at 2.6% (roughly same as before).
I can keep going but eventually it's just going to keep growing until all the memory is consumed and then it goes to swap and because the memory isn't freeing up, it's not going to help.
It's a slooow leak but it's a leak.
@djensen47 maybe it's the node-side db cache. I'm not sure what kind of memory limits we set for it. Does the memory usage grow quickly at first and then slow down approaching an asymptote?
Please share output of
top sorted by memory usage and