Questions about the setup for community.nodebb.org
-
@baris said in Search crashes MongoDB and NodeBB:
This forum is hosted on a 4gb($20/month) droplet.
That's 4GB, 2 CPUs, and 80GB SSD
- Is the entire forum hosted on the same server? NodeBB and MongoDB?
- Are you using clustering?
- If yes to clustering, are you setup for two instances (or for each CPU)? Or more?
- Are you using a Redis server for pub/sub for sessions?
- Do you have 6000 pageview per hour from bots?
-
This post is deleted!
-
- Is the entire forum hosted on the same server? NodeBB and MongoDB?
Yes
- Are you using clustering?
Yes
- If yes to clustering, are you setup for two instances (or for each CPU)? Or more?
2 node procs
- Are you using a Redis server for pub/sub for sessions?
Yes redis is used for pubsub and sessions
- Do you have 6000 pageview per hour from bots?
Pageviews from bots range from 2.5k to 5k per hour. And seesm to spike every 4 days.
-
(Was going to update the existing 3 to 4 but saw that you might already be answering those)
- About how much memory is being used by
- Each nodejs instance
- Redis (answered 250MB)
- MongoDB (though this should be the same as #6 above but I noticed my instance uses more)
- About how much memory is being used by
-
- Do you manually set the amount of memory for WiredTiger or just go with the default 50% - 1GB?
Default settings
- Any special settings for redis?
in redis.conf
maxmemory 250000000 maxmemory-policy volatile-lruThis limits redis to 250mb memory and evicts least recently used keys when memory is reaches 250mb.
- Do you use nginx to serve static assets?
Yes
-
IIRC nginx also handles the 503 page
-
Thanks for the info. It looks like I need 2 CPUs for the nodebb server and to setup a redis instance (somewhere).
Last thing, do 503s caused by load get logged? If not, how can I change it so that they are logged. I want to measure current 503 occurrences vs. any after I make these changes. Basically, I want to make sure throwing more money at the problem (more/better instances) fixes it.
-
do you know the correct way to add clustering on node bb ?
-
@faizanzahid Yes, it's in the docs: https://docs.nodebb.org/configuring/scaling/
Do not create more processes than CPUs. It's not advised as the results of doing such a thing are unpredictable.
-
Ugh, I turned on clustering and now Socket.IO is broken ...
POST https://www.axisandallies.org/forums/socket.io/?EIO=3&transport=polling&t=MUiNOWE&sid=q1ikZjbjopxQbJZxAAYo 400 (Bad Request) -
I had to set the load balancing algorithm in HAProxy to
sourcewhich is the same or similar toip_hashin nginx. -
@djensen47 What did you set it to?
-
balance source hash-type consistentI've updated my haproxy config here: https://community.nodebb.org/topic/13315/haproxy-config
It probably needs a little more explanation that is there but it's an example to get you started.
-
@baris How do I know if the pub/sub is working for sessions?
Some uses are reporting the logout problem after I turned on clustering and setup redis for pub/sub. But I haven't experienced it yet today but I haven't been on much.
Until I turned on IP sticky sessions, the site was erroring out on websockets (which might be unrelated).
-
@djensen47 said in Questions about the setup for community.nodebb.org:
Until I turned on IP sticky sessions, the site was erroring out on websockets (which might be unrelated).
Not unrelated -- socket.io's handshake requires two requests that need to land on the same server, so the sticky sessions is a must
