So, interesting thing.
I have disabled execution of this query

"zscore" "uid:41843:followed_tids" "990614"

by hardcoding response of "Topics.filterWatchedTids" function (always return []).

Redis and CPU load decreased of about 50%

Next query on my list is:

10. 1. (integer) 369411
11. (integer) 1524255134
    3) (integer) 291408
    4) 1) "zrevrangebyscore"
    2) "topics:recent"
    3) "+inf"
    4) "1524082333364"
    5) "WITHSCORES"
    6) "LIMIT"
    7) "0"
    "-1"

which took about 0.3s to run and basically should be cached

@baris at redis monitor I see a lot queries like:
"zscore" "uid:41843:followed_tids" "990614"

What they mean ? User #41843 watching topic #990614 ?

@baris it seems that signed in user need some data from redis, but after nodebb upgrade redis stats looks not so good,
total operations increased from 9M to 25M per minute
CPU load from 40% to 100%
so yeach, that's the problem

There is also one more application entry via urstyle.pl (this domain has turned ON varnish for static files), urstyle.com is serving statics via nodebb as now, but it seems to not be a clue of the problem

@baris we are not loading categories at home page, there is even no request to nodebb /api endpoint (as a guest).
Yes, it's public (https://urstyle.com) you can compare page speed as a guest and signed in user.
There is 7M topic because we have about 7M subpages connected via nodebb-plugin-comments

@baris Performace is much much better for guests, but other hands worse for signed in users.
We have just upgraded nodebb from 1.5.1 to 1.8.2.

A guest visitor is able to get HTTP response from the homepage in 100-200ms, where signed in user need to wait for about 4-5s.
We have already 7M topics (not 1M) and probably some redis queries are not optimized

Protip for someone in the future who will visit this topic:

DB keeps schemaDate (timestamp) and schemaLog (table), you can read this keys to check which schema upgrades are already applied.

topic can be closed

Hello,
how can I force update again schema? When doing update my internet connection was shut down, I'm not able to run it second time because saying that everything is updated

@PitaJ we are now testing 10 instances instead of 20
@baris great tip! I didn't saw before this debug page, we don't have it visible in admin menu (nodebb 1.5.1). Now I see that only half of our instances getting the traffic - so there is a problem with loadbalancer.
We are serving static files via varnish cache.

Should we expect a huge performance difference between version 1.5 and 1.8 of nodebb?

Hello guys,
I'm looking for the ideas how to debug nodebb load.

Right now our nodebb application is using 200 registered users (400 connections with guests) online and we have about 1 million topics.
Unfortunately, our community receiving very often 503 (heavy load) error page, and application is very slow.

Our stack looks like:

• haproxy loadbalancer
• varnish (cache statics)
• nodebb loadbalancer
• 10 - 20 docker instances of nodebb running on two ports each

Everything of it is working on 3 hosts, from 13 to 27GB RAM and about 10% cpu load.

Where should we start to debug why nodebb is slow?

@julian @psychobunny

https://forum.vivaldi.net/

Ok, as I can see simple CSS rules can do this job, maybe in the future we will build some plugin to support this feature

Hello guys!
Did someone maybe wondering how to internationalize forum and serve different categories for users based on their language?
Example:
User A has set up English language as a default and see category "General Discussion" with ID: 1
user B has set up French language as a default and see category "Discussion générale" with ID: 2

Example:
http://forums.opera.com/ , if you change site language, you will see new boards specified for chosen language

Is there any plugin fulfilling this idea? or can we talk about the nodebb core how to do that?

Hello again,
this issue is related to server/redis, NOT nodebb itself.
I have created dedicated Redis (3.0) cluster via Azure portal and seems to working fine from the 1hour.
I need to add rest of the plugins and check if they are not cause any issue but seems that problem was with the server/newest redis

Hello guys,
I'm sick because of trying to run stable nodebb instance with Redis or MongoDB.
I'm running newest version of nodebb (right now it's current master, previously was latest official version), newest Redis and previously newest MongoDB.

1. First problem - nodebb is not supporting secured connections to MongoDB (connection with ssl=true)
   a) I was trying to fix it by modyfing connection string
   "var connString = 'mongodb://' + usernamePassword + servers.join() + '/' + nconf.get('mongo:database') + '?ssl=true';"
   This trick allows me to connect with mongodb (run setup) but didnt finish installation, only about 50% of initialize data goes to mongodb and nodebb won't start.

2. After few days of fight I have moved to Redis.
   a) My nodebb instance successfully complete initialization on redis and working fine... for about 10min ... after that time I'm not able to refresh the site. After about 30min I'm getting an error
   "23/9 07:56 [1424] - error: Error: Redis connection to xxxxxxx:xxxx failed - read ETIMEDOUT
   "
   b ) I was trying to ping redis on every connection every 4min
   " setInterval(function() {
   cxn.ping();
   winston.info('Redis Ping');
   }, 1000 * 60 * 4);"
   c) Redis stills timeout, so I have added retry strategy:
   " options.retry_strategy = function (options) {
   if (options.error.code === 'ECONNREFUSED') {
   // End reconnecting on a specific error and flush all commands with a individual error
   winston.error('Redis: The server refused the connection');
   }
   if (options.total_retry_time > 1000 * 60 * 60) {
   // End reconnecting after a specific timeout and flush all commands with a individual error
   winston.error('Redis: Retry time exhausted');
   }
   if (options.times_connected > 10) {
   // End reconnecting with built in error
   return undefined;
   }
   // reconnect after
   winston.error('Redis: Reconnecting');
   winston.error(options.error.code);
   return Math.max(options.attempt * 100, 3000);
   };"
   d) still nothing... ofc. I have double checked that redis configuration is OK and every possible timeout options are disabled.

Any ideas how can I prevent timeouts or debug it deeper ?

example log:
https://gist.github.com/anonymous/b62a40ef21059cd68dfb6712fe4b7912