Help, Redis taking up all server memory



  • I recently migrated a MyBB forum to NodeBB locally. The migration went well and everything seemed to be working properly, so I uploaded the site to a 1GB DO Droplet, however as soon as Redis starts it consumes all the memory and the server crashes, despite the fact there isn't a single user logged in.

    I've been googling tutorials on how to configure and optimize Redis for days now, but I don't have a lot of experience with Redis and lot of the tutorials I've found assume you already have some knowledge of Redis and how to configure variables, but I'm rather lost here. My forum has about 260,000 messages and 2700 users.

    Could someone here help me configure Redis or give me some insight in what I should be doing?

    Thanks!


  • Translator

    Perhaps you can find something in your Redis logs, maby that will tell you something on whats clogging up all the memory.


  • Anime Lovers

    Can you send me a private message to show your forum. I want to see it! 😛


  • Community Rep

    Alternatively, use Mongo as a DB store



  • This post is deleted!


  • Thanks for the responses.

    @Kowlin said:

    Perhaps you can find something in your Redis logs, maby that will tell you something on whats clogging up all the memory.

    I checked the logs and there were 3 warnings:

    1. The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128.

    2. Overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctlvm.overcommit_memory=1' for this to take effect.

    3. You have Transparent Huge Pages (THP) support enabled in your kernel. This will create latency and memory usage issues with Redis. To fix this issue run the command 'echo never > /sys/kernel/mm/transparent_hugepage/enabled' as root, and add it to your /etc/rc.local in order to retain the setting after a reboot. Redis must be restarted after THP is disabled.

    I've found solutions to all those warnings and fixed them. They don't show up on the log anymore, but Redis is still crashing as soon as it start. It almost seems like it's not starting at all.

    @MadCuzMissed said:

    Can you send me a private message to show your forum. I want to see it! 😛

    I can send you a private message with a link to the MyBB forum, but I can't even get the NodeBB forum to show up yet 😞

    Once it's finished I'll post a link 😃

    @BDHarrington7 said:

    Alternatively, use Mongo as a DB store

    At this point I'm definitely considering doing this.


  • Anime Lovers

    Jeez! Send me link that MyBB forum. 😉


  • Translator

    How much memory does the local installation running on redis consumes?


Log in to reply
 


Looks like your connection to NodeBB was lost, please wait while we try to reconnect.