How to export from Redis to MongoDB? (My database got wiped)

? Offline

@Pilvinen well. Then you have to think what can cause Redis to destroy its database.

Corruption, seems like the most logical case.
And as Redis does not stores the database on your HDD it can only be the RAM.

Also the fact that both of you use OVH makes it a bit strange.

Charly86

@AOKP
I agree, upgrading to 3.0.5 will certainly not solve the issue, but does not hurt to try

PitaJ

@AOKP Well, it persists it to HDD on shutdown. Maybe the server was forced shutdown, and redis didn't have time to save, or the save corrupted the db?

Pilvinen

If it helps clarifying the issue - when I noticed the forum had crashed and database was gone I tried to use redis-cli to do a proper shutdown - I connected which worked fine and tried running commands - And I got no response to the commands like Redis normally gives.

Charly86

In my case it's saved every 5 minutes onto disk, so I should have lost only 5 minutes, except if as you says, it saved corrupted db.

297] 08 Nov 02:19:36.116 * Background saving terminated with success
[297] 08 Nov 02:24:37.088 * 10 changes in 300 seconds. Saving...
[297] 08 Nov 02:24:37.091 * Background saving started by pid 4508
[4508] 08 Nov 02:24:37.114 * DB saved on disk
[4508] 08 Nov 02:24:37.115 * RDB: 0 MB of memory used by copy-on-write
[297] 08 Nov 02:24:37.192 * Background saving terminated with success
[297] 08 Nov 02:29:38.091 * 10 changes in 300 seconds. Saving...
[297] 08 Nov 02:29:38.092 * Background saving started by pid 4511
[4511] 08 Nov 02:29:38.110 * DB saved on disk
[4511] 08 Nov 02:29:38.110 * RDB: 0 MB of memory used by copy-on-write
[297] 08 Nov 02:29:38.193 * Background saving terminated with success
[297] 08 Nov 02:34:39.034 * 10 changes in 300 seconds. Saving...
[297] 08 Nov 02:34:39.035 * Background saving started by pid 4514
[4514] 08 Nov 02:34:39.059 * DB saved on disk

Charly86

after corruption I connected to redis without issue but database structure was

instead of

? Offline

Why don't you try AOF instead of RDB?
It can save every second, without any certain performance loss. The only disadvantage is that it uses more disk space.

Charly86

yeah no problem for me using AOF, I need to set it in redis.conf ?

? Offline

@Charly86 yep.

Charly86

I'll check this thanks

? Offline

Another idea would be to configure a cronjob running every X minutes, copying the database.
cp -R /var/lib/redis.rdb /root

Charly86

Yeah I've already put a backup into /etc/cron.hourly as a fix

wellenreiter

@pitaj My version is this:

web02:~$ redis-server -v
Redis server v=3.0.3 sha=00000000:0 malloc=jemalloc-3.6.0 bits=64 build=e1e08a07153b9ea1

? Offline

@wellenreiter are you also a OVH user?

wellenreiter

@AOKP not sure what you mean with OVH and I'm not the one who leased the host, but it's a linode server, so I assume it's a virtual machine

? Offline

@wellenreiter OVH is an ISP, providing servers.
However, I can only assume that something is wrong with your Redis setup or servers.

Does anyone uses the Redis repo from Chris Lea?

wellenreiter

@AOKP said:

@wellenreiter OVH is an ISP, providing servers.
However, I can only assume that something is wrong with your Redis setup or servers.

Then, why occurs the problem to a number of different installations in just a couple of days on systems that have run fine for month before?
Also as mentioned above, my redis configuration is 99.9% the default config

? Offline

@wellenreiter as said. I am running Redis since May and never had a problem similar to this.
The whole case is indeed very strange...

wellenreiter

It is really strange and if you count all the different installations mentioned here and in the thread 'lost all my data' I doubt, that it is related to the redis configuration

? Offline

@wellenreiter but then again, why the issue appears also on different NodeBB versions?
Maybe really give the PPA Repo from Chris Lea a try or switch to MongoDB.