Redis or MongoDB?

julian

@JaredBusch No but the guys from NodeBB have a migration tool to there disposal.

Yes, we offer Redis to MongoDB migrations for a $50 flat fee, as it requires a bit of prep work and execution expertise

sanatisharif

restart with this error using mongodb after upgrade to 0.9.3:

20/12 18:04 [2947] - error: MongoError: server 127.0.0.1:27017 sockets closed
    at Server.destroy (/path/to/nodebb/node_modules/mongodb/node_modules/mongodb-core/lib/topologies/server.js:676:47)
    at Server.close (/path/to/nodebb/node_modules/mongodb/lib/server.js:367:17)
    at Db.close (/path/to/nodebb/node_modules/mongodb/lib/db.js:333:19)
    at Object.module.close (/path/to/nodebb/src/database/mongo.js:228:6)
    at shutdown (/path/to/nodebb/app.js:305:28)
    at process.<anonymous> (/path/to/nodebb/app.js:176:3)
    at process.emit (events.js:107:17)
    at process._fatalException (node.js:236:26)

restarting nodebb multiple time · Issue #3978 · NodeBB/NodeBB

nodebb will be restart after some hours, with this on log: 20/12 17:57 [678] - error: TypeError: Cannot read property 'length' of undefined at Object.Plugins.normalise (/path/to/nodebb/src/plugins.js:225:27) at Request._callback (/path/t...

GitHub (github.com)

Shard

@julian

I guess that depends on what is covered by the word "caching"

I was curious about caching posts, etc. Not "just sessions and websockets.
"

JaredBusch

@julian said in Redis or MongoDB?:

@Kowlin said:

@JaredBusch No but the guys from NodeBB have a migration tool to there disposal.

Yes, we offer Redis to MongoDB migrations for a $50 flat fee, as it requires a bit of prep work and execution expertise

We are years down the road now, and I am wanting to migrate my D&D campaign forum to a new VM and would like to use the modern standard of mongodb instead of the legacy standard of Redis.

Is the above still all we have? A little searching turned up this year old post also.

@julian said in Drop Redis/Improve MongoDB/Support SQL?:

Yes, let it be known that if we do decide to drop support, the Redis to Mongo migration script will be immediately published

How much is this called upon? My forum is tiny, but the thought of trying to manually migrate things is still horrid.

PitaJ

GitHub - BenLubar/nodebb-postgres-converter: Converts an existing NodeBB NoSQL database to a relational PostgreSQL database.

Converts an existing NodeBB NoSQL database to a relational PostgreSQL database. - BenLubar/nodebb-postgres-converter

GitHub (github.com)

You can use this to convert between any of the three database types.

JaredBusch

@PitaJ said in Redis or MongoDB?:

GitHub - BenLubar/nodebb-postgres-converter: Converts an existing NodeBB NoSQL database to a relational PostgreSQL database.

Converts an existing NodeBB NoSQL database to a relational PostgreSQL database. - BenLubar/nodebb-postgres-converter

GitHub (github.com)

You can use this to convert between any of the three database types.

This is awesome. Thanks.

scottalanmiller

@PitaJ said in Redis or MongoDB?:

GitHub - BenLubar/nodebb-postgres-converter: Converts an existing NodeBB NoSQL database to a relational PostgreSQL database.

Converts an existing NodeBB NoSQL database to a relational PostgreSQL database. - BenLubar/nodebb-postgres-converter

GitHub (github.com)

You can use this to convert between any of the three database types.

Very cool!

scottalanmiller

@nodeSide said in Redis or MongoDB?:

What is best to use? Always hearing bad things about Mongodb and Redis I have been told "redis is usually used for more temporary data store.

Can't imagine what bad is being said about MongoDB. It's been amazing for us. Screaming fast, really easy to maintain, insanely stable. We are super happy with it.

We have done as much as 191 million hits in a month on MongoDB without the server even working hard.

julian

@scottalanmiller Just don't shard MongoDB... it's where the problems arise

scottalanmiller

@julian said in Redis or MongoDB?:

@scottalanmiller Just don't shard MongoDB... it's where the problems arise

What issues have you seen? It should handle it well, in theory. Of course, you also shouldn't need to. The scale of the community necessary to justify sharding would be astronomic.

sweetp

I migrated my forum from mongo to Postgres. using the mentioned plugin. and before the I migrated a mySQL myBB setup to mongo. Its not all that difficult to migrate

scottalanmiller

@sweetp said in Redis or MongoDB?:

I migrated my forum from mongo to Postgres.

What was the impetus in going from MongoDB to PostgreSQL? MongoDB does such an amazing job.

sweetp

@scottalanmiller im already familiar with Postgres, and monogDB isn't officially compatible with my Plesk VPS.

JJSagan

I have been working with PostgreSQL for over two months. So far not a single issue. @Ben-Lubar did an amazing job, and continues to do so - see pull request here:
https://github.com/NodeBB/NodeBB/pull/6745

PostgreSQL is probably the best solution if you are hosting in AWS, since MongoDB is not available unless you can front 20K USD$ per year

scottalanmiller

@sweetp said in Redis or MongoDB?:

@scottalanmiller im already familiar with Postgres, and monogDB isn't officially compatible with my Plesk VPS.

Ah, makes sense. I bet the performance with a web hosting service is pretty bad, though.

scottalanmiller

@JJSagan said in Redis or MongoDB?:

I have been working with PostgreSQL for over two months. So far not a single issue. @Ben-Lubar did an amazing job, and continues to do so - see pull request here:
https://github.com/NodeBB/NodeBB/pull/6745

PostgreSQL is probably the best solution if you are hosting in AWS, since MongoDB is not available unless you can front 20K USD$ per year

I think that there must be some confusion. MongoDB is the same cost on Amazon as it is anywhere else, free. You must be thinking that using AWS requires you to not use a normal setup but some special AWS service. That's incorrect. You'd run MOngoDB the same as anywhere else, being on AWS might offer additional choices, but not fewer. There is no limitation or cost like you are thinking there. Even if you wanted a hosted MongoDB that you aren't responsible for, MongoDB's own Atlas service is VERY affordable and on AWS.

JJSagan

If you want to have pre-configured server managed by aws, I believe mongodb is unavailable.
you can setup your own server, however...

scottalanmiller

@JJSagan said in Redis or MongoDB?:

If you want to have pre-configured server managed by aws, I believe mongodb is unavailable.
you can setup your own server, however...

So the same as anywhere else. It's just something you install on your NodeBB VM. The needs even for the busiest sites is very minimal.

But if you want it fully hosted on AWS and fully managed, that's what Atlas is for. And they have a free tier, I believe.

JJSagan

Anyway, my point was that PostgreSQL is stable and working.
Take care!

sweetp

@scottalanmiller my support forum has pretty low traffic, so it’s not really an issue

Actually the version of postgresql I had to install on my server doesn’t seem to be compatible with my install of Plesk either.

But it works well, and I don’t have to mess around learning how to support mongodb.