Database other than Redis and Mongodb

[finid]

If the MongoDB guys will just simplify user management, it will be a lot easier to use and manage.

[bentael]

oh well.. im happy with redis for now - maybe one when it all crashes on me i wont be so happy

but to add to that, I would to see a "nosqlite" and/or "sqlite" support too, for development purposes, so I won't have to worry about installing a db server on every machine im developing against.

[julian]

As always with Redis, make sure you have sane backups! High speed, high risk

[finid]

@julian

How much RAM will be needed for a busy site using Redis.

[julian]

RAM usage goes up based on the amount of content, so there's no one number I can say like "99999 users, or x posts per minute", except for number of posts. I believe @baris did some rough calculations for Redis...

[finid]

@julian

Considering this, how about having support for something like Postres? Mongodb itself is a minor pain in the neck

[bentael]

i have a redis DB with 350k+ posts, 10k+ users, 30k topics

# Memory
used_memory:665206136
used_memory_human:634.39M
used_memory_rss:709705728
used_memory_peak:1787709472
used_memory_peak_human:1.66G
used_memory_lua:22528
mem_fragmentation_ratio:1.07
mem_allocator:jemalloc-3.2.0

[finid]

@bentael

That's good. Redis is it. I'll abandon MongoDB.

[julian]

The other issue is that there's no way to switch databases after the initial setup/import, although with @bentael's help, I'm sure we could build an exporter compatible with nodebb-plugin-importer

[bentael]

@julian the import use the abstracted db module.. so you can import to anything.. but yea, after the import is done .. it's going to suck if you decide to switch

[baris]

Thats why I was thinking about building a db.exportToJson() which would create the same json database output from mongo and redis. And then later db.importFromJson() so you can switch between the two. It would require some effort though.

[bentael]

@baris said:

Thats why I was thinking about building a db.exportToJson() which would create the same json database output from mongo and redis. And then later db.importFromJson() so you can switch between the two. It would require some effort though.

that file might become one hell of a fat JSON - might run into memory issues trying to write/parse that

[psychobunny]

haha yeah 600mb json file

my vote for the next addition to our DBAL is csv flat file db.

[baris]

Looks like you can do mongoexport --collection objects --out objects.json in mongo.

[bentael]

haha yeah 600mb json file

@psychobunny probably more.. JSON is verbose

[baris]

If json is verbose I dont know what xml is

[bentael]

@baris i know lol, JSON is verbose comparing to csv for example, but obviously allows more complex structures.