During the creation of new categories : Resulting document after update is larger than 16777216 error

Nuran Akimbek

During the creation of new categories I get error : Resulting document after update is larger than 16777216. I can't increase mongo db 16MB limitation. How to divide nodebb collections. How to solve this problem

<baris>

A category object shouldn't be more than 16mb, are you storing custom data in the category key?

Nuran Akimbek

@baris A have a lot of category in my community(more than 9000). We divide into small groups and categories our users. I inserted all categories using Add category and edit category form. Please do you have any ideas how to resolve this problem?

julian

@Nuran-Akimbek please share the stack trace from the logs

Nuran Akimbek

@julian Did I upload the correct ones?

<baris>

Ahh I think with that many groups it is the groupslug:groupname object that is hitting the 16mb limit. You can confirm if thats the case by checking the size of that document. Try running Object.bsonsize(db.objects.findOne({_key: "groupslug:groupname"})); see what it returns.

<baris>

@Nuran-Akimbek https://github.com/NodeBB/NodeBB/issues/12481

Nuran Akimbek

@baris @julian Sorry for the late reply, I've been away from the project for a few days. But the problem is still very relevant. Object.bsonsize(db.objects.findOne({_key: "groupslug:groupname"})) result is 16777201. My community is loaded very slow, if more than 50 active users show 503 blue screen high traffic error.CPU is up to 100. All of this cause of big size of group object?
@baris The problem will be fixed only in may with 3.8.0 update?

<baris>

@Nuran-Akimbek you can test develop branch if you want to test the fix, make a backup of your database in case you want to rollback.

Nuran Akimbek

@baris Yes, I test develop branch and it's really worked now. But community still loaded slow and shows from time to time 503 error