Nice! Thanks baris! I agree that's simpler

Please add MLB The Show forums as well (forums.theshow.com) to the list.

Thanks!

Thanks baris! We'll keep this for reference

Just wanted to add what a huge difference our current JMeter tests is telling us. Now we can bump the number of threads to see how much our current set up can handle.

Thank you!

Woot! It's working on our development environment. Only change I made from the snippet was

hookData.topic.tid to hookData.post.topic.tid

Thanks for your help!

Yes, the group is visible. I'll try the updated snippet.

I'll also add it to both hooks.

Thank you so much!

This won't retro, but you're right, calculating on post is better than calculating on fetch for each.

Awesome! Thank you so much! We'll try that.

It's lightning fast without it

So it sounds like to fix the performance issue, we will have to remove that hook. Is there no other way to do that in a performant manner?

Yes, that is a custom theme based on slick theme.

postedInByDeveloper is something we added to check if a topic has any developer posts.

@Teemberland added that a while ago: https://community.nodebb.org/topic/14867/display-group-badge-on-topic-list/11

@baris said in How to improve popular posts response time?:

Help Fine Tuning Advanced Cache Settings

Hi, I'm on the advanced cache page and I'm seeing Post Cache, Object Cache, Group Cache and Local Cache are all maxed out. I'm guessing this affects performa...

NodeBB Community (community.nodebb.org)

Yep, I think we solved that by deleting unused groups that we set up. We used to have group specific categories. We did that a couple of years and there's a bunch that we don't need anymore. The hit ratio is pretty decent now.

Here's the output

ubuntu@ip-10-111-250-13:~/nodebb$ ./nodebb plugins
2023-02-23T18:44:33.214Z [4567,4568,4569,4570,4571,4572,4573,4574/11855] - verbose: [minifier] utilizing a maximum of 7 additional threads
Active plugins:
	* [email protected] (installed, enabled)
	* [email protected] (installed, enabled)
	* [email protected] (installed, enabled)
	* [email protected] (installed, enabled)
	* [email protected] (installed, enabled)
	* [email protected] (installed, enabled)
	* [email protected] (installed, enabled)
	* [email protected] (installed, enabled)
	* [email protected] (installed, disabled)
	* [email protected] (installed, enabled)
	* [email protected] (installed, disabled)
	* [email protected] (installed, disabled)
	* [email protected] (installed, disabled)
	* [email protected] (installed, enabled)
	* [email protected] (installed, disabled)
	* [email protected] (installed, enabled)

Yup, it is public. You can access here: https://forums.theshow.com

Thanks!

It's our low peak right now, but expect it to pick up next month.

To add more context, here's more info ...

1 NodeBB instance with 8 vCPU, 16 GB
1 MongoDB instance with 2 vCPU, 16 GB

The configs are based on the NodeBB documentation.

I'm curious which missteps we did and how we can fine tune. Thanks for your help!

Here you go.

{
    "db": "nodebb",
    "collections": 5,
    "views": 0,
    "objects": 23784853,
    "avgObjSize": 113.46550924657807,
    "dataSize": 2698760458,
    "storageSize": 1733615616,
    "indexes": 11,
    "indexSize": 2583236608,
    "totalSize": 4316852224,
    "scaleFactor": 1,
    "fsUsedSize": 12107075584,
    "fsTotalSize": 31024283648,
    "ok": 1,
    "serverStatusError": "",
    "mem": {
        "bits": 64,
        "resident": "5.557",
        "virtual": "8.015",
        "supported": true,
        "mapped": "NaN"
    },
    "collectionData": [
        {
            "name": "nodebb.sessions",
            "count": 0,
            "size": 0,
            "storageSize": 4096,
            "totalIndexSize": 8192,
            "indexSizes": {
                "_id_": 4096,
                "expires_1": 4096
            }
        },
        {
            "name": "nodebb.searchtopic",
            "count": 58315,
            "size": 4782801,
            "avgObjSize": 82,
            "storageSize": 2662400,
            "totalIndexSize": 5169152,
            "indexSizes": {
                "_id_": 638976,
                "content_text_uid_1_cid_1": 4530176
            }
        },
        {
            "name": "nodebb.socket.io",
            "count": 3442,
            "size": 5240037,
            "avgObjSize": 1522,
            "storageSize": 573440,
            "totalIndexSize": 73728,
            "indexSizes": {
                "_id_": 73728
            }
        },
        {
            "name": "nodebb.objects",
            "count": 23173019,
            "size": 2406545811,
            "avgObjSize": 103,
            "storageSize": 1588232192,
            "totalIndexSize": 1722556416,
            "indexSizes": {
                "_id_": 651784192,
                "_key_1_score_-1": 402395136,
                "_key_1_value_-1": 508846080,
                "expireAt_1": 159531008
            }
        },
        {
            "name": "nodebb.searchpost",
            "count": 550077,
            "size": 282191809,
            "avgObjSize": 513,
            "storageSize": 142143488,
            "totalIndexSize": 855429120,
            "indexSizes": {
                "_id_": 7294976,
                "content_text_uid_1_cid_1": 848134144
            }
        }
    ],
    "network": {
        "bytesIn": "35.923",
        "bytesOut": "13.088",
        "physicalBytesIn": 38559006598,
        "physicalBytesOut": 14052769242,
        "numSlowDNSOperations": 0,
        "numSlowSSLOperations": 0,
        "numRequests": "10,304,639",
        "tcpFastOpen": {
            "kernelSetting": 1,
            "serverSupported": true,
            "clientSupported": true,
            "accepted": 0
        },
        "compression": {
            "snappy": {
                "compressor": {
                    "bytesIn": 0,
                    "bytesOut": 0
                },
                "decompressor": {
                    "bytesIn": 0,
                    "bytesOut": 0
                }
            },
            "zstd": {
                "compressor": {
                    "bytesIn": 0,
                    "bytesOut": 0
                },
                "decompressor": {
                    "bytesIn": 0,
                    "bytesOut": 0
                }
            },
            "zlib": {
                "compressor": {
                    "bytesIn": 0,
                    "bytesOut": 0
                },
                "decompressor": {
                    "bytesIn": 0,
                    "bytesOut": 0
                }
            }
        },
        "serviceExecutors": {
            "passthrough": {
                "threadsRunning": 96,
                "clientsInTotal": 96,
                "clientsRunning": 96,
                "clientsWaitingForData": 0
            },
            "fixed": {
                "threadsRunning": 1,
                "clientsInTotal": 0,
                "clientsRunning": 0,
                "clientsWaitingForData": 0
            }
        }
    }
}

We must've misconfigured something then ...

Here you go. Thanks!

Gotcha. It is still set to 200.

We have 43 categories.

/api/recent is about 500ms on average
/api/popular is about 5s on average

I also see this ...

• Topics Indexed: 59384
• Posts Indexed: 567384

I'm trying a couple of things ...

• I'm selecting parent categories to exclude from the index. We have quite a number of unused categories now.
• I'm also clearing index and will reindex after that operation is done.

Anyway, I tried setting both to 200 and don't see much of a difference.