NodeBB Assets - Object Storage

[phenomlab]

@razibal I'm using CF, not AWS.

[razibal]

same API - it works for AWS, CF, Backblaze, Wasabi etc
In the CF dashboard, click on R2, then 'Overview' and 'manage r2 tokens' on the top right

[razibal]

Note that you will have to set the 'S3 uploads' plugin to also use the same bucket as you created for the core static assets

[phenomlab]

@razibal So I need that plugin in NodeBB also?

Presently, I get

NoSuchBucket: The specified bucket does not exist.
    at de_NoSuchBucketRes (/home/sudonix.dev/nodebb/node_modules/@aws-sdk/client-s3/dist-cjs/protocols/Aws_restXml.js:6053:23)
    at de_ListObjectsV2CommandError (/home/sudonix.dev/nodebb/node_modules/@aws-sdk/client-s3/dist-cjs/protocols/Aws_restXml.js:5083:25)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async /home/sudonix.dev/nodebb/node_modules/@aws-sdk/middleware-serde/dist-cjs/deserializerMiddleware.js:7:24
    at async /home/sudonix.dev/nodebb/node_modules/@aws-sdk/middleware-signing/dist-cjs/middleware.js:14:20
    at async /home/sudonix.dev/nodebb/node_modules/@aws-sdk/middleware-retry/dist-cjs/retryMiddleware.js:27:46
    at async /home/sudonix.dev/nodebb/node_modules/@aws-sdk/middleware-logger/dist-cjs/loggerMiddleware.js:7:26
    at async S3SyncClient.listBucketObjects (/home/sudonix.dev/nodebb/node_modules/s3-sync-client/lib/commands/list-bucket-objects.js:12:20)
    at async Promise.all (index 1)
    at async S3SyncClient.bucketWithLocal (/home/sudonix.dev/nodebb/node_modules/s3-sync-client/lib/commands/bucket-with-local.js:22:44) {
  '$fault': 'client',
  '$metadata': {
    httpStatusCode: 404,
    requestId: undefined,
    extendedRequestId: undefined,
    cfId: undefined,
    attempts: 1,
    totalRetryDelay: 0
  },
  Code: 'NoSuchBucket'
}

[razibal]

The postbuild script needs to point to your actual bucket if its named differently s3://nodebb-static/assets

You need the upload S3 plugin so new uploads are dynamically added to the bucket and don't need to be synched on build.

[phenomlab]

@razibal Ok, I'm almost there...

Getting this in the console (even though access is permitted)

AccessDenied: Access Denied
    at throwDefaultError (/home/sudonix.dev/nodebb/node_modules/@aws-sdk/smithy-client/dist-cjs/default-error-handler.js:8:22)
    at /home/sudonix.dev/nodebb/node_modules/@aws-sdk/smithy-client/dist-cjs/default-error-handler.js:18:39
    at de_PutObjectCommandError (/home/sudonix.dev/nodebb/node_modules/@aws-sdk/client-s3/dist-cjs/protocols/Aws_restXml.js:5701:12)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async /home/sudonix.dev/nodebb/node_modules/@aws-sdk/middleware-serde/dist-cjs/deserializerMiddleware.js:7:24
    at async /home/sudonix.dev/nodebb/node_modules/@aws-sdk/middleware-signing/dist-cjs/middleware.js:14:20
    at async /home/sudonix.dev/nodebb/node_modules/@aws-sdk/middleware-retry/dist-cjs/retryMiddleware.js:27:46
    at async /home/sudonix.dev/nodebb/node_modules/@aws-sdk/middleware-flexible-checksums/dist-cjs/flexibleChecksumsMiddleware.js:58:20
    at async /home/sudonix.dev/nodebb/node_modules/@aws-sdk/middleware-logger/dist-cjs/loggerMiddleware.js:7:26
    at async LocalObject.uploadObject (/home/sudonix.dev/nodebb/node_modules/s3-sync-client/lib/sync-objects/local-object.js:55:9) {
  '$fault': 'client',
  '$metadata': {
    httpStatusCode: 403,
    requestId: undefined,
    extendedRequestId: undefined,
    cfId: undefined,
    attempts: 1,
    totalRetryDelay: 0
  },
  Code: 'AccessDenied'
}

EDIT: Got it

[phenomlab]

@razibal I "sort of" have this working in the sense that the site is delivered, although ./nodebb start tells me the address is already in use, and some assets aren't being loaded.

[razibal]

which assets are missing? can you access them from the direct url?

[razibal]

When working, this should be completely transparent to nodeBB - essentially delegating the work done by nginx to cloudflare workers and using nodeBB as an API microservice

[phenomlab]

@razibal Assets such as avatars, some font-awesome icons.

Some examples

failed to load resource: the server responded with a status of 404 ()
fa-brands-400.woff2:1     Failed to load resource: the server responded with a status of 404 ()
/assets/uploads/profile/55-profileavatar-1661514770650.png:1     Failed to load resource: the server responded with a status of 404 ()
/assets/uploads/profile/1-profileavatar-1654009436557.png:1     Failed to load resource: the server responded with a status of 404 ()
/assets/uploads/profile/40-profileavatar-1649005649588.jpeg:1     Failed to load resource: the server responded with a status of 404 ()
/assets/images/blank-profile-pic-progressive.jpeg:1     Failed to load resource: the server responded with a status of 404 ()
/assets/uploads/profile/31-profileavatar-1642760955052.jpeg:1     Failed to load resource: the server responded with a status of 404 ()
fa-regular-400.ttf:1     Failed to load resource: the server responded with a status of 404 ()
fa-brands-400.ttf:1     Failed to load resource: the server responded with a status of 404 ()
nodebb.min.js?v=53dqct16ks2:5 Uncaught (in promise) TypeError: app.alert is not a function

EDIT - doesn't look like it's pulling in subdirectories - just the root of assets

[razibal]

strange - what do you see in the bucket?

[phenomlab]

@razibal Just the /assets folder and individual files - no subdirectories.

[razibal]

Should look like

[razibal]

Your sync progress showed 9238 files, are they all in the /assets folder?

[phenomlab]

@razibal Looks like it, yes. Not sure why though. Bucket name is nodebb-dev2

[razibal]

That's strange, you could do a sync using the aws cli to see if that fixes it

sudo pip install awscli

aws s3 sync build/public  s3://nodebb-dev2/assets --endpoint-url https://[account id].cloudflarestorage.com

[phenomlab]

@razibal shouldn't that be

aws s3 sync build/public  s3://nodebb-dev2/assets --endpoint-url https://[account id].r2.cloudflarestorage.com

[razibal]

yes, sorry typo

[phenomlab]

@razibal Looks promising on script execute

upload: build/public/admin.min.js to s3://nodebb-dev2/assets/admin.min.js
upload: build/public/nodebb.min.js to s3://nodebb-dev2/assets/nodebb.min.js
upload: build/public/plugins/nodebb-plugin-ns-embed/js/acp.js to s3://nodebb-dev2/assets/plugins/nodebb-plugin-ns-embed/js/acp.js
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-cyrillic-200-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-cyrillic-200-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-cyrillic-900-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-cyrillic-900-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-cyrillic-500-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-cyrillic-500-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-cyrillic-600-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-cyrillic-600-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-cyrillic-300-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-cyrillic-300-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-cyrillic-700-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-cyrillic-700-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-cyrillic-ext-100-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-cyrillic-ext-100-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-cyrillic-400-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-cyrillic-400-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-cyrillic-100-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-cyrillic-100-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-cyrillic-ext-600-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-cyrillic-ext-600-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-cyrillic-ext-300-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-cyrillic-ext-300-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-cyrillic-800-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-cyrillic-800-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-cyrillic-ext-400-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-cyrillic-ext-400-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-cyrillic-ext-700-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-cyrillic-ext-700-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-cyrillic-ext-500-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-cyrillic-ext-500-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-cyrillic-ext-200-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-cyrillic-ext-200-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-greek-100-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-greek-100-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-cyrillic-ext-900-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-cyrillic-ext-900-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-cyrillic-ext-800-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-cyrillic-ext-800-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-greek-300-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-greek-300-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-greek-200-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-greek-200-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-greek-400-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-greek-400-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-greek-500-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-greek-500-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-greek-700-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-greek-700-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-greek-800-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-greek-800-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-greek-600-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-greek-600-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-greek-900-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-greek-900-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-greek-ext-400-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-greek-ext-400-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-greek-ext-300-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-greek-ext-300-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-greek-ext-200-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-greek-ext-200-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-greek-ext-500-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-greek-ext-500-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-greek-ext-100-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-greek-ext-100-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-greek-ext-600-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-greek-ext-600-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-latin-200-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-latin-200-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-greek-ext-700-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-greek-ext-700-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-latin-300-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-latin-300-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-latin-400-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-latin-400-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-latin-100-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-latin-100-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-greek-ext-800-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-greek-ext-800-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-latin-500-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-latin-500-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-greek-ext-900-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-greek-ext-900-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-latin-600-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-latin-600-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-latin-700-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-latin-700-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-latin-800-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-latin-800-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-latin-900-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-latin-900-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-latin-ext-100-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-latin-ext-100-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-latin-ext-300-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-latin-ext-300-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-latin-ext-500-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-latin-ext-500-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-latin-ext-700-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-latin-ext-700-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-latin-ext-200-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-latin-ext-200-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-vietnamese-100-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-vietnamese-100-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-latin-ext-400-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-latin-ext-400-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-latin-ext-600-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-latin-ext-600-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-latin-ext-800-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-latin-ext-800-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-vietnamese-200-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-vietnamese-200-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-vietnamese-400-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-vietnamese-400-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-vietnamese-500-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-vietnamese-500-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-vietnamese-700-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-vietnamese-700-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-vietnamese-600-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-vietnamese-600-normal.woff
upload: build/public/plugins/nodebb-theme-harmony/inter/inter-vietnamese-300-normal.woff to s3://nodebb-dev2/assets/plugins/nodebb-theme-harmony/inter/inter-vietnamese-300-normal.woff

However, the bucket itself remains the same.

[razibal]

shouldn't be possible - as I'm sure you already know S3 buckets/Object storage don't really have 'folders' just object keys with a slash to signify a directory - somehow, in your case the keys are getting translated to the file name