[nodebb-plugin-s3-uploads] Store your uploads in AWS S3

miksago

Hi all,

Here's a new plugin to NodeBB from the guys behind Kano — we've recently overhauled our NodeBB install, and as part of an upgrade to our infrastructure, we've decided to try and not sort any images locally on instances, but instead use shared storage. We'll be battle testing this plugin over the next few days, but so far, it seems like it'll work.

Give it a whirl, let me know.

GitHub - KanoComputing/nodebb-plugin-s3-uploads: A plugin for NodeBB to take file uploads and store them on S3

A plugin for NodeBB to take file uploads and store them on S3 - GitHub - KanoComputing/nodebb-plugin-s3-uploads: A plugin for NodeBB to take file uploads and store them on S3

GitHub (github.com)

This will require NodeBB >=0.3.2 or anything after 695891ffd7192a2c92d239950e2db095ce948274 in master.

Cheers,
Micheil Smith

miksago

Aside: Many thanks to @barisusakli and @julianlam on supporting the development of this plugin from the NodeBB side, which required various changes to the internals of NodeBB.

<baris>

Thanks @miksago for putting the effort into this, there were many people requesting this feature.

julian

Woo hoo!

Two image upload plugins down, 99+ more to go.

psychobunny

nice job, looking forward to seeing what else you guys come up with

finid

This is great.

Now, how about a remote storage plugin that's provider independent, that is, that can be used to configure remote storage to any provider or at least the most popular ones.

Doable?

miksago

@psychobunny said:

nice job, looking forward to seeing what else you guys come up with

For the next few months, not much, purely as we need to switch to a different strand of development and can't spend much time on Talk

miksago

@planner said:

This is great.

Now, how about a remote storage plugin that's provider independent, that is, that can be used to configure remote storage to any provider or at least the most popular ones.

Doable?

I guess it'd be doable, I think pkgcloud would enable this: https://github.com/pkgcloud/pkgcloud#storage — however, I won't be implementing it, feel free to fork our S3 Uploader though.

trevor

Thanks @miksago !

miksago

Small note on this: whilst I'm the original author, I've since left Kano, and as they have IP over it, and control access to the source code commits, I can no longer actually maintain it. It's up to them if they want to make me a maintainer of that repository.

julian

@miksago What license was it released under? Given the MIT license, you can just fork it, no?

GitHub - KanoComputing/nodebb-plugin-s3-uploads: A plugin for NodeBB to take file uploads and store them on S3

A plugin for NodeBB to take file uploads and store them on S3 - GitHub - KanoComputing/nodebb-plugin-s3-uploads: A plugin for NodeBB to take file uploads and store them on S3

GitHub (github.com)

miksago

@julian yeah, if I fork it, I'd have to republish as a different package on NPM, which isn't something that's ideal.

chenneil

Hello

I have NodeBB V0.5.0 installed, S3 bucket set up and tried to install and activate the nodebb-s3-uploads from the admin panel->Plugins. Below is the error I have got whenever trying to upload a picture:
'''
Error

Upload Error : nodebb-plugin-s3-uploads :: The XML you provided was not well-formed or did not validate against our published schema
'''

Futher more, when trying to config the settings for nodebb-s3-uploads from NodeBB ACP --> Plugins section:
'''
Not Found

You seem to have stumbled upon a page that does not exist. Return to the home page.
'''

Though it installs and activates without any errors, what else can be wrong? Thanks in advance.

a_5mith

Seems Amazon may have changed something perhaps. The plugin is also very out of date. It's only compatible with 0.3.2, however 0.4.0 introduced breaking changes. I'm not sure the original author of this plugin is around any more. If I get the chance, I will have a look and see what the issue could be.

chenneil

All right!! Thank you @a_5mith.

chenneil

Hello @a_5mith have you had a chance to take a look at this? Thanks

wladiston

Is there someone looking for solutions?

<baris>

I think this plugin is maintained here now https://github.com/joe1chen/nodebb-plugin-s3-uploads

louisemcmahon

I have updated this plugin and added a new package to npm https://github.com/LewisMcMahon/nodebb-plugin-s3-uploads

rod

@lewismcmahon

It is nice to see one of the Amazon S3 uploader plugins being actively maintained.

Enhancement Requests:

Modify this plugin to upload images in a path for each individual user (currently all uploads go to the bucket root -- Look at the nodebb-plugin-amazons3 plugin for an example of this)
Create the ability to scan the database for images and then to delete the ones that no longer exist in the database from the S3 bucket (Deleted posts and threads, re-uploaded (changed) images, etc.)

Otherwise, thank you very much for taking over supporting this plugin.