[nodebb-plugin-import] Import your forum to NBB

bentael

@julian nah not mine, a friend's - it would be cool if you can add it to your list of who's using NodeBB to push some traffic towards it, but wait not yet, gotta change those category boxes on the home page.

hehe, yea, I won't

trevor

lol nice.

StuartH

@bentael is the blog on your site a custom plugin you have done?

bentael

@StuartH the blog is WordPress, notice the domain change, but the extra navigation items, yea, these were added via a plugin, still very experimental though, I don't have a readme for it yet, but if you install and view the admin page of it, you'll get an idea.

StuartH

@StuartH the blog is WordPress, notice the domain change, but the extra navigation items, yea, these were added via a plugin, still very experimental though, I don't have a readme for it yet, but if you install and view the admin page of it, you'll get an idea.

@bentael I did not click on the blog button so did not see it went to wordpress. I have blogs on my xenforo site and they are not generating very much content, but it's a different type of person going to our sites mines gaming your medical so I can see you will get people to blog more easily.

bentael

@StuartH if it makes you feel better, the bloggers are paid doctors

psychobunny

Let me know when you're comfortable enough for me to list this site on nodebb.org, and the 'who is using nodebb' list. I'll also tweet and facebook the URL, when you're ready for it.

bentael

@psychobunny I will thank you !

Tom Wilson

Apologies for resurrecting this topic, but is this plugin available for v1.4 of NodeBB? I don't see it listed in the list of available plugins on the admin panel.

alff0x1f

@Tom-Wilson Unfortunately

LATEST VERSION ONLY SUPPORTS:
NodeBB v1.0.0

via https://github.com/akhoury/nodebb-plugin-import

I install nodeBB v1.0.0 and update my forum to 1.2.0 after import information from my old forum (v 1.2.0 was actual when I import from phpbb3)
(IMHO it is most important plugin for commtity grow and I don't know why it is not support for actual versions)

Tom Wilson

Ah that's a shame. I just tried to downgrade, but encountered all sorts of problems :(.

Bri

@Tom-Wilson if you're importing an old forum, I'm assuming you'd be starting from scratch. Just reset your database and do git checkout v1.0.0 and then the regular setup steps from there.

If you're trying to merge with existing data already in NBB, that's another thing entirely.

Bri

@alff0x1f said in [nodebb-plugin-import] Import your forum to NBB:

I don't know why it is not support for actual versions

It's because it takes a lot of work to keep the plugin up to date with the newest version. We know it works for v1.0.0 but since it touches some internal api's that aren't necessarily supposed to be developer-facing, it will encounter more breakages than say, a normal plugin.

bentael

I will be upping support soon to a more recent version. Sorry guys it's been a few crazy months and didn't get a chance to work on it.

Tom Wilson

Great to hear - looking forward to it!

GaryBusey

@bentael I'm got a new forum set up with v1.0.0 and everything seems to work, except I get an "invalid csrf token" error when I try to log in. I have nodebb listening on a public facing interface, no proxying. The URL I'm using to access the site matches the one in config.json, it's just the server IP. I had no problems earlier with a different db and the most recent nodebb release, but the importer obviously won't work there.

Thanks for any help.

PitaJ

@GaryBusey make sure sockets are working. Check for any errors on the client or server. Try running nodebb in dev mode with ./nodebb dev.

oPignonLibre

Has anyone managed to import a fairly large mybb forum with the importer ? I wanted to migrate from an old mybb1.6 forum with ~5000threads, 15000 members and around 1.5M individual posts. I first migrated that forum to mybb1.8 then installed nodebb 1.0.0 as per the nodebb-plugin-import github readme.

The import works for a while but nodebb eventually crash before all the posts are imported.

I tried cleaning up the original database with only sticky threads + threads whose latest post was less than 2y old. Still didn't manage to do a successfull import. Sadly resuming the import creates duplicated threads.

One physical machine with 16GB of ram, original database in a mariadb docker container, destination DB on mongodb 3.4.1 running in the official docker container, nodebb on another docker container based on the official ubuntu xenial image.

Thanks
Thomas

bentael

@oPignonLibre there is a memory leak, i've known of this issue, but I am refactoring the importer plugin.

here's what you can do if the crash is because you ran out of memory,

go back to NodeBB Admin panel > Plugins > Import
Resume the import by clicking on "Last import was interrupted, try to resume"
the import will start to re-import all the posts, but it will skip the ones already imported

With 1.5M posts, you might have to do this a couple of times - I have definitely imported over 2M posts, and once 60M, it wasn't fun, but doable.

I just moved homes and I am still settling in, I will wrap up my refactor soon, and it will support NodeBB 1.4+ too, sorry the inconvenience.

bentael

wait, sorry I just read that.

Sadly resuming the import creates duplicated threads.

really? I have never had this issue. I will take a look, can you give me a small sample of data, and link me to the mybb exporter that you're using?