Source forums exporters to NodeBB, I need your DB Dump.

[Valodim]

@bentael If you're interested, I could provide you with a db dump of a 60k users 1.4 mio posts smf instance. It's heavily modified, but I guess the database layout shouldn't be too different. I'd be interested if nodebb can scale to that and how a running instance of it would perform (and if it works well, if my users would like it).

[bentael]

@Valodim I've imported a UBB forum with over 320k+ posts, see it live
NodeBB can scale

But yea, i'd love to see over a 1 mil posts

[Valodim]

Cool. I'll create a cleaned db dump one of these days

[bentael]

have a feeling the "convert" process will barf somewhere in the way.
But your DB would be a great way to test both the importer's and NodeBB's ability to scale.

Awesome thanks!

[Tim Frost]

greatest forum around!

[a_5mith]

@Tim-Frost said:

greatest forum around!

Saviour of the universe IMO.

http://youtu.be/RzDQV4tvEDM

[Valodim]

Thought of something: smf saves for each user and thread up to what post that user has read. does nodebb do this? if so, does your importer retain that information?

I'm wondering because on the "unread" page in nodebb, there seem to be only links to the latest post and the first of a thread, but no "to latest unread" which is probably what the user wants in almost all cases. This is a lot of data to save (users × threads) which is why a lot of forum softwares didn't bother back in the day, but I remember this was one of the killer features of smf back when I changed to it.

[a_5mith]

When you load a topic, if you've been to that topic before. It will bring up a quick alert window asking if you want to return to where you were last in that topic. Which would usually be the first unread post. As for if it can be transported over from smf, not with the exporter I made. It's been a long time since I transferred from smf, but I recall that smf saves the highest PID of your last visit, any after that are considered new, which takes you to last PID plus one post. I'm not sure where this is saved however. I'm also not sure if that's something that nodebb can import.

[Valodim]

Oh, there it is. Didn't see that before. Seems like an unnecessary extra click to me, going to the first unread post really is the norm rather than a special use case...

Hmm. I certainly would like to have those imported. Why do you think it's not something nodebb can import? The table is smf_log_topic, and it's pretty much just tuples of (id_member,id_topic,id_msg). Is nodebb's way of saving this vastly different?

[a_5mith]

I didn't say NodeBB couldn't import it, I'm just not sure, I'd need someone like @julian or @baris to confirm if there's a way of importing the read state on a topic per user.

[bentael]

@Valodim
That's definitely possible. It might take more iterations over the records, which means more importing time, but doable.

Right now I am trying to import your 1.1M posts and getting segmentation fault errors, once I get passed those, I'll look into adding more features.

[Valodim]

Sweet. Thanks for your work

[Steve]

@bentael said:

b[email protected]

Just emailed you a link to my database from my offroading forum. Not the biggest, not the smallest.

4,575 threads
62,418 posts
635 members

vBulletin 4.2.2

[bentael]

@Steve

awesome! thanks man, I will test that VB exporter and release it soon!

[Steve]

Killer. Looking forward to trying it out. Need to breathe new life into that site. Change is probably the answer.

[Tanner]

@bentael can you list the forums that you still need DB dumps for?

[bentael]

https://github.com/akhoury/nodebb-plugin-import/labels/Blocked-Need-A-DB-Dump

[bentael]

@Steve and @xCausxn, the vbulletin plugin is released.

@Steve Thanks again for your db dump.

you don't need to install it, just select it from the list of source exporters in the config.

It's not yet compatible with [email protected], you need to use the latest stable release. [email protected]

Also, I recommend that you use the latest importer plugin [email protected]

so

cd /path/to/nodebb

rm -rf node_modules/nodebb-plugin-import
npm install nodebb-plugin-import

# or 
npm update nodebb-plugin-import

# then activate it from the ACP and use it in there.

Also, after the import is complete, you can use the post-import tools to convert the BBCode to Markdown

Let me know if you're having issues.

[xCausxn]

@bentael Legend :d

If your not busy could you help me with some nodejs

[bentael]

i saw your chat msg, ill reply there