Source forums exporters to NodeBB, I need your DB Dump.
-
@bentael If you're interested, I could provide you with a db dump of a 60k users 1.4 mio posts smf instance. It's heavily modified, but I guess the database layout shouldn't be too different. I'd be interested if nodebb can scale to that and how a running instance of it would perform (and if it works well, if my users would like it).
-
have a feeling the "convert" process will barf somewhere in the way.
But your DB would be a great way to test both the importer's and NodeBB's ability to scale.Awesome thanks!
-
Thought of something: smf saves for each user and thread up to what post that user has read. does nodebb do this? if so, does your importer retain that information?
I'm wondering because on the "unread" page in nodebb, there seem to be only links to the latest post and the first of a thread, but no "to latest unread" which is probably what the user wants in almost all cases. This is a lot of data to save (users × threads) which is why a lot of forum softwares didn't bother back in the day, but I remember this was one of the killer features of smf back when I changed to it.
-
When you load a topic, if you've been to that topic before. It will bring up a quick alert window asking if you want to return to where you were last in that topic. Which would usually be the first unread post. As for if it can be transported over from smf, not with the exporter I made. It's been a long time since I transferred from smf, but I recall that smf saves the highest PID of your last visit, any after that are considered new, which takes you to last PID plus one post. I'm not sure where this is saved however. I'm also not sure if that's something that nodebb can import.
-
Oh, there it is. Didn't see that before. Seems like an unnecessary extra click to me, going to the first unread post really is the norm rather than a special use case...
Hmm. I certainly would like to have those imported. Why do you think it's not something nodebb can import? The table is smf_log_topic, and it's pretty much just tuples of (id_member,id_topic,id_msg). Is nodebb's way of saving this vastly different?
-
@Valodim
That's definitely possible. It might take more iterations over the records, which means more importing time, but doable.Right now I am trying to import your 1.1M posts and getting segmentation fault errors, once I get passed those, I'll look into adding more features.
-
@Steve and @xCausxn, the vbulletin plugin is released.
@Steve Thanks again for your db dump.
you don't need to install it, just select it from the list of source exporters in the config.
It's not yet compatible with nodebb@master, you need to use the latest stable release.
nodebb@v0.5.0-4
Also, I recommend that you use the latest importer plugin nodebb-plugin-import@0.2.4-1
so
cd /path/to/nodebb rm -rf node_modules/nodebb-plugin-import npm install nodebb-plugin-import # or npm update nodebb-plugin-import # then activate it from the ACP and use it in there.
Also, after the import is complete, you can use the post-import tools to convert the BBCode to Markdown
Let me know if you're having issues.