WordPress to NodeBB
-
wordpress exporter is coming soon, probably couple of weeks, very busy this month guys sorry.
track it here
https://github.com/a5mith/nodebb-plugin-import-wordpress -
-
@Rahul-Ramesh said:
@a_5mith this would really help us if we could shift from wordpress to nodebb. Since wordpress is one of the most popular cms, this plugin might help a lot of people.
Any deadline for this one? Really curious to knowAs an extension to the chat message you sent, this is the progress on the Wordpress Plugin.
@bentael said:
wordpress exporter is coming soon, probably couple of weeks, very busy this month guys sorry.
track it here
https://github.com/a5mith/nodebb-plugin-import-wordpress -
@Rahul-Ramesh said:
@a_5mith @bentael really nice to hear that
Just out of curiosity, how will the import preserve the images that are uploaded into wordpress media library.Not thought about that. I guess the import process would copy over the link to the image from the post content, so if the server hosting the images is still live, then the images would be transferred (assuming Wordpress uses absolute URLs). However this would break when you transferred the domain name over.
One option could be to create the same folder structure in the public folder of Nodebb, so you'd have a folder that looks something like
public/wp-content/theme-name/images/uploads/then the image file names, then all you'd need to do is copy all the images from your existing server to the new one. I've not used Wordpress for a while, so I'm not sure if that would work though. Depends how the images are linked. I could have a look into it when I've got a spare 10 minutes. -
about the images:
I would keep them live in their own links, or if you move them, you can create a JSON map to redirect all old links to the new ones.
You can basically do the same thing with old categories, topics, and user links (maybe not for posts links because a lot of them are just #pid which are handled on the JS)read this note: https://github.com/akhoury/nodebb-plugin-import#imported-now-what
and see this module: https://github.com/akhoury/RedirectBB - you can basically use it for any linksOR if you're fancy, and dont want to run another process, you can use http://wiki.nginx.org/HttpMapModule
PS: Wordpress importer soon, maybe end of next month. it's ok to bug me every 2 weeks so I wont forget.
-
any of you have a decent wordpress 4.x DB I can develop against?
-
got it thanks
-
@vegetagz6 holy crap, that WP DB is too.. weird... well, I don't understand few things:
According to this official WP guide, http://codex.wordpress.org/Database_Description (which only goes up to 3.8, but heck, close enough) the WP Database schema should be, fairly, simple.
Looking at the guide, I can definitely write an exporter for it in few hours, but that example you sent me threw me off.
For example, based on the schema below
- What the hell are the
wp_{NUMBER}_{TABLENAME}such aswp_9_posts/wp_9_commentsandwp_12_posts/wp_12_comments - Are these some attempt of pagination? migration results? that schema doesn't even have a regular
wp_poststable? - Where are the "other" numbers, such as 1, 2, 3, .... 8?
- am I suppose to scan the schema for all of these relevant tables and join them?
I understand you might have some plugins that might edit the schema, but this is too non-standard, I don't think i can write a general purpose WP exporter based on this schema.
Even reading the WP DB handler source seems pretty straight forward. https://github.com/WordPress/WordPress/blob/master/wp-includes/wp-db.php
I am definitely missing something and I need some guidance from a WP guru.
wp_9_commentmeta wp_9_comments wp_9_layerslider wp_9_links wp_9_options wp_9_postmeta wp_9_posts wp_9_terms wp_9_term_relationships wp_9_term_taxonomy wp_9_wpstickies wp_9_wpstickies_images wp_10_layerslider wp_10_yapbimage wp_11_layerslider wp_11_revslider_settings wp_11_revslider_sliders wp_11_revslider_slides wp_12_commentmeta wp_12_comments wp_12_layerslider wp_12_links wp_12_options wp_12_postmeta wp_12_posts wp_12_terms wp_12_term_relationships wp_12_term_taxonomy wp_aiowps_events wp_aiowps_failed_logins wp_aiowps_global_meta wp_aiowps_login_activity wp_aiowps_login_lockdown wp_author_love wp_bbplike wp_blogs wp_blog_versions wp_bpspro_login_security wp_bpspro_seclog_ignore wp_bp_activity wp_bp_activity_meta wp_bp_album wp_bp_album_tags wp_bp_cp_galleries wp_bp_easyalbums_templates wp_bp_friends wp_bp_links wp_bp_links_categories wp_bp_links_linkmeta wp_bp_links_votes wp_bp_messages_messages wp_bp_messages_notices wp_bp_messages_recipients wp_bp_notifications wp_bp_user_blogs wp_bp_user_blogs_blogmeta wp_bp_xprofile_data wp_bp_xprofile_fields wp_bp_xprofile_groups wp_bp_xprofile_meta wp_bwwc_btc_addresses wp_cntctfrm_field wp_commentmeta wp_comments wp_comments_fbseo wp_cp wp_crumina_slider wp_cr_ips wp_dashboard_chat wp_delucksLoveButton wp_delucksLoveButtonStatistics wp_domain_mapping wp_domain_mapping_logins wp_download_log wp_easy_gallery wp_easy_gallery_images wp_ewwwio_images wp_folderfeed_playlist wp_formmaker wp_formmaker_sessions wp_formmaker_submits wp_formmaker_themes wp_formmaker_views wp_frontend_builder_options wp_frontend_builder_pages wp_gallery_albums wp_gallery_pics wp_gallery_settings wp_gdsr_data_article wp_gdsr_data_category wp_gdsr_data_comment wp_gdsr_ips wp_gdsr_moderate wp_gdsr_multis wp_gdsr_multis_data wp_gdsr_multis_trend wp_gdsr_multis_values wp_gdsr_templates wp_gdsr_votes_log wp_gdsr_votes_trend wp_gtabber wp_hmp_playlist wp_hmp_rating wp_html5mp3_items wp_html5mp3_playlist wp_html5mp3_sales wp_ilightbox wp_imsanity wp_itro_plugin_field wp_itro_plugin_option wp_itsec_lockouts wp_itsec_log wp_itsec_temp wp_kklike wp_kklikeuser wp_layerslider wp_like_dislike_counters wp_links wp_lydl_posts wp_lydl_poststimestamp wp_monalisa wp_newsletter wp_newsletter_emails wp_newsletter_stats wp_nggv_settings wp_nggv_votes wp_ngg_album wp_ngg_gallery wp_ngg_pictures wp_nh_locations wp_nxs_log wp_oauth2_access_tokens wp_oauth2_auth_codes wp_oauth2_clients wp_oauth2_options wp_oauth2_refresh_tokens wp_om_hits_log wp_options wp_option_tree - What the hell are the
-
@bentael Could it not just be the table names? Rather than just wp_comments etc, owner of that database may have used wp_9_comments. Alternatively, it could be part of a multi site install. There's a data plugin for Wordpress that will create X number of whatever you need, comments, posts, etc. You could probably compare them, see how they differ.
-
@a_5mith as far as i know, you can't change the CORE table names, that would break WP. You can only use a custom "table prefix", that's it.
Also. the numbers dont add up, let alone that there are 2 main tables missing,
wp_postsandwp_users@vegetagz6 said:
1600+ posts
wp_9_postshas 105 rows
wp_12_postshas 2 rowsThere are no more
wp_*poststables, where are the 1600+ posts?400 comments
wp_9_commentshas 16 rows
wp_12_commenthas 1 row
wp_commentshas 694 rows <- OK, maybe I should filter300+ users
There is no
wp_userstable??this is a list of all the tables in that schema with their rows count
wp_9_commentmeta: ROWCOUNT=7 wp_9_comments: ROWCOUNT=16 wp_9_layerslider: ROWCOUNT=0 wp_9_links: ROWCOUNT=0 wp_9_options: ROWCOUNT=217 wp_9_postmeta: ROWCOUNT=342 wp_9_posts: ROWCOUNT=105 wp_9_terms: ROWCOUNT=21 wp_9_term_relationships: ROWCOUNT=48 wp_9_term_taxonomy: ROWCOUNT=21 wp_9_wpstickies: ROWCOUNT=0 wp_9_wpstickies_images: ROWCOUNT=0 wp_10_layerslider: ROWCOUNT=0 wp_10_yapbimage: ROWCOUNT=1 wp_11_layerslider: ROWCOUNT=0 wp_11_revslider_settings: ROWCOUNT=0 wp_11_revslider_sliders: ROWCOUNT=0 wp_11_revslider_slides: ROWCOUNT=0 wp_12_commentmeta: ROWCOUNT=0 wp_12_comments: ROWCOUNT=1 wp_12_layerslider: ROWCOUNT=0 wp_12_links: ROWCOUNT=0 wp_12_options: ROWCOUNT=101 wp_12_postmeta: ROWCOUNT=1 wp_12_posts: ROWCOUNT=2 wp_12_terms: ROWCOUNT=1 wp_12_term_relationships: ROWCOUNT=1 wp_12_term_taxonomy: ROWCOUNT=1 wp_aiowps_events: ROWCOUNT=0 wp_aiowps_failed_logins: ROWCOUNT=0 wp_aiowps_global_meta: ROWCOUNT=0 wp_aiowps_login_activity: ROWCOUNT=0 wp_aiowps_login_lockdown: ROWCOUNT=0 wp_author_love: ROWCOUNT=0 wp_bbplike: ROWCOUNT=0 wp_blogs: ROWCOUNT=3 wp_blog_versions: ROWCOUNT=4 wp_bpspro_login_security: ROWCOUNT=0 wp_bpspro_seclog_ignore: ROWCOUNT=0 wp_bp_activity: ROWCOUNT=1,052 wp_bp_activity_meta: ROWCOUNT=582 wp_bp_album: ROWCOUNT=0 wp_bp_album_tags: ROWCOUNT=0 wp_bp_cp_galleries: ROWCOUNT=0 wp_bp_easyalbums_templates: ROWCOUNT=3 wp_bp_friends: ROWCOUNT=112 wp_bp_links: ROWCOUNT=1 wp_bp_links_categories: ROWCOUNT=4 wp_bp_links_linkmeta: ROWCOUNT=1 wp_bp_links_votes: ROWCOUNT=0 wp_bp_messages_messages: ROWCOUNT=3 wp_bp_messages_notices: ROWCOUNT=0 wp_bp_messages_recipients: ROWCOUNT=6 wp_bp_notifications: ROWCOUNT=92 wp_bp_user_blogs: ROWCOUNT=47 wp_bp_user_blogs_blogmeta: ROWCOUNT=3 wp_bp_xprofile_data: ROWCOUNT=4,370 wp_bp_xprofile_fields: ROWCOUNT=5 wp_bp_xprofile_groups: ROWCOUNT=2 wp_bp_xprofile_meta: ROWCOUNT=18 wp_bwwc_btc_addresses: ROWCOUNT=0 wp_cntctfrm_field: ROWCOUNT=13 wp_commentmeta: ROWCOUNT=4,734 wp_comments: ROWCOUNT=694 wp_comments_fbseo: ROWCOUNT=2 wp_cp: ROWCOUNT=30 wp_crumina_slider: ROWCOUNT=0 wp_cr_ips: ROWCOUNT=1 wp_dashboard_chat: ROWCOUNT=9 wp_delucksLoveButton: ROWCOUNT=0 wp_delucksLoveButtonStatistics: ROWCOUNT=0 wp_domain_mapping: ROWCOUNT=0 wp_domain_mapping_logins: ROWCOUNT=0 wp_download_log: ROWCOUNT=507 wp_easy_gallery: ROWCOUNT=0 wp_easy_gallery_images: ROWCOUNT=0 wp_ewwwio_images: ROWCOUNT=34,904 wp_folderfeed_playlist: ROWCOUNT=10 wp_formmaker: ROWCOUNT=2 wp_formmaker_sessions: ROWCOUNT=0 wp_formmaker_submits: ROWCOUNT=0 wp_formmaker_themes: ROWCOUNT=41 wp_formmaker_views: ROWCOUNT=2 wp_frontend_builder_options: ROWCOUNT=124 wp_frontend_builder_pages: ROWCOUNT=0 wp_gallery_albums: ROWCOUNT=0 wp_gallery_pics: ROWCOUNT=0 wp_gallery_settings: ROWCOUNT=1 wp_gdsr_data_article: ROWCOUNT=686 wp_gdsr_data_category: ROWCOUNT=0 wp_gdsr_data_comment: ROWCOUNT=213 wp_gdsr_ips: ROWCOUNT=0 wp_gdsr_moderate: ROWCOUNT=0 wp_gdsr_multis: ROWCOUNT=0 wp_gdsr_multis_data: ROWCOUNT=0 wp_gdsr_multis_trend: ROWCOUNT=0 wp_gdsr_multis_values: ROWCOUNT=0 wp_gdsr_templates: ROWCOUNT=44 wp_gdsr_votes_log: ROWCOUNT=323 wp_gdsr_votes_trend: ROWCOUNT=278 wp_gtabber: ROWCOUNT=10 wp_hmp_playlist: ROWCOUNT=0 wp_hmp_rating: ROWCOUNT=0 wp_html5mp3_items: ROWCOUNT=46 wp_html5mp3_playlist: ROWCOUNT=1 wp_html5mp3_sales: ROWCOUNT=0 wp_ilightbox: ROWCOUNT=11 wp_imsanity: ROWCOUNT=2 wp_itro_plugin_field: ROWCOUNT=1 wp_itro_plugin_option: ROWCOUNT=77 wp_itsec_lockouts: ROWCOUNT=0 wp_itsec_log: ROWCOUNT=0 wp_itsec_temp: ROWCOUNT=0 wp_kklike: ROWCOUNT=0 wp_kklikeuser: ROWCOUNT=0 wp_layerslider: ROWCOUNT=6 wp_like_dislike_counters: ROWCOUNT=1 wp_links: ROWCOUNT=0 wp_lydl_posts: ROWCOUNT=70 wp_lydl_poststimestamp: ROWCOUNT=126 wp_monalisa: ROWCOUNT=17 wp_newsletter: ROWCOUNT=188 wp_newsletter_emails: ROWCOUNT=10 wp_newsletter_stats: ROWCOUNT=156 wp_nggv_settings: ROWCOUNT=15 wp_nggv_votes: ROWCOUNT=0 wp_ngg_album: ROWCOUNT=1 wp_ngg_gallery: ROWCOUNT=21 wp_ngg_pictures: ROWCOUNT=677 wp_nh_locations: ROWCOUNT=0 wp_nxs_log: ROWCOUNT=0 wp_oauth2_access_tokens: ROWCOUNT=0 wp_oauth2_auth_codes: ROWCOUNT=0 wp_oauth2_clients: ROWCOUNT=1 wp_oauth2_options: ROWCOUNT=0 wp_oauth2_refresh_tokens: ROWCOUNT=0 wp_om_hits_log: ROWCOUNT=1,207 wp_options: ROWCOUNT=5,521 wp_option_tree: ROWCOUNT=38 -
I installed a fresh WP 4 install, and here's how a fresh DB looks like - i can write an exporter for this, anything non-standard needs its own exporter, unless there is some logical code path we can take for each case, then yea
-
@bentael said:
I installed a fresh WP 4 install, and here's how a fresh DB looks like - i can write an exporter for this, anything non-standard needs its own exporter, unless there is some logical code path we can take for each case, then yea
I'd say that would be the most logical approach. I'm pretty sure the relevant pieces could be extracted from a custom Wordpress install, and placed into a clean one.
-
Hmm, ya that database was part of a multi site install and there are have been used some plugins which added lot more tables. But like a_5mith mentioned, in case of old sites likes these which have modified databases, is not it possible to extract the required ones alone?
Another idea which struck me was, if such databases will need their own exporter, why not, in my case, I transfer the required wordpress database of this site to another simple new install of non multi site wordpress, and then export it to nodebb. Because wordpress to wordpress exporters usually figure all out all type of complicated databases. So do you think such two stage exports will do the trick for multi site or complicated wordpress databases?
Am asking this because, in our case, as you saw, the database has been modified a lot, because we used many plugins, some which I made and some from codecanyon, which introduced some really necessary functions for us.
@bentael
