iterate on nodebb posts

[sanatisharif]

a plugin that execute some java-script as input on strings in noddbb Posts, Topics, Category ,... as callback then update it.

[julian]

I believe you'll need a bit more detail if you'd like assistance on this

[sanatisharif]

@julian said:

I believe you'll need a bit more detail if you'd like assistance on this

Hi, suppose you want to replace all word "Adobe" with the word "Adobe Inc." in the forum posts .
So using the above plug-ins, a JavaScript that replaces the word run on all posts and do that jobs.

Or suppose you want all ANSI Strings to utf8 encoding conversion, this time the above plug-ins the run a JavaScript code on all posts, topics and categories, etc.

excuse me if my English is poor,

[sanatisharif]

another example this plugin may be used to remove offensive words (profanity filters) on all existing posts or topics.

[sanatisharif]

@julian

I believe you'll need a bit more detail if you'd like assistance on this

please help me to write this plugin:

https://github.com/sohrabafard/nodebb-plugin-alter-allContent

[bentael]

@sanatisharif , the import plugin already does that, as long as you have actually completed the import process. You can iterate over all of these records, posts, topics, signatures, etc.. and convert them, either via custom JS or using the built-in HTML-To-Markdown, or BBCode-To-Markdown, or both at the same time.

The best part is that importer had already save a copy of the original content, so you can run it multiple times, each time as if it was the first.

,

[bentael]

Now, granted, your plugin https://github.com/sohrabafard/nodebb-plugin-alter-allContent, would be a little different, because it won't require the import plugin, nor any import process to occur.

@julian I believe @sanatisharif just want to iterate over all posts and topics and do some string operations on them. most likely to fix this, https://github.com/akhoury/nodebb-plugin-import/issues/108

@sanatisharif , im looking into this today

[bentael]

i'll fix the utf-8 thingy and we can write your plugin later, but it should be easy.

[sanatisharif]

@bentael yes I wan't this plugin to fix imported posts, also I can't use "Toggle Post-import-tools" because of this issue:

https://github.com/akhoury/nodebb-plugin-import/issues/143

[sanatisharif]

pre-parse function Syntax:

content = encoding.convert(content,"windows-1252","utf8").toString().replace(/�/gi,'ف');

[bentael]

@sanatisharif glad to know what worked for you. Can you share a link to your forum, i'd like to test the encoding on various operating systems

[sanatisharif]

@bentael
our forum:
آموزش مجازی آلاء
Our Association provides for poor students, free and quality education.
Thank you very much, you saved us!

[sanatisharif]

using this plugin - alter all existing content - we can remove all unrecognized bbcode to markdown plugin.

[bentael]

You can still use the parseBefore function and just select the "don't touch my content" and convert again, you virtually execute any JavaScript you need, as long as your return a string.

[sanatisharif]

@bentael I write this run_me.js file and run it with node run_me.js command, that iterate over all nodebb posts and run a JavaScript function on content filed and update it.

how to efficient it using db.collection('objects').updateMany() ?

content of run_me.js file:

var MongoClient = require('mongodb').MongoClient;
var assert = require('assert');
var ObjectId = require('mongodb').ObjectID;

//'mongodb://<dbuser>:<dbpassword>@<mongodb host>:<mongodb port>/<dbName>'
var url = ''; 

var converter = require("bbcode-to-markdown");

var convert = function(str){ // alter it and put your desire JavaScript cods.
        if ( typeof str == 'string' ){
                str = str.toString().toLowerCase();
                return converter(str);
        }
        else
                return str;
}

var updatePosts = function(db, callback){
   var cursor =db.collection('objects').find( { _key:{ $regex: /post:/i } } );
   cursor.each(function(err, doc) {
      assert.equal(err, null);

      if (doc != null ) {
        var newcontent = convert( doc.content );
        db.collection('objects').updateOne({ _key: doc._key }, { $set: { "content": newcontent } });
        console.log("after  update --"+doc._key);

      } else {
         callback();
      }
   });
}

MongoClient.connect(url, function(err, db) {
  assert.equal(null, err);

   updatePosts(db, function() {
        db.close();
   });

});