[nodebb-plugin-rss] RSS Feed plugin

[eva2000]

Anyway to populate the RSS feed plugin from a text file ?

i.e. feed.txt containing

rssurl1
rssurl2
rssurl3

and import that in a database listing that can also be selected on the 'Enter the RSS feed URL' field ? Would make it easier if you are setting up alot of RSS feeds

Also need for a way to backup/export the existing RSS feed settings/url and forum association and import it into a different NodeBB instance ?

[Guiri]

@baris, does the user already need to exist in the DB? If I want to scrape a sub-reddit, I should manually create the RedditBot user, right?

[baris]

Yes the user that you put in the plugin page should be an existing user on the forum. You can create one from the users page manually.

[Guiri]

Awesome, it's working great. Some feeds have the HTML ascii and tags still, such as & and <td>. Would enabling the html-sanitizer plugin instead of the one in the Markdown plugin potentially fix that? I assume all feeds are piped through one of these.

[julian]

@Guiri If you are seeing html tags like < and > in your post content, then they were escaped in the feed itself (probably). If they were imported as-is, they would've been sanitized out by the markdown plugin.

That is, if you specifically see things like <tr><td>, then the post content probably reads <tr><td>, and is not detected as HTML, since it's actually just escaped text.

[Bryant Young]

@baris You stole this plugin directly from my mind! Was looking for exactly this.

Howevever, I gave this a spin today and it works up until the point of of the body content. All of the posts came in, they're titled correctly and attributed to the correct user, however, the content is simply : {posts.content}, if you click edit on the post, it becomes [object Object] (it's trying to parse it).

Is this a result of the feed's format, or something else?

Im on nodebb v0.4.3.

[baris]

@Bryant-Young published a new version can you try that one? v0.1.9.

[Bryant Young]

@baris Alright, updated to 0.1.9, restarted nodebb, I'll report back when the next interval goes through and pulls in new comments if there's further issues. On a sidenote does it show plugin version anywhere?

[Bryant Young]

@baris Just got some new content pulled in - worked great!

Now I just needa figure out how to do bulk deletions of old content! Thanks again for fixing that!

[a_5mith]

@Bryant-Young Click the first topic, then hold shift and click the last one, and it will tick all the ones in between a la Google Mail.

[psychobunny]

@a_5mith said:

@Bryant-Young Click the first topic, then hold shift and click the last one, and it will tick all the ones in between a la Google Mail.

Haha wow, you're a power user. So much so that even I didn't know we could do that. I guess kudos to @baris for building that in

[baris]

Updated with tags input and topic timestamp. v0.1.11

[Silvina]

Was playing around with this plugin, its working great with posts and all, yet i felt something was missing.

-URL Source (URL of the Original Content)

• Title Prefix (RSS ?)

[Tanner]

An optional URL source at the end of the post would be nice.

[Silvina]

hi @baris

Recently i tried pulling this RSS feed, and it is failing, any idea why?

feed url: http://www.rssitfor.me/getrss?name=%40AmazonAppADay

running via nodebb dev,

the error shown is: error:
[[nodebb-plugin-rss:error]] Error pulling feed http://www.rssitfor.me/getrss?name=%40AmazonAppADay Cannot read property 'feed' of null

[omar5687]

Anyway to get the feed to post as read as to avoid spam in the unread tab?

[julian]

@Silvina Can you provide Baris with the full stack trace from that error?

[Silvina]

@julian I can probably do that. where can i find the full stack trace?
what ever that is shown on the ./nodebb dev console window?

[julian]

@Silvina said:

what ever that is shown on the ./nodebb dev console window?

Yep, that's it

[Silvina]

@Silvina said:

Rssitfor.me

(www.rssitfor.me)

[www-data@vultr forums-gameredge]$ ./nodebb dev
Launching NodeBB in "development" mode.
To run the production build of NodeBB, please use "forever".
More Information: https://docs.nodebb.org/en/latest/running/index.html
info: NodeBB v0.5.0 Copyright (C) 2013-2014 NodeBB Inc.
info: This program comes with ABSOLUTELY NO WARRANTY.
info: This is free software, and you are welcome to redistribute it under certain conditions.
info:
info: Time: Wed Sep 24 2014 23:20:12 GMT+0800 (SGT)
info: Initializing NodeBB v0.5.0
info: * using configuration stored in: /srv/forums-gameredge/config.json
info: * using redis store at 127.0.0.1:6379
info: * using themes stored in: /srv/forums-gameredge/node_modules
info: Base Configuration OK.
warn: You have no redis password setup!
morgan deprecated morgan(options): use morgan("default", options) instead src/logger.js:128:22
morgan deprecated default format: use combined format src/logger.js:128:22
info: [notifications.init] Registering jobs.
info: [user.startJobs] Registering User Jobs
info: Enabling 'trust proxy'
info: [plugins] Initializing plugins system
info: [themes] Using theme nodebb-theme-lavender
info: Middlewares loaded.
info: [plugins] Found 1 CSS file(s) for plugin nodebb-plugin-youtube

warn: [plugins/nodebb-plugin-mentions] This plugin may not be compatible with your version of NodeBB. This may cause unintended behaviour or crashing.
warn: [plugins/nodebb-plugin-mentions] In the event of an unresponsive NodeBB caused by this plugin, run ./nodebb reset plugin="nodebb-plugin-mentions".

info: [plugins] Found 1 LESS file(s) for plugin nodebb-plugin-mentions
info: [plugins] Found 2 js file(s) for plugin nodebb-plugin-mentions
warn: [plugins/nodebb-plugin-spoilers] staticDir is deprecated, use staticDirs instead
info: [plugins] Found 1 LESS file(s) for plugin nodebb-plugin-spoilers
info: [plugins] Found 1 js file(s) for plugin nodebb-plugin-spoilers
info: [plugins] Found 1 LESS file(s) for plugin nodebb-plugin-spam-be-gone
info: [plugins] Found 1 js file(s) for plugin nodebb-plugin-spam-be-gone
info: [plugins] Found 1 LESS file(s) for plugin nodebb-plugin-linkcheck
info: [plugins] Found 1 js file(s) for plugin nodebb-plugin-linkcheck
info: [plugins] Found 1 js file(s) for plugin nodebb-plugin-twitter
info: [plugins] Found 1 LESS file(s) for plugin nodebb-plugin-emoji-extended
info: [plugins] Found 2 js file(s) for plugin nodebb-plugin-emoji-extended
info: [plugins] Found 1 js file(s) for plugin nodebb-theme-blacknred
info: [plugins] Found 1 CSS file(s) for plugin nodebb-widget-essentials
info: [plugins] Found 1 LESS file(s) for plugin nodebb-plugin-markdown
info: [plugins] Found 2 js file(s) for plugin nodebb-plugin-markdown
warn: [plugins/nodebb-plugin-featured-threads] staticDir is deprecated, use staticDirs instead
info: [plugins] Found 1 CSS file(s) for plugin nodebb-plugin-featured-threads
info: [plugins] Found 2 js file(s) for plugin nodebb-plugin-desktop-notifications
info: [plugins] Found 3 js file(s) for plugin nodebb-theme-lavender
info: [plugins] Loaded plugin: nodebb-plugin-rss
info: [plugins] Loaded plugin: nodebb-plugin-soundcloud
info: [plugins] Loaded plugin: nodebb-plugin-twitchtv
info: [plugins] Loaded plugin: nodebb-plugin-emailer-mailgun
info: [plugins] Loaded plugin: nodebb-plugin-youtube
info: [plugins] Loaded plugin: nodebb-plugin-mentions
info: [plugins] Loaded plugin: nodebb-plugin-spoilers
info: [plugins] Loaded plugin: nodebb-plugin-spam-be-gone
info: [plugins] Loaded plugin: nodebb-plugin-linkcheck
info: [plugins] Loaded plugin: nodebb-plugin-twitter
info: [plugins] Loaded plugin: nodebb-plugin-soundpack-default
info: [plugins] Loaded plugin: nodebb-plugin-emoji-extended
info: [plugins] Loaded plugin: nodebb-theme-blacknred
info: [plugins] Loaded plugin: nodebb-widget-essentials
info: [plugins] Loaded plugin: nodebb-plugin-imgur
info: [plugins] Loaded plugin: nodebb-plugin-markdown
info: [plugins] Loaded plugin: nodebb-plugin-slack
info: [plugins] Loaded plugin: nodebb-plugin-featured-threads
info: [plugins] Loaded plugin: nodebb-plugin-desktop-notifications
info: [plugins] Loaded plugin: nodebb-plugin-dbsearch
info: [plugins] Loaded plugin: nodebb-theme-lavender
info: [plugins] Sorting hooks to fire in priority sequence
info: [plugins] Plugins OK
info: [meta/css] Minifying LESS/CSS
warn: [plugins] The action:app.load hook is deprecated in favour of static:app.load, please notify the developers of the following plugins:

• nodebb-plugin-featured-threads
  warn: [meta/css] File not found! nodebb-plugin-featured-threads/css/main.css
  info: [plugins/spam-be-gone] Settings loaded
  info: [sounds] Sounds OK
  info: [meta/css] Done.
  info: [themes] Compiling templates
  info: [themes] Successfully compiled templates.
  info: NodeBB attempting to listen on: 0.0.0.0:4567
  info: NodeBB is now listening on: 0.0.0.0:4567
  info: [meta/js] Successfully minified.
  info: [meta/js] Retrieved Mapping.
  info: [meta/js] Compilation complete
  info: NodeBB Ready
  info: [socket] uid 1 (1JqnG1PdkeqC-cOkP5ac) has successfully reconnected.
  warn: Route requested but not found: /css/assets/vendor/masonry.js
  warn: Route requested but not found: /css/assets/vendor/imagesLoaded.js
  warn: Route requested but not found: /css/assets/vendor/masonry.js
  warn: Route requested but not found: /css/assets/vendor/imagesLoaded.js
  warn: Route requested but not found: /css/assets/vendor/imagesLoaded.js
  warn: Route requested but not found: /css/assets/vendor/masonry.js
  error: [[nodebb-plugin-rss:error]] Error pulling feed http://www.rssitfor.me/getrss?name=%40AmazonAppADay Cannot read property 'feed' of null