[nodebb-plugin-rss] RSS Feed plugin

<baris>

0.3.6 needs nodejs 4.2 since the to-markdown dependency was updated to 2.0.

Let me know if it still hapens with nodejs 4+

pichalite

@baris oops I didn't check that to-markdown required nodejs 4+. Just updated all dependencies to latest without checking.

Leonardo Galani

last stable version of nodejs

.. still..

9/4 12:08 [16030] - [31merror[39m: Error: ENOENT: no such file or directory, open '/home/forum/NodeBB/node_modules/nodebb-plugin-rss/node_modules/to-markdown/index.js'
    at Error (native)
    at Object.fs.openSync (fs.js:584:18)
    at Object.fs.readFileSync (fs.js:431:33)
    at Object.Module._extensions..js (module.js:421:20)
    at Module.load (module.js:357:32)
    at Function.Module._load (module.js:314:12)
    at Module.require (module.js:367:17)
    at require (internal/module.js:16:19)
    at Object.<anonymous> (/home/forum/NodeBB/node_modules/nodebb-plugin-rss/index.js:7:15)
    at Module._compile (module.js:413:34)
    at Object.Module._extensions..js (module.js:422:10)
    at Module.load (module.js:357:32)
    at Function.Module._load (module.js:314:12)
    at Module.require (module.js:367:17)
    at require (internal/module.js:16:19)
    at Object.Plugins.requireLibrary (/home/forum/NodeBB/src/plugins.js:42:33)
9/4 12:08 [16030] - [33mwarn[39m: [plugins] Unable to parse library for: nodebb-plugin-rss

Leonardo Galani

nothing that a npm install couldnt resolve.. but it should work outside the box

Leonardo Galani

@baris Some feeds (like wordpress feeds) are not putting the link of the original post.

Leonardo Galani

And.. its me again

Trying to get the content of the google testing blog

14/4 00:00 [29580] - [32minfo[39m: [plugin-rss] posting, http://feeds.feedburner.com/blogspot/RLXA - title: [object Object], published date: 2016-04-08T22:00:00Z
14/4 00:00 [29580] - [31merror[39m: TypeError: Cannot read property 'content' of undefined
    at /home/forum/NodeBB/node_modules/nodebb-plugin-rss/index.js:195:33
    at /home/forum/NodeBB/src/database/mongo/sorted.js:342:4
    at handleCallback (/home/forum/NodeBB/node_modules/mongodb/lib/utils.js:96:12)
    at /home/forum/NodeBB/node_modules/mongodb/lib/collection.js:1357:5
    at handleCallback (/home/forum/NodeBB/node_modules/mongodb/lib/utils.js:96:12)
    at /home/forum/NodeBB/node_modules/mongodb/lib/cursor.js:657:5
    at handleCallback (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/cursor.js:159:5)
    at nextFunction (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/cursor.js:662:5)
    at /home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/cursor.js:564:7
    at queryCallback (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/cursor.js:241:5)
    at Callbacks.emit (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/topologies/server.js:116:3)
    at null.messageHandler (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/topologies/server.js:291:23)
    at Socket.<anonymous> (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/connection/connection.js:285:22)
    at emitOne (events.js:90:13)
    at Socket.emit (events.js:182:7)
    at readableAddChunk (_stream_readable.js:153:18)
TypeError: Cannot read property 'content' of undefined
    at /home/forum/NodeBB/node_modules/nodebb-plugin-rss/index.js:195:33
    at /home/forum/NodeBB/src/database/mongo/sorted.js:342:4
    at handleCallback (/home/forum/NodeBB/node_modules/mongodb/lib/utils.js:96:12)
    at /home/forum/NodeBB/node_modules/mongodb/lib/collection.js:1357:5
    at handleCallback (/home/forum/NodeBB/node_modules/mongodb/lib/utils.js:96:12)
    at /home/forum/NodeBB/node_modules/mongodb/lib/cursor.js:657:5
    at handleCallback (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/cursor.js:159:5)
    at nextFunction (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/cursor.js:662:5)
    at /home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/cursor.js:564:7
    at queryCallback (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/cursor.js:241:5)
    at Callbacks.emit (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/topologies/server.js:116:3)
    at null.messageHandler (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/topologies/server.js:291:23)
    at Socket.<anonymous> (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/connection/connection.js:285:22)
    at emitOne (events.js:90:13)
    at Socket.emit (events.js:182:7)
    at readableAddChunk (_stream_readable.js:153:18)

<baris>

Published 0.3.7 which should fix the crash, you should see a warning in the logs if the feed entry doesn't have a proper content.

sohpingting

Hi @baris, thank you for creating this plugin.

I am new to node.js and nodeBB. Must I have a url that ends with ".rss" ? I am using http://ll-slack.herokuapp.com/ to create a rss feed from a channel on slack and I got the error in my log.

[[nodebb-plugin-rss:error]] Error pulling feed http://ll-slack.herokuapp.com/exampleurl winston.warning is not a function

When you open http://ll-slack.herokuapp.com/exampleurl, you will see this:

https://github.com/gozman/slack-rss RSS for Node Thu, 05 May 2016 07:38:51 GMT 30 is a service that sends girlfriends and wives presents like chocolate and tea every month]]> https://www.theguardian.exampleurl?CMP=Share_iOSApp_Other https://www.theguardian.exampleurl?CMP=Share_iOSApp_Other Thu, 05 May 2016 01:03:12 GMT

Please help

<baris>

@sohpingting I fixed the winston.warrning error in 0.3.8, the feed won't be posted if it can't be loaded by the yahoo feed api, so there is chance that the feed you are using isn't compatible.

zombie

I am getting the same node_modules/to-markdown errors

5/5 13:58 [6337] - [33mwarn[39m: [plugins/nodebb-plugin-sso-google] 
Hook `filter:user.delete` is deprecated, please use `static:user.delete` instead.

5/5 13:58 [6337] - [31merror[39m: SyntaxError: Unexpected token )
    at Module._compile (module.js:439:25)
    at Object.Module._extensions..js (module.js:474:10)
    at Module.load (module.js:356:32)
    at Function.Module._load (module.js:312:12)
    at Module.require (module.js:364:17)
    at require (module.js:380:17)
    at createHtmlParser (/home/cloud/NodeBB/node_modules/nodebb-plugin-rss/node_modules/to-markdown/lib/html-parser.js:32:17)
    at Object.<anonymous> (/home/cloud/NodeBB/node_modules/nodebb-plugin-rss/node_modules/to-markdown/lib/html-parser.js:76:63)
    at Module._compile (module.js:456:26)
    at Object.Module._extensions..js (module.js:474:10)

5/5 13:58 [6337] - [33mwarn[39m: [plugins] Unable to parse library for: nodebb-plugin-rss

I have latest node 4.4.3 and NPM version 2.15.1

The only other thing I can think of is I am using @trevor zenith theme that he just released.

B-738

@baris said in [nodebb-plugin-rss] RSS Feed plugin:

@sohpingting I fixed the winston.warrning error in 0.3.8, the feed won't be posted if it can't be loaded by the yahoo feed api, so there is chance that the feed you are using isn't compatible.
9/5 16:18 [21430] - info: [plugin-rss] posting, http://news.finance.ua/ru/rss - title: Кэмерон: выход Британии из ЕС угрожает безопасности в Европе, published date: 2016-05-09T13:00:00Z
9/5 16:18 [21430] - warn: [nodebb-plugin-rss] invalid content for entry, http://news.finance.ua/ru/rss
9/5 16:18 [21430] - info: [plugin-rss] posting, http://news.finance.ua/ru/rss - title: Украина заняла 5 место в рейтинге "кумовского капитализма", published date: 2016-05-09T12:00:00Z
9/5 16:18 [21430] - warn: [nodebb-plugin-rss] invalid content for entry, http://news.finance.ua/ru/rss
9/5 16:18 [21430] - info: [plugin-rss] posting, http://news.finance.ua/ru/rss - title: Нетрезвых водителей будут штрафовать на 40 тысяч грн, published date: 2016-05-09T11:00:00Z
9/5 16:18 [21430] - warn: [nodebb-plugin-rss] invalid content for entry, http://news.finance.ua/ru/rss
9/5 16:18 [21430] - info: [plugin-rss] posting, http://news.finance.ua/ru/rss - title: Украина сегодня отмечает День победы над нацизмом во Второй мировой войне, published date: 2016-05-09T10:00:00Z
9/5 16:18 [21430] - warn: [nodebb-plugin-rss] invalid content for entry, http://news.finance.ua/ru/rss

0.3.6 work fine! After update feed stop!

<baris>

Try with 0.3.9

B-738

@baris said in [nodebb-plugin-rss] RSS Feed plugin:

Try with 0.3.9

COOL!!! All work and receive update from RSS source! Very very thanks for quick reply and good support!

B-738

This post is deleted!

sohpingting

@baris thank you for fixing winston.warrning error in 0.3.8. You are the most awesome and fastest developer I have ever seen on getting bugs fixed. I also upgrade to 0.3.9 after getting "invalid content for entry".

The RSS is posting the title (into topic) and text which is great but the URL is not posted and no one can read more about the article. Can you include the posting for URL? Thank you in advance

<baris>

@sohpingting Can you post the rss feed url you are using so I can test. Do you want the rss feed url that you enter in the plugin ACP page to be added into the content or is it some other url?

sohpingting

@baris It's working! The URL is showing! It looks great! Thank you so much so much!!

Screenshot from the web:
0_1462932936864_Screen Shot 2016-05-11 at 10.14.59 AM.png

Below are 1 line of code inside the RSS (originally it's from a slack chat channel, we use herokuapp to get a rss version of it).

<code>https://github.com/gozman/slack-rss RSS for Node Wed, 11 May 2016 02:16:47 GMT 30 https:// backchannel . com / can-this-scientist-predict-your-childs-future-d2f43c2a1668#.lghxhsfw7 https: // backchannel . com / can-this-scientist-predict-your-childs-future-d2f43c2a1668#.lghxhsfw7 </code> (I added the spacing to prevent a preview).

sohpingting

@baris what did you change? the url is not showing anymore. And the iFramely plugin I used cannot generate a preview without a url.

<baris>

Nothing changed in the rss plugin, could be a change in the iframely plugin.

Leonardo Galani

So sad.. half of the RSS feeds i got on my forum doesn't display the link of the content