[nodebb-plugin-rss] RSS Feed plugin

Leonardo Galani

Hi.. Some wordpress feeds are not showing the link to the original content ( ex: https://perdidonoteste.wordpress.com/feed/ )

The "error" No new feed is returned" only happens sometimes. ..

Leonardo Galani

and getting this other error

6/4 16:00 [30892] - [32minfo[39m: [plugin-rss] posting, http://portaltestesoftware.blogspot.com/feeds/posts/default - title: [object Object], published date: 2016-03-30T17:55:00Z

6/4 16:00 [30892] - [31merror[39m: TypeError: Cannot read property 'content' of undefined
    at /home/forum/NodeBB/node_modules/nodebb-plugin-rss/index.js:195:33
    at /home/forum/NodeBB/src/database/mongo/sorted.js:342:4
    at handleCallback (/home/forum/NodeBB/node_modules/mongodb/lib/utils.js:96:12)
    at /home/forum/NodeBB/node_modules/mongodb/lib/collection.js:1357:5
    at handleCallback (/home/forum/NodeBB/node_modules/mongodb/lib/utils.js:96:12)
    at /home/forum/NodeBB/node_modules/mongodb/lib/cursor.js:657:5
    at handleCallback (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/cursor.js:159:5)
    at nextFunction (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/cursor.js:662:5)
    at /home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/cursor.js:564:7
    at queryCallback (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/cursor.js:241:5)
    at Callbacks.emit (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/topologies/server.js:116:3)
    at null.messageHandler (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/topologies/server.js:291:23)
    at Socket.<anonymous> (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/connection/connection.js:285:22)
    at Socket.emit (events.js:95:17)
    at Socket.<anonymous> (_stream_readable.js:765:14)
    at Socket.emit (events.js:92:17)
TypeError: Cannot read property 'content' of undefined
    at /home/forum/NodeBB/node_modules/nodebb-plugin-rss/index.js:195:33
    at /home/forum/NodeBB/src/database/mongo/sorted.js:342:4
    at handleCallback (/home/forum/NodeBB/node_modules/mongodb/lib/utils.js:96:12)
    at /home/forum/NodeBB/node_modules/mongodb/lib/collection.js:1357:5
    at handleCallback (/home/forum/NodeBB/node_modules/mongodb/lib/utils.js:96:12)
    at /home/forum/NodeBB/node_modules/mongodb/lib/cursor.js:657:5
    at handleCallback (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/cursor.js:159:5)
    at nextFunction (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/cursor.js:662:5)
    at /home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/cursor.js:564:7
    at queryCallback (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/cursor.js:241:5)
    at Callbacks.emit (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/topologies/server.js:116:3)
    at null.messageHandler (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/topologies/server.js:291:23)
    at Socket.<anonymous> (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/connection/connection.js:285:22)
    at Socket.emit (events.js:95:17)
    at Socket.<anonymous> (_stream_readable.js:765:14)
    at Socket.emit (events.js:92:17)

pichalite

@Leonardo-Galani What's your NodeBB version and what version of the plugin are you using?

tkiblin

[[modules:composer.user_said_in, @pichalite, [nodebb-plugin-rss] RSS Feed plugin]]

@Leonardo-Galani What's your NodeBB version and what version of the plugin are you using?

Doesn't work for me, can't see it in the menu, see here https://community.nodebb.org/topic/8109/rss-poster/4

Running latest 102 and .35 of the plugin.

Leonardo Galani

@pichalite im using last stable of nodebb
NodeBB v1.0.2.

nodebb-plugin-rss: Installed 0.3.5 | Latest 0.3.5

pichalite

@Leonardo-Galani @tkiblin seems to be an issue with the plugin dependencies. Sent a PR to update dependencies. The PR is merged but the plugin is not published to NPM with changes. You can clone it using git.

Deactivate and uninstall the plugin
cd /path_to_nodebb/node_modules
git clone https://github.com/barisusakli/nodebb-plugin-rss.git
cd nodebb-plugin-rss
npm i
restart NodeBB and activate the plugin from ACP -> Plugins

julian

@pichalite Seems @baris is the only publisher for that plugin, so we'll wait for him to come online (in a couple hours I guess) so he can publish

<baris>

Published 0.3.6.

Leonardo Galani

new error

/4 15:18 [13435] - [31merror[39m: SyntaxError: Unexpected token ILLEGAL
    at Module._compile (module.js:439:25)
    at Object.Module._extensions..js (module.js:474:10)
    at Module.load (module.js:356:32)
    at Function.Module._load (module.js:312:12)
    at Module.require (module.js:364:17)
    at require (module.js:380:17)
    at Object.<anonymous> (/home/forum/NodeBB/node_modules/nodebb-plugin-rss/node_modules/to-markdown/index.js:23:15)
    at Module._compile (module.js:456:26)
    at Object.Module._extensions..js (module.js:474:10)
    at Module.load (module.js:356:32)
    at Function.Module._load (module.js:312:12)
    at Module.require (module.js:364:17)
    at require (module.js:380:17)
    at Object.<anonymous> (/home/forum/NodeBB/node_modules/nodebb-plugin-rss/index.js:7:15)
    at Module._compile (module.js:456:26)
    at Object.Module._extensions..js (module.js:474:10)
8/4 15:18 [13435] - [33mwarn[39m: [plugins] Unable to parse library for: nodebb-plugin-rss

<baris>

0.3.6 needs nodejs 4.2 since the to-markdown dependency was updated to 2.0.

Let me know if it still hapens with nodejs 4+

pichalite

@baris oops I didn't check that to-markdown required nodejs 4+. Just updated all dependencies to latest without checking.

Leonardo Galani

last stable version of nodejs

.. still..

9/4 12:08 [16030] - [31merror[39m: Error: ENOENT: no such file or directory, open '/home/forum/NodeBB/node_modules/nodebb-plugin-rss/node_modules/to-markdown/index.js'
    at Error (native)
    at Object.fs.openSync (fs.js:584:18)
    at Object.fs.readFileSync (fs.js:431:33)
    at Object.Module._extensions..js (module.js:421:20)
    at Module.load (module.js:357:32)
    at Function.Module._load (module.js:314:12)
    at Module.require (module.js:367:17)
    at require (internal/module.js:16:19)
    at Object.<anonymous> (/home/forum/NodeBB/node_modules/nodebb-plugin-rss/index.js:7:15)
    at Module._compile (module.js:413:34)
    at Object.Module._extensions..js (module.js:422:10)
    at Module.load (module.js:357:32)
    at Function.Module._load (module.js:314:12)
    at Module.require (module.js:367:17)
    at require (internal/module.js:16:19)
    at Object.Plugins.requireLibrary (/home/forum/NodeBB/src/plugins.js:42:33)
9/4 12:08 [16030] - [33mwarn[39m: [plugins] Unable to parse library for: nodebb-plugin-rss

Leonardo Galani

nothing that a npm install couldnt resolve.. but it should work outside the box

Leonardo Galani

@baris Some feeds (like wordpress feeds) are not putting the link of the original post.

Leonardo Galani

And.. its me again

Trying to get the content of the google testing blog

14/4 00:00 [29580] - [32minfo[39m: [plugin-rss] posting, http://feeds.feedburner.com/blogspot/RLXA - title: [object Object], published date: 2016-04-08T22:00:00Z
14/4 00:00 [29580] - [31merror[39m: TypeError: Cannot read property 'content' of undefined
    at /home/forum/NodeBB/node_modules/nodebb-plugin-rss/index.js:195:33
    at /home/forum/NodeBB/src/database/mongo/sorted.js:342:4
    at handleCallback (/home/forum/NodeBB/node_modules/mongodb/lib/utils.js:96:12)
    at /home/forum/NodeBB/node_modules/mongodb/lib/collection.js:1357:5
    at handleCallback (/home/forum/NodeBB/node_modules/mongodb/lib/utils.js:96:12)
    at /home/forum/NodeBB/node_modules/mongodb/lib/cursor.js:657:5
    at handleCallback (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/cursor.js:159:5)
    at nextFunction (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/cursor.js:662:5)
    at /home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/cursor.js:564:7
    at queryCallback (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/cursor.js:241:5)
    at Callbacks.emit (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/topologies/server.js:116:3)
    at null.messageHandler (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/topologies/server.js:291:23)
    at Socket.<anonymous> (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/connection/connection.js:285:22)
    at emitOne (events.js:90:13)
    at Socket.emit (events.js:182:7)
    at readableAddChunk (_stream_readable.js:153:18)
TypeError: Cannot read property 'content' of undefined
    at /home/forum/NodeBB/node_modules/nodebb-plugin-rss/index.js:195:33
    at /home/forum/NodeBB/src/database/mongo/sorted.js:342:4
    at handleCallback (/home/forum/NodeBB/node_modules/mongodb/lib/utils.js:96:12)
    at /home/forum/NodeBB/node_modules/mongodb/lib/collection.js:1357:5
    at handleCallback (/home/forum/NodeBB/node_modules/mongodb/lib/utils.js:96:12)
    at /home/forum/NodeBB/node_modules/mongodb/lib/cursor.js:657:5
    at handleCallback (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/cursor.js:159:5)
    at nextFunction (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/cursor.js:662:5)
    at /home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/cursor.js:564:7
    at queryCallback (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/cursor.js:241:5)
    at Callbacks.emit (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/topologies/server.js:116:3)
    at null.messageHandler (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/topologies/server.js:291:23)
    at Socket.<anonymous> (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/connection/connection.js:285:22)
    at emitOne (events.js:90:13)
    at Socket.emit (events.js:182:7)
    at readableAddChunk (_stream_readable.js:153:18)

<baris>

Published 0.3.7 which should fix the crash, you should see a warning in the logs if the feed entry doesn't have a proper content.

sohpingting

Hi @baris, thank you for creating this plugin.

I am new to node.js and nodeBB. Must I have a url that ends with ".rss" ? I am using http://ll-slack.herokuapp.com/ to create a rss feed from a channel on slack and I got the error in my log.

[[nodebb-plugin-rss:error]] Error pulling feed http://ll-slack.herokuapp.com/exampleurl winston.warning is not a function

When you open http://ll-slack.herokuapp.com/exampleurl, you will see this:

https://github.com/gozman/slack-rss RSS for Node Thu, 05 May 2016 07:38:51 GMT 30 is a service that sends girlfriends and wives presents like chocolate and tea every month]]> https://www.theguardian.exampleurl?CMP=Share_iOSApp_Other https://www.theguardian.exampleurl?CMP=Share_iOSApp_Other Thu, 05 May 2016 01:03:12 GMT

Please help

<baris>

@sohpingting I fixed the winston.warrning error in 0.3.8, the feed won't be posted if it can't be loaded by the yahoo feed api, so there is chance that the feed you are using isn't compatible.

zombie

I am getting the same node_modules/to-markdown errors

5/5 13:58 [6337] - [33mwarn[39m: [plugins/nodebb-plugin-sso-google] 
Hook `filter:user.delete` is deprecated, please use `static:user.delete` instead.

5/5 13:58 [6337] - [31merror[39m: SyntaxError: Unexpected token )
    at Module._compile (module.js:439:25)
    at Object.Module._extensions..js (module.js:474:10)
    at Module.load (module.js:356:32)
    at Function.Module._load (module.js:312:12)
    at Module.require (module.js:364:17)
    at require (module.js:380:17)
    at createHtmlParser (/home/cloud/NodeBB/node_modules/nodebb-plugin-rss/node_modules/to-markdown/lib/html-parser.js:32:17)
    at Object.<anonymous> (/home/cloud/NodeBB/node_modules/nodebb-plugin-rss/node_modules/to-markdown/lib/html-parser.js:76:63)
    at Module._compile (module.js:456:26)
    at Object.Module._extensions..js (module.js:474:10)

5/5 13:58 [6337] - [33mwarn[39m: [plugins] Unable to parse library for: nodebb-plugin-rss

I have latest node 4.4.3 and NPM version 2.15.1

The only other thing I can think of is I am using @trevor zenith theme that he just released.

B-738

@baris said in [nodebb-plugin-rss] RSS Feed plugin:

@sohpingting I fixed the winston.warrning error in 0.3.8, the feed won't be posted if it can't be loaded by the yahoo feed api, so there is chance that the feed you are using isn't compatible.
9/5 16:18 [21430] - info: [plugin-rss] posting, http://news.finance.ua/ru/rss - title: Кэмерон: выход Британии из ЕС угрожает безопасности в Европе, published date: 2016-05-09T13:00:00Z
9/5 16:18 [21430] - warn: [nodebb-plugin-rss] invalid content for entry, http://news.finance.ua/ru/rss
9/5 16:18 [21430] - info: [plugin-rss] posting, http://news.finance.ua/ru/rss - title: Украина заняла 5 место в рейтинге "кумовского капитализма", published date: 2016-05-09T12:00:00Z
9/5 16:18 [21430] - warn: [nodebb-plugin-rss] invalid content for entry, http://news.finance.ua/ru/rss
9/5 16:18 [21430] - info: [plugin-rss] posting, http://news.finance.ua/ru/rss - title: Нетрезвых водителей будут штрафовать на 40 тысяч грн, published date: 2016-05-09T11:00:00Z
9/5 16:18 [21430] - warn: [nodebb-plugin-rss] invalid content for entry, http://news.finance.ua/ru/rss
9/5 16:18 [21430] - info: [plugin-rss] posting, http://news.finance.ua/ru/rss - title: Украина сегодня отмечает День победы над нацизмом во Второй мировой войне, published date: 2016-05-09T10:00:00Z
9/5 16:18 [21430] - warn: [nodebb-plugin-rss] invalid content for entry, http://news.finance.ua/ru/rss

0.3.6 work fine! After update feed stop!