[nodebb-plugin-rss] RSS Feed plugin

Leonardo Galani

And.. its me again

Trying to get the content of the google testing blog

14/4 00:00 [29580] - [32minfo[39m: [plugin-rss] posting, http://feeds.feedburner.com/blogspot/RLXA - title: [object Object], published date: 2016-04-08T22:00:00Z
14/4 00:00 [29580] - [31merror[39m: TypeError: Cannot read property 'content' of undefined
    at /home/forum/NodeBB/node_modules/nodebb-plugin-rss/index.js:195:33
    at /home/forum/NodeBB/src/database/mongo/sorted.js:342:4
    at handleCallback (/home/forum/NodeBB/node_modules/mongodb/lib/utils.js:96:12)
    at /home/forum/NodeBB/node_modules/mongodb/lib/collection.js:1357:5
    at handleCallback (/home/forum/NodeBB/node_modules/mongodb/lib/utils.js:96:12)
    at /home/forum/NodeBB/node_modules/mongodb/lib/cursor.js:657:5
    at handleCallback (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/cursor.js:159:5)
    at nextFunction (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/cursor.js:662:5)
    at /home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/cursor.js:564:7
    at queryCallback (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/cursor.js:241:5)
    at Callbacks.emit (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/topologies/server.js:116:3)
    at null.messageHandler (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/topologies/server.js:291:23)
    at Socket.<anonymous> (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/connection/connection.js:285:22)
    at emitOne (events.js:90:13)
    at Socket.emit (events.js:182:7)
    at readableAddChunk (_stream_readable.js:153:18)
TypeError: Cannot read property 'content' of undefined
    at /home/forum/NodeBB/node_modules/nodebb-plugin-rss/index.js:195:33
    at /home/forum/NodeBB/src/database/mongo/sorted.js:342:4
    at handleCallback (/home/forum/NodeBB/node_modules/mongodb/lib/utils.js:96:12)
    at /home/forum/NodeBB/node_modules/mongodb/lib/collection.js:1357:5
    at handleCallback (/home/forum/NodeBB/node_modules/mongodb/lib/utils.js:96:12)
    at /home/forum/NodeBB/node_modules/mongodb/lib/cursor.js:657:5
    at handleCallback (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/cursor.js:159:5)
    at nextFunction (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/cursor.js:662:5)
    at /home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/cursor.js:564:7
    at queryCallback (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/cursor.js:241:5)
    at Callbacks.emit (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/topologies/server.js:116:3)
    at null.messageHandler (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/topologies/server.js:291:23)
    at Socket.<anonymous> (/home/forum/NodeBB/node_modules/mongodb/node_modules/mongodb-core/lib/connection/connection.js:285:22)
    at emitOne (events.js:90:13)
    at Socket.emit (events.js:182:7)
    at readableAddChunk (_stream_readable.js:153:18)

<baris>

Published 0.3.7 which should fix the crash, you should see a warning in the logs if the feed entry doesn't have a proper content.

sohpingting

Hi @baris, thank you for creating this plugin.

I am new to node.js and nodeBB. Must I have a url that ends with ".rss" ? I am using http://ll-slack.herokuapp.com/ to create a rss feed from a channel on slack and I got the error in my log.

[[nodebb-plugin-rss:error]] Error pulling feed http://ll-slack.herokuapp.com/exampleurl winston.warning is not a function

When you open http://ll-slack.herokuapp.com/exampleurl, you will see this:

https://github.com/gozman/slack-rss RSS for Node Thu, 05 May 2016 07:38:51 GMT 30 is a service that sends girlfriends and wives presents like chocolate and tea every month]]> https://www.theguardian.exampleurl?CMP=Share_iOSApp_Other https://www.theguardian.exampleurl?CMP=Share_iOSApp_Other Thu, 05 May 2016 01:03:12 GMT

Please help

<baris>

@sohpingting I fixed the winston.warrning error in 0.3.8, the feed won't be posted if it can't be loaded by the yahoo feed api, so there is chance that the feed you are using isn't compatible.

zombie

I am getting the same node_modules/to-markdown errors

5/5 13:58 [6337] - [33mwarn[39m: [plugins/nodebb-plugin-sso-google] 
Hook `filter:user.delete` is deprecated, please use `static:user.delete` instead.

5/5 13:58 [6337] - [31merror[39m: SyntaxError: Unexpected token )
    at Module._compile (module.js:439:25)
    at Object.Module._extensions..js (module.js:474:10)
    at Module.load (module.js:356:32)
    at Function.Module._load (module.js:312:12)
    at Module.require (module.js:364:17)
    at require (module.js:380:17)
    at createHtmlParser (/home/cloud/NodeBB/node_modules/nodebb-plugin-rss/node_modules/to-markdown/lib/html-parser.js:32:17)
    at Object.<anonymous> (/home/cloud/NodeBB/node_modules/nodebb-plugin-rss/node_modules/to-markdown/lib/html-parser.js:76:63)
    at Module._compile (module.js:456:26)
    at Object.Module._extensions..js (module.js:474:10)

5/5 13:58 [6337] - [33mwarn[39m: [plugins] Unable to parse library for: nodebb-plugin-rss

I have latest node 4.4.3 and NPM version 2.15.1

The only other thing I can think of is I am using @trevor zenith theme that he just released.

B-738

@baris said in [nodebb-plugin-rss] RSS Feed plugin:

@sohpingting I fixed the winston.warrning error in 0.3.8, the feed won't be posted if it can't be loaded by the yahoo feed api, so there is chance that the feed you are using isn't compatible.
9/5 16:18 [21430] - info: [plugin-rss] posting, http://news.finance.ua/ru/rss - title: Кэмерон: выход Британии из ЕС угрожает безопасности в Европе, published date: 2016-05-09T13:00:00Z
9/5 16:18 [21430] - warn: [nodebb-plugin-rss] invalid content for entry, http://news.finance.ua/ru/rss
9/5 16:18 [21430] - info: [plugin-rss] posting, http://news.finance.ua/ru/rss - title: Украина заняла 5 место в рейтинге "кумовского капитализма", published date: 2016-05-09T12:00:00Z
9/5 16:18 [21430] - warn: [nodebb-plugin-rss] invalid content for entry, http://news.finance.ua/ru/rss
9/5 16:18 [21430] - info: [plugin-rss] posting, http://news.finance.ua/ru/rss - title: Нетрезвых водителей будут штрафовать на 40 тысяч грн, published date: 2016-05-09T11:00:00Z
9/5 16:18 [21430] - warn: [nodebb-plugin-rss] invalid content for entry, http://news.finance.ua/ru/rss
9/5 16:18 [21430] - info: [plugin-rss] posting, http://news.finance.ua/ru/rss - title: Украина сегодня отмечает День победы над нацизмом во Второй мировой войне, published date: 2016-05-09T10:00:00Z
9/5 16:18 [21430] - warn: [nodebb-plugin-rss] invalid content for entry, http://news.finance.ua/ru/rss

0.3.6 work fine! After update feed stop!

<baris>

Try with 0.3.9

B-738

@baris said in [nodebb-plugin-rss] RSS Feed plugin:

Try with 0.3.9

COOL!!! All work and receive update from RSS source! Very very thanks for quick reply and good support!

B-738

This post is deleted!

sohpingting

@baris thank you for fixing winston.warrning error in 0.3.8. You are the most awesome and fastest developer I have ever seen on getting bugs fixed. I also upgrade to 0.3.9 after getting "invalid content for entry".

The RSS is posting the title (into topic) and text which is great but the URL is not posted and no one can read more about the article. Can you include the posting for URL? Thank you in advance

<baris>

@sohpingting Can you post the rss feed url you are using so I can test. Do you want the rss feed url that you enter in the plugin ACP page to be added into the content or is it some other url?

sohpingting

@baris It's working! The URL is showing! It looks great! Thank you so much so much!!

Screenshot from the web:
0_1462932936864_Screen Shot 2016-05-11 at 10.14.59 AM.png

Below are 1 line of code inside the RSS (originally it's from a slack chat channel, we use herokuapp to get a rss version of it).

<code>https://github.com/gozman/slack-rss RSS for Node Wed, 11 May 2016 02:16:47 GMT 30 https:// backchannel . com / can-this-scientist-predict-your-childs-future-d2f43c2a1668#.lghxhsfw7 https: // backchannel . com / can-this-scientist-predict-your-childs-future-d2f43c2a1668#.lghxhsfw7 </code> (I added the spacing to prevent a preview).

sohpingting

@baris what did you change? the url is not showing anymore. And the iFramely plugin I used cannot generate a preview without a url.

<baris>

Nothing changed in the rss plugin, could be a change in the iframely plugin.

Leonardo Galani

So sad.. half of the RSS feeds i got on my forum doesn't display the link of the content

Leonardo Galani

my feed that doesnt show links are:

http://feeds.feedburner.com/smartbear (feedburner)

blog.eviltester.com /feeds/posts/default (atom) (doesnt work)

watirmelon.com /feed/ (wordpress feed)

http://rafaelchiavegatto.com.br/rss/ (ghost blog)

(added some white space za the link wasnt showing...)

sohpingting

@baris your rss feed did not post the url, it's before iframely could generate. Please help to get the url posted again, please please please

What your RSS plugin posted:
0_1463466042347_Screen Shot 2016-05-17 at 2.18.44 PM.png

Sample of of the RSS:
https://github.com/gozman/slack-rss RSS for Node Tue, 17 May 2016 06:14:14 GMT 30 http://www.newyorker(dot)com/tech/elements/the-coming-horror-of-virtual-reality?intcid=mod-latest http://www.newyorker(dot)com/tech/elements/the-coming-horror-of-virtual-reality?intcid=mod-latest

Note: Replaced I've replaced . with (dot) to prevent a preview generated about the url.

zombie

Same issues as others are having now, RSS feeds work, but no links are posted or generated before the topic itself is.

<baris>

Not sure what you guys are after, the plugin gets the content from the rss and posts thats as the content of the topic. So whatever content is in the feed entry gets posted. Do you want the rss url you put into the ACP page to also appear in the content?

<baris>

0.3.11 should include the entry url in the content.