IFramely alternatives, homebrewed solution, etc.
-
There have been some developments on that front... namely that there's been a shift for awhile now away from site owners ignoring crawlers to them actively providing metadata that more explicitly defines what content you're seeing.
This was supercharged via social media unfurling, and the standards that came about (og.me, etc.)
Of course, whether the crawler respects any of that is irrelevant, but it does lead to us having an easier time if the target site actively SENDS us what we need to know. e.g. If all we have to do is parse
<head>for metadata, that's an order of magnitude easier than parsing the entire site body for a relevant paragraph, image, etc. -
@julian Wondering if we can simply use this - see https://www.npmjs.com/package/link-preview-js
-
@julian said in IFramely alternatives, homebrewed solution, etc.:
solution that unfurls links asynchronously (but serves them unfurled if we've already seen it before, aka cached).
I think this should be possible to achieve in the iframely plugin.
@phenomlab said in IFramely alternatives, homebrewed solution, etc.:
people think as it handles repeat requests as individual access when it isn't, and should be cached (delivered free).
It should be possible to do this caching in the plugin as well.
Though using an embed tags library instead may be easier and cover most things more effectively.
-
@phenomlab said in IFramely alternatives, homebrewed solution, etc.:
@julian said in reduce speed in v3.0.0:
Not to derail this thread, but I do feel sometimes that IFramely is a bit heavy-handed of a solution
I totally support that ethic, and I know it's the same for @DownPW because we've both seen quite heavy CPU usage from iFramely.
Completely agree with this.
iframely works correctly from the point of view of result but it is true that sometimes it overloads the loading of a page see from the server.
And it's implementation, even if it is not insurmountable, is not necessarily easy for everyone.Something working as an all-in-one plugin would be a must in the best of all worlds
The solution proposed by @phenomlab seems interesting
-
@phenomlab agreed on all counts, just need to find a time to start experimenting. Too many projects, too few hours in the day
-
@julian just coming back here with an update.
Today, I noticed my NodeBB installation was playing up - to the point where hardly anything worked properly and sockets.io was having a breakdown. I restarted the VPS and everything was back to normal for about 10 minutes, and then all hell broke loose again.
After letting some monitoring run for an hour, I was able to quickly determine that the culprit was iFramely. Not the NodeBB plugin, but the self hosted instance I've been running for a while has suddenly decided it's going to occupy all the cores and drain the available memory from my system. There were also a stack of zombie processes associated with pm2 so I took the decision to try out the hosted API version which works.
Great, ok, now let's put everything back to self hosted and restart. This is where Armageddon took place with NodeBB refusing to build, and crashing each time I tried to open a post with links.
A quick disable plugin and a rebuild, and everything is back to normal.
My personal experiences here but I won't be putting iFramely back on my forum because of its detrimental impact on resources and the sudden runaway processes.
This means I'm in the market for a replacement. I'd prefer pretty URLs as this is a modem approach, but for now, I won't be using iframely for anything.
Any update at your end?
Thanks
-
@phenomlab said in IFramely alternatives, homebrewed solution, etc.:
Any update at your end?
Yes, my wife had a baby and so I'm getting less sleep than usual
But this is definitely on my radar as something to address...
-
@julian said in IFramely alternatives, homebrewed solution, etc.:
Yes, my wife had a baby and so I'm getting less sleep than usual
Congratulations! Hope your wife and new arrival are doing well.
-
@julian said in IFramely alternatives, homebrewed solution, etc.:
@phenomlab said in IFramely alternatives, homebrewed solution, etc.:
Any update at your end?
Yes, my wife had a baby and so I'm getting less sleep than usual
But this is definitely on my radar as something to address...
congrats!
-
@crazycells wait, that's not my baby...
-
ha ha Congratulations @julian
@julian said in IFramely alternatives, homebrewed solution, etc.:
Yes, my wife had a baby and so I'm getting less sleep than usual
It is sure that less and chopped sleep, it will last some time
@julian said in IFramely alternatives, homebrewed solution, etc.:
But this is definitely on my radar as something to address...
This is a good thing because If iframely is so messed up on V3, it's a brake on the switch to V3 for me.
-
@DownPW said in IFramely alternatives, homebrewed solution, etc.:
This is a good thing because If iframely is so messed up on V3, it's a brake on the switch to V3 for me.
Yes, I have to admit it's been something of a bumpy ride for me and it either works well, or not at all. I don't think it's a NodeBB issue though.
-
@DownPW said in IFramely alternatives, homebrewed solution, etc.:
This is a good thing because If iframely is so messed up on V3, it's a brake on the switch to V3 for me.
Good to know. I hope it can be fixed soon.
-
@crazycells said in IFramely alternatives, homebrewed solution, etc.:
Good to know. I hope it can be fixed soon.
I don't think it's going to be a fix - more of a departure from iFramely altogether with a home-brew solution
