Skip to content

RSS parser script [NodeBB]

Customisation
47 2 12.4k 2
  • @jac I spent three hours looking into this today and sadly it’s not a simple affair in the sense that I can’t reuse the older Flarum script. Essentially, it’s a rewrite but not the end of the world.

    I’ve finished most of this, but have hit a stumbling block with the newer API so will need to research further before we can be ready for an initial release.

    There are some dependencies also, but nothing too major. Essentially, you will require nodebb-plugin-write-api (listed as the Write API) plugin to be able to use this new script. It also (currently) requires PHP to be installed (although future versions will probably make use of Python.

    @phenomlab said in RSS parser script [NodeBB]:

    @jac I spent three hours looking into this today and sadly it’s not a simple affair in the sense that I can’t reuse the older Flarum script. Essentially, it’s a rewrite but not the end of the world.

    I’ve finished most of this, but have hit a stumbling block with the newer API so will need to research further before we can be ready for an initial release.

    There are some dependencies also, but nothing too major. Essentially, you will require nodebb-plugin-write-api (listed as the Write API) plugin to be able to use this new script. It also (currently) requires PHP to be installed (although future versions will probably make use of Python.

    Amazing work Mark, can’t thank you enough for all the effort that’s going into releasing this and making it compatible.

    It’s a shame you’ve ran into a few issues, but can’t thank you enough! If this does get released I don’t see why more users wouldn’t want to use it.

  • @phenomlab said in RSS parser script [NodeBB]:

    @jac I spent three hours looking into this today and sadly it’s not a simple affair in the sense that I can’t reuse the older Flarum script. Essentially, it’s a rewrite but not the end of the world.

    I’ve finished most of this, but have hit a stumbling block with the newer API so will need to research further before we can be ready for an initial release.

    There are some dependencies also, but nothing too major. Essentially, you will require nodebb-plugin-write-api (listed as the Write API) plugin to be able to use this new script. It also (currently) requires PHP to be installed (although future versions will probably make use of Python.

    Amazing work Mark, can’t thank you enough for all the effort that’s going into releasing this and making it compatible.

    It’s a shame you’ve ran into a few issues, but can’t thank you enough! If this does get released I don’t see why more users wouldn’t want to use it.

    @jac ok, I spent some more time (another 2 hours) looking into this, and now have it working

    unknown.png
    unknown-1.png
    unknown-2.png

    Essentially, it works fine, but the issue here is that there is no text - it’s just videos. Looking at the structure of the XML file, it’s not the same as a standard RSS or ATOM file.

    Proving difficult. Work continues…

    I’ll keep you posted.

  • @jac ok, I spent some more time (another 2 hours) looking into this, and now have it working

    unknown.png
    unknown-1.png
    unknown-2.png

    Essentially, it works fine, but the issue here is that there is no text - it’s just videos. Looking at the structure of the XML file, it’s not the same as a standard RSS or ATOM file.

    Proving difficult. Work continues…

    I’ll keep you posted.

    @phenomlab said in RSS parser script [NodeBB]:

    @jac ok, I spent some more time (another 2 hours) looking into this, and now have it working

    unknown.png
    unknown-1.png
    unknown-2.png

    Essentially, it works fine, but the issue here is that there is no text - it’s just videos. Looking at the structure of the XML file, it’s not the same as a standard RSS or ATOM file.

    Proving difficult. Work continues…

    I’ll keep you posted.

    Wow!!!

    Absolute genius! 🤝 👏

    The work continues for you, but absolutely amazing work Mark! 👏🏻

  • @phenomlab said in RSS parser script [NodeBB]:

    @jac ok, I spent some more time (another 2 hours) looking into this, and now have it working

    unknown.png
    unknown-1.png
    unknown-2.png

    Essentially, it works fine, but the issue here is that there is no text - it’s just videos. Looking at the structure of the XML file, it’s not the same as a standard RSS or ATOM file.

    Proving difficult. Work continues…

    I’ll keep you posted.

    Wow!!!

    Absolute genius! 🤝 👏

    The work continues for you, but absolutely amazing work Mark! 👏🏻

    @jac thanks. I think I’ve found a way to get the description of the YouTube video from the XML structure in the URL, but this may cause issues with other URLs that are in fact RSS and atom compliant.

    I’ll look at this a bit more tomorrow.

  • @jac thanks. I think I’ve found a way to get the description of the YouTube video from the XML structure in the URL, but this may cause issues with other URLs that are in fact RSS and atom compliant.

    I’ll look at this a bit more tomorrow.

    @phenomlab said in RSS parser script [NodeBB]:

    @jac thanks. I think I’ve found a way to get the description of the YouTube video from the XML structure in the URL, but this may cause issues with other URLs that are in fact RSS and atom compliant.

    I’ll look at this a bit more tomorrow.

    Thanks very much mate for all the hard work especially on a weekend, it’s very much appreciated!

  • @phenomlab said in RSS parser script [NodeBB]:

    @jac thanks. I think I’ve found a way to get the description of the YouTube video from the XML structure in the URL, but this may cause issues with other URLs that are in fact RSS and atom compliant.

    I’ll look at this a bit more tomorrow.

    Thanks very much mate for all the hard work especially on a weekend, it’s very much appreciated!

    @jac No problems. Happy to help.

  • @jac No problems. Happy to help.

    @phenomlab said in RSS parser script [NodeBB]:

    @jac No problems. Happy to help.

    Many thanks mate, looking forward to its release, it’ll really make a great difference importing match interviews, highlights etc. 🍾

  • @phenomlab said in RSS parser script [NodeBB]:

    @jac No problems. Happy to help.

    Many thanks mate, looking forward to its release, it’ll really make a great difference importing match interviews, highlights etc. 🍾

    @jac 😁 will this be published on the node forum too?

  • @jac 😁 will this be published on the node forum too?

    @jac Possibly. Ideally as a plugin though if that does happen

  • @jac Possibly. Ideally as a plugin though if that does happen

    @phenomlab said in RSS parser script [NodeBB]:

    @jac Possibly. Ideally as a plugin though if that does happen

    Fantastic! Can’t wait 😁 it will be a fantastic addition!

  • @phenomlab said in RSS parser script [NodeBB]:

    @jac Possibly. Ideally as a plugin though if that does happen

    Fantastic! Can’t wait 😁 it will be a fantastic addition!

    Does this plugin currently work fine but you’re trying to develop it to pull in descriptions otherwise it would be bad for SEO etc?

    Is that right 🤔.

    I’m looking forward to its release as you know 😁.

  • Does this plugin currently work fine but you’re trying to develop it to pull in descriptions otherwise it would be bad for SEO etc?

    Is that right 🤔.

    I’m looking forward to its release as you know 😁.

    @jac Yes, pretty much that. The only part left to develop is the feed you provided me. It’s structured differently meaning I have to fetch the data from a large array, and it takes time to identify which array key holds the specific string you want.

    For other RSS and ATOM feeds it’ll work out of the box. However, it (currently) requires PHP and MySQL (as it was ported from Flarum) and ideally should be moved to native NodeJS and MongoDB. Sadly, work commitments mean I haven’t had as much time as I’d like to update all of this so inevitably, the release has been delayed.

  • @jac Yes, pretty much that. The only part left to develop is the feed you provided me. It’s structured differently meaning I have to fetch the data from a large array, and it takes time to identify which array key holds the specific string you want.

    For other RSS and ATOM feeds it’ll work out of the box. However, it (currently) requires PHP and MySQL (as it was ported from Flarum) and ideally should be moved to native NodeJS and MongoDB. Sadly, work commitments mean I haven’t had as much time as I’d like to update all of this so inevitably, the release has been delayed.

    @phenomlab said in RSS parser script [NodeBB]:

    @jac Yes, pretty much that. The only part left to develop is the feed you provided me. It’s structured differently meaning I have to fetch the data from a large array, and it takes time to identify which array key holds the specific string you want.

    For other RSS and ATOM feeds it’ll work out of the box. However, it (currently) requires PHP and MySQL (as it was ported from Flarum) and ideally should be moved to native NodeJS and MongoDB. Sadly, work commitments mean I haven’t had as much time as I’d like to update all of this so inevitably, the release has been delayed.

    Thanks for the update Mark, all sounds very interesting and of course promising, and I eagerly await it’s release 😁.

  • @phenomlab said in RSS parser script [NodeBB]:

    @jac Yes, pretty much that. The only part left to develop is the feed you provided me. It’s structured differently meaning I have to fetch the data from a large array, and it takes time to identify which array key holds the specific string you want.

    For other RSS and ATOM feeds it’ll work out of the box. However, it (currently) requires PHP and MySQL (as it was ported from Flarum) and ideally should be moved to native NodeJS and MongoDB. Sadly, work commitments mean I haven’t had as much time as I’d like to update all of this so inevitably, the release has been delayed.

    Thanks for the update Mark, all sounds very interesting and of course promising, and I eagerly await it’s release 😁.

    @jac said in RSS parser script [NodeBB]:

    @phenomlab said in RSS parser script [NodeBB]:

    @jac Yes, pretty much that. The only part left to develop is the feed you provided me. It’s structured differently meaning I have to fetch the data from a large array, and it takes time to identify which array key holds the specific string you want.

    For other RSS and ATOM feeds it’ll work out of the box. However, it (currently) requires PHP and MySQL (as it was ported from Flarum) and ideally should be moved to native NodeJS and MongoDB. Sadly, work commitments mean I haven’t had as much time as I’d like to update all of this so inevitably, the release has been delayed.

    Thanks for the update Mark, all sounds very interesting and of course promising, and I eagerly await it’s release 😁.

    Just checking in on this, is there any advancement? 👍🏻

  • @jac said in RSS parser script [NodeBB]:

    @phenomlab said in RSS parser script [NodeBB]:

    @jac Yes, pretty much that. The only part left to develop is the feed you provided me. It’s structured differently meaning I have to fetch the data from a large array, and it takes time to identify which array key holds the specific string you want.

    For other RSS and ATOM feeds it’ll work out of the box. However, it (currently) requires PHP and MySQL (as it was ported from Flarum) and ideally should be moved to native NodeJS and MongoDB. Sadly, work commitments mean I haven’t had as much time as I’d like to update all of this so inevitably, the release has been delayed.

    Thanks for the update Mark, all sounds very interesting and of course promising, and I eagerly await it’s release 😁.

    Just checking in on this, is there any advancement? 👍🏻

    @jac Still on my list. Going to be looking at this hopefully soon.

  • @jac Still on my list. Going to be looking at this hopefully soon.

    @phenomlab said in RSS parser script [NodeBB]:

    @jac Still on my list. Going to be looking at this hopefully soon.

    👏🏻👏🏻🤞🏻 Can’t wait pal!!

  • @phenomlab said in RSS parser script [NodeBB]:

    @jac Still on my list. Going to be looking at this hopefully soon.

    👏🏻👏🏻🤞🏻 Can’t wait pal!!

    @jac said in RSS parser script [NodeBB]:

    @phenomlab said in RSS parser script [NodeBB]:

    @jac Still on my list. Going to be looking at this hopefully soon.

    👏🏻👏🏻🤞🏻 Can’t wait pal!!

    Any update mate? 🤝😉

  • @jac said in RSS parser script [NodeBB]:

    @phenomlab said in RSS parser script [NodeBB]:

    @jac Still on my list. Going to be looking at this hopefully soon.

    👏🏻👏🏻🤞🏻 Can’t wait pal!!

    Any update mate? 🤝😉

    @jac Not yet. Sorry. Still on my list, but take comfort in the fact that it’s 75% completed 🙂

  • @jac Not yet. Sorry. Still on my list, but take comfort in the fact that it’s 75% completed 🙂

    @phenomlab said in RSS parser script [NodeBB]:

    @jac Not yet. Sorry. Still on my list, but take comfort in the fact that it’s 75% completed 🙂

    Brilliant mate, can’t wait! 😁😁😁😁😁😁

  • @phenomlab said in RSS parser script [NodeBB]:

    @jac Not yet. Sorry. Still on my list, but take comfort in the fact that it’s 75% completed 🙂

    Brilliant mate, can’t wait! 😁😁😁😁😁😁

    @jac said in RSS parser script [NodeBB]:

    @phenomlab said in RSS parser script [NodeBB]:

    @jac Not yet. Sorry. Still on my list, but take comfort in the fact that it’s 75% completed 🙂

    Brilliant mate, can’t wait! 😁😁😁😁😁😁

    Any update on this mate? I know you’re a busy man! 😁.


Related Topics
  • SEO and Nodebb

    Performance nodebb seo
    2
    2 Votes
    2 Posts
    782 Views
    @Panda It’s the best it’s ever been to be honest. I’ve used a myriad of systems in the past - most notably, WordPress, and then Flarum (which for SEO, was absolutely dire - they never even had SEO out of the box, and relied on a third party extension to do it), and NodeBB easily fares the best - see below example https://www.google.com/search?q=site%3Asudonix.org&oq=site%3Asudonix.org&aqs=chrome..69i57j69i60j69i58j69i60l2.9039j0j3&sourceid=chrome&ie=UTF-8#ip=1 However, this was not without significant effort on my part once I’d migrated from COM to ORG - see below posts https://community.nodebb.org/topic/17286/google-crawl-error-after-site-migration/17?_=1688461250365 And also https://support.google.com/webmasters/thread/221027803?hl=en&msgid=221464164 It was painful to say the least - as it turns out, there was an issue in NodeBB core that prevented spiders from getting to content, which as far as I understand, is now fixed. SEO in itself is a dark art - a black box that nobody really fully understands, and it’s essentially going to boil down to one thing - “content”. Google’s algorithm for indexing has also changed dramatically over the years. They only now crawl content that has value, so if it believes that your site has nothing to offer, it will simply skip it.
  • Composer options on nodebb

    Solved Configure nodebb
    8
    1
    3 Votes
    8 Posts
    1k Views
    @Panda You should be able to expose the CSS for these using F12 to get into console [image: 1686833368846-3591518c-e3a3-4ada-a43c-6b32a5e0359c-image.png] [image: 1686833399483-a2b8ed46-4157-4ff2-85f0-576543380107-image.png] That should then expose the element once selected [image: 1686833431032-89d9c545-a47a-40d1-98f4-80cf3b958e8f-image.png] Here’s the below CSS you need based on the screenshot provided. .composer .formatting-bar .formatting-group li[data-format="picture-o"], .composer .formatting-bar .formatting-group li[data-format="spoiler"] { display: none; }
  • 2 Votes
    2 Posts
    616 Views
    @dave1904 that’s a really good point actually. I know it was there previously on Persona, but you’re right - no such function exists on harmony. However, putting something in place to mimick the behaviour of Persona won’t be hard from the js standpoint, although I wonder if perhaps we should ask the NodeBB developers is this feature was overlooked?
  • Gettin Erors NodeBB

    Solved Configure nodebb eror
    7
    0 Votes
    7 Posts
    1k Views
    @phenomlab no forum is working goods. there is no eror message since yestarday.
  • 4 Votes
    8 Posts
    4k Views
    @DownPW done
  • NodeBB Discord Plugins

    Unsolved Customisation nodebb discord plugin
    7
    0 Votes
    7 Posts
    2k Views
    @RiekMedia hi. Just following up on this thread (I know it’s old) but was curious to understand if it’s still an issue or not ?
  • NodeBB Design help

    Solved Customisation
    8
    3
    2 Votes
    8 Posts
    2k Views
    @riekmedia I’ve applied some new CSS to your site. Can you reload the page and try again ? For the record, this is what I added #footer { background: #2d343e; border-top: 4px solid #2d343e; font-size: 0.9em; margin-top: 70px; padding: 80px 0 0; position: relative; clear: both; bottom: 0; left: 0; right: 0; z-index: 1000; margin-left: -15px; margin-right: -338px; } The /categories page seems a bit messed up, so looking at that currently EDIT - issued some override CSS in the CATEGORIES widget <!--- CSS fix for overspill on /categories page - DO NOT DELETE --> <style> #footer { margin-right: -45px; } </style> That should resolve the /categories issue.
  • [NodeBB] custom Gravatar image not showing

    Solved Customisation
    6
    1 Votes
    6 Posts
    2k Views
    @jac said in [NodeBB] custom Gravatar image not showing: @phenomlab said in [NodeBB] custom Gravatar image not showing: @jac are you using Custom ? Sure am mate Confirmed Fixed