Skip to content

RSS parser script [NodeBB]

Customisation
47 2 23.8k 2
  • @jac I spent three hours looking into this today and sadly it’s not a simple affair in the sense that I can’t reuse the older Flarum script. Essentially, it’s a rewrite but not the end of the world.

    I’ve finished most of this, but have hit a stumbling block with the newer API so will need to research further before we can be ready for an initial release.

    There are some dependencies also, but nothing too major. Essentially, you will require nodebb-plugin-write-api (listed as the Write API) plugin to be able to use this new script. It also (currently) requires PHP to be installed (although future versions will probably make use of Python.

    wrote on last edited by
    #5

    @phenomlab said in RSS parser script [NodeBB]:

    @jac I spent three hours looking into this today and sadly it’s not a simple affair in the sense that I can’t reuse the older Flarum script. Essentially, it’s a rewrite but not the end of the world.

    I’ve finished most of this, but have hit a stumbling block with the newer API so will need to research further before we can be ready for an initial release.

    There are some dependencies also, but nothing too major. Essentially, you will require nodebb-plugin-write-api (listed as the Write API) plugin to be able to use this new script. It also (currently) requires PHP to be installed (although future versions will probably make use of Python.

    Amazing work Mark, can’t thank you enough for all the effort that’s going into releasing this and making it compatible.

    It’s a shame you’ve ran into a few issues, but can’t thank you enough! If this does get released I don’t see why more users wouldn’t want to use it.

  • JAC JAC

    @phenomlab said in RSS parser script [NodeBB]:

    @jac I spent three hours looking into this today and sadly it’s not a simple affair in the sense that I can’t reuse the older Flarum script. Essentially, it’s a rewrite but not the end of the world.

    I’ve finished most of this, but have hit a stumbling block with the newer API so will need to research further before we can be ready for an initial release.

    There are some dependencies also, but nothing too major. Essentially, you will require nodebb-plugin-write-api (listed as the Write API) plugin to be able to use this new script. It also (currently) requires PHP to be installed (although future versions will probably make use of Python.

    Amazing work Mark, can’t thank you enough for all the effort that’s going into releasing this and making it compatible.

    It’s a shame you’ve ran into a few issues, but can’t thank you enough! If this does get released I don’t see why more users wouldn’t want to use it.

    wrote on last edited by
    #6

    @jac ok, I spent some more time (another 2 hours) looking into this, and now have it working

    unknown.png
    unknown-1.png
    unknown-2.png

    Essentially, it works fine, but the issue here is that there is no text - it’s just videos. Looking at the structure of the XML file, it’s not the same as a standard RSS or ATOM file.

    Proving difficult. Work continues…

    I’ll keep you posted.

  • @jac ok, I spent some more time (another 2 hours) looking into this, and now have it working

    unknown.png
    unknown-1.png
    unknown-2.png

    Essentially, it works fine, but the issue here is that there is no text - it’s just videos. Looking at the structure of the XML file, it’s not the same as a standard RSS or ATOM file.

    Proving difficult. Work continues…

    I’ll keep you posted.

    wrote on last edited by
    #7

    @phenomlab said in RSS parser script [NodeBB]:

    @jac ok, I spent some more time (another 2 hours) looking into this, and now have it working

    unknown.png
    unknown-1.png
    unknown-2.png

    Essentially, it works fine, but the issue here is that there is no text - it’s just videos. Looking at the structure of the XML file, it’s not the same as a standard RSS or ATOM file.

    Proving difficult. Work continues…

    I’ll keep you posted.

    Wow!!!

    Absolute genius! 🤝 👏

    The work continues for you, but absolutely amazing work Mark! 👏🏻

  • JAC JAC

    @phenomlab said in RSS parser script [NodeBB]:

    @jac ok, I spent some more time (another 2 hours) looking into this, and now have it working

    unknown.png
    unknown-1.png
    unknown-2.png

    Essentially, it works fine, but the issue here is that there is no text - it’s just videos. Looking at the structure of the XML file, it’s not the same as a standard RSS or ATOM file.

    Proving difficult. Work continues…

    I’ll keep you posted.

    Wow!!!

    Absolute genius! 🤝 👏

    The work continues for you, but absolutely amazing work Mark! 👏🏻

    wrote on last edited by
    #8

    @jac thanks. I think I’ve found a way to get the description of the YouTube video from the XML structure in the URL, but this may cause issues with other URLs that are in fact RSS and atom compliant.

    I’ll look at this a bit more tomorrow.

  • @jac thanks. I think I’ve found a way to get the description of the YouTube video from the XML structure in the URL, but this may cause issues with other URLs that are in fact RSS and atom compliant.

    I’ll look at this a bit more tomorrow.

    wrote on last edited by
    #9

    @phenomlab said in RSS parser script [NodeBB]:

    @jac thanks. I think I’ve found a way to get the description of the YouTube video from the XML structure in the URL, but this may cause issues with other URLs that are in fact RSS and atom compliant.

    I’ll look at this a bit more tomorrow.

    Thanks very much mate for all the hard work especially on a weekend, it’s very much appreciated!

  • JAC JAC

    @phenomlab said in RSS parser script [NodeBB]:

    @jac thanks. I think I’ve found a way to get the description of the YouTube video from the XML structure in the URL, but this may cause issues with other URLs that are in fact RSS and atom compliant.

    I’ll look at this a bit more tomorrow.

    Thanks very much mate for all the hard work especially on a weekend, it’s very much appreciated!

    wrote on last edited by
    #10

    @jac No problems. Happy to help.

  • @jac No problems. Happy to help.

    wrote on last edited by
    #11

    @phenomlab said in RSS parser script [NodeBB]:

    @jac No problems. Happy to help.

    Many thanks mate, looking forward to its release, it’ll really make a great difference importing match interviews, highlights etc. 🍾

  • JAC JAC

    @phenomlab said in RSS parser script [NodeBB]:

    @jac No problems. Happy to help.

    Many thanks mate, looking forward to its release, it’ll really make a great difference importing match interviews, highlights etc. 🍾

    wrote on last edited by
    #12

    @jac 😁 will this be published on the node forum too?

  • JAC JAC

    @jac 😁 will this be published on the node forum too?

    wrote on last edited by
    #13

    @jac Possibly. Ideally as a plugin though if that does happen

  • @jac Possibly. Ideally as a plugin though if that does happen

    wrote on last edited by
    #14

    @phenomlab said in RSS parser script [NodeBB]:

    @jac Possibly. Ideally as a plugin though if that does happen

    Fantastic! Can’t wait 😁 it will be a fantastic addition!

  • JAC JAC

    @phenomlab said in RSS parser script [NodeBB]:

    @jac Possibly. Ideally as a plugin though if that does happen

    Fantastic! Can’t wait 😁 it will be a fantastic addition!

    wrote on last edited by
    #15

    Does this plugin currently work fine but you’re trying to develop it to pull in descriptions otherwise it would be bad for SEO etc?

    Is that right 🤔.

    I’m looking forward to its release as you know 😁.

  • JAC JAC

    Does this plugin currently work fine but you’re trying to develop it to pull in descriptions otherwise it would be bad for SEO etc?

    Is that right 🤔.

    I’m looking forward to its release as you know 😁.

    wrote on last edited by
    #16

    @jac Yes, pretty much that. The only part left to develop is the feed you provided me. It’s structured differently meaning I have to fetch the data from a large array, and it takes time to identify which array key holds the specific string you want.

    For other RSS and ATOM feeds it’ll work out of the box. However, it (currently) requires PHP and MySQL (as it was ported from Flarum) and ideally should be moved to native NodeJS and MongoDB. Sadly, work commitments mean I haven’t had as much time as I’d like to update all of this so inevitably, the release has been delayed.

  • @jac Yes, pretty much that. The only part left to develop is the feed you provided me. It’s structured differently meaning I have to fetch the data from a large array, and it takes time to identify which array key holds the specific string you want.

    For other RSS and ATOM feeds it’ll work out of the box. However, it (currently) requires PHP and MySQL (as it was ported from Flarum) and ideally should be moved to native NodeJS and MongoDB. Sadly, work commitments mean I haven’t had as much time as I’d like to update all of this so inevitably, the release has been delayed.

    wrote on last edited by
    #17

    @phenomlab said in RSS parser script [NodeBB]:

    @jac Yes, pretty much that. The only part left to develop is the feed you provided me. It’s structured differently meaning I have to fetch the data from a large array, and it takes time to identify which array key holds the specific string you want.

    For other RSS and ATOM feeds it’ll work out of the box. However, it (currently) requires PHP and MySQL (as it was ported from Flarum) and ideally should be moved to native NodeJS and MongoDB. Sadly, work commitments mean I haven’t had as much time as I’d like to update all of this so inevitably, the release has been delayed.

    Thanks for the update Mark, all sounds very interesting and of course promising, and I eagerly await it’s release 😁.

  • JAC JAC

    @phenomlab said in RSS parser script [NodeBB]:

    @jac Yes, pretty much that. The only part left to develop is the feed you provided me. It’s structured differently meaning I have to fetch the data from a large array, and it takes time to identify which array key holds the specific string you want.

    For other RSS and ATOM feeds it’ll work out of the box. However, it (currently) requires PHP and MySQL (as it was ported from Flarum) and ideally should be moved to native NodeJS and MongoDB. Sadly, work commitments mean I haven’t had as much time as I’d like to update all of this so inevitably, the release has been delayed.

    Thanks for the update Mark, all sounds very interesting and of course promising, and I eagerly await it’s release 😁.

    wrote on last edited by
    #18

    @jac said in RSS parser script [NodeBB]:

    @phenomlab said in RSS parser script [NodeBB]:

    @jac Yes, pretty much that. The only part left to develop is the feed you provided me. It’s structured differently meaning I have to fetch the data from a large array, and it takes time to identify which array key holds the specific string you want.

    For other RSS and ATOM feeds it’ll work out of the box. However, it (currently) requires PHP and MySQL (as it was ported from Flarum) and ideally should be moved to native NodeJS and MongoDB. Sadly, work commitments mean I haven’t had as much time as I’d like to update all of this so inevitably, the release has been delayed.

    Thanks for the update Mark, all sounds very interesting and of course promising, and I eagerly await it’s release 😁.

    Just checking in on this, is there any advancement? 👍🏻

  • JAC JAC

    @jac said in RSS parser script [NodeBB]:

    @phenomlab said in RSS parser script [NodeBB]:

    @jac Yes, pretty much that. The only part left to develop is the feed you provided me. It’s structured differently meaning I have to fetch the data from a large array, and it takes time to identify which array key holds the specific string you want.

    For other RSS and ATOM feeds it’ll work out of the box. However, it (currently) requires PHP and MySQL (as it was ported from Flarum) and ideally should be moved to native NodeJS and MongoDB. Sadly, work commitments mean I haven’t had as much time as I’d like to update all of this so inevitably, the release has been delayed.

    Thanks for the update Mark, all sounds very interesting and of course promising, and I eagerly await it’s release 😁.

    Just checking in on this, is there any advancement? 👍🏻

    wrote on last edited by
    #19

    @jac Still on my list. Going to be looking at this hopefully soon.

  • @jac Still on my list. Going to be looking at this hopefully soon.

    wrote on last edited by
    #20

    @phenomlab said in RSS parser script [NodeBB]:

    @jac Still on my list. Going to be looking at this hopefully soon.

    👏🏻👏🏻🤞🏻 Can’t wait pal!!

  • JAC JAC

    @phenomlab said in RSS parser script [NodeBB]:

    @jac Still on my list. Going to be looking at this hopefully soon.

    👏🏻👏🏻🤞🏻 Can’t wait pal!!

    wrote on last edited by
    #21

    @jac said in RSS parser script [NodeBB]:

    @phenomlab said in RSS parser script [NodeBB]:

    @jac Still on my list. Going to be looking at this hopefully soon.

    👏🏻👏🏻🤞🏻 Can’t wait pal!!

    Any update mate? 🤝😉

  • JAC JAC

    @jac said in RSS parser script [NodeBB]:

    @phenomlab said in RSS parser script [NodeBB]:

    @jac Still on my list. Going to be looking at this hopefully soon.

    👏🏻👏🏻🤞🏻 Can’t wait pal!!

    Any update mate? 🤝😉

    wrote on last edited by
    #22

    @jac Not yet. Sorry. Still on my list, but take comfort in the fact that it’s 75% completed 🙂

  • @jac Not yet. Sorry. Still on my list, but take comfort in the fact that it’s 75% completed 🙂

    wrote on last edited by
    #23

    @phenomlab said in RSS parser script [NodeBB]:

    @jac Not yet. Sorry. Still on my list, but take comfort in the fact that it’s 75% completed 🙂

    Brilliant mate, can’t wait! 😁😁😁😁😁😁

  • JAC JAC

    @phenomlab said in RSS parser script [NodeBB]:

    @jac Not yet. Sorry. Still on my list, but take comfort in the fact that it’s 75% completed 🙂

    Brilliant mate, can’t wait! 😁😁😁😁😁😁

    wrote on last edited by JAC
    #24

    @jac said in RSS parser script [NodeBB]:

    @phenomlab said in RSS parser script [NodeBB]:

    @jac Not yet. Sorry. Still on my list, but take comfort in the fact that it’s 75% completed 🙂

    Brilliant mate, can’t wait! 😁😁😁😁😁😁

    Any update on this mate? I know you’re a busy man! 😁.


Related Topics
  • Bug Report

    Solved Bugs nodebb bugs
    47
    1
    26 Votes
    47 Posts
    20k Views
    phenomlab
    @crazycells Good points, thanks. I completely forgot that classes are added - makes life much simpler! EDIT - seems this is pretty straightforward, and only needs the below CSS .upvoted i { color: var(--bs-user-level) !important; } This then yields [image: 3f072f8a-ebfa-4910-8723-73c493b8e4eb-image.png] However, the caveat here is that the .upvoted class will only show for your upvotes, and nobody else’s. However, this does satisfy the original request however I would love to see my upvoted posts more clearly, because currently, when I upvote, nothing on the post tool is changing, it would be nicer if there is an indication that I have upvoted (like a filled or colored triangle?)
  • Upgrade issues

    Solved Configure nodebb
    2
    1
    2 Votes
    2 Posts
    1k Views
    DownPW
    Use this code git fetch # Grab the latest code from the NodeBB repository git checkout v3.x git reset --hard origin/v3.x And you will have the latest version without specifying it https://docs.nodebb.org/configuring/upgrade/
  • Whitespace fixes in Nodebb

    Solved Customisation nodebb
    18
    2
    7 Votes
    18 Posts
    7k Views
    phenomlab
    @Panda Just circling back here with something of an update (which I think you’ll like). I’ve completely restructured the ranking system. There are now less ranks, with a higher point threshold to reach them. More importantly, if you reload the site, you’ll notice that the ranks are now icons. I also removed the “Author” badge, and made this a single icon, which (to me) looks much better.
  • optional "snow falling" theme

    Solved Customisation nodebb
    6
    6 Votes
    6 Posts
    2k Views
    phenomlab
    @Sala ok, but that’s still the same loop which is going to have an impact on the CPU.
  • 4 Votes
    8 Posts
    5k Views
    phenomlab
    @DownPW done
  • [NodeBB] username cards

    Solved Customisation nodebb
    8
    5 Votes
    8 Posts
    3k Views
    Sampo2910
    @phenomlab Aha…nice to know. As always thank you for the reply and information.
  • Iframely (Nodebb)

    Solved Configure
    40
    4 Votes
    40 Posts
    17k Views
    phenomlab
    @DownPW This is now resolved. The issue was an incorrect URL specified in the Nodebb plugin. I’ve corrected this, and now it works as intended.
  • How to set a signature in NodeBB?

    Solved Customisation
    4
    2 Votes
    4 Posts
    2k Views
    JAC
    @phenomlab said in How to set a signature in NodeBB?: @jac No issues at all with copying. This is set using the signature for the user you are posting as. In the case of Hostrisk, it’s set like the below [image: 7bf04183-f6e8-4d72-b0eb-c9a05c9cd24b-image.png] You can set the signature by using https://domain.com/user/theuser/edit Mamy thanks Mark, I’ll set this up later .