Skip to content

using exclusive nodebb forum data to create a chatgpt chatbot?

Discussion
7 2 2.5k 1
  • It appears that we are entering a new age… I guess soon we will be wearing glasses that can listen us and analyze statements/commands and make reservations, create alarms, send messages etc.

    With the GPT-4 Turbo (more powerful, faster, and most importantly cheaper), assistants (plug-ins), and a GPT store (specialized gpt versions created by users)…

    I wonder if there’s a potential to leverage NodeBB forum data to train GPT-4 Turbo in a way to create a chatbot, and when users write a question, this bot will give a concise information/answer to users and guiding them directly to relevant topic(s) in the forum by sharing the topic links?

  • It appears that we are entering a new age… I guess soon we will be wearing glasses that can listen us and analyze statements/commands and make reservations, create alarms, send messages etc.

    With the GPT-4 Turbo (more powerful, faster, and most importantly cheaper), assistants (plug-ins), and a GPT store (specialized gpt versions created by users)…

    I wonder if there’s a potential to leverage NodeBB forum data to train GPT-4 Turbo in a way to create a chatbot, and when users write a question, this bot will give a concise information/answer to users and guiding them directly to relevant topic(s) in the forum by sharing the topic links?

    @crazycells Interesting concept, and certainly one that warrants further exploration as it could extend the reach of any forum well beyond what search engines can offer.

    I know that someone in the NodeBB community has already begun something along these lines in the form of ChatGPT moderation, which looks good but isn’t free in the sense that it needs “credits” to work

    https://community.nodebb.org/topic/17198/chatgpt-moderation?_=1699722431266

    From recollection, a pro subscription to GPT4 costs $20/month - and is has caps, such as 50 queries max per 4 hours, and many are questioning if this fee make the product worth it or not - it’s not something I’d specifically use in terms of a subscription per month - at least, not enough to warrant it’s cost.

    For the training part, I guess that ChatGPT would have to crawl your website rather like an indexing service does. However, we already have search capabilities in NodeBB and ChatGPT would effectively be another - the question here is do we really need it?

  • @crazycells Interesting concept, and certainly one that warrants further exploration as it could extend the reach of any forum well beyond what search engines can offer.

    I know that someone in the NodeBB community has already begun something along these lines in the form of ChatGPT moderation, which looks good but isn’t free in the sense that it needs “credits” to work

    https://community.nodebb.org/topic/17198/chatgpt-moderation?_=1699722431266

    From recollection, a pro subscription to GPT4 costs $20/month - and is has caps, such as 50 queries max per 4 hours, and many are questioning if this fee make the product worth it or not - it’s not something I’d specifically use in terms of a subscription per month - at least, not enough to warrant it’s cost.

    For the training part, I guess that ChatGPT would have to crawl your website rather like an indexing service does. However, we already have search capabilities in NodeBB and ChatGPT would effectively be another - the question here is do we really need it?

    @phenomlab said in using exclusive nodebb forum data to create a chatgpt chatbot?:

    From recollection, a pro subscription to GPT4 costs $20/month - and is has caps, such as 50 queries max per 4 hours, and many are questioning if this fee make the product worth it or not - it’s not something I’d specifically use in terms of a subscription per month - at least, not enough to warrant it’s cost.

    Maybe I am mistaken, but I thought this is the price for web-based ChatGPT subscription, where you use it for your own questions, right?

    I thought API price is based on the usage? input tokens & output tokens…

    https://help.openai.com/en/articles/7127956-how-much-does-gpt-4-cost

  • @phenomlab said in using exclusive nodebb forum data to create a chatgpt chatbot?:

    From recollection, a pro subscription to GPT4 costs $20/month - and is has caps, such as 50 queries max per 4 hours, and many are questioning if this fee make the product worth it or not - it’s not something I’d specifically use in terms of a subscription per month - at least, not enough to warrant it’s cost.

    Maybe I am mistaken, but I thought this is the price for web-based ChatGPT subscription, where you use it for your own questions, right?

    I thought API price is based on the usage? input tokens & output tokens…

    https://help.openai.com/en/articles/7127956-how-much-does-gpt-4-cost

    @crazycells said in using exclusive nodebb forum data to create a chatgpt chatbot?:

    where you use it for your own questions, right?

    Yes, that’s right. Sorry - I was trying to draw some parallel in terms of the cost.

    @crazycells said in using exclusive nodebb forum data to create a chatgpt chatbot?:

    I thought API price is based on the usage? input tokens & output tokens…

    Yes, it is, although on larger forums it could still land up being quite expensive depending on how often it is used.

  • @crazycells said in using exclusive nodebb forum data to create a chatgpt chatbot?:

    where you use it for your own questions, right?

    Yes, that’s right. Sorry - I was trying to draw some parallel in terms of the cost.

    @crazycells said in using exclusive nodebb forum data to create a chatgpt chatbot?:

    I thought API price is based on the usage? input tokens & output tokens…

    Yes, it is, although on larger forums it could still land up being quite expensive depending on how often it is used.

    @phenomlab yes, you are right. But my assumption is that larger forums would have money to fund this, although it does not necessarily have to be the case. This is the rate for GPT-Turbo…

    Screen Shot 2023-11-11 at 18.32.43.png

    $1 for 100.000 input tokens
    $3 for 100.000 output tokens

  • @phenomlab yes, you are right. But my assumption is that larger forums would have money to fund this, although it does not necessarily have to be the case. This is the rate for GPT-Turbo…

    Screen Shot 2023-11-11 at 18.32.43.png

    $1 for 100.000 input tokens
    $3 for 100.000 output tokens

    @crazycells your figures don’t seem to match the video?

    Don’t you mean $1 for 1,000? 🤔

  • @crazycells your figures don’t seem to match the video?

    Don’t you mean $1 for 1,000? 🤔

    @phenomlab oh no, that is 1 cent on the video, but you are right, symbols are similar… I just converted it to $1 , since it is more intuitive in daily life…


Related Topics
  • 0 Votes
    1 Posts
    551 Views
    No one has replied
  • What plugins are being used here on Sudonix?

    Solved General nodebb plugins development
    6
    5 Votes
    6 Posts
    2k Views
    @Roki-Antic Welcome! This site isn’t running Persona, but Harmony - a very heavily customised version at that. Do you have a URL where your site is currently located that is publicly accessible? Feel free to PM this info if you do not want to disclose here. Happy to help with any customisation needs.
  • Lawyers use of ChatGPT backfires

    Discussion chatgpt
    10
    9 Votes
    10 Posts
    3k Views
    @crazycells yes, I think it certainly has a place - but to enrich knowledge, rather than simply substitute it. I remember years ago when I did my exams. You weren’t allowed a calculator or anything like that and had to show your workings on a separate piece of paper which you were given additional marks for. These days, they use iPads etc in schools, so the art of writing a letter or needing to perform mathematical calculations in your head is gone. One of my very first jobs was in a newsagent who had a really old till (yes, not a Point-Of-Service like you have today) - all this till did was add up the individual figures, but didn’t tell you how much change to give - you had to do that part. Sounds simple enough, but with technology doing everything for us these days, our basic skills (think the “Three R’s”, and see example below) have taken a back seat and I think that’s made us lazy. https://www.merriam-webster.com/dictionary/three R's Again, my point here being to enrich - not completely replace basic skills we learn as we age.
  • adding some console.log to Nodebb

    Solved Customisation nodebb
    4
    1 Votes
    4 Posts
    2k Views
    @eeeee if you’re using the console, you could try node app.js > app.log 2>&1 This would redirect stdout to a file named app.log and redirect stderr to stdout. I’m not sure about standard logging under NodeBB, but there is an error log located at logs/error.log. Failing that, you could always stop the NodeBB service then use ./nodebb dev from the console which would then provide debug output.
  • NodeBB: Privileges for the Announcement channel

    Solved Configure nodebb
    6
    1
    1 Votes
    6 Posts
    2k Views
    Up to you really
  • 14 Votes
    69 Posts
    52k Views
    @phenomlab Seems to be better with some scaling fix for redis on redis.conf. I haven’t seen the message yet since the changes I made # I increase it to the value of /proc/sys/net/core/somaxconn tcp-backlog 4096 # I'm uncommenting because it can slow down Redis. Uncommented by default !!!!!!!!!!!!!!!!!!! #save 900 1 #save 300 10 #save 60 10000 If you have other Redis optimizations. I take all your advice https://severalnines.com/blog/performance-tuning-redis/
  • Podcast Share NodeBB

    Solved Configure podcast nodebb
    15
    4 Votes
    15 Posts
    4k Views
    @cagatay You could experiment with nodebb-plugin-ns-embed but I expect the x-origin tag on the remote site to prevent playback.
  • Forum Icons NodeBB

    Solved Customisation icons forum nodebb
    13
    0 Votes
    13 Posts
    4k Views
    @cagatay That matches what I see [image: 1667218162107-4f0f858d-9812-42b1-9f61-ffb13d31dccd-image.png]