Skip to content

using exclusive nodebb forum data to create a chatgpt chatbot?

Discussion
7 2 3.0k 1
  • wrote on last edited by
    #1

    It appears that we are entering a new age… I guess soon we will be wearing glasses that can listen us and analyze statements/commands and make reservations, create alarms, send messages etc.

    With the GPT-4 Turbo (more powerful, faster, and most importantly cheaper), assistants (plug-ins), and a GPT store (specialized gpt versions created by users)…

    I wonder if there’s a potential to leverage NodeBB forum data to train GPT-4 Turbo in a way to create a chatbot, and when users write a question, this bot will give a concise information/answer to users and guiding them directly to relevant topic(s) in the forum by sharing the topic links?

  • It appears that we are entering a new age… I guess soon we will be wearing glasses that can listen us and analyze statements/commands and make reservations, create alarms, send messages etc.

    With the GPT-4 Turbo (more powerful, faster, and most importantly cheaper), assistants (plug-ins), and a GPT store (specialized gpt versions created by users)…

    I wonder if there’s a potential to leverage NodeBB forum data to train GPT-4 Turbo in a way to create a chatbot, and when users write a question, this bot will give a concise information/answer to users and guiding them directly to relevant topic(s) in the forum by sharing the topic links?

    wrote on last edited by
    #2

    @crazycells Interesting concept, and certainly one that warrants further exploration as it could extend the reach of any forum well beyond what search engines can offer.

    I know that someone in the NodeBB community has already begun something along these lines in the form of ChatGPT moderation, which looks good but isn’t free in the sense that it needs “credits” to work

    https://community.nodebb.org/topic/17198/chatgpt-moderation?_=1699722431266

    From recollection, a pro subscription to GPT4 costs $20/month - and is has caps, such as 50 queries max per 4 hours, and many are questioning if this fee make the product worth it or not - it’s not something I’d specifically use in terms of a subscription per month - at least, not enough to warrant it’s cost.

    For the training part, I guess that ChatGPT would have to crawl your website rather like an indexing service does. However, we already have search capabilities in NodeBB and ChatGPT would effectively be another - the question here is do we really need it?

  • @crazycells Interesting concept, and certainly one that warrants further exploration as it could extend the reach of any forum well beyond what search engines can offer.

    I know that someone in the NodeBB community has already begun something along these lines in the form of ChatGPT moderation, which looks good but isn’t free in the sense that it needs “credits” to work

    https://community.nodebb.org/topic/17198/chatgpt-moderation?_=1699722431266

    From recollection, a pro subscription to GPT4 costs $20/month - and is has caps, such as 50 queries max per 4 hours, and many are questioning if this fee make the product worth it or not - it’s not something I’d specifically use in terms of a subscription per month - at least, not enough to warrant it’s cost.

    For the training part, I guess that ChatGPT would have to crawl your website rather like an indexing service does. However, we already have search capabilities in NodeBB and ChatGPT would effectively be another - the question here is do we really need it?

    wrote on last edited by phenomlab
    #3

    @phenomlab said in using exclusive nodebb forum data to create a chatgpt chatbot?:

    From recollection, a pro subscription to GPT4 costs $20/month - and is has caps, such as 50 queries max per 4 hours, and many are questioning if this fee make the product worth it or not - it’s not something I’d specifically use in terms of a subscription per month - at least, not enough to warrant it’s cost.

    Maybe I am mistaken, but I thought this is the price for web-based ChatGPT subscription, where you use it for your own questions, right?

    I thought API price is based on the usage? input tokens & output tokens…

    https://help.openai.com/en/articles/7127956-how-much-does-gpt-4-cost

  • @phenomlab said in using exclusive nodebb forum data to create a chatgpt chatbot?:

    From recollection, a pro subscription to GPT4 costs $20/month - and is has caps, such as 50 queries max per 4 hours, and many are questioning if this fee make the product worth it or not - it’s not something I’d specifically use in terms of a subscription per month - at least, not enough to warrant it’s cost.

    Maybe I am mistaken, but I thought this is the price for web-based ChatGPT subscription, where you use it for your own questions, right?

    I thought API price is based on the usage? input tokens & output tokens…

    https://help.openai.com/en/articles/7127956-how-much-does-gpt-4-cost

    wrote on last edited by
    #4

    @crazycells said in using exclusive nodebb forum data to create a chatgpt chatbot?:

    where you use it for your own questions, right?

    Yes, that’s right. Sorry - I was trying to draw some parallel in terms of the cost.

    @crazycells said in using exclusive nodebb forum data to create a chatgpt chatbot?:

    I thought API price is based on the usage? input tokens & output tokens…

    Yes, it is, although on larger forums it could still land up being quite expensive depending on how often it is used.

  • @crazycells said in using exclusive nodebb forum data to create a chatgpt chatbot?:

    where you use it for your own questions, right?

    Yes, that’s right. Sorry - I was trying to draw some parallel in terms of the cost.

    @crazycells said in using exclusive nodebb forum data to create a chatgpt chatbot?:

    I thought API price is based on the usage? input tokens & output tokens…

    Yes, it is, although on larger forums it could still land up being quite expensive depending on how often it is used.

    wrote on last edited by
    #5

    @phenomlab yes, you are right. But my assumption is that larger forums would have money to fund this, although it does not necessarily have to be the case. This is the rate for GPT-Turbo…

    Screen Shot 2023-11-11 at 18.32.43.png

    $1 for 100.000 input tokens
    $3 for 100.000 output tokens

  • @phenomlab yes, you are right. But my assumption is that larger forums would have money to fund this, although it does not necessarily have to be the case. This is the rate for GPT-Turbo…

    Screen Shot 2023-11-11 at 18.32.43.png

    $1 for 100.000 input tokens
    $3 for 100.000 output tokens

    wrote on last edited by
    #6

    @crazycells your figures don’t seem to match the video?

    Don’t you mean $1 for 1,000? 🤔

  • @crazycells your figures don’t seem to match the video?

    Don’t you mean $1 for 1,000? 🤔

    wrote on last edited by
    #7

    @phenomlab oh no, that is 1 cent on the video, but you are right, symbols are similar… I just converted it to $1 , since it is more intuitive in daily life…


Related Topics
  • 0 Votes
    1 Posts
    619 Views
    No one has replied
  • SEO and Nodebb

    Performance nodebb seo
    2
    2 Votes
    2 Posts
    2k Views
    phenomlab
    @Panda It’s the best it’s ever been to be honest. I’ve used a myriad of systems in the past - most notably, WordPress, and then Flarum (which for SEO, was absolutely dire - they never even had SEO out of the box, and relied on a third party extension to do it), and NodeBB easily fares the best - see below example https://www.google.com/search?q=site%3Asudonix.org&oq=site%3Asudonix.org&aqs=chrome..69i57j69i60j69i58j69i60l2.9039j0j3&sourceid=chrome&ie=UTF-8#ip=1 However, this was not without significant effort on my part once I’d migrated from COM to ORG - see below posts https://community.nodebb.org/topic/17286/google-crawl-error-after-site-migration/17?_=1688461250365 And also https://support.google.com/webmasters/thread/221027803?hl=en&msgid=221464164 It was painful to say the least - as it turns out, there was an issue in NodeBB core that prevented spiders from getting to content, which as far as I understand, is now fixed. SEO in itself is a dark art - a black box that nobody really fully understands, and it’s essentially going to boil down to one thing - “content”. Google’s algorithm for indexing has also changed dramatically over the years. They only now crawl content that has value, so if it believes that your site has nothing to offer, it will simply skip it.
  • Lawyers use of ChatGPT backfires

    Discussion chatgpt
    10
    9 Votes
    10 Posts
    3k Views
    phenomlab
    @crazycells yes, I think it certainly has a place - but to enrich knowledge, rather than simply substitute it. I remember years ago when I did my exams. You weren’t allowed a calculator or anything like that and had to show your workings on a separate piece of paper which you were given additional marks for. These days, they use iPads etc in schools, so the art of writing a letter or needing to perform mathematical calculations in your head is gone. One of my very first jobs was in a newsagent who had a really old till (yes, not a Point-Of-Service like you have today) - all this till did was add up the individual figures, but didn’t tell you how much change to give - you had to do that part. Sounds simple enough, but with technology doing everything for us these days, our basic skills (think the “Three R’s”, and see example below) have taken a back seat and I think that’s made us lazy. https://www.merriam-webster.com/dictionary/three R's Again, my point here being to enrich - not completely replace basic skills we learn as we age.
  • NODEBB: Nginx error performance & High CPU

    Solved Performance performance nodebb nginx
    69
    4
    14 Votes
    69 Posts
    64k Views
    DownPW
    @phenomlab Seems to be better with some scaling fix for redis on redis.conf. I haven’t seen the message yet since the changes I made # I increase it to the value of /proc/sys/net/core/somaxconn tcp-backlog 4096 # I'm uncommenting because it can slow down Redis. Uncommented by default !!!!!!!!!!!!!!!!!!! #save 900 1 #save 300 10 #save 60 10000 If you have other Redis optimizations. I take all your advice https://severalnines.com/blog/performance-tuning-redis/
  • How to fix size of photos & videos NodeBB

    Solved Customisation nodebb nodebb size
    7
    3 Votes
    7 Posts
    3k Views
    phenomlab
    @crazycells pleasure. Using percentages makes much more sense in this case. It’s the same argument with px vs pt vs em with fonts, margins, padding, etc., in the sense that em is generally preferred over px and pt https://stackoverflow.com/questions/609517/why-em-instead-of-px
  • Top Ranked Forums

    Chitchat nodebb top ranked
    9
    1
    3 Votes
    9 Posts
    3k Views
    phenomlab
    The real issue here is that most people consider forums to be “dead” in the sense that nobody uses them anymore, and social media groups have taken their place. Their once dominant stance in the 90’s and early 00’s will never be experienced again, but having said that, there are a number of forums that did in fact survive the social media onslaught, and still enjoy a large user base. Forums tend to be niche. One that immediately sticks out is Reddit - despite looking like it was designed in the 80s, it still has an enormous user base. Another is Stack Overflow, which needs no introduction. The key to any forum is the content it offers, and the more people whom contribute in terms of posting , the more popular and widely respected it becomes as a reliable source of information. Forums are still intensely popular with gamers, alongside those that offer tips on hacking etc.
  • [NODEBB] Help for my custom CSS

    Solved Customisation nodebb css bugfix
    258
    49 Votes
    258 Posts
    173k Views
    cagatay
    mark hi, Refused to apply style from ‘https://efelsefe.com/assets/customfonts/FontAwesome-6-Pro/pro/css/v4-font-face.css’ because its MIME type (‘text/plain’) is not a supported stylesheet MIME type, and strict MIME checking is enabled. I keep getting this error.
  • Iframely (Nodebb)

    Solved Configure
    40
    4 Votes
    40 Posts
    17k Views
    phenomlab
    @DownPW This is now resolved. The issue was an incorrect URL specified in the Nodebb plugin. I’ve corrected this, and now it works as intended.