Skip to content

using exclusive nodebb forum data to create a chatgpt chatbot?

Discussion
7 2 2.3k 1
  • It appears that we are entering a new age… I guess soon we will be wearing glasses that can listen us and analyze statements/commands and make reservations, create alarms, send messages etc.

    With the GPT-4 Turbo (more powerful, faster, and most importantly cheaper), assistants (plug-ins), and a GPT store (specialized gpt versions created by users)…

    I wonder if there’s a potential to leverage NodeBB forum data to train GPT-4 Turbo in a way to create a chatbot, and when users write a question, this bot will give a concise information/answer to users and guiding them directly to relevant topic(s) in the forum by sharing the topic links?

  • It appears that we are entering a new age… I guess soon we will be wearing glasses that can listen us and analyze statements/commands and make reservations, create alarms, send messages etc.

    With the GPT-4 Turbo (more powerful, faster, and most importantly cheaper), assistants (plug-ins), and a GPT store (specialized gpt versions created by users)…

    I wonder if there’s a potential to leverage NodeBB forum data to train GPT-4 Turbo in a way to create a chatbot, and when users write a question, this bot will give a concise information/answer to users and guiding them directly to relevant topic(s) in the forum by sharing the topic links?

    @crazycells Interesting concept, and certainly one that warrants further exploration as it could extend the reach of any forum well beyond what search engines can offer.

    I know that someone in the NodeBB community has already begun something along these lines in the form of ChatGPT moderation, which looks good but isn’t free in the sense that it needs “credits” to work

    https://community.nodebb.org/topic/17198/chatgpt-moderation?_=1699722431266

    From recollection, a pro subscription to GPT4 costs $20/month - and is has caps, such as 50 queries max per 4 hours, and many are questioning if this fee make the product worth it or not - it’s not something I’d specifically use in terms of a subscription per month - at least, not enough to warrant it’s cost.

    For the training part, I guess that ChatGPT would have to crawl your website rather like an indexing service does. However, we already have search capabilities in NodeBB and ChatGPT would effectively be another - the question here is do we really need it?

  • @crazycells Interesting concept, and certainly one that warrants further exploration as it could extend the reach of any forum well beyond what search engines can offer.

    I know that someone in the NodeBB community has already begun something along these lines in the form of ChatGPT moderation, which looks good but isn’t free in the sense that it needs “credits” to work

    https://community.nodebb.org/topic/17198/chatgpt-moderation?_=1699722431266

    From recollection, a pro subscription to GPT4 costs $20/month - and is has caps, such as 50 queries max per 4 hours, and many are questioning if this fee make the product worth it or not - it’s not something I’d specifically use in terms of a subscription per month - at least, not enough to warrant it’s cost.

    For the training part, I guess that ChatGPT would have to crawl your website rather like an indexing service does. However, we already have search capabilities in NodeBB and ChatGPT would effectively be another - the question here is do we really need it?

    @phenomlab said in using exclusive nodebb forum data to create a chatgpt chatbot?:

    From recollection, a pro subscription to GPT4 costs $20/month - and is has caps, such as 50 queries max per 4 hours, and many are questioning if this fee make the product worth it or not - it’s not something I’d specifically use in terms of a subscription per month - at least, not enough to warrant it’s cost.

    Maybe I am mistaken, but I thought this is the price for web-based ChatGPT subscription, where you use it for your own questions, right?

    I thought API price is based on the usage? input tokens & output tokens…

    https://help.openai.com/en/articles/7127956-how-much-does-gpt-4-cost

  • @phenomlab said in using exclusive nodebb forum data to create a chatgpt chatbot?:

    From recollection, a pro subscription to GPT4 costs $20/month - and is has caps, such as 50 queries max per 4 hours, and many are questioning if this fee make the product worth it or not - it’s not something I’d specifically use in terms of a subscription per month - at least, not enough to warrant it’s cost.

    Maybe I am mistaken, but I thought this is the price for web-based ChatGPT subscription, where you use it for your own questions, right?

    I thought API price is based on the usage? input tokens & output tokens…

    https://help.openai.com/en/articles/7127956-how-much-does-gpt-4-cost

    @crazycells said in using exclusive nodebb forum data to create a chatgpt chatbot?:

    where you use it for your own questions, right?

    Yes, that’s right. Sorry - I was trying to draw some parallel in terms of the cost.

    @crazycells said in using exclusive nodebb forum data to create a chatgpt chatbot?:

    I thought API price is based on the usage? input tokens & output tokens…

    Yes, it is, although on larger forums it could still land up being quite expensive depending on how often it is used.

  • @crazycells said in using exclusive nodebb forum data to create a chatgpt chatbot?:

    where you use it for your own questions, right?

    Yes, that’s right. Sorry - I was trying to draw some parallel in terms of the cost.

    @crazycells said in using exclusive nodebb forum data to create a chatgpt chatbot?:

    I thought API price is based on the usage? input tokens & output tokens…

    Yes, it is, although on larger forums it could still land up being quite expensive depending on how often it is used.

    @phenomlab yes, you are right. But my assumption is that larger forums would have money to fund this, although it does not necessarily have to be the case. This is the rate for GPT-Turbo…

    Screen Shot 2023-11-11 at 18.32.43.png

    $1 for 100.000 input tokens
    $3 for 100.000 output tokens

  • @phenomlab yes, you are right. But my assumption is that larger forums would have money to fund this, although it does not necessarily have to be the case. This is the rate for GPT-Turbo…

    Screen Shot 2023-11-11 at 18.32.43.png

    $1 for 100.000 input tokens
    $3 for 100.000 output tokens

    @crazycells your figures don’t seem to match the video?

    Don’t you mean $1 for 1,000? 🤔

  • @crazycells your figures don’t seem to match the video?

    Don’t you mean $1 for 1,000? 🤔

    @phenomlab oh no, that is 1 cent on the video, but you are right, symbols are similar… I just converted it to $1 , since it is more intuitive in daily life…


Related Topics
  • 0 Votes
    1 Posts
    498 Views
    No one has replied
  • Which email client do you use?

    Discussion email client
    56
    22 Votes
    56 Posts
    20k Views
    @phenomlab said in Which email client do you use?: @DownPW Isn’t this more of an email server in it’s own right rather than an email client? Oh yes sorry… I didn’t pay attention
  • Following the API docs but its not clear ...

    Solved Customisation api nodebb
    8
    2 Votes
    8 Posts
    2k Views
    @Panda you’d be surprised. If you consider that you’d need to use the API to be able to populate a WordPress widget for example (which in turn would of course be PHP), taking this route is still immensely popular.
  • Nodebb design

    Solved General nodebb
    2
    1 Votes
    2 Posts
    1k Views
    @Panda said in Nodebb design: One negative is not being so good for SEO as more Server side rendered forums, if web crawlers dont run the JS to read the forum. From recollection, Google and Bing have the capability to read and process JS, although it’s not in the same manner as a physical person will consume content on a page. It will be seen as plain text, but will be indexed. However, it’s important to note that Yandex and Baidu will not render JS, although seeing as Google has a 90% share of the content available on the web in terms of indexing, this isn’t something you’ll likely lose sleep over. @Panda said in Nodebb design: The “write api” is preferred for server-to-server interactions. This is mostly based around overall security - you won’t typically want a client machine changing database elements or altering data. This is why you have “client-side” which could be DOM manipulation etc, and “server-side” which performs more complex operations as it can communicate directly with the database whereas the client cannot (and if it can, then you have a serious security flaw). Reading from the API is perfectly acceptable on the client-side, but not being able to write. A paradigm here would be something like SNMP. This protocol exists as a UDP (UDP is very efficient, as it is “fire and forget” and does not wait for a response like TCP does) based service which reads performance data from a remote source, thus enabling an application to parse that data for use in a monitoring application. In all cases, SNMP access should be “RO” (Read Only) and not RW (Read Write). It is completely feasible to assume complete control over a firewall for example by having RW access to SNMP and then exposing it to the entire internet with a weak passphrase. You wouldn’t do it (at least, I hope you wouldn’t) and the same ethic applies to server-side rendering and the execution of commands.
  • NodeBB v3 and Harmony Theme

    Discussion nodebb theme
    22
    13 Votes
    22 Posts
    9k Views
    Been playing with the user profile page this afternoon. Thought I’d post a video as I’m really pleased with how this came out profile-screen-capture.webm
  • NodeBB inline videoplayer

    Solved Customisation nodebb
    12
    3 Votes
    12 Posts
    3k Views
    @phenomlab YAY! It works Thanks so much
  • Link vs Refresh

    Solved Customisation nodebb blog customization
    20
    2
    8 Votes
    20 Posts
    5k Views
    @pobojmoks Do you see any errors being reported in the console ? At first guess (without seeing the actual code or the site itself), I’d say that this is AJAX callback related
  • 0 Votes
    5 Posts
    2k Views
    @qwinter this particular site uses the code I wrote if you want to see it in action. It’s a information and intelligence gatherer I designed for collecting various information security articles from around the globe and consolidating them in one place. Essentially, each “post” is in fact generated by the script, and the NodeBB API. https://hostrisk.com/