Skip to content

Lawyers use of ChatGPT backfires

Discussion
  • OpenAI’s ChatGPT has impressed users with its incredible ability to write essays, speeches, do homework, crack computer code and pen poems - but it’s also prone to providing information that is incorrect.

    https://news.sky.com/story/lawyers-fined-after-citing-bogus-cases-from-chatgpt-research-12908318

  • You’d think that for such a flagrant breach of the law from the very same institution designed to uphold it would attract a much harsher punishment than a USD 5,000 fine.

    I’d say this is the equivalent of lying in court - perjury in fact, and you’d think that same institution would impose greater sanctions, such as revoking their license to practice law - particularly as they stood by the complete diatribe of false information they presented.

    A complete breakdown in terms of fact checking, and I’m surprised this case wasn’t thrown out as a result.

    I’m not a lawyer by any stretch of the imagination, but this truly begs belief.

  • lol just 5000? But on top of lying, this is stupidity… incompetence of the law firm…

    maybe you remember, previously I was mentioning about this “fake” references before on this forum, when I asked about my own field to chatgpt and asked for some reading suggestions, it gave me completely made up scientific article names that looks very legit, and I was very surprised how I could not know these articles… later, it turns out, it is imitating article names and sounds legit, however, those references do not exist.

    if I use the court decision in “crazycells v. Sudonix” case as example, I would at least search for the case and read the decision 1 time…

  • @crazycells said in Lawyers use of ChatGPT backfires:

    lol just 5000? But on top of lying, this is stupidity… incompetence of the law firm…

    I know - begs belief.

    @crazycells said in Lawyers use of ChatGPT backfires:

    maybe you remember, previously I was mentioning about this “fake” references before on this forum, when I asked about my own field to chatgpt and asked for some reading suggestions, it gave me completely made up scientific article names that looks very legit, and I was very surprised how I could not know these articles… later, it turns out, it is imitating article names and sounds legit, however, those references do not exist.

    Yes, I remember this exact discussion.

  • @phenomlab said in Lawyers use of ChatGPT backfires:

    Yes, I remember this exact discussion.

    So, not following discussions on sudonix will cost this law firm 5000 and credibility issues…

  • @crazycells said in Lawyers use of ChatGPT backfires:

    So, not following discussions on sudonix will cost this law firm 5000 and credibility issues…

    🙂 it certainly seems that way.

  • @phenomlab by the way, I started to use Bard as well… it seems that it is useful as chatgpt but for different purposes.

    unlike chatgpt, bard can give me correct references in the field and even provide me direct PubMed links… however, bard gives me very short summaries and focuses on the correct and current info… chatgpt remembers what I say better, bard does not like long writings or does not like fantasies as chatgpt does 😄

  • @crazycells Thanks. I’m going to be looking at Bard myself. I’ve personally identified some serious flaws with ChatGPT - for example, giving it deliberately vulnerable code and asking it to make changes based on security requirements. It responded “well”, but failed to spot a simple SQL injection vulnerability I’d added in a PHP function - and it also failed to suggest that I changed my script to use PDO rather than literal strings (which is what would allow the SQL to be injected in the first place).

    I never expected ChatGPT to be “perfect”, but this is a glaring omission in my view as there are thousands of articles on the web concerning remediating this specific issue.

    It just makes me shudder - the thought of those with no fundamental experience of what secure code looks like adopting suggestions from ChatGPT which are inherently insecure and by default, easily exploited.

  • @phenomlab yeah, that is right. I agree but rather than codes, I am making ChatGPT to help me with emails, letters etc. Very helpful to draft a letter, although I do not directly use any of the stuff it gives me, I save a lot of time (and the best part is no mental exhaustion during this initial process) thanks to it.
    Of course, it might be a little different for you, since you are a native speaker.

  • @crazycells yes, I think it certainly has a place - but to enrich knowledge, rather than simply substitute it.

    I remember years ago when I did my exams. You weren’t allowed a calculator or anything like that and had to show your workings on a separate piece of paper which you were given additional marks for.

    These days, they use iPads etc in schools, so the art of writing a letter or needing to perform mathematical calculations in your head is gone. One of my very first jobs was in a newsagent who had a really old till (yes, not a Point-Of-Service like you have today) - all this till did was add up the individual figures, but didn’t tell you how much change to give - you had to do that part.

    Sounds simple enough, but with technology doing everything for us these days, our basic skills (think the “Three R’s”, and see example below) have taken a back seat and I think that’s made us lazy.

    https://www.merriam-webster.com/dictionary/three R's

    Again, my point here being to enrich - not completely replace basic skills we learn as we age.


Related Topics
  • Best Search Engine?

    Discussion
    13
    1 Votes
    13 Posts
    129 Views

    @phenomlab and that is the exact moment you double click on the browser icon and start typing away what you want to search for haha

  • 15 Votes
    14 Posts
    264 Views

    @phenomlab said in What's your view on RSS - is it dead technology?:

    @JAC would be keen to get your views around RSS feeds

    I’ve used RSS feeds over the years to pull in articles on forums and websites. I also have an RSS feed app on my phone that contains selective football news, it’s still an incredibly handful tool for me.

  • Which email client do you use?

    Discussion
    39
    15 Votes
    39 Posts
    584 Views

    Circling back here - admittedly, with my tail between my legs. I’ve been through literally every single email client I can think of, and whilst Outlook works, it doesn’t have a unified mailbox (although the Android and iPhone versions do), and this is something of a show-stopper for me.

    Years ago, when I had only one email account to manage, life was simple and you could use webmail without issue. However, times do change, and I’m now in a position where I need to monitor numerous accounts constantly, and flipping between webmail apps is not an option anymore.

    I don’t have time to scan through multiple inboxes either, and so would need a unified mailbox. I tried Canary Mail, and this also does not work if you have the VPN running locally on the machine - same as eMClient.

    I’ve installed eMClient again, and stopped the machine level VPN (my preference), but enabled the browser extension so at least my internet activity is secured, but I can still use the app. I know this goes against all the principles I raised earlier, but the app is superior in every way, and easily the best I’ve found so far. Besides, I’d have to disable the VPN at machine level for the push notifications to work, as I’ve mentioned here

    https://sudonix.org/topic/665/planned-sunset-of-ntfy-plugin

  • Google looks to AI paywall option

    Discussion
    1
    1 Votes
    1 Posts
    288 Views
    No one has replied
  • 4 Votes
    7 Posts
    706 Views

    @phenomlab oh no, that is 1 cent on the video, but you are right, symbols are similar… I just converted it to $1 , since it is more intuitive in daily life…

  • I have a dream, a vanilla one

    Discussion
    8
    1 Votes
    8 Posts
    454 Views

    @Panda I think we’re already seeing that direction being followed - although probably not in the sense of self-hosted.

  • The corporate greed of Amazon

    Discussion
    11
    13 Votes
    11 Posts
    488 Views

    And so it starts. Amazon are going to introduce forced ads even for Prime customers on their platform. To remove them, you have to pay more??

    https://news.sky.com/story/amazons-prime-video-to-include-ads-from-2024-unless-you-pay-more-12967202

  • 16 Votes
    21 Posts
    1k Views

    @crazycells said in How long before AI takes over your job?:

    sponsored content

    To me, this is the method to get yourself to the top of the list. Unfair advantage doesn’t even properly describe it.