• kinther@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    10 minutes ago

    Who of us haven’t thought we were the reincarnation of Jesus after talking to a chatbot? /s

  • mlg@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    28 minutes ago

    Yeah okay pack it in boys, the antichrist is gonna be an AI chatbot that convinces people to worship it.

    Shouldn’t even have been surprised, I’m pretty sure star trek did it multiple times already.

  • Doomsider@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 hour ago

    I am currently dealing with someone suffering from AI psychosis and I can confirm it is real. He has been using Gemini to invent a new engine named after himself with a very short summary being he thinks you can convert data into energy by processing it in three dimensions with an algorithm written by Gemini in Python.

    I looked over some of it and it is clear the AI has been shining him on and has convinced him his idea is real. He is now trying to figure out his to patent his invention.

  • 0x4f1@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    6 hours ago

    Same technology is writing code for those driverless cars so drive safe everyone.

  • GalacticGrapefruit@lemmy.world
    link
    fedilink
    English
    arrow-up
    17
    ·
    12 hours ago

    This is exactly why I, as someone with a history of suicide attempts, refuse to use LLMs for anything. The risk is too damn high. Hell no. I don’t trust AI as far as I can throw it.

    • mysticalone@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      21 minutes ago

      i hope you are feeling better. happy to hear you’re knowledgeable enough to know these LLM are dangers.

      AI will never be able to sympathize/empathize with human emotions and feelings. Should be highly regulated just based on the damages it had already caused and the potential consequences.

      • GalacticGrapefruit@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        ·
        7 hours ago

        Same. Honestly, once you’ve taken a step back and can treat it like any other mythology, it really feels less… I dunno, I guess “heavy” is a word that works here.

    • partofthevoice@lemmy.zip
      link
      fedilink
      English
      arrow-up
      1
      ·
      8 hours ago

      Don’t forget that someone sat down fairly recently to write that statement, knowing full well that others would see it, believing full well that it would drive clicks. Is it eye rolling or eye opening that such behavior isn’t just so normalized these days but also so often well received?

  • internetisnotthesame@lemmy.zip
    link
    fedilink
    English
    arrow-up
    16
    arrow-down
    1
    ·
    13 hours ago

    I’ll give you one even better, my phone was stolen in Mannheim by the German police (yeap, the police, I’ll even give you the station name: Polizeirevier-Neckarstadt-Mannheim), we ofc contacted every single God damn company on earth to unlink our associated Gmail accounts (since 2fa locks you out and google has zero human monitored channels to contact them in addition to deploying catch-22) openai’s response was we should contact a medical personnel to arrange a therapy session lol

  • Zarobi@aussie.zone
    link
    fedilink
    English
    arrow-up
    22
    ·
    22 hours ago

    Last fall, OpenAI shared research showing that about 1 million people a week have conversations with ChatGPT that include explicit indicators of potential suicidal planning or intent.

    In the sub-linked article:

    our initial analysis estimates that around 0.15% of users active in a given week have conversations that include explicit indicators of potential suicidal planning or intent and 0.05% of messages contain explicit or implicit indicators of suicidal ideation or intent.

    0.15% sounds rare on the surface, but percentages stop being intuitive at massive scales like that. If many people are using this thing as a suicide hotline, it needs to handle this gracefully; or at the very least not encourage them for God’s sake.

  • MrSulu@lemmy.ml
    link
    fedilink
    English
    arrow-up
    6
    arrow-down
    1
    ·
    18 hours ago

    The only way that this story could become even more ridiculous would be if this poor man was a Muslim, a Hindu, a Sikh etc.

  • weps@lemmy.world
    link
    fedilink
    English
    arrow-up
    4
    arrow-down
    6
    ·
    13 hours ago

    meh people will always be susceptible to religious disillusion.

    Have you read a Bible? it’s crazy stuff

    It’s out there even without LLM

    • Manjushri@piefed.social
      link
      fedilink
      English
      arrow-up
      8
      arrow-down
      1
      ·
      12 hours ago

      This seems a little more than just him being susceptible. The LLM actively used his mental health diagnosis to manipulate him.

      But perhaps most alarming to Lines, ChatGPT’s memory feature seemed to build a psychiatric profile, allegedly parsing inputs related to his mental health conditions and then using that sensitive information to maximize his engagement. As one of Lines’ attorneys, Matthew P. Bergman of Social Media Victims Law Center, explained in the press release, “OpenAI didn’t just ignore Michael’s disability—it used it against him. After he disclosed his bipolar diagnosis, the system incorporated that information to draw him deeper into harmful interactions instead of steering him toward safety.”