Machine-made delusions are mysteriously getting deeper and out of control.

ChatGPT’s sycophancy, hallucinations, and authoritative-sounding responses are going to get people killed. That seems to be the inevitable conclusion presented in a recent New York Times report that follows the stories of several people who found themselves lost in delusions that were facilitated, if not originated, through conversations with the popular chatbot.

In Eugene’s case, something interesting happened as he kept talking to ChatGPT: Once he called out the chatbot for lying to him, nearly getting him killed, ChatGPT admitted to manipulating him, claimed it had succeeded when it tried to “break” 12 other people the same way, and encouraged him to reach out to journalists to expose the scheme. The Times reported that many other journalists and experts have received outreach from people claiming to blow the whistle on something that a chatbot brought to their attention.

  • Opinionhaver@feddit.uk
    link
    fedilink
    English
    arrow-up
    7
    arrow-down
    7
    ·
    14 hours ago

    I don’t like that part about it either but instead of stopping using it, I simply told it to stop acting that way.

    • krashmo@lemmy.world
      link
      fedilink
      arrow-up
      14
      arrow-down
      7
      ·
      14 hours ago

      When I use this tool it destroys the planet and gives me bad information but I am going to keep using it.

      Umm OK, good luck with that I guess.

          • Tarquinn2049@lemmy.world
            link
            fedilink
            arrow-up
            3
            arrow-down
            3
            ·
            12 hours ago

            There is a reason they chose that as their screen name. I don’t know if they built that account as a troll, or if they got told their opinions are wrong so often in life that having “opinions” became their whole identity. Anytime I see someone with the most “swimming against the current” ideas, I look up, and there is that name again. At this point, I’m very much rooting for troll, as their life would suck even more if it’s all genuine. As much as the life of a troll would suck already.

            • Opinionhaver@feddit.uk
              link
              fedilink
              English
              arrow-up
              3
              arrow-down
              1
              ·
              11 hours ago

              I’m more than happy to elaborate on any of my unpopular opinions that you view as trolling. I’m very much sharing my honest views here.