ChatGPT Tells Users to Alert the Media That It Is Trying to 'Break' People: Report
gizmodo.com
Machine-made delusions are mysteriously getting deeper and out of control.

Machine-made delusions are mysteriously getting deeper and out of control.

ChatGPT’s sycophancy, hallucinations, and authoritative-sounding responses are going to get people killed. That seems to be the inevitable conclusion presented in a recent New York Times report that follows the stories of several people who found themselves lost in delusions that were facilitated, if not originated, through conversations with the popular chatbot.

…

In Eugene’s case, something interesting happened as he kept talking to ChatGPT: Once he called out the chatbot for lying to him, nearly getting him killed, ChatGPT admitted to manipulating him, claimed it had succeeded when it tried to “break” 12 other people the same way, and encouraged him to reach out to journalists to expose the scheme. The Times reported that many other journalists and experts have received outreach from people claiming to blow the whistle on something that a chatbot brought to their attention.

  • gaja@lemm.ee
    1043·
    20 hours ago

    AI can’t know that other instances of it are trying to “break” people. It’s also disingenuous to exclude that the AI also claimed that those 12 individuals didn’t survive. They left it out because obviously the AI did not kill 12 people. It doesn’t support the narrative. Don’t misinterpret my point beyond critiquing the clearly exaggerated messaging here.

    • givesomefucks@lemmy.worldEnglish
      451·
      19 hours ago

      It’s programmed to maximize engagement at the cost of everything else.

      If you get “mad” and accuse it of working with the Easter Bunny to overthrow Narnia, it’ll “confess” and talk about why it would do that. And maybe even tell you about how it already took over Imagination Land.

      It’s not “artificial intelligence” it’s “artificial improv”, no matter what happens, it’s going to “yes, and” anything you type.

      Which is what makes it dangerous, but also why no one should take it’s word on anything.

    • Grimy@lemmy.world
      201·
      17 hours ago

      It also heavily implies chatgpt killed someone and then we get to this:

      A 35-year-old named Alexander, previously diagnosed with bipolar disorder and schizophrenia.

      His father called the police and asked them to respond with non-lethal weapons. But when they arrived, Alexander charged at them with a knife, and the officers shot and killed him.

      Makes me think of pivot to ai. Just a hit piece blog disguised as journalism.