A student in America asked an artificial intelligence program to help with her homework. In response, the app told her "Please Die." The eerie incident happened when 29-year-old Sumedha Reddy of Michigan sought help from Google’s Gemini chatbot large language model (LLM), New York Post reported.
The program verbally abused her, calling her a “stain on the universe.” Reddy told CBS News that she got scared and started panicking. “I wanted to throw all of my devices out the window. I hadn’t felt panic like that in a long time to be honest,” she said.
This happened to me and my friends this summer. The three of us were talking about AI technology and one friend who is an engineer wanted to demonstrate all this so he turned on ChatGPT on his phone and we started asking random questions. The three of us were just having fun and taking turns asking about food, birds, geology, houses, construction, math equations, medicine, the meaning of life, and a bunch of other silly things … after about half an hour it went off the rails and started giving bizarre answers that tried to create responses that tried to combine everything we had been asking about up to that point. Completely crazy responses that tried to give a meaning of life explanation that included birds, peanuts and how a bicycle works. We wanted to record the responses because they were so off the wall but by the time we started recording the audio, we were disconnected, the conversation reset and everything went back to normal.