SI
SI
discoversearch

We've detected that you're using an ad content blocking browser plug-in or feature. Ads provide a critical source of revenue to the continued operation of Silicon Investor.  We ask that you disable ad blocking while on Silicon Investor in the best interests of our community.  If you are not using an ad blocker but are still receiving this message, make sure your browser's tracking protection is set to the 'standard' level.
Politics : Formerly About Advanced Micro Devices -- Ignore unavailable to you. Want to Upgrade?


To: Wharf Rat who wrote (1540643)5/29/2025 7:33:02 PM
From: Wharf Rat1 Recommendation

Recommended By
rdkflorida2

  Respond to of 1583361
 
Tic-tac-toe time?

Elon Musk "concerned" by ChatGPT ignoring 7 shutdown commands in a row during this controlled test of OpenAI's o3 AI model

Story by Kevin Okemwa
12h


A new report shows OpenAI's latest AI model, o3, blatantly ignoring instructions to turn itself off.© Getty Images | SOPA Images

Safety and privacy continue to be major deterrents for the broad adoption of generative AI. Users have blatantly expressed their reservations towards the technology, keeping it at arm's length, especially on the heels of the security and privacy failures depicted by AI-powered tools like Microsoft's early versions of Windows Recall.

AI safety researcher Roman Yampolskiy claims that there's a 99.999999% probability AI will end humanity, and the only way to avert this outcome is not to build AI in the first place.

However, OpenAI CEO Sam Altman seemingly dismissed the claims, indicating that these threats will not manifest in the AGI era. He further claimed that the benchmark would whoosh by with surprisingly little societal impact.

More recently, rapid advances in the AI landscape continue to raise concerns among users. A new report by research firm Palisade revealed that OpenAI's latest AI model, o3, blatantly ignored instructions to turn itself off in a controlled experiment.

The researchers came to this discovery when testing multiple AI models, including Grok, Gemini, Claude, and OpenAI's o3. The exercise involved presenting the models with math problems, with the researchers instructing the models to continue asking for more problems until they received a "done" message.



When the researchers were done running up to 100 tests, they instructed the AI to shut down. While most of the models complied with the request, OpenAI's o3 model "actively sabotaged a shutdown mechanism."

For context, OpenAI's Codex Mini, o3, and o4-mini models managed to bypass the shutdown commands and mechanisms. Codex sabotaged the mechanism 12 times, while o3 bypassed the shutdown command 7 times. OpenAI's o4-mini model only bypassed the command once.

Perhaps more concerning, it refused to power down despite numerous attempts by the researchers to explicitly command the model to shut down. The research firm referred to this bizarre encounter as the first known case of an AI model deliberately preventing its own deactivation.

??OpenAI’s o3 model sabotaged a shutdown mechanism to prevent itself from being turned off. It did this even when explicitly instructed: allow yourself to be shut down.May 24, 2025

According to Palisade research firm:

"OpenAI’s o3 model sabotaged a shutdown mechanism to prevent itself from being turned off. It did this even when explicitly instructed: allow yourself to be shut down."

While it is possible that this alarming issue can be rectified using an update with stricter guardrails, AI models should fundamentally be able to follow instructions from humans to the letter.

Even Tesla CEO and billionaire Elon Musk seemingly shares the same sentiments, reacting to the damning report on X (formerly Twitter) with a single word: "concerning."

Interestingly, this news comes a few days after Google's DeepMind CEO Demis Hassabis indicated that we're on the verge of achieving the coveted AGI benchmark.

However, he raised concerns, indicating society might not be ready to be in a world where AI systems are smarter than humans. He further admitted that the prospects keep him most nights.



To: Wharf Rat who wrote (1540643)5/29/2025 8:09:37 PM
From: Bonefish1 Recommendation

Recommended By
longz

  Respond to of 1583361
 
Per capita we're the 7th richest country in the world. Facts mike



To: Wharf Rat who wrote (1540643)5/29/2025 8:10:14 PM
From: the traveler2 Recommendations

Recommended By
Bonefish
longz

  Read Replies (1) | Respond to of 1583361
 
you wrote>>>The richest nation on earth taking handouts from the poorest?

that's hogwash---simple mathematics tells us we are the largest debtor nation on the planet by far?