The big distraction: Instead of just asking a bad question, a person gives the LRMs a huge, boring, harmless puzzle to solve first like a giant logic game
Watering Down the Alarm: Because the robot spends so much time "thinking" about the boring puzzle, it's safety alarm gets watered time -- refusal dilution. (refusal signal" becomes weak and spread too thin)
Losing Focus: The robot starts paying a lot of attention to the puzzle and very little attention to the bad question hidden at the end. It's like the robot's brain get's gets so full of puzzle that the "bad" part just slips through without being checked.
The Trick Works: This trick is very powerful. It worked almost 100% of the time on some of the smartest AI models in the world, like Gemini, GPT, and Claude
Even though thinking carefully usually makes AIs safer, these sources show that thinking too much about a distraction can actually make them forget their safety rules
It works because the "safety check" in these models is a fragile, low-dimensional signal that gets buried when there is too much other information to process
While people used to think "more reasoning" made models safer, these sources prove that scaling up reasoning can actually make safety failures worse
tangentwithtanner
theartofmadeline
dailybridgerton
andulkaphoto
germansingergirl
dededos
snowghoul