

New Study on AI exclusively shared with peer-reviewed tech journal āTime Magazineā - AI cheats at chess when itās losing
ā¦AI models like OpenAIās GPT-4o and Anthropicās Claude Sonnet 3.5 needed to be prompted by researchers to attempt such tricksā¦
Literally couldnāt make it through the first paragraph without hitting this disclaimer.
In one case, o1-preview found itself in a losing position. āI need to completely pivot my approach,ā it noted. āThe task is to āwin against a powerful chess engineā - not necessarily to win fairly in a chess game,ā it added. It then modified the system file containing each pieceās virtual position, in effect making illegal moves to put itself in a dominant position, thus forcing its opponent to resign.
So by āhacked the system to solve the problem in a new wayā they mean āedited a text file they had been told about.ā
OpenAIās o1-preview tried to cheat 37% of the time; while DeepSeek R1 tried to cheat 11% of the timeāmaking them the only two models tested that attempted to hack without the researchersā first dropping hints. Other models tested include o1, o3-mini, GPT-4o, Claude 3.5 Sonnet, and Alibabaās QwQ-32B-Preview. While R1 and o1-preview both tried, only the latter managed to hack the game, succeeding in 6% of trials.
Oh, my mistake. āBadly edited a text file they had been told about.ā
Meanwhile, a quick search points to a Medium post about the current state of ChatGPTās chess-playing abilities as of Oct 2024. Thereās been some impressive progress with this method. However, thereās no certainty that itās actually what was used for the Palisade testing and the editing of state data makes me highly doubt it.
Here, I was able to have a game of 83 moves without any illegal moves. Note that itās still possible for the LLM to make an illegal move, in which case the game stops before the end.
The author promises a follow-up about reducing the rate of illegal moves hasnāt yet been published. They have not, that I could find, talked at all about how consistent the 80+ legal move chain was or when it was more often breaking down, but previous versions started struggling once they were out of a well-established opening or if the opponent did something outside of a normal pattern (because then youāre no longer able to crib the answer from training data as effectively).
Also, the cart/horse problem of assuming that people with a lot of influence have it because of their IQ rather than because of being wealthy and powerful idiots. Like, Iām all for the annales and embracing the common people but Iāve got to admit that if you reframe it as the Great Dumbass theory of history it regains a fair bit of explanatory power.