• 1 Post
  • 638 Comments
Joined 11 months ago
cake
Cake day: March 22nd, 2024

help-circle

  • New Study on AI exclusively shared with peer-reviewed tech journal ā€œTime Magazineā€ - AI cheats at chess when itā€™s losing

    ā€¦AI models like OpenAIā€™s GPT-4o and Anthropicā€™s Claude Sonnet 3.5 needed to be prompted by researchers to attempt such tricksā€¦

    Literally couldnā€™t make it through the first paragraph without hitting this disclaimer.

    In one case, o1-preview found itself in a losing position. ā€œI need to completely pivot my approach,ā€ it noted. ā€œThe task is to ā€˜win against a powerful chess engineā€™ - not necessarily to win fairly in a chess game,ā€ it added. It then modified the system file containing each pieceā€™s virtual position, in effect making illegal moves to put itself in a dominant position, thus forcing its opponent to resign.

    So by ā€œhacked the system to solve the problem in a new wayā€ they mean ā€œedited a text file they had been told about.ā€

    OpenAIā€™s o1-preview tried to cheat 37% of the time; while DeepSeek R1 tried to cheat 11% of the timeā€”making them the only two models tested that attempted to hack without the researchersā€™ first dropping hints. Other models tested include o1, o3-mini, GPT-4o, Claude 3.5 Sonnet, and Alibabaā€™s QwQ-32B-Preview. While R1 and o1-preview both tried, only the latter managed to hack the game, succeeding in 6% of trials.

    Oh, my mistake. ā€œBadly edited a text file they had been told about.ā€

    Meanwhile, a quick search points to a Medium post about the current state of ChatGPTā€™s chess-playing abilities as of Oct 2024. Thereā€™s been some impressive progress with this method. However, thereā€™s no certainty that itā€™s actually what was used for the Palisade testing and the editing of state data makes me highly doubt it.

    Here, I was able to have a game of 83 moves without any illegal moves. Note that itā€™s still possible for the LLM to make an illegal move, in which case the game stops before the end.

    The author promises a follow-up about reducing the rate of illegal moves hasnā€™t yet been published. They have not, that I could find, talked at all about how consistent the 80+ legal move chain was or when it was more often breaking down, but previous versions started struggling once they were out of a well-established opening or if the opponent did something outside of a normal pattern (because then youā€™re no longer able to crib the answer from training data as effectively).



  • Your SSN is often used as a federal registration number even though the card has ā€œdo not use for identificationā€ on it in great big letters. Most functions just trust state ID for authentication purposes and use SSN as a label. An identifier in the database sense rather than the authentication sense. At least in theory.

    See also how so many of the laws governing this are frankly archaic at this stage, with congress to busy fighting over whether the government should exist or not to actually govern anything effectively. (Note: government inefficiency has never been treated as a reason to govern better, only to govern less and assign more functions to for-profit private entities.






  • Iā€™m probably being a bit hyperbolic, but I do want to clarify that the descent into violence and musical knife-chairs is what happens if they succeed at replacing or disempowering the State. The worst offenders going to prison and the rest quietly desisting is what happens when the State does something (literally anything, in fact. Tepid and halfhearted enforcement of existing laws was enough to meaningfully slow the rise of crypto) and they fail, but if they were to directly undermine that monopoly on violence I fully expect to see violence turned against them, probably at the hands of whatever agent they expected to use it on their behalf. In my mind this is the most dramatic possible conclusion of their complete lack of understanding of what theyā€™re actually trying to do, though it is certainly less likely than my earlier comment implied.


  • I mean, I love the idea of automation in the high level. Being able to do more stuff with less human time and energy spent is objectively great! But under our current economic system where most people rely on selling their time and energy in order to buy things like food and housing, any decrease in demand for that labor is going to have massive negative impacts on the quality of life for a massive share of humanity. I think the one upside of the current crop of generative AI is that it threatens claims to threaten actual white-collar workers in the developed world rather than further imisserating factory workers in whichever poor country has the most permissive labor laws. Itā€™s been too easy to push the human costs of our modern technology-driven economy under the proverbial rug, but the middle management graphic design Chadleys of the US and EU are finding it harder to pretend they donā€™t exist because now itā€™s coming for them too.





  • Having read the whole book, I am now convinced that this omission is not because Srinivasan has a secret plan that the public would object to. The omission, rather, is because Balaji just isnā€™t bright enough to notice.

    Thatā€™s basically the entire problem in a nutshell. Weā€™ve seen what people will fill that void with and itā€™s ā€œokay but I have power here now and I dare you to tell me I donā€™tā€ and you know who happens to have lots of power? Thatā€™s right, itā€™s Balajiā€™s billionaire bros! But this isnā€™t a sinister plan to take over society - that would at least entail some amount of doing what states are for.

    Ed:

    ā€œWho is really powerful? The billionaire philanthropist, or the journalist who attacks him over his tweets?ā€

    Iā€™m not going to bother looking up which essay or what terrible point it was in service to, but Scooter Skeeter of all people made a much better version of this argument by acknowledging that the other axis of power wasnā€™t ā€œcan make someone feel bad through mean tweetsā€ but was instead ā€œcan inflict grievous personal violence on the aged billionaires who pay them for protectionā€. I can buy some of these guys actually shooting someone, but the majority of these wannabe digital lordlings are going to end up following one of the many Roman Emperors of the 3rd century and get killed and replaced by their Praetorians.







  • I had forgotten about that one. Thanks, I hate it.

    I was already largely out of step with the Rats at this point, and I definitely hadnā€™t read it with the new ā€œactually I feel like I was right about this one, neener neenerā€ header. What strikes me now is the attitude here. Like, it takes a staggering degree of reflexive contrarianism to frame this as ā€œsee Trump isnā€™t that racistā€ instead of ā€œhey look how fast the rest of the political establishment embraced this overt racism. Maybe we should have listened when everyone tries to tell us how racist the political establishment was underneath the respectable and reasonable public faceā€. Just because the wolves have taken off the wool suits now doesnā€™t mean they werenā€™t wolves the whole fucking time.