This is a game played on June 19 between Ueno Asami (as black) and Fujisawa Rina (as white). At move 159, Asami cut with K14.
It involves a followup of the life and death of the white group M10, and most human players would be able to judge it, but AI (from Golaxy to Katago) all seem to deem it “alive” and continue to fight without securing the life of that group first. While a human player can read out the sequence like Rina did during the game and make the right choice.
But it takes like 10k+ playouts before AI realize the K14 cut is a very good move, and (with few playouts AI even judges K14 as a blunder). And it takes millions of playouts before AI realizes the M10 white group is in trouble.
What other AI blindspots and hallucinations have you seen in real games?
You must log in or register to comment.
Blind spots like this occur all of the time. Can you give some additional details and context? And I’ll try to get this position as an sgf position for training.
What network were you using to evaluate this position?
Do you have an sgf file of this game that you can share, so that I can attempt to reproduce this issue? (Sometimes, the real blind spot is few plys into the tree, so it’s sometimes useful to be able to look into the position.)
As a follow up, I looked into this position with the current strongest rated network, and at 25 visits, K14 is actually the favorite move, followed by the reduction at O8*. After 100,000 visits it hates every move, but thinks that K14 is about 6.5 points better than the next best move H14. There are some big territorial swings, and depending on the exact sequence the network will like the situation more or less, so the network thinks this is a very volatile position.
* Note, now that I’ve had a look at it, I don’t believe that it is possible for black to kill white at M10. Best black can do seems to be seki: bO8, O7, N5, P8, N8, N9, M8, P9. But if you have a better result for black please let me know.
