The model, called GameNGen, was made by Dani Valevski at Google Research and his colleagues, who declined to speak to New Scientist. According to their paper on the research, the AI can be played for up to 20 seconds while retaining all the features of the original, such as scores, ammunition levels and map layouts. Players can attack enemies, open doors and interact with the environment as usual.
After this period, the model begins to run out of memory and the illusion falls apart.
Yes, this does nothing for game dev. But I don’t think it was supposed to.
The fact that this is a genAI Model generating a reasonable, context aware image a whopping 20 times a second is nonetheless pretty impressive.