Microsoft boasted an AI model that can generate the game's graphics in real-time while reacting to the player's interactions.

Despite a decade of AI growth, Cook says, there's no method yet to measure what exactly an AI model has captured and what it has not. Muse is able to provide grainy gifs of one fairly simple video game based on seven years of footage, but it is not a solution for holding everything about a game or every possible outcome of what players could do.

Microsoft Research has created Muse, a first-of-its-kind generative AI model that can generate a game environment based on visuals or players’ controller actions. It understands a 3D game world and game physics and can react to how players interact with a game.