Microsoft’s new AI model can create video game gameplay

Microsoft Research and Xbox game studio Ninja Theory have developed a new artificial intelligence model called Muse that can generate gameplay visuals and predict controller inputs, marking what the company calls a breakthrough in AI for gaming.

The model, trained on over one billion images and controller actions from the 2020 game Bleeding Edge, demonstrates an understanding of 3D game worlds and physics while responding to player interactions. Microsoft describes Muse as the first of a new category called World and Human Action Models (WHAM).