Microsoft Unveils Muse: A Generative AI Model for Gaming

Microsoft has introduced Muse, a generative AI model designed for gameplay ideation, announced in a press release. Muse, developed by the Microsoft Research Game Intelligence team in collaboration with Xbox Game Studios' Ninja Theory, is capable of generating game visuals and controller actions, or both.

Muse operates as a World and Human Action Model (WHAM), which allows it to predict how a game will evolve from an initial prompt sequence. This capability is demonstrated through gameplay sequences generated by Muse, which are consistent over several minutes. The model was trained on data from the Xbox game Bleeding Edge, using over 1 billion images and controller actions.

To support further research and development, Microsoft is open-sourcing the weights and sample data of Muse, making them available on Azure AI Foundry. Additionally, the WHAM Demonstrator, a concept prototype, provides a visual interface for interacting with WHAM models, enabling developers to experiment with Muse's capabilities.