Microsoft Unveils Muse: A Generative AI Model for Gaming

Microsoft has introduced Muse, a generative AI model designed for gameplay ideation, as announced in a press release. Muse can generate game visuals and controller actions, offering new possibilities for game developers.

Microsoft has introduced Muse, a generative AI model designed for gameplay ideation, announced in a press release. Muse, developed by the Microsoft Research Game Intelligence team in collaboration with Xbox Game Studios' Ninja Theory, is capable of generating game visuals and controller actions, or both.

Muse operates as a World and Human Action Model (WHAM), which allows it to predict how a game will evolve from an initial prompt sequence. This capability is demonstrated through gameplay sequences generated by Muse, which are consistent over several minutes. The model was trained on data from the Xbox game Bleeding Edge, using over 1 billion images and controller actions.

To support further research and development, Microsoft is open-sourcing the weights and sample data of Muse, making them available on Azure AI Foundry. Additionally, the WHAM Demonstrator, a concept prototype, provides a visual interface for interacting with WHAM models, enabling developers to experiment with Muse's capabilities.

We hope you enjoyed this article.

Consider subscribing to one of several newsletters we publish. For example, in the Daily AI Brief you can read the most up to date AI news round-up 6 days per week.

Also, consider following our LinkedIn page AI Brief.

Subscribe to Daily AI Brief

Daily report covering major AI developments and industry news, with both top stories and complete market updates

You May Also Like