The Sequence Research #510: Microsoft's Muse AI can Design Entire Video Game Worlds
The model unlocks new possibilities in gameplay design.
Games have played a monumental role in the evolution of AI. From creating training environments to simulating real world conditions, games represent incredible catalyzers on AI learning. A new field known as world action models is rapidly emerging as a field to combine games and AI. Microsoft just dropped an ecising research in this area with a model that can create games after watching human players.
Sounds crazy? Let’s discuss.
Muse, a generative AI model, marks a pivotal advancement in the convergence of artificial intelligence and video games. This model, developed by the Microsoft Research Game Intelligence and Teachable AI Experiences teams in collaboration with Xbox Game Studios’ Ninja Theory, introduces the first World and Human Action Model (WHAM), designed to generate game visuals and controller actions. Muse aims to support human creativity by generating complex gameplay sequences. This essay provides a technical overview of Muse, emphasizing its architecture, capabilities, and key innovations.
