To receive industry-leading AI updates and exclusive content, sign up for our daily and weekly newsletters. Learn more
Google researchers have achieved a major milestone in AI, creating a neural network that can generate real-time gameplay for the classic shooter Doom without the use of a traditional game engine. The system, called GameNGen, is a major step forward in AI, with each frame predicted by a diffusion model, generating playable gameplay at 20 frames per second on a single chip.
“We present GameNGen, the first game engine powered exclusively by neural models that enables high-quality, real-time interaction with complex environments over long trajectories,” the researchers wrote in their paper published on the preprint server arXiv.
This achievement marks the first time that AI has fully simulated a complex video game with high-quality graphics and interactivity. GameNGen runs on a single Tensor Processing Unit (TPU), a custom-built AI accelerator chip from Google, and handles Doom's complex 3D environments and fast-paced action with incredible efficiency, without requiring the usual components of a game engine.
AI Game Engine: Revolutionizing the $200 Billion Gaming Industry
Doom has long been a technology benchmark since its release in 1993, and has been ported to an astonishing variety of platforms, from microwave ovens to digital cameras. But GameNGen transcends these early adaptations: unlike traditional game engines that rely on painstakingly coded software to manage the game state and render the visuals, GameNGen uses an AI-driven generative and diffusive model to autonomously simulate the entire game environment.
The shift from traditional game engines to AI-driven systems like GameNGen has the potential to transform the $200 billion global games industry. By eliminating the need for hand-programmed game logic, AI-driven engines have the potential to significantly reduce both development time and costs. This technological shift democratizes game creation, empowering even smaller studios and individual creators to create complex interactive experiences never before imagined.
Beyond cost and time savings, AI-driven game engines have the potential to open the door to entirely new genres of games, where environments, narratives, and gameplay mechanics dynamically evolve based on player actions. This innovation could revolutionize the gaming industry, moving it away from a blockbuster-centric model toward a more diverse and varied ecosystem.
A video of Google's “GameNGen,” an AI-powered system that simulates the classic first-person shooter “Doom” without using a traditional game engine. The video showcases the ability of neural networks to recreate the game's iconic visuals and demonstrates the potential for AI to generate complex interactive environments in real time. (Credit: Google)
From Video Games to Self-Driving Cars: The Wide-ranging Impact of AI-Driven Simulation
GameNGen's potential applications go beyond gaming: its capabilities suggest transformative potential in industries such as virtual reality, autonomous vehicles, and smart cities, where real-time simulation is essential for training, testing, and operational management.
For example, self-driving cars need the ability to simulate countless driving scenarios to safely navigate complex environments, a task that an AI-driven engine like GameNGen can perform with high fidelity and real-time processing.
In the fields of virtual and augmented reality, AI-driven engines can create fully immersive, interactive worlds that adapt to user input in real time, which could revolutionize sectors like education, healthcare, and remote work, where interactive simulations can provide more effective and engaging experiences.
A schematic showing the flow of data from a game environment through various neural network components, including a denoising network and action embeddings, illustrating the complex AI process of generating real-time gameplay without the use of a traditional game engine. (Credit: Google)
The Future of Gaming: When AI Dreams Up Virtual Worlds
GameNGen represents a big leap forward, but it also comes with challenges: while it can run Doom at interactive speeds, modern, graphically intensive games can require much more computing power.
Furthermore, current systems are tailored to specific games (e.g., Doom), and developing a more general-purpose AI game engine that can run multiple titles remains a difficult challenge.
Still, GameNGen is an important step towards a new era of game engines, one where games aren't just played by AI, but created and run by AI.
As AI continues to advance, we may be on the brink of a future where our favorite games aren’t born from lines of code, but from the limitless creativity of machines.
This development also opens up exciting possibilities for game creation and interaction. Future games will be able to adapt to player actions in real time and generate new content on the fly. AI-powered game engines could also dramatically reduce development time and costs, democratizing game creation.
As we stand at the dawn of a new era of gaming, one thing is clear: the line between human creativity and machine intelligence is blurring, promising a future of digital entertainment we can't even imagine. With GameNGen, Google researchers have offered a glimpse into that future: a world where the only limit to our virtual experiences is the imagination of our AI.
VB Daily
Stay up to date! Get the latest news every day by email
Thanks for subscribing! Check out other VB newsletters here.
An error has occurred.
