NVIDIA's first digital human technology compact language model is demonstrated in Mecha BREAK, a new multiplayer mech game developed by Amazing Seasun Games, bringing characters to life and delivering a more dynamic and immersive gameplay experience on GeForce RTX AI PCs.
The new on-device model, called Nemotron-4 4B Instruct, improves the conversational capabilities of game characters, allowing them to understand players more intuitively and respond naturally.
NVIDIA has optimized its ACE technology to run directly on GeForce RTX AI PCs and laptops, greatly enhancing developers' ability to deploy cutting-edge digital human technology in next-generation games like Mecha BREAK.
A small language model built specifically for role-playing
NVIDIA Nemotron-4 4B Instruct delivers better role-playing, search-enhanced generation, and function calling capabilities, allowing game characters to more intuitively understand player instructions, respond to gamers, and take more precise and appropriate actions.
The model is delivered as an NVIDIA NIM microservice to streamline the development and deployment of generative AI-powered applications. NIM is optimized for low memory usage, improving response times and enabling developers to take advantage of more than 100 million GeForce RTX-powered PCs and laptops.
Nemotron-4 4B Instruct is part of NVIDIA ACE, a suite of digital human technologies that delivers generative AI-powered voice, intelligence and animation, and is available as a NIM for game developers to deploy on cloud and device.
First game showcases ACE NIM microservices
Mecha BREAK, developed by Amazing Seasun Games, a gaming subsidiary of Kingsoft Corporation, is showcasing the NVIDIA Nemotron-4 4B Instruct NIM running on device for the first time in game interaction powered by ACE. The NVIDIA Audio2Face-3D NIM and OpenAI's Whisper automatic speech recognition model provide on-device facial animation and speech recognition. ElevenLabs provides character audio through the cloud.
The demo, which debuted at Gamescom, the world's largest gaming expo, uses NVIDIA ACE and digital human technology to allow players to interact with Mecha non-playable characters (NPCs) who help players choose from a variety of mechanized robots (Mecha) to suit their playstyle and team's needs, assist with customizing their appearance, and offer advice on how to best prepare their giant fighting machines for battle.
“We are excited to showcase the power and potential of ACE NIM microservices in Mecha BREAK, where we used Audio2Face and Nemotron-4 4B Instruct to dramatically increase in-game immersion,” said Kris Kwok, CEO of Amazing Seasun Games.
Perfect World Games Explores Latest in Digital Human Technology
NVIDIA ACE and Digital Human Technologies continues to expand its presence in the gaming industry.
Perfect World Games, a global game publisher and developer, is evolving its NVIDIA ACE and digital human technology demo, Legends, with new AI-powered vision capabilities. In the demo, the character Yun Ni can use a computer's camera powered by ChatGPT-4o to see the gamer and identify people and objects in the real world, adding an augmented reality layer to the gameplay experience. These capabilities bring new levels of immersion and accessibility to PC gaming.
Learn more about NVIDIA ACE and download NIM to start building your own generative AI-powered gaming characters.
