In a creative experiment shown during GDC 2024, a team of game creators from Ubisoft explore the future of Non Player Characters (NPCs), interactive gameplay, and emergent storytelling.
Ubisoft is exploring new types of interactive gameplay with dynamic NPCs, a field that is being revolutionised with the emergence of generative AI technologies. “NEO NPCs” the product of their latest research and development project are advanced NPCs designed to interact in real time with players, their environment and other characters, opening up new possibilities for dynamic and emergent storytelling.
“AI is a powerful tool that can greatly enhance players’ experiences by making games more dynamic, immersive and unique,” said John Spitzer, vice president of developer and performance technologies at NVIDIA. “We are thrilled to partner with Ubisoft to leverage NVIDIA ACE in the advancement of digital characters.”
Developed by a multidisciplinary team at Ubisoft Paris, NEO NPCs are born from the close collaboration between Ubisoft creators and leading GenAI technology partners, NVIDIA and Inworld AI. Inworld’s Character Engine and LLM technology enable Ubisoft’s narrative team to build a complete background, knowledge base and conversational style for each NPC, while NVIDIA Audio2Face, part of NVIDIA ACE suite of technologies, is used to enable real-time facial animation.
Ubisoft showcased the capabilities of these NEO NPCs through three separate demo scenarios. Each scenario focuses on different aspects of NPC behaviours, environmental and contextual awareness; a spectrum of real-time reactions and animations; as well as conversation memory, collaboration and strategic decision-making. Combined, these discoveries through the experiment pushes the boundaries of game design and immersion.
With NEO NPCs, Ubisoft’s narrative and animation designers blended the reliability of scripted game elements with the dynamism of spontaneous player interactions, nudging the future of game development towards new horizons.
Leveraging Inworld AI technology, Ubisoft’s narrative team created two NEO NPCs, Bloom and Iron, who have their own background story, knowledge base, and different conversational styles to establish these unique characters in the demo universe.
Inworld technology also provides the NEO NPCs with intrinsic knowledge of their surroundings, as well as interactive responses courtesy of Inworld’s LLM. Audio2Face provides facial animations and lip synching for the two NPCs’ faces in real-time.
