Generative AI brings video game NPCs to life

Generative AI brings video game NPCs to life

full version at cryptopolitan

Generative AI has a massive use case in the world of gaming and that’s bringing NPCs to life. Large language models (LLMs) make it possible to add dynamic elements to the gaming experience, making it more fun and unpredictable. 

AI-powered NPCs began appearing in 2023, about a year after the release of OpenAI’s ChatGPT. Ever since the release of LLMs, the gaming industry has witnessed many applications that specialize in bringing life to NPCs. 

AI isn’t new to video games

Prior to the takeover of generative AI, NPCs have been powered by deterministic AI or non-deterministic AI. Deterministic AI makes NPCs move in a specified and predictable manner, like moving horizontally, vertically, or in circles.

In addition, they have limited phrases that they repeat during the game and no conversation capabilities. A good example of deterministic AI NPC is in Diablo II (2000) and Final Fantasy Tactics (1997).

Also read: OpenAI goes lite, releases cheaper AI model called GPT-4o mini

Non-deterministic NPC AI has the opposite behavior of deterministic NPC AI and is more advanced. These types of AI NPC are unpredictable and rely on many technologies like learning algorithms, randomness, and Behavior Trees. For example, in some games like Grand Theft Auto V (2013), the NPC will learn and adapt to the player’s movement and tactics.     

Right now, creating a generative AI-powered character is easy and can be done by connecting the NPC to an LLM API such as GPT-4o, Gemini, or even an open-source model. This will give the NPC the ability to conversate with gamers and interact with their environment in realistic ways.

Advancing NPCs doesn’t stop here, and many features could be added to the NPC like voice conversations, emotions and autonomous behavior. Adding such features is possible through technologies like natural language processing, deep learning, machine visions, and emotion models.

Startups compete to build the best generative NPC AI engine

Last March, Ubisoft Paris Studio presented a project named NEO NPC in collaboration with Nvidia and Inworld. The project creates NPCs with personalities and relies on writers to shape their backstories and conversation styles. Such NPCs aren’t just powered by machines but rather by a creative writer who thinks about the character’s experiences, dreams, and hopes.

Ubisoft showcased a demo of generative AI-powered NPCs during the GDC 2024 event in San Francisco, California. According to Sean Hollister from The Verge, Ubisoft showcased two generative AI NPCs named Bloom and Iron.

Bloom was better in terms of replies, emotions, and interaction because a narrative designer worked on creating the character’s backstory. Ubisoft stated that the project is still a prototype and has not commented on including it in a video game yet.

Inworld AI who partnered with Ubisoft to develop Bloom and Iron is an AI company that specializes in creating generative AI-based NPCs for video games. In November 2023, Inworld AI announced a co-development partnership with Xbox to create tech that powers AI NPCs.

In May 2024, the company launched Inworld Voice, an AI voice generator that produces dynamic voice experiences for gamers. Last year, Inworld AI successfully raised $50 million, and the company was valued at $500 million.

Also read: Paris 2024 Olympics to feature AI-powered chatbot for athletes

Another competitor in the space of generative AI NPCs is Convai, a conversational AI platform that creates real-time and voice-to-voice conversations with NPCs. The platform allows developers to create NPCs that can have dynamic conversations with gamers. During the GDC 2024 conference, the company announced new features, including long-term character memory, which enables NPCs to remember gamers and deepen their relationship.

Furthermore, Altera, a San Francisco company, built an AI agent just for Minecraft. These agents interact and play with gamers just like a friend. Altera has successfully raised $9 million from Patron, First Spark Venture, and other investors from its latest seed round. 

Recently, a group of former Google Deepmind employees and researchers raised $16 million for their startup Artificial Agency. The company offers an AI behavior engine that requires developers to input the dreams, hopes, and motivations of an NPC. This will shape the behavior of each NPC and the way they interact with gamers.


Cryptopolitan reporting by Randa Moses

Recent conversions

0.0335 BTC to NOK 0.39 BTC to CZK 2.3 ETH to GBP 3000 DOGE to CHF 0.11 BTC to BTC 0.0209 BTC to EUR 0.0167 BTC to CAD 0.061 BTC to CZK 0.69 SOL to BTC 0.024 BTC to GBP 0.0036 BTC to CZK