New Leak Shows PlayStation Experimenting With AI Character Rendering Using Horizon’s Aloy

The use of AI in gaming has become the forefront for development over the past year. While an arbitrary tool, the use of AI is now entering AAA development as well. At Xbox, we’ve seen this illustrated with the Inworld partnership to create AI tools for its developers. And in February, the firm showcased Muse – the new suite to assist in game creation & even benefit game preservation too.

Additionally,PlayStation has entered this AI race as well. Announcing a partnership with AMD, the new deal will bring better improvements to its titles similar to the competing Xbox company. Project Amethyst is a hands-on collaboration between Sony & AMD. Speaking to Digital Foundry recently, lead architect for PlayStation Mark Cerny tells that PSSR will benefit greatly come 2026 with FSR4 on the way for AMD silicon.

Now in a new development via The Verge, PlayStation/Sony Interactive Entertainment is now toying with AI characters as well. Utilizing the Aloy from Horizon Forbidden West, footage of an AI render was posted online. That was until it was copyrighted by Muso – a copyright firm that advertises for PlayStation. 

Sony Interactive Entertainment director of software engineering Sharwin Raghoebardajal is heard narrating over the now-deleted video. When questioned by The Verge, Raghoebardajal responded that the demo does use OpenAI whisper chat-to-speech alongside GPT-4 & Llama 3 for the conversation/decision-making. However, there also internal tools at use as well.

Raghoebardajal shares that Sony’s in-house Emotional Voice Synthesis (EVS) system is working for speech generation as well as Mockingbird technology from Sony for the face to speech animation too. The demo is running on a PC build, but Raghoebardajal says that tests for PlayStation 5 has been made with “little overhead.”

Are you behind this new effort by PlayStation?

Source: The Verge