Digital Domain's "Zoey": the new face of AI:

Digital Domain's "Zoey": the new face of AI:

During the great FMX art and technology meeting in Stuttgart, the Oscar-winning VFX studio and leader in digital human technology, Digital Domain, presented “Zoey” as the most advanced 3d human being in the world.

Based on machine learning and created using an advanced version of the technology and process that helped bring Thanos to the big screen, the photorealistic Zoey can have conversations with multiple attendees at the same time, remember people, access the internet to answer questions, and more. again, paving the way for the next step in AI evolution.

“With the potential of the metaverse and continued advances in AI, the desire to interact face-to-face with autonomous humans is becoming more important and part of modern life,” said Daniel Seah, Global CEO of Digital Domain. "For decades, Digital Domain has pioneered digital human technology and Zoey has pushed the concepts of virtual assistants like Alexa and Siri forward, creating a digital assistant you can truly interact with."

Building on its autonomous human proof-of-concept, " Douglas “, Zoey is the result of years of research and development by the award-winning visual effects house, led by its internal Digital Humans Group.

Zoey's physical appearance is based on actress Zoey Moses ( Yellowstone, Reflection ), who worked with Digital Domain to create a full range of facial movements and mannerisms, as well as a full range of emotional expressions. Using that data and his proprietary Charlatan facial animation tool - recently seen in blockbuster films, including Free guy Nominated for an Oscar - the artists were able to film the real-life footage of Moses and create a flexible digital face, capable of reacting in real time.

To give Zoey her personality, Digital Domain used multiple forms of machine learning to make sure she could understand most of the questions and formulate appropriate answers, then log onto the internet (or stored data) for her answer. But instead of just giving a verbal or textual response, Zoey can be completely emotional. If a question creates confusion, it will seem perplexed; if she is told a joke, she will smile. During a conversation, she Zoey will move and fidget based on her responses and she will even get annoyed when she is interrupted. She can interact with participants, ask them questions and opinions, and the facial recognition software allows her to recognize and remember people.

Zoey

Chatbots can also be added, giving Zoey the potential to quickly take on the role of an established virtual assistant for implementation in hospitality, services, and more.

To provide Zoey with a robust and flexible speech system capable of more than just reciting scripted responses, Digital Domain used WellSaid Labs' AI-powered speech synthesis technology ( wellsaidlabs. com ). Using the tools from WellSaid Labs, Zoey can access a vast vocabulary of words and phrases, making sure no response is beyond her ability to vocalize.

There are also multiple options for controlling the pitch of her responses, including varying levels of enthusiasm to reflect the goal of the interactions. For a retail environment, for example, a more optimistic approach would be needed, where a conversation would be more leveled. Zoey also has the ability to expand her vocal skills by incorporating multiple language packs, making her fully bilingual.

Zoey

Once Zoey is “educated” and ready to interact with the real world, she can then be added to multiple platforms, including custom systems designed by potential users or game engines like Unity and Epic Games software. For her introductory FMX presentation, Zoey was seen running in real time on Epic Games' Unreal Engine 4.

"For the past 30 years, Digital Domain has been one of the world leaders behind some of the most sophisticated and memorable visual effects ever, so it was a natural progression for us to become a leader in digital and virtual humans and create 'Zoey," l 'the world's most advanced autonomous human being, ”said John Fragomeni, global president of Digital Domain. "We will continue to push the boundaries of visual effects in all fields and on any screen as we seek ways to deliver an experience to people, regardless of medium or platform of delivery."

Zoey will be available for license from Digital Domain in the near future.

digitaldomain.com 

Go to the source of the article on www.animationmagazine.net