Unity, a leading platform for creating interactive, real-time 3D content, has announced the launch of two new AI-based products, Sentis and Muse. These tools are designed to enhance the creation of real-time 3D (RT3D) content and are currently available in closed beta, with plans for a global launch later this year.
According to Marc Whitten, SVP of Unity Create Solutions, the company's vision for AI revolves around two main benefits. Firstly, they aim to make it easier for people to access tools and techniques for game development. Secondly, they want to increase productivity, enabling professionals to create high-quality games faster and meet the increasing demand for gaming content.
Unity Sentis and Muse Offer Real-Time 3D Creation
Unity Sentis is a cross-platform runtime inference solution that allows creators to embed AI models into any Unity project without worrying about high latency. On the other hand, Unity Muse is a set of tools designed to help users create RT3D content more efficiently. One of these tools, Unity Muse Chat, enables users to find information and answers to support questions in documentation by typing a prompt in a chat box.
Unity emphasized the company's commitment to harnessing the power of AI to drive innovation, accelerate content creation, and increase productivity across games, entertainment, and industrial use cases.
Imagine more with Unity AI 🔮 Introducing:
⭐ #UnityMuse, a platform of AI capabilities for content creation, with Muse Chat for AI-based search now in closed beta
⭐ #UnitySentis for AI-powered experiences at Unity runtime, now in closed betaLearn more: https://t.co/PThr4Ju0d4 pic.twitter.com/ggVqJKaEVF
— Unity for Games (@unitygames) June 27, 2023
AI Marketplace and Developer Concerns
In addition to Sentis and Muse, Unity also announced the launch of a dedicated AI marketplace in the Asset Store, offering several other tools for creators. These include Leonardo AI for rapid game asset creation, Convai for AI-based characters, and Zibra AI for VFX and physics creation.
However, the announcement has sparked concerns among developers and artists, particularly about Sentis. Questions have been raised about the tech's ability to create images, models, and animation, and whether it relies on work taken from artists without their consent or compensation. Unity has yet to respond to these concerns.
Unity's Vision for AI and Its Implications
Unity believes that AI will impact every aspect of the creative process, from systems to objects to pixels, and consequently, all the resulting runtime characters, worlds, and experiences. They see AI as a tool that can enhance productivity while allowing creators to maintain full control of their vision. They also believe that AI offers the possibility of in-game features and capabilities that couldn't be built otherwise, potentially revolutionizing player experiences by embedding AI models in the runtime so content reacts and responds to players and users in new ways.
This vision, however, comes with potential implications. The introduction of AI tools like Sentis and Muse could significantly change the landscape of game development, making it more accessible and efficient. However, the concerns raised by the developer community highlight potential ethical and legal issues, particularly around the use of AI-generated content. Unity will need to address these concerns to ensure the successful adoption of these new tools.
