TikTok Unveils Digital Twins to Help Creators Reach Global Audiences

TikTok, the popular short-form video platform, unveiled a set of new generative AI tools designed to help organizations and content creators grow their global audiences by utilizing customizable digital avatars (or digital twins) and language dubbing features. These new tools, which build upon the Symphony generative AI ad suite announced last month, aim to break down language barriers in marketing and allow brands to add a human touch to their content, even when real models or presenters are not available. Much like HeyGen or Synthesia, creating digital twins can make content creation significantly easier and much more cost-effective than live shoots.

Symphony Digital Avatars: Stock and Custom Options

The first of these new offerings is Symphony Digital Avatars, which come in two varieties: stock and custom.

Stock avatars are based on paid actors from a diverse range of backgrounds, nationalities, and languages, and are available for commercial use.

On the other hand, custom avatars are created to resemble a specific content creator or brand spokesperson and can speak multiple languages, enabling accounts that use them to reach foreign audiences while maintaining a specific likeness.

To ensure transparency, videos that feature these avatars will be labeled as “AI-generated.”

Symphony AI Dubbing: Breaking Language Barriers

The multi-language support for these avatars is made possible by Symphony AI Dubbing, a powerful “global translation tool.”

This tool allows creators and marketers to dub their content into more than 10 languages and dialects, including French, Spanish, Portuguese, German, and Korean.

In fact, Symphony AI Dubbing automatically detects the language spoken in videos and can transcribe, translate, and produce a dubbed video in the user’s chosen language.

Precedent for Multi-Language Content

There is already precedent for creators attempting to retain their own identities while breaking into other language markets.

For example, popular YouTube creator MrBeast uses YouTube’s multi-language audio track support to dub his videos into other languages. Similarly, singer FKA Twigs recently revealed that she has created a multilingual “deepfake” version of herself to help promote her work globally.

Potential Benefits and Concerns

TikTok’s Head of Creative Product, Andy Yang, believes that these new AI tools will “unlock a new avenue for creators to scale their opportunities with brands globally.” By removing language barriers and adding a human touch where real actors or presenters cannot be used, creators can potentially reach a much larger audience and create more engaging branded content.

However, there are also concerns surrounding the use of these AI tools. This demonstration video provided by TikTok (below), featuring a custom digital avatar based on TikTok’s global head of content strategy and operations, Adrienne Lahens, appears slightly uncanny. While it looks just natural enough to be convincing if not fixated on its overly expressive movements, some users may find the AI-generated avatars unsettling.

Creators will also need to trust that TikTok’s new dubbing tools are accurate enough to avoid embarrassing mistranslation blunders. Additionally, TikTok users who are already frustrated with the platform’s pervasive ads may not find being pitched to by digital avatars any less annoying than the real deal.

An additional concern for me around digital twins is who owns the avatar. I’m not sure I like the idea of TikTok, HeyGen, Synthesia, or any other corporation owning the rights to my likeness and voice. So, I do encourage you to consider this when exploring digital twins/custom avatars.

Looking Forward

Despite the concerns, TikTok’s new generative AI tools represent a significant step forward in the platform’s efforts to support creators and help them reach a global audience. As the technology continues to evolve, it is likely that we will see further improvements in the naturalness and accuracy of AI-generated content.

Creators who embrace these tools and use them effectively may find themselves at the forefront of a new era of global content creation, connecting with audiences across languages and cultures in ways that were previously impossible. However, they must also remain mindful of the potential drawbacks and ensure that they maintain the trust and engagement of their existing followers.

As TikTok continues to innovate and provide new tools for creators, it will be interesting to see how the platform and its users adapt and evolve in the face of these technological advancements. The launch of Symphony Digital Avatars and AI Dubbing marks an exciting new chapter in the world of short-form video content, and its impact will undoubtedly be felt by creators, brands, and viewers alike in the years to come.

---

Remember, AI won’t take your job. Someone who knows how to use AI will. Upskilling your team today, ensures success tomorrow. In-person and virtual training workshops are available. Or, schedule a session for a comprehensive AI Transformation strategic roadmap to ensure your marketing team utilizes the right GAI tech stack for your needs.