YouTube has expanded its innovative AI-powered auto-dubbing feature to a wider range of creators within its Partner Program, focusing primarily on knowledge and informational content. The tool, which started testing in June 2023 with a small group of creators, is now available to hundreds of thousands of channels. This move aims to bridge language barriers and make content more accessible to a global audience.
The auto-dubbing feature automatically generates dubbed versions of videos in different languages, based on the original language. For example, videos created in English are dubbed into French, German, Hindi, Italian, Spanish, Indonesian, Japanese, and Portuguese. On the other hand, videos created in these languages will only receive English dubs. YouTube’s AI automatically detects the language of the video when it is uploaded and starts creating dubbed versions without requiring the creator to take extra steps.
While the dubbing process is automated, creators have full control over the generated content. They can preview, unpublish, or delete the dubbed versions to ensure the translation aligns with their standards. This gives creators flexibility and ensures that the dubbed content maintains the quality and tone they desire. Creators can find and manage these dubbed videos in the "Languages" section of YouTube Studio.
Currently, the AI-generated dubs may not fully capture the natural tone and emotions of the original content. YouTube acknowledges this limitation and promises future updates that will focus on improving the authenticity of the dubbed voices. The platform aims to enhance the dubs by better capturing the tone, emotion, and ambiance of the original video, making them more natural and engaging for viewers.
Upload Your Video: Creators can upload their video as usual. YouTube will automatically detect the language and create dubbed versions in other supported languages.
Watch Your Dubbed Videos: To review the dubbed versions, creators can visit the "Languages" section in YouTube Studio. If they are not satisfied with the dubs, they can unpublish or delete them easily.
Accessing Dubbing Settings: Creators can find the AI dubbing feature in YouTube Studio under "Advanced Settings." If available for their channel, they can review the dubs before making them public.
While YouTube has made significant strides with this feature, the technology is still in its early stages. YouTube has openly acknowledged that the AI dubbing may not always be perfect, with potential issues in translation accuracy and voice representation. However, the platform is committed to refining the technology, and updates to improve quality are expected soon.
Currently, the feature is available to knowledge-focused content creators, but YouTube has plans to expand it to a broader range of content types in the future.