Google should gradually start offering automatic dubbing on videos shot by YouTubers whose language you don’t understand. A novelty soon allowed thanks to AI.
Minimizing the language barrier between content creators and viewers from different regions is YouTube’s goal. If it has already put in place major means to improve over the years the experience offered by its subtitling system, the Google subsidiary now wants to go further… by switching to dubbing. To do this, YouTube got hold of the Aloud team, a start-up from Google’s Area 120 incubator.
The latter has developed an AI-powered automatic dubbing service, which content creators will soon be able to use to easily dub their videos into one or more languages.
Automatic dubbing, how does it work?
The system developed by Aloud is relatively simple, at least on paper. The tool begins by transcribing the audio track of a video into writing, then submits the script obtained to the user to let him read it again and make any corrections. Once the script has been validated by a human, the translation is done, quickly followed by AI dubbing.
YouTube linkSubscribe to Frandroid
We also learn from The Vergethat YouTube is testing this new tool with a few “ hundreds of videographers. However, only three languages are supported at this stage by Aloud (English, Spanish and Portuguese), but others should be added later.
Asked by The Vergeone of YouTube’s spokespersons also indicated that the platform ” works to make translated audio tracks sound like the voice of the creator, with more expression and lip-sync “, we read. A refinement planned this time for 2024.
In the meantime, if you want to get an idea of the result so far, you can check out this video. The original is in English, but it is possible to access the Spanish version dubbed by AI by selecting audio track number 2 from the video settings.
To follow us, we invite you to download our Android and iOS application. You can read our articles, files, and watch our latest YouTube videos.