Meta has officially launched an artificial intelligence (AI)-based voice dubbing feature on Reels globally, allowing users to translate their voices into other languages with the added option of lip-syncing so that lip movements match the translation.
Mark Zuckerberg first introduced this technology at the Meta Connect 2024 event.
Initially, translations are only available from English to Spanish and vice versa. Meta ensures support for other languages will follow soon. Currently, the feature is limited to Facebook creators with more than 1,000 followers, while all public Instagram account holders can use it immediately.
This feature works by training the user's native voice and then generating a translated audio track that maintains the tone and intonation of the voice. The lip-sync option will match the mouth movements to the translation, resulting in a more natural-sounding translation.
