Deepdub, a deep learning powered audiovisual dubbing and language localization startup, has unveiled its new Generative AI product, Deepdub GO. The innovative AI studio platform, initially developed for Hollywood projects, will now serve a broader range of industries, from business to education.
Deepdub has collaborated on numerous projects with Hollywood studios, with some of its works featured on streaming giants like Hulu and Amazon Prime. Its proprietary AI technology is now incorporated into Deepdub GO, aiming to revolutionize video localization with speed, quality, and scalability. Traditionally, dubbing has been restricted mainly to the entertainment industry, primarily due to the high costs, complexity, and time-consuming nature of the process.
The new platform's features include human-like sound, emotion-prompting, voice-guiding technology, and a powerful voice cloning tool. It allows for editing voice characteristics, languages, translations, controlling duration, and word count for lip-sync adjustment. The platform also hosts thousands of voices across 65 languages.
A notable feature of Deepdub GO is "emotion prompting". The feature, powered by a custom LLM, allows users to guide the emotional expression in the generated audio via text prompts. "Voice guiding", another feature, allows users to offer a voice recording to guide the AI in producing the desired emotional expression.
The tool will provide high-quality dubbing for any content - from corporate training videos to influencer content. It aims to resonate with global audiences on a deeper, personal level by enhancing storytelling. Users can upload their videos, select the video style and languages, and the dubbed video is ready for download shortly thereafter. The process involves automatic transcription, translation, voice generation, and audio mixing. Users maintain full control throughout, with the ability to make edits as needed.
Deepdub GO also provides API access too for seamless integration into existing tools and workflows.
