Generative AI World: Video Translation and Technology

The Israeli startup Panjaya, founded by deep learning experts Hilik Shani and Ariel Shalom, has introduced an innovative video dubbing tool called BodyTalk. This product allows for realistic translation by preserving the original voice while automatically adapting the speaker’s facial expressions and movements to match the new language. This approach to generative AI was made possible by Panjaya’s unique technology, which ensures natural synchronization of speech and facial movements.

After three years of development, Panjaya secured $9.5 million in external funding, and experienced executive Guy Piekarz, who previously sold a video recommendation startup to Apple, joined the team. He is helping the company expand within the B2B market.

BodyTalk supports audio translations into 29 languages, with automatic adjustments to match new phrases. Users can upload their videos to the platform, where the system adapts them to fit the characteristics of the target language. Panjaya also plans to introduce an API and offer near real-time processing, which makes its solution appealing to large companies. Among Panjaya’s clients are TED and JFrog, both reporting increased audience engagement thanks to translated content.

Panjaya is focused on technology security, protecting its developments from misuse. Guy Piekarz noted that Panjaya produces "deeply realistic" videos, avoiding associations with the term “deepfake,” which carries negative connotations. The company is also considering the addition of watermarks to prevent misuse of synthetic media.

The global video content translation market is in high demand, as audiences prefer content in their native languages. Panjaya offers a solution that can replace subtitles, making content more natural and engaging, as demonstrated by TED's statistics: dubbed videos produced with Panjaya saw a 115% increase in views.

Among Panjaya’s competitors are well-known companies like Vimeo and ElevenLabs, as well as smaller startups. However, the Panjaya team believes that their approach to content generation and high-quality synchronization will secure strong market positions in the video dubbing industry.