Panjaya's AI video translation tool BodyTalk is revolutionizing the video translation industry. It can accurately convert the voices of the characters in the video into other languages, and can perfectly synchronize the facial expressions and body movements of the characters, achieving a highly natural language conversion effect. This technology breaks through the limitations of traditional dubbing and provides a new solution for the global dissemination of video content. BodyTalk is founded by two Israeli deep learning experts and led by experienced CEOs, with a strong team and leading technology.
A startup called Panjaya is revolutionizing the game of video translation. After three years of secret research and development, the company launched the breakthrough product BodyTalk, an AI tool that accurately converts the voices of characters in videos into other languages. Unlike traditional dubbing, BodyTalk not only perfectly replicates the speaker's original acoustic features, but also automatically adjusts the facial expressions and body movements of the characters in the video to naturally match the voice patterns of the new language.
Panjaya was founded by two Israeli government deep learning experts Hilik Shani and Ariel Shalom. In 2021, the two left the government department to start a business, and then welcomed Guy Piekarz, who has rich industry experience, as CEO. Matcha, a streaming media discovery and recommendation platform previously founded by Piquetz, was acquired by Apple in 2013.
Currently, BodyTalk supports translation in 29 languages. The workflow first involves audio translation, then generating new voices that mimic the acoustic speaker, and finally automatically adjusting the speaker's lip shape and movements in the video to match the new language expression. Although the processing time is close to real-time, it still takes several minutes to complete the processing of a video.
At the technical level, Panjaya adopts a hybrid strategy, which not only uses third-party large language models, but also independently develops core technologies. According to Piquetz, the company's lip synchronization engine is completely developed by an internal AI research team, because there is no solution on the market that can meet the needs of its complex business scenarios such as multi-angle and multi-speaker.
The company is currently focusing on the B2B market and has reached cooperation with institutions such as JFrog and TED. TED said the number of views of lecture videos dubbed using Panjaya tools increased by 115%, and the full viewing rate doubled. The company plans to further expand applications in sports, education, marketing and medical fields.
To avoid technical abuse, Panjaya strictly controls the use of tools and plans to develop functions such as watermarks to identify synthetic video content. Although subtitles have become the standard for video content - more than half of American viewers will turn on subtitles when viewing, the international market still has huge demand for dubbing content. Data from research firm CSA shows that native language content can lead to higher user engagement, especially in the B2B field.
This $9.5 million financing round was participated by a number of investment institutions and individuals, including Viola Ventures, R-Squared Ventures, and JFrog co-founder and CEO Shlomi Ben Haim. In the future, Panjaya plans to launch API interfaces and further improve processing speed and move towards the goal of real-time processing.
The emergence of BodyTalk indicates that video translation technology has reached a new height, with huge future development potential. It is worth looking forward to its application in more fields and further breakthroughs in technology, bringing more convenient and better video content to global audiences. Experience.