The problem of inconsistency between the mouth shape and the dubbing language in dubbed movies has always troubled audiences and affected the movie-watching experience. Indian startup NeuralGarage is committed to solving this problem. The "VisualDub" technology it developed can accurately match mouth shapes and dubbing to improve film quality. This article will introduce NeuralGarage's technology, development history and future plans in detail, and analyze its advantages and challenges in the industry.
When watching dubbed movies, audiences often encounter a problem: the character's mouth shape does not match the dubbing language, which not only affects the viewing experience, but also makes it difficult to immerse yourself in the story. In order to change this situation, NeuralGarage, an Indian startup founded in 2021, is actively working hard to revolutionize the dubbing industry.
NeuralGarage is headquartered in Bangalore, India, and was co-founded by four old friends Anjan Panjaj, Subhashish Saha, Subabraat Dbanta and Mandal Natkar. The platform aims to solve the problem of facial motion mismatch in dubbed content. With its technology "VisualDub", NeuralGarage not only ensures that the character's mouth shape and dubbing are consistent, but also maintains the naturalness and high quality of the picture.
NeuralGarage stood out in the AWS Global Generative AI Accelerator Program and received $1 million in AWS promotional credits and other support. The company emphasizes that video quality must be ensured when adjusting facial expressions, especially when camera angles and lighting change, which is a particularly difficult challenge.
For example, if a professor speaks in Spanish while watching "Paper," NeuralGarage's technology can make it appear as if he is speaking English. "Once you experience synchronicity like this, it's hard to go back to the way it was before," said Subbharat Depantal, the company's co-founder and chief technology officer.
Currently, NeuralGarage has partnered with big names such as Amazon India and Coca-Cola to help the advertising industry quickly update video content for different festivals or promotions. Depantal mentioned that Amazon India recently started leveraging the technology by applying the same video footage to different seasonal marketing campaigns.
In the film industry, NeuralGarage cooperates with film distributors such as Europa Movies, which has a market share of 95%, to help them cope with challenges such as global distribution, piracy prevention, and dubbing synchronization.
Despite NeuralGarage's technological potential, it still faces many challenges. One of the main issues is ensuring that facial adjustments are seamlessly integrated with high-quality video, while adapting to different camera angles and lighting conditions. In addition, the technology needs to remain natural and avoid an "artificial intelligence feel" when processing the facial expressions of high-profile actors.
In order to cope with competition, NeuralGarage plans to further expand its market influence in 2025. The company successfully received US$1.45 million in financing from Xfinity Ventures in 2022 and is currently preparing for Series A financing to expand business scale and improve products.
Highlight:
NeuralGarage uses AI technology to solve the problem of inconsistency between dubbing and lip-syncs, improving the movie-watching experience.
The company has partnered with well-known brands such as Amazon India and Coca-Cola to promote flexible updates of advertising content.
NeuralGarage plans to expand its market influence in 2025 and is preparing for Series A financing.
NeuralGarage's technology brings new possibilities to the film and advertising industries, and its future development is worth looking forward to. However, to continue to maintain competitiveness, it is necessary to continuously overcome technical problems and improve the naturalness and stability of AI technology.