Amazon India collaborates with NeuralGarage to implement generative AI for multilingual lipsync of dialogues in advertising

The tech company helped Amazon India with visually dubbing its ad creatives into seven different regional languages.

NeuralGarage’s ‘VisualDubTM’, helped Amazon create native, authentic visual dubbing for their Amazon Daily and Amazon Fresh advertising creatives that recently went live on TV and digital platforms.

NeuralGarage, a deep tech startup from Bengaluru, has managed to break new ground in the advertising and marketing domain with its generative AI technology, VisualDubTM, that helps with multilingual lipsync in content & media. Advertising creatives and other marketing content in India are usually produced and shot in one language (usually Hindi) and then dubbed into several different languages, making them look inauthentic to regional viewers. NeuralGarage helps repurpose those creatives by making them look native and local for regional consumers through its proprietary technology, VisualDubTM.

The NeuralGarage team has collaborated with Amazon India for their Amazon Daily (Agency: Ogilvy) and Amazon Fresh (Agency: Media.Monks) ad campaigns that went live across TV and digital platforms. Its collaboration with the e-commerce giant represents a global first-use case of integrating generative AI technology in multilingual lipsync. VisualDubTM, being language agnostic, makes dubbed content look natural and syncs the lips and jaw movements of the actors within the video to make it more visually authentic. It helped Amazon India with visually dubbing its ad creatives into seven different regional languages.

Mandar Natekar, co-founder, and CEO NeuralGarage said “There is a lot of news around what is possible with generative AI technology, but it takes a client like Amazon to back new tech into its business, actually walk the talk, and show the world what is possible. We are thrilled to collaborate with Amazon on these campaigns and showcase the power of our tech. It has always been our vision at NeuralGarage to harness the true potential of generative AI to make communication seamless & make dubbed content look visually authentic. I am thankful to Amazon India who gave a budding Indian startup like ours a chance to demonstrate the scope of ‘VisualDubTM’. We are committed to pushing the boundaries in advertising and marketing further with our proprietary tech and this is just the start!”