Amazon Prime Video’s new AI tech matches lips to dubbed audio

Amazon’s Prime Video is launching a new AI-powered feature that lines up an actor’s mouth with “human-dubbed” audio. The feature is only available with the English dub of the German series Maxton Hall for now, but Prime Video plans to expand it to “additional titles” in the future.

In its announcement, Prime Video says it uses a combination of AI and visual effects technologies to make lip movements match up with translated speech. Meta and YouTube recently launched an AI-powered auto-dubbing feature for creators, while allowing them to turn on a “lip sync” option to make it look like creators are actually speaking in a user’s preferred language.

Last year, Prime Video began experimenting with “AI-aided” dubbing in English and Spanish across 12 movies and TV shows, including El Cid: La Leyenda, Mi Mamá Lora, and Long Lost. The streamer’s lip-sync dubbing is currently available for seasons 1 and 2 of Maxton Hall for subscribers around the globe, and will launch with the show’s third season coming December 9th.