When AI Doesn鈥檛 Replace Jobs: The Case of Visual Dubbing in Watch the Skies
Artificial intelligence (AI) is often framed as a threat to all kinds of jobs. Many believe automation and AI will fully take over a wide array of professions, and that translation will be one of the first to go. While companies are definitely deploying AI for many tasks, more often it isn鈥檛 replacing jobs so much as changing the way we work鈥攁nd what is possible.听
A perfect example of this is the Swedish sci-fi feature film Watch the Skies (original title: UFO Sweden). It recently made history as the first feature-length movie to use AI-powered visual dubbing or 鈥渧ubbing.鈥 The original Swedish version of Watch the Skies was released in 2022, followed by the vubbed English version in 2025. The new technology makes the English version feel more natural, and thereby improves the viewer鈥檚 experience. But it doesn鈥檛 replace human translators or voice actors. It enhances the creative work of humans, allowing it to shine even brighter.听
Let鈥檚 go behind the camera for a closer look at what鈥檚 at work in this new workflow of translation in film.
What鈥檚 the Difference Between Dubbing and Visual Dubbing?
If you鈥檝e ever watched a foreign film, you likely know the difference between subtitling and dubbing, and you probably have your personal preference. Dubbing is a voice-over audio track in another language that replaces the original spoken dialogue. Voice actors perform the translated dialogue while watching the film to synchronize the audio as best they can with what the actors are saying and doing on the screen.听
Dubbing allows you to watch foreign films in your native language rather hearing the original actor鈥檚 voices and reading translated subtitles at the bottom of the screen. But no matter how good the dubbing is, the lip and mouth movements often don鈥檛 match up perfectly. That鈥檚 not due to a lack of quality work from the dubbing team. The fact is, languages are simply very different. Some viewers find these mismatched movements distracting, which is why some people choose when watching foreign language content.听
Visual dubbing now offers a technological solution to this common problem. Vubbing uses AI-enhanced software to modify the on-screen lip movements of each actor to match the translated dialogue.听
This new technology is often confused with 鈥淎I dubbing鈥 where AI is used to translate the video or audio dialogue and synchronize a machine voice with the actor鈥檚 mouth movements. AI dubbing is an attempt to cut out human translators and voice actors from much of the dubbing process. But vubbing is just the opposite: By modifying the visual content, film producers can focus on creating a native experience in any language鈥攐ne that relies on human translators for idiomatic dialogue adaptations and human voice actors for natural delivery of the translated dialogue.
This distinction is crucial. Unlike AI dubbing tools, which are intended to remove most human intervention from the dubbing process, vubbing empowers the industry to make use of human assets to produce a better foreign language film experience.
The Film Debut of Vubbing in Watch the Skies
The visual dubbing technology used in Watch the Skies was developed by a company called Flawless AI. Their system analyzes the actor鈥檚 face, learns the dynamics of speech, and subtly adjusts the mouth and jaw movements to fit the new language track. The result literally speaks for itself. The actors appear to be talking naturally in the language you hear with no lip movement mismatches, creating an illusion that they performed the lines themselves.听
In Watch the Skies, On-Screen Actors became Their Own Voice-Over Artists
In the case of Watch the Skies, that鈥檚 exactly what happened. The original Swedish actors were also the English voice actors鈥攎eaning they dubbed themselves. Listening to their Swedish accents gives the film a decidedly Swedish touch that just might win over subtitle fans who prefer the authentic touch when watching foreign content. In any case, AI did not replace humans, but helped them get the job done in a different way.
An AI-Enhanced Localization Process That Puts Humans First
In the translation industry, 鈥渓ocalization鈥 is the process of translating and adapting content for a foreign target audience. Vubbing is now a new and very promising form of localization for the film industry.听
So what exactly did the localization process look like for Watch the Skies? The actual workflow hasn鈥檛 been disclosed, but we know what tool they used and that the original actors dubbed themselves. So, as a Spanish-to-English translator with years of experience in audiovisual translation, I can tell you that it probably looked something like this:
- Translation and adaptation: A team of human translators and localization experts translated what鈥檚 called the dialogue list鈥攁 specialized transcription of the film鈥檚 Swedish audio track鈥攊nto English. The translation was then edited and adapted into a script that the voice actors used to record the English audio.听
- Voice-over performance: The original actors recorded the translated dialogue in a studio while watching themselves on screen, ensuring emotional authenticity, tone, and pacing aligned with the original Swedish and the action in each scene.
- AI processing: Flawless AI鈥檚 visual dubbing tool edited the video, adjusting the lip movements to align with the English audio and produce the final polished result, with lots of help from technical experts behind the scenes.
The Future of Foreign Film?
If you haven鈥檛 seen Watch the Skies, I invite you to check it out. As a movie lover myself, I find it hard to tell that you鈥檙e watching a film originally produced in Swedish. Plus, the actor鈥檚 accents add authenticity, providing a unique viewing experience.听
As a translator who works in the audiovisual industry, I鈥檓 excited about this new AI tool and how it can make my behind-the-scenes work look and feel like the original on the big screen. AI-powered vubbing can solve a purely technical challenge鈥攕ynchronizing lip movements鈥攖hat has long been a stumbling block in dubbing. And it鈥檚 another reminder of how AI can help rather than replace human creativity.听
About the Author
听is a Spanish to English subtitler and translator. Her subtitles can be seen on Netflix and she specializes in tourism translation. She is also an active volunteer for the 情侣自拍. The 情侣自拍 represents almost 9,000 translators and interpreters in more than 100 countries. To hire a translation or interpreting professional, please visit听.
Language Services Directory
Subscribe to The ATA Compass
Connect with The ATA Compass
Recent Posts
Why Should I Hire a Professional?
It takes more than just the ability to understand two languages. Professional translators and interpreters have the education, experience, and expertise to understand the nuances in one language and transfer…
Read More about Why Should I Hire a Professional?Buying Language Services
Guide to Buying Translation Services Translators help power the global economy, working with businesses, governments, non-profits and individuals. Translators work with the written word. The ATA Guide to Buying Translation…
Read More about Buying Language ServicesTranslator vs. Interpreter
Watch a Day in the Life of Translators and Interpreters See how translators and interpreters work in this short animated video. Translators do the writing Translators work with the written…
Read More about Translator vs. InterpreterWhat is a Certified Translation?
What are the basics of a certified translation? In the United States, anyone can certify a translation. A translator does not need to be certified in order to provide a…
Read More about What is a Certified Translation?Language Services Directory
Start Your Search ATA’s Language Services Directory includes ATA members offering professional translation and interpreting services. Need help finding the right professional? Professional translators and interpreters make it possible for…
Read More about Language Services DirectoryFind a Translator or Interpreter Near You
Searching for a Nearby Translator or Interpreter? Whether you require accurate document translations, real-time interpreting for an event, or specialized industry expertise, finding the right professional near you has never…
Read More about Find a Translator or Interpreter Near You
