{"id":11862,"date":"2022-04-21T12:00:08","date_gmt":"2022-04-21T12:00:08","guid":{"rendered":"https:\/\/www.1stopasia.com\/blog\/?p=11862"},"modified":"2022-04-21T09:02:23","modified_gmt":"2022-04-21T09:02:23","slug":"machine-dubbing","status":"publish","type":"post","link":"https:\/\/www.1stopasia.com\/blog\/machine-dubbing\/","title":{"rendered":"The Issues With Machine Dubbing For Asian Languages"},"content":{"rendered":"

Although dubbing in film and television has been around since the 1950s, machine dubbing is a much more recent phenomenon. There\u2019s been a massive proliferation of video content all around the world. This is because the process of globalization has meant that one culture can enjoy another culture\u2019s video and film productions and vice versa.<\/p>\n

Borders and boundaries are shifting and shrinking and we have access to so much more \u201cforeign\u201d content than we\u2019ve ever had. But machine dubbing doesn\u2019t come without its challenges.<\/p>\n

It\u2019s not a perfected art and is by no means so especially when it comes to Asian languages. Why is this the case? There are several reasons which we\u2019ll explore below. Ready to find out more? Let\u2019s take a look.<\/p>\n

What is Machine Dubbing?<\/h2>\n

In the field of translation, and in particular, when it comes to film, video and television series, there are several different formats or branches of translation that should be considered. Yes, there is what is called a direct translation.<\/p>\n

But there are other forms or branches as well. These include localization, which is essentially the process of taking a text from the original language and translating it in such a way that the intended meaning and nuances are carried through as well.<\/p>\n

A part of the translation tree also includes dubbing. In short, this is an audiovisual translation that takes dialogues, translates them, and enacts them in such a way as to give the impression that the media is in the target language.<\/p>\n

One sticky part with this is ensuring that the timing the dubbing actor has is used optimally – in other words, he or she needs to convey speech for as long as the actor in the original piece. Another challenge is the alignment with lip movements. All this gets even more complicated when machine dubbing comes into the picture. So, what is it?<\/p>\n

Machine dubbing is taking the capabilities of machines and introducing them to the translation-localization-dubbing process. Some sources indicate that the process is divided into several components. First, the video is transcribed from audio to text by a Speech-to-Text API. Then, that text is taken and translated by a Translation API.<\/p>\n

Finally, the translation is uploaded through a Text-to-Speech API. Overall, if a human were to do all this, it would take hundreds of hours and just for one film or video. But with the elegance of machines, the process can be simplified, expedited, and made significantly more convenient for viewers.<\/p>\n

Issues With Auto Dubbing<\/h2>\n

While all that\u2019s been said above sounds quite simple and straightforward, there are several issues to consider.<\/p>\n

As a starting point, during the Speech-to-Text transcription, errors can be made. This will mean that the Translation API will be working with inaccurate or awkward translations. Next up, the translations can be mispronounced and convey a different meaning, tone, or nuance.<\/p>\n

But there are other challenges, too. These include:<\/p>\n