Yandex has added to its browser the technology of automatic voice-over translation into Russian of live broadcasts on the YouTube video hosting. Now, online broadcasts will be available in Russian in real time.
It is noted that at the moment the technology is working in open beta testing mode. Translation of broadcasts on YouTube channels from the playlist is available. According to the press service of the company, for fast and high-quality work, it was necessary to rebuild the entire architecture of the voice-over translation of the video.
It is explained that when translating a live broadcast, one neural network recognizes audio and turns it into text, the other determines the gender of a speaker by biometrics, and the third neural network selects from the text semantic fragments, which are the parts that contain a complete thought.
“Translation of broadcasts can already be launched in English, German, French, Italian, and Spanish,” the head of Yandex Browser, Dmitry Timko, said.
Voice-over translation of streams is now available for a specific list of YouTube channels on which live broadcasts are conducted. In the future, the company plans to translate broadcasts and videos on other platforms as well.
Ru-Main, 05.08.2022
Source: TASS
