The Yandex team reported on the further development of video translation technology in foreign languages and the inclusion of simultaneous interpretation support with 12 votes, six male and six female.
The slot transfer system is integrated into Yandex.Browser and makes full use of machine learning and artificial intelligence technologies based on neural networks.
Two neuronets are used to recognize different speakers in the video: first, one translates speech into text, restores punctuation and defines the boundaries of sentences, then the other analyzes the spectrogram of voices and notes the fragments spoken by different people on the audio track, so it becomes clear which speaker has said what, and the translation of the video with a large number of actors becomes much easier.
- Marked in Yandex.
The Yandex system currently supports English, French, German, Spanish and Italian, and plans include the addition of new language pairs and the expansion of product functionality.