voice over translation

Voice-over video translation

Caution

Before creating Issues, we strongly recommend that you read the FAQ section, as well as existing Issues

Voice-over video translation is now available not only in YandexBrowser. I am very grateful to Yandex.Translate , sodapng , mynovelhost , SashaXser and all other contributors. Thank you <3

Installing the extension:

Warning

If you are using Tampermonkey 5.2.0+, be sure to enable developer mode or use Tampermonkey MV2

1. Install the Tampermonkey extension (Safari alternative: UserScripts )
2. "Install Script"

List of functionality:

1. Translation of video from one of the available languages ​​into Russian, English or Kazakh
2. Translation of streams to YouTube (works with a slight delay)
3. Displaying subtitles generated by a neural network (auto-generated subtitles are additionally displayed on YouTube)
4. Saving used subtitles (in .srt format)
5. Saving translation audio track (in .mp3 format)
6. Automatic video translation when opening
7. Sliders for changing video volume and translation
8. Automatically adjusting the volume of the translated video (as in the Yandex browser)
9. Sync translation volume with video volume
10. Limit video translation from native language (language can be selected in the menu)
11. Proxying audio
12. Translation using hotkey

Useful links:

1. Library for JS (vot.js): Link
2. Terminal version (vot-cli): Link
3. Wiki: Link

Note:

1. I recommend allowing autoplay of “audio and video” to avoid errors when running the extension
2. The extension cannot translate videos longer than 4 hours (translator API limitation)

List of supported sites:

You can see the complete list of supported websites and all restrictions associated with their support in the wiki

Our domains:

These domains can be set in the extension settings (only those domains that can be changed without rebuilding are listed here):

Proxy server

Required for proxying requests if you cannot make a direct request to Yandex servers

• vot-worker.toil.cc (Balancer between proxy servers)
• vot-worker-s1.toil.cc
• vot-worker-s2.toil.cc
• vot.deno.dev
• vot-new.toil-dump.workers.dev ( ️ does not work in the Russian Federation)

Media Proxy Server

Necessary for proxying .m3u8 files and correcting translation for indirect links to .mp4 or .webm (more details in the repository)

• media-proxy.toil.cc

VOT-Backend

Required for translating additional sites that use a video format that is not supported by Yandex servers.

• vot.toil.cc

How to build an extension?

1. Install Node.js 18.18+ / Bun
2. Install dependencies:

NPM:

npm install

Bun:

bun install --yarn

3. Building the extension:

   3.0. All versions at once:

   npm run build

   3.1. All minified versions at once:

   npm run build:min

   3.2. Regular version only:

   npm run build:default

   3.3. Only normal min. versions:

   npm run build:default-min

How to patch vot.js

1. Make the necessary changes to node_modules/vot.js/needed file
2. Save changes with:

NPM (not tested, but should work):

npx patch-package vot.js

Bun:

bunx patch-package --use-yarn vot.js

Do not use patches from bun patch or any npm packages. They will be incompatible with the patch-package, and may also break when the package is updated.

How to update localization files

A console utility l10n-tui has been created for all interaction with localization files.

To call the utility, use the command:

bun l10n

You can read more about the utility here

Appearance customization:

The extension supports appearance customization using Stylus, Stylish and other similar extensions

Example of changing styles:

 /* ==UserStyle==
@name         VOT-styles
@version      16.09.2023
@namespace    vot-styles
@description  LLL
@author       Toil
@license      No License
==/UserStyle== */

: root {
  --vot-font-family : "Roboto" , "Segoe UI" , BlinkMacSystemFont , system-ui ,
    -apple-system;

  --vot-primary-rgb : 139 , 180 , 245 ;
  --vot-onprimary-rgb : 32 , 33 , 36 ;
  --vot-surface-rgb : 32 , 33 , 36 ;
  --vot-onsurface-rgb : 227 , 227 , 227 ;

  --vot-subtitles-color : rgb ( var ( --vot-onsurface-rgb , 227 , 227 , 227 ));
  --vot-subtitles-passed-color : rgb ( var ( --vot-primary-rgb , 33 , 150 , 243 ));
}

The extension has been tested in the following browsers:

Status	Browser	Browser version	Platform	Extension
⠀✅	Firefox Developer Edition	v106 - v129, 64 bit	Windows	Tampermonkey (MV2), FireMonkey, VioletMonkey, Greasemonkey
⠀✅	Firefox	v116.0.2	Windows, Linux, Android	Tampermonkey (MV2), Violetmonkey
⠀✅	Firefox Nightly	v118.0a1	Windows, Android	Tampermonkey (MV2)
⠀✅	LibreWolf	v100.0.2-1	Windows	Tampermonkey (MV2)
⠀✅	Brave	v1.46 - v1.68.134	Windows	Tampermonkey (MV2)
⠀✅	MS Edge	v106.0.1370.34	Windows, Linux	Tampermonkey (MV2)
⠀✅	Cent Browser	v4.3.9.248, 32 bit	Windows	Tampermonkey (MV2)
⠀✅	Cent Browser Beta	v5.0.1002.182, 64 bit	Windows	Tampermonkey (MV2)
⠀✅	Google Chrome	v106 - v127	Windows, MacOS, Linux	Tampermonkey (MV2), Tampermonkey (MV3), Violetmonkey, OrangeMonkey, User Javascript and CSS
⠀✅	Opera GX	LVL4 (core: 91) - LVL5 (core 109)	Windows	Tampermonkey Opera
⠀✅	Opera	v92.0.4561.43	Windows	Tampermonkey Opera
⠀✅	Vivaldi	5.7.2921.63	Windows, Linux	Tampermonkey (MV2)
⠀✅	Safari	v15.6.1	MacOS, iOS	Userscripts
⠀✅	Kiwi Browser	v116.0.5845.61	Android	Tampermonkey (MV2)
⠀✅	Yandex Browser	v24.4-24.6	Windows	Tampermonkey (MV2), Tampermonkey (MV3)
⠀✅	Arc	v1.6.1	Windows	Tampermonkey (MV3)
⠀✅	Incognition	v4.1.1.0 (v125)	Windows	Tampermonkey (MV3), Tampermonkey (MV2)

The modern version of Tampermonkey (MV3) has not been tested in most browsers. If there are problems, it is recommended to use Tampermonkey Legacy (MV2)

To activate the script in Tampermonkey (MV3), you must enable "Developer Mode"

Tested in the following extensions for user scripts:

Status	Browser	Extension
⠀✅	Any	Tampermonkey Legacy (MV2)
⠀✅	Opera	Tampermonkey Opera
⠀✅	Chrome	Tampermonkey (MV3)
⠀❔	Safari	Userscripts
⠀✅	Any	Violetmonkey
⠀❔	Any	AdGuard Userscripts
⠀Installation guide	Firefox	Firemonkey
⠀✅	Firefox	Greasemonkey
️ RequestIdleCallback throws errors, but works	Any	OrangeMonkey
⠀Installation guide	Any	User Javascript and CSS