Return of the Rooster - LingQ Video Tools Version 2

More Info Support Purchase Sign up to LingQ
Forums Discord SendOwl Rooster Referral

V2 STATUS: ALPHA

Browsers: Chrome
Latest Version: 0.26
Patch Notes: Discord

Netflix Test Notes

You must disable the LingQ Import Extension (if applicable) while using Rooster Video Tools on Netflix

Disney+ Test Notes

An included TAMPERMONKEY script is required for access to the Audio Files and subsequent functions on Disney+. (Audio Download, LingQ Transcribe, Whisper JAX)

The Audio Downloader is based off this TAMPERMONKEY disney-audio-downloader. It does not work properly in its base state, if you have it installed you will need to uninstall it.

The script is Included in the ZIP of Video Tools V2 → /scripts/test/disney/AudioDownloaderRooster.js

Instructions to Install Tampermonkey

(Instructions for Disney - same for Amazon Prime)
Install TamperMonkey
image

Copy and paste the script located inside AudioDownloaderRooster.js. (In the ZIP folder)


Save the Script

Enable the script

Overview

Rooster Video Tools is a browser extension developed for Chrome Manifest 3. The main functions are dynamic LingQ lesson creation and providing a sophisticated video overlay for language learning. It supercedes V1 Rooster Video Website Tools and is included with MasterLingQ Premium as an optional install.

Author Notes

Video Tools version 1 was an experiment into the world of website manipulation and user experience. We have learned a lot and as a community have come up with several ideas, fixes and improvements to the software. Unfortunately the overall sentiment is still that while being extremely beneficial it is confusing and increasingly so for new users with each update.

Goals

  1. Improve the New User experience
  2. Improve the GUI
  3. Modify/remove confusing systems
  4. Expand user choices for translations / transliteration / text-to-speech
  5. Improve the No LingQ mode
  6. Integrate all video websites into a single extension

Development Progress

As of 18 October 2024. Expected completion end November 2024.
Status Key: [TBA, Pre-Alpha, Alpha, Beta, Release]
DRM = Digital Rights Management → Audio is protected and can’t be used

Website Language Completion Availability Status Subtitles Audio / Transcribe
Version 2 Features . 98%+ :ballot_box_with_check: Alpha . .
6Play French 10% X TBA ? :white_check_mark:
Amazon Multi 30% X TBA :white_check_mark: X (DRM)
Animelon Japanese 10% X TBA :white_check_mark: :white_check_mark:
AppleTV Multi 10% X TBA :white_check_mark: X (DRM)
ARD Mediathek German 90% :ballot_box_with_check: Alpha :white_check_mark: :white_check_mark:
Britbox British English 90% :ballot_box_with_check: Alpha :white_check_mark: X (DRM)
Crunchyroll Multi 10% X TBA * X (DRM)
Dailymotion Multi 90% :ballot_box_with_check: Alpha :white_check_mark: :white_check_mark:
Disney+ Multi 95%+ :ballot_box_with_check: Alpha :white_check_mark: :white_check_mark:
DRDK Danish 30% X TBA :white_check_mark: ?
Finnish Me Finnish 10% X TBA :white_check_mark: :white_check_mark:
Foxtel English 50% X TBA :white_check_mark: ?
FranceTV French 30% X TBA :white_check_mark: :white_check_mark:
Hulu English/Spanish 30% X TBA :white_check_mark: X (DRM)
IQ Mandarin/Vietnamese/Thai 90% :ballot_box_with_check: Alpha :white_check_mark: :white_check_mark: (TBA)
Max English/Spanish 30% X TBA :white_check_mark: X (DRM)
MegaTV Greek 90% :ballot_box_with_check: Alpha :white_check_mark: :white_check_mark:
Netflix Multi 98%+ :ballot_box_with_check: Alpha :white_check_mark: :white_check_mark:
NPO Dutch 90% :ballot_box_with_check: Alpha :white_check_mark: X (DRM)
NRK Norwegian 30% X TBA :white_check_mark: ?
Paramount+ English/Spanish 95% :ballot_box_with_check: Alpha :white_check_mark: X
Rutube Russian 95%+ :ballot_box_with_check: Alpha X :white_check_mark:
Stan Australian English 95% :ballot_box_with_check: Alpha :white_check_mark: X (DRM)
TikTok Multi 90% :ballot_box_with_check: Alpha :white_check_mark: :white_check_mark:
Udemy Multi 50% X TBA :white_check_mark: ?
Viki Asian 95% :ballot_box_with_check: Alpha :white_check_mark: X (DRM)
Vix Spanish 60% :ballot_box_with_check: Pre-Alpha :white_check_mark: X (DRM)
Weverse Korean 95% :ballot_box_with_check: Alpha :white_check_mark: :white_check_mark:
Yle Areena Finnish 95% :ballot_box_with_check: Alpha :white_check_mark: :white_check_mark:
YouTube Multi 98%+ :ballot_box_with_check: Alpha :white_check_mark: :white_check_mark:
YouTube Shorts Multi 70% :ballot_box_with_check: Pre-Alpha :white_check_mark: :white_check_mark:

Version 2 Features List

LingQ Features

Feature Description
LingQ Profile Sync all preferred settings directly from your LingQ Profile
Course and Lesson Creation Automatic Course / Lesson creation based on adjustable import settings. Import options include: Subtitles, Transcribe, Translate to Target and Own Files. Also Import the YouTube comments as a LingQ lesson. (optional)
Lesson Loading Reload existing LingQ lessons into the overlay. Selectable via dropdown or lesson Id input
Word and Phrase Status Create and update LingQ word statuses. Available on mouseover, keybind or by clicking the word in the captions.
Display and Update Stats Automatically record Words Read and Listening Time. (Optional)
LingQ Transcribe Generate subtitles from the video’s audio using LingQ provided Whisper model.
LingQ Transliterate Parse all available Transliteration types. Available as a caption display element or on word click
LingQ Text to Speech Return all voice types and options. Available in multiple places including Audio Dub and on word click.
LingQ Word Translate Utilize Context Word Translations (GPT) and DeepL as optional Clicked Word translation sources
LingQ Sentence Translate Choose between GPT, DeepL and Google for sentence translations. (LingQ lessons only)

Caption Features

Feature Description
Paired Captions The studied subtitles can be paired with a translation line generated from various sources.
Word Elements The words in the studied subtitle are replaced with LingQable elements. (Similar to LingQ reader)
Translation Elements The word translations are pre-generated and displayed above/below the word as it appears. Up to 2 different languages translations can be generated and displayed at a time.
Transliteration Elements Display your preferred transliteration option directly above/below the word in the captions.
Phrase LingQing Highlight phrases in the captions to display a LingQable translation menu.
Spoken / Non Spoken Speed Automatically adjusts the video playback rate depending on if someone is speaking or not.
Word Level Timestamps A word marker is placed underneath the word as it is spoken in real time. Also available as a scrolling popup. The tick rate can be increased for more precise languages.
Shadow Caption Pause the video for a user preferred interval after each line.
Previous / Next Caption Move to the next or previous subtitle. Also adjusts video time accordingly. Available via button click or keybind.
Replay Caption Replay the current caption. Available via button click or keybind.
Time Differential Add a timing delay in either direction for when subtitles are displayed relevant to the speech.
Pause on Mouseover Automatically pause the video at end of caption when mousing over the captions. Video plays again on mouse exit if it was previously playing.
Blur unless Mouseover The captions box can be blurred out unless being hovered by the mouse.

Overlay UI

Video Control Bar
Mode Control Font Control Display Control Word Color Control
250x500 189x301
Element Control Word Side Bar Keybindings Control Sources Control
Word Status Clicked Word Theme Editor
226x165
Blurred Captions Theme Swap
600x126 400x290

3rd Party (Transcribe)

Feature Description
Whisper JAX Generate subtitles from the video’s audio using Whisper Large model.

3rd Party (Text to Speech)

Feature Description
Meta With 1100+ voice options the niche language you are studying is surely supported. (Not available for Dubbing)
Edge 318+ voices with regional options. (Not available for Dubbing)
Google 57+ voices with regional options

3rd Party (Translate)

Feature Description
Google (F) Full data translation model. Returns multiple translations, synonyms and lemma. Available for all translation types.
Google (S) / (S2) Two simple translation models. They return different translations but only the most likely one. Available for all translation types.
Google (HTML) Lightning model using a deprecated mobile translate module. Results may vary. Available for all translation types.
Reverso For Reverso supported languages. Returns multiple translations. Available for all translation types.

3rd Party (Transliterate/Diacritics/Splitting)

Provider Description
Rooster Homebrew transliteration options for Serbian, Arabic, Belarusian, Gujarati, Georgian, Macedonian, Hindi, Khmer, Persian, Hebrew: Latin and Cantonese: Yựtyựt
RussianGram Russian stress marks and emphasis Latin transliteration. Stress marks are superficial only, the original word is LingQed.
Farasa - QCRI Processes Arabic text and returns a diacritical version. Diacritics are superficial only, the original word is LingQed.
Slovnyk Returns Ukrainian stress marks from original Ukrainian text. Stress marks are superficial only, the original word is LingQed.
EzLang Returns Zhuyin (Bo-Po-Mo-Fo) from given Chinese characters.
SpacY Identifies word lemma based on position in the caption. For selected languages only.
Thai Word Cut Creates recognizable words from Thai strings. Activated when the main line language is Thai.

UI UPDATES

Navigation Menu

Overlay Settings Menu
Improvements to UI options and user clarity while maintaining complex systems

Video Overlay

Overlay Settings
Utilize complex settings to create a tailored LingQ lesson / overlay

Summary
audiosourcedrop top line source
Generate Subtitle Trans Generate Subtitle
subtitle options Own Files
Saved Lesson No LingQ Mode

Text to Speech and Translation Settings
Users can now access a range of text to speech and translation services

Summary
image 350x174
350x174 350x174
350x174 350x174
350x174 350x174
350x174 350x174

Feedback / Bug Reports

We would highly appreciate any feedback / bug reports during the Alpha stage. Post a comment or get in contact with us on Discord

Thanks

Massive thank you to @samuelbtaylor and @ryldsamu for their efforts and ideas

9 Likes

I have a question. In version 2 can I import the discussion below the video from youtube to Lingq? I can’t find this option anywhere.

2 Likes

Yep. Was added in an recent update.

1 Like