Audio and Transcript Sync issues?

Hi there! Is anyone else having audio issues where the content they are watching is miscued from where the speech is? For instance, I’ll be watching a recorded lecture, and the speaker will be three sentences ahead (or in some instances, behind) where the text underlying is, making it very difficult to follow along. It’s irregular also, in some videos it occurs, other’s it’s no issues. Some videos correct itself when I come back to it, others which never had the issue all of a sudden start doing it.

Any help is GREATLY appreciated, this is 95% what I use the app for. Reading and following along with the listening.

2 Likes

That sounds like an issue with lesson timestamps. You can report issues like that and our content team will look into it and have it fixed.

1 Like

This happens when I import my own mp3 files. Lingq does a great job of providing a transcription, but the timestamps of the transcription don’t match the audio. Since I have to set all the timestamps manually, it simply isn’t worthwhile importing audio.

Any update on this? I am finding that the imported text has not been correctly divided so it syncs with the audio. This is particularly problematic when there is a question and answer dialog between two characters in the video. Everything is correctly synced when I watch the YT video with the subtitles on, but not on the imported lesson in LingQ. Thx.

2 Likes

Someone else suggested that we should click “generate timestamps”, wait for the new timestamps to be generated; close the browser completely, open a new browser session, open Lingq again, and then the timestamps are more accurate.
I’ve found that works - somewhat - but I still need to set timestamps manually for sections that have background noise or music.
I’ve started using recordings of news radio, so this approach works fairly well for me. I’ve given up using TV shows or movies. I’ve wasted far too many hours trying to import them and when I finally get them into Lingq, the timestamps aren’t even close because of all the background noise and music.
It seems strange that Lingq can do a good job of transcribing speech, but can’t synchronize the transcription with the audio. Maybe two separate software app’s are being used to create the transcription and create the timestamps, and the two app’s don’t talk to each other. The transcription software can filter out background noise, but the timestamp software doesn’t do a good job of that.

You’re right that it’s 2 different systems. And not an easy problem to solve automatically without machine learning. Transcribe is the process of taking audio files and returning timestamps and text. Forced alignment takes text and audio and guesses what the timestamps are. At this stage whisper gives more accurate results but it may be possible to implement a better forced alignment solution in future

2 Likes

Brand new to LingQ and I’m also having this issue with the very first video I imported from Youtube. The highlighted/underlined sentences are 2 or 3 sentences behind the actual audio. Has a fix been implemented since? If not, is there a way to turn off the underlining sentences? I could do without it if I have to, but having them on while out of sync is just distracting.

1 Like

Synching audio text is a killer feature. Real shame that it still doesnt work better.

When importing YT videos, most of the time the subtitles will be out of sync with the audio

Thanks for your feedback, everyone. We are looking into it.

2 Likes

Thanks! In the meantime, is there a way to turn off the underline text on desktop browser? I found the option “Show Audio Underline in Text” in the mobile app, so I was able to turn off, but I can’t seem to find that on desktop.

@martin57 Yes, you can go to Settings > Reader and adjust the Highlight Style.

Sorry, could you please elaborate? I set both light theme and dark theme highlight styles to “off” but it’s still underlining the text as it plays. This highlight style setting seems to pertain to the yellow/blue word lingQs instead. I’m looking to turn off the underlining text on desktop browsers. Thanks.

@martin57 Sorry, my bad, I thought you were referring to highlight style. Underlining can be disabled under Settings > Reader > TTS > Audio Display Style.

It can be disabled on mobile though. Is there no way to do the same on desktop?

Hi @martin57 !

You can disable the highlighting during the playback in the:
SettingsReaderTEXT-TO-SPEECHAudio display style

I would appreciate it if you could share a link to the video that shows the issue after being imported. This will help in addressing it. Most likely it is caused by the overlaying timestamps in the source YouTube subtitles, which often happens in the auto-generated ones.

1 Like

Oh, this worked, thanks! Didn’t think to check text to speech option, since it was actual audio.

As for the video giving me issues, for some reason when I try to open it now from LingQ, the video stays on a black screen without playing and then I get this error when I try to fast forward or reverse 5 seconds.

In fact, it seems that none of the videos that I have are working now. When I click on the video button, it’s just a black screen.

I had to go back to Youtube to find it again: https://www.youtube.com/watch?v=UALTRDJEfXk

It has a subtitle track, so I was surprised it was out of sync in LingQ.

1 Like

@martin57 Can you please post the lesson URL too? I’d like to try on my end and see what happens. Thanks.

Ah, is this it? Login - LingQ

Not sure if I’m sharing it correctly. I just opened the lesson and copied the URL at the top. Is there a share button somewhere?

@martin57 All good! I opened a lesson and I was able to play the video just fine, no issues detected. Are you able to play the same video directly on YT?