More > JRiver Media Center 32 for Linux
Auto-Generating Subtitles for Video at Home with Whisper.cpp
bob:
--- Quote from: mwillems on January 30, 2024, 08:50:29 am ---...
Probably the easiest near term way to integrate would be to add it to audio analysis and do it on import if no subtitle track is detected (or add it as a checkbox, etc.).
--- End quote ---
This sounds like a cool idea.
mwillems:
It looks like someone else had the same idea as me: VLC media player is going to be adding offline real-time generated subtitles, most likely using some kind of a local whisper implementation.
https://www.pcmag.com/news/vlc-media-player-to-use-ai-to-generate-subtitles-for-videos
Doc4:
Yeah coming off that news, it'd be really cool to have a feature like this in MC. Going off what Hendrik said I can affirm, especially in certain languages, whisper is much better with full sentences and often fails on single words in non-Latin languages. JP is especially bad since many different words sound the same and how they are written is derived from sentence context.
All the machines I happen to run MC on should in theory be performant enough to pre-process the audio track for subtitle generation, but I think having this feature in any form would be great.
lepa:
How about real time or timed lyrics?
zybex:
Real time lyrics, good luck with that!
https://www.youtube.com/watch?v=iYtBMgLfqKQ
maybe AI can tell what he's saying there ;D
Navigation
[0] Message Index
[#] Next page
[*] Previous page
Go to full version