Too Long, Didnt Watch

WIP experiments in summarizing long youtube videos.

HF Space

Whats going on here?

1. Downloaded https://www.youtube.com/watch?v=KQ7Dw-739VY
2. Used whisper.cpp to transcribe audio to text (see ufo-clean.txt)
3. Trim the relevant section of text (see ufo-clean-parts.txt)
4. Break text into chunks
5. Summarize each chunk
6. Profit?

Step-by-step

Download audio (m4a)

pip install yt-dlp
yt-dlp -f "bestaudio[ext=m4a]" --extract-audio  'https://www.youtube.com/watch?v=jnoxjLJind4'

Transcode audio (wav)

ffmpeg -i *.m4a -hide_banner -vn -loglevel error -ar 16000 -ac 1 -c:a pcm_s16le -y resampled.wav

Transcribe with whisper.cpp

main -m ../models/ggml-medium.en.bin -f resampled.wav -t 32 -otxt

Chunk

Process