Wav2lip is a lip-sync expert, that is all you need for speech to lip generation in the wild
We need a video and an audio, both files have to be exact same length. The audio we will extract from a Vietnamese video (named
vi-news.mp4) and the video we will download an English video (named
en-news.mp4). See this guide to download these videos.
# Cutting the video and audio (14 seconds) ffmpeg -i en-news.mp4 -ss 00:00:00.000 -to 00:00:14.000 -async 1 en-news-cut.mp4 ffmpeg -i vi-news.mp4 -ss 00:01:27.500 -to 00:01:41.500 -async 1 vi-news-cut.mp4 # Extract audio from vi-news-cut.mp4 ffmpeg -i vi-news-cut.mp4 -q:a 0 -map a vi-news-cut.mp3
vi-news-cut.mp3 to the wav2lip web demo and download the result video