数字人 Digital Human SadTalker: Generate a Video from a Single Image and a Single Audio/Music Clip – Installation and Usage Tutorial

[baike]Generated video effect demo[/baike]
Installation Tutorial
Tip: If your computer is too weak or does not have a good graphics card, do not install it—use the online version directly. If you are confident in your computer specs, install it according to the following tutorial.
[baike]Windows 10 installation[/baike]
1. Install Python 3.8 and check "Add Python to PATH".
https://www.python.org/downloads/release/python-3810/



2.Install Git or install it using Scoop
Open Computer > Run, enter powershell, and execute the following commands in powershell. Just copy them all over at once. With a fast internet connection, it will install quickly; with a slow one, it may take a few minutes.
Set-ExecutionPolicy -ExecutionPolicy RemoteSigned -Scope CurrentUser
irm get.scoop.sh | iex
scoop install git

3. Install ffmpeg. Follow this tutorial or install it using scoop.
Then enter in powershell:  scoop install ffmpeg

4. Download the SadTalker repository by running
Then enter: git clone https://github.com/Winfredy/SadTalker.git

5. Download the checkpoints and gfpgan models. Download the two separately,
https://github.com/OpenTalker/SadTalker#2-download-models
The first is 1.5G; the second is 600+ MB




After downloading, extract the folder and place it in the sadtalker root directory


   Note: sadtalker must be renamed to checkpoints; otherwise, an error will occur: Failed in loading audio2pose_checkpoint





6. Run webui.bat, and it will launch the Gradio-supported WebUI demo. If you encounter the startup failure issue, fix it according to step 7.



7. app_sadtalker.zip error fix
https://github.com/OpenTalker/SadTalker/files/13259997/app_sadtalker.zip
Extract the downloaded fix file and copy it to the sadtalker root directory to replace the files.
Close the previous webui.bat and restart. The final result is that the address 127 appears; copy it into a browser and it will work.




[baike]macOS installation[/baike]https://github.com/OpenTalker/SadTalker/blob/main/docs/install.md

[baike]Two ways to try it online[/baike]
huggingface:https://huggingface.co/spaces/vinthony/SadTalker

discord:https://discord.com/invite/rrayYqZ4tf
[baike]Generation operations and settings[/baike]



[baike]Normal running status prompt[/baike]After everything is set up, the normal prompt looks like the image below. There will be an execution progress bar. Open your webui.bat to see the execution process. Other issues will report errors here; the next section provides solutions for various errors.



[baike]Generation errors and solutions[/baike]If you encounter audio or image path errors, check whether the image is empty or the audio path is empty. The solution is to change the names of the audio and image files to letters; Chinese is not supported.