Files
storyteller-ml/animation/SadTalker/docs/webui_extension.md
T
Brandon Thomas 2d2b25d5a6 Add SadTalker @ ae0b26359d44c9379450a8e02a38b45eeec15549
MIT license

Commit:

https://github.com/OpenTalker/SadTalker

commit ae0b26359d44c9379450a8e02a38b45eeec15549 (HEAD -> main, origin/main, origin/HEAD)
Author: shadowcun <shadowcun@tencent.com>
Date:   Mon Jul 3 13:48:35 2023 +0800

    fixed bug: hacking facexlib of FAN
2023-07-27 15:00:20 -04:00

2.1 KiB

Run SadTalker as a Stable Diffusion WebUI Extension.

  1. Installing the lastest version of stable-diffusion-webui and install the sadtalker via extension. image

  2. Download the checkpoints manually, for Linux and Mac:

    
    cd SOMEWHERE_YOU_LIKE
    
    bash <(wget -qO- https://raw.githubusercontent.com/Winfredy/SadTalker/main/scripts/download_models.sh)
    

    For windows, you can download all the checkpoints from google drive or 百度云盘 提取码: sadt.

3.1. options 1: put the checkpoint in stable-diffusion-webui/models/SadTalker or stable-diffusion-webui/extensions/SadTalker/checkpoints/, the checkpoints will be detected automatically.

3.2. Options 2: Set the path of SADTALKTER_CHECKPOINTS in webui_user.sh(linux) or webui_user.bat(windows) by:

> only works if you are directly starting webui from `webui_user.sh` or `webui_user.bat`.

```bash
# windows (webui_user.bat)
set SADTALKER_CHECKPOINTS=D:\SadTalker\checkpoints

# linux (webui_user.sh)
export SADTALKER_CHECKPOINTS=/path/to/SadTalker/checkpoints
```
  1. Then, starting the webui via webui.sh or webui_user.sh(linux) or webui_user.bat(windows) or any other methods, the SadTalker can be used in stable-diffusion-webui directly.

    image

Questsions

  1. if you are running on CPU, you need to specific --disable-safe-unpickle in webui_user.sh or webui_user.bat.

    # windows (webui_user.bat)
    set COMMANDLINE_ARGS="--disable-safe-unpickle"
    
    # linux (webui_user.sh)
    export COMMANDLINE_ARGS="--disable-safe-unpickle"
    

(Some important discussion if you are unable to use full mode).