GymDreams Docs (GymDreams8)

Control Net for Automatic1111

WebUI docker image on vast only comes with Canny, so we’ll have to download the models from Hugging Face. There are two ways: either clone the entire model repo (40GB) or download indivdually. Unless you need all the models, it’s faster and require less disk space to just get the models you need.

See also SDXL Control Net for models specific to SDXL

Control Net Model Specifications

The control net models are named in the following format and here are the parts:

Control Net Model Specifications

Source: /lllyasviel/ControlNet-v1-1-nightlyopen in new window

Clone entire repo

Install git LFS

https://github.com/git-lfs/git-lfs/blob/main/INSTALLING.mdopen in new window

mkdir /workspace/tmp
cd /workspace/tmp
curl -s https://packagecloud.io/install/repositories/github/git-lfs/script.deb.sh | sudo bash
apt-get install git-lfs

Clone the Repo

This should work but it’s super slow. Also, the full model git repo is currently at 40 GB. So instead of this, just download via Hugging Face API below

mkdir /workspace/downloads
cd /workspace/downloads
git lfs install
git clone https://huggingface.co/lllyasviel/ControlNet-v1-1

Download via wget

CN Tile

cd /workspace/stable-diffusion-webui/extensions/sd-webui-controlnet/models
wget https://huggingface.co/lllyasviel/ControlNet-v1-1/resolve/main/control_v11f1e_sd15_tile.pth

CN Soft Edge

cd /workspace/stable-diffusion-webui/extensions/sd-webui-controlnet/models
wget https://huggingface.co/lllyasviel/ControlNet-v1-1/resolve/main/control_v11p_sd15_softedge.pth

CN Open Pose

cd /workspace/stable-diffusion-webui/extensions/sd-webui-controlnet/models
wget https://huggingface.co/lllyasviel/ControlNet-v1-1/resolve/main/control_v11p_sd15_openpose.pth

CN Line art

cd /workspace/stable-diffusion-webui/extensions/sd-webui-controlnet/models
wget https://huggingface.co/lllyasviel/ControlNet-v1-1/resolve/main/control_v11p_sd15_lineart.pth

CN Shuffle

cd /workspace/stable-diffusion-webui/extensions/sd-webui-controlnet/models
wget https://huggingface.co/lllyasviel/ControlNet-v1-1/resolve/main/control_v11e_sd15_shuffle.pth

CN Depth

cd /workspace/stable-diffusion-webui/extensions/sd-webui-controlnet/models
wget https://huggingface.co/lllyasviel/ControlNet-v1-1/resolve/main/control_v11f1p_sd15_depth.pth

CN Inpaint

cd /workspace/stable-diffusion-webui/extensions/sd-webui-controlnet/models
wget https://huggingface.co/lllyasviel/ControlNet-v1-1/resolve/main/control_v11p_sd15_inpaint.pth

CN line art anime

cd /workspace/stable-diffusion-webui/extensions/sd-webui-controlnet/models
wget https://huggingface.co/lllyasviel/ControlNet-v1-1/resolve/main/control_v11p_sd15s2_lineart_anime.pth
Last Updated: