thibaud

/

controlnet-sd21

like 414

I have tried to use ControlNet with Stable Diffusion XL 1.0 but I failed:

RuntimeError: mat1 and mat2 shapes cannot be multiplied (154x768 and 1024x320)

Using

controlnet = [
    ControlNetModel.from_pretrained('thibaud/controlnet-sd21-canny-diffusers', torch_dtype=torch.float16),
]

pipe = StableDiffusionControlNetPipeline.from_pretrained(
    'stabilityai/stable-diffusion-xl-base-1.0', controlnet=controlnet,
    torch_dtype=torch.float16,
    use_safetensors=True, variant="fp16",
)

Do you plan to make xl versions of your awesome controlnet? It would be really great.