brush / CN.md
erikayurika's picture
Upload 94 files
c957591 verified

ControlNet Canny Edge

Let's take the pestered cake and try to inpaint it again. Now I would like to use a sleeping cat for it:

sleeping cat

I use Canny Edge node from comfyui_controlnet_aux. Don't forget to resize canny edge mask to 512 pixels:

sleeping cat inpaint

Let's look at the result:

sleeping cat inpaint

The first problem I see here is some kind of object behind the cat. Such objects appear since the inpainting mask strictly aligns with the removed object, the cake in our case. To remove such artifact we should expand our mask a little:

sleeping cat inpaint

Now. what's up with cat back and tail? Let's see the inpainting mask and canny edge mask side to side:

masks

The inpainting works (mostly) only in masked (white) area, so we cut off cat's back. The ControlNet mask should be inside the inpaint mask.

To address the issue I resized the mask to 256 pixels:

sleeping cat inpaint

This is better but still have a room for improvement. The problem with edge mask downsampling is that edge lines tend to be broken and after some size we will got a mess:

sleeping cat inpaint

Look at the edge mask, at this resolution it is so broken:

masks