ForBo7 // Salman Naqvi - Stable Diffusion, Summarized

[giscus[bot]]

ForBo7 // Salman Naqvi - Stable Diffusion, Summarized

A concise, high level overview on the mechanisms of stable diffusion.

https://forbo7.github.io/forblog/posts/12_stable_diffusion_summarized.html

[Max-We]

Nice, I like the diagrams that you created for your explanations.

By the way, there's a typo in "Autoencoder" under https://forbo7.github.io/forblog/posts/12_stable_diffusion_summarized.html.

[ForBo7]

Thanks for pointing out the typo! I've fixed it.

"Autoencdoer" 😄

[SehajDxstiny]

why is there a need of scheduler in inference?

[ForBo7]

I think it's so that the correct amount of noise is removed in each step.

It's been a while since I've gone through the process, so I may be incorrect, but the noise that the latent has during inference is added in accordance to a scheduler. So that scheduler is needed to correctly remove an amount of noise.

[CalvHobbes]

Excellent article, thank you. Really helps understand the fastai lesson better.

[ForBo7]

That's great to know! 😀