Questions tagged [diffusion-models]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
15 views

What does it take to create quality website illustrations using AI?

I would like to create illustrations quickly using text prompts. I have tried using DALL-E, which follows the prompt well enough, but the quality of the image details is not good. I have also tried ...
2 votes
0 answers
86 views

Reverse Process in Diffusion Model Doesn't Return Original Image

I am attempting to program a Denoising Diffusion Model based on the one introduced in the article by Ho et al. (2020). However, I have run into issues while testing the reverse diffusion process. ...
1 vote
0 answers
78 views

Latent Diffusion Model Can't Learn the Latent Space of a VAE for the MNIST-Fashion Dataset

I'm currently playing around with LDMs on the MNIST-Fashion dataset. I thought the VQVAEs used in the original paper were a bit overkill for what I'm doing (and I don't fully understand how they ...
  • 127
0 votes
2 answers
54 views

How to derive the variance of the forward step of Variational Diffusion Models in terms of the log signal-to-noise ratio $\lambda_t$?

Regarding Eq. (1) in Progressive Distillation for Fast Sampling of Diffusion Models, $$ q(\mathbf{z}_t|\mathbf{z}_s) = \mathcal{N}(\mathbf{z}_t; (\alpha_t/\alpha_s)\mathbf{z}_s, \sigma _{t|s}^2 \...
  • 121
0 votes
0 answers
285 views

How to use diffusers StableDiffusionImg2ImgPipeline with "Inpainting conditioning mask strength 0-1" and an inpainting.ckpt model?

I'm working on a project & want to change the art style of images but keep them close to their original form. As shown in the image, this can be done using https://github.com/AUTOMATIC1111/stable-...
0 votes
0 answers
217 views

Do tensor cores provide advantages for running Stable Diffusion or only for training?

If I am only interested in running Stable Diffusion, using pre-trained weights, to generate images, are there any advantages to using a GPU with more Tensor cores? Or will any CUDA-compatible GPU ...
  • 101
1 vote
2 answers
78 views

Reverse Distribution in Denoising Diffusion Models is Simple

In explanations of denoising diffusion models it is stated that $q(x_{t-1}|x_t)$ is intractable. This is often justified via Bayes' rule, i.e. $$ q(x_{t-1}|x_t) \propto q(x_t|x_{t-1})q(x_{t-1}) $$ and ...
1 vote
0 answers
66 views

Is it possible to combine DDPM with GAN?

From what I understand in GAN, the main idea is that you have a generator and a discriminator network that are "competing" with each other. The generator trying to make images that the ...
-1 votes
1 answer
194 views

Is Diffusion model instable during the training? [closed]

I ran an experiment using a diffusion model (SR3 model) and got good results (experiment using jupyter notebook). Then, after running the same notebook many times with the same configuration, I did ...
  • 101
2 votes
2 answers
80 views

Forward Diffusion Process Derivation In Diffusion Models

In papers and other material regarding diffusion models the forward diffusion process is defined by adding a small amount of Gaussian noise to an image $x_0$ for $T$ time steps. In each time step the ...
  • 21
1 vote
0 answers
26 views

How is the variance for a diffusion kernel derived for a diffusion model?

So I'm watching this video tutorial from CVPR this year on diffusion models, and I am confused by the variance term in the distribution on the left on the video. I understand that in the forward ...
10 votes
2 answers
3k views

Using AI to extend an imagine pattern

I have created some nice patterns using the MidJourney tool. I'd like to find a way to extend these patterns, and I was thinking about an AI tool that takes one of these patterns and extends it in all ...