Questions tagged [diffusion-models]
The diffusion-models tag has no usage guidance.
12
questions
0
votes
0
answers
15
views
What does it take to create quality website illustrations using AI?
I would like to create illustrations quickly using text prompts. I have tried using DALL-E, which follows the prompt well enough, but the quality of the image details is not good. I have also tried ...
- 101
2
votes
0
answers
86
views
Reverse Process in Diffusion Model Doesn't Return Original Image
I am attempting to program a Denoising Diffusion Model based on the one introduced in the article by Ho et al. (2020). However, I have run into issues while testing the reverse diffusion process.
...
- 21
1
vote
0
answers
78
views
Latent Diffusion Model Can't Learn the Latent Space of a VAE for the MNIST-Fashion Dataset
I'm currently playing around with LDMs on the MNIST-Fashion dataset. I thought the VQVAEs used in the original paper were a bit overkill for what I'm doing (and I don't fully understand how they ...
- 127
0
votes
2
answers
54
views
How to derive the variance of the forward step of Variational Diffusion Models in terms of the log signal-to-noise ratio $\lambda_t$?
Regarding Eq. (1) in Progressive Distillation for Fast Sampling of Diffusion Models,
$$
q(\mathbf{z}_t|\mathbf{z}_s) = \mathcal{N}(\mathbf{z}_t; (\alpha_t/\alpha_s)\mathbf{z}_s, \sigma _{t|s}^2 \...
- 121
0
votes
0
answers
285
views
How to use diffusers StableDiffusionImg2ImgPipeline with "Inpainting conditioning mask strength 0-1" and an inpainting.ckpt model?
I'm working on a project & want to change the art style of images but keep them close to their original form.
As shown in the image, this can be done using https://github.com/AUTOMATIC1111/stable-...
0
votes
0
answers
217
views
Do tensor cores provide advantages for running Stable Diffusion or only for training?
If I am only interested in running Stable Diffusion, using pre-trained weights, to generate images, are there any advantages to using a GPU with more Tensor cores? Or will any CUDA-compatible GPU ...
- 101
1
vote
2
answers
78
views
Reverse Distribution in Denoising Diffusion Models is Simple
In explanations of denoising diffusion models it is stated that $q(x_{t-1}|x_t)$ is intractable. This is often justified via Bayes' rule, i.e.
$$
q(x_{t-1}|x_t) \propto q(x_t|x_{t-1})q(x_{t-1})
$$
and ...
1
vote
0
answers
66
views
Is it possible to combine DDPM with GAN?
From what I understand in GAN, the main idea is that you have a generator and a discriminator network that are "competing" with each other. The generator trying to make images that the ...
-1
votes
1
answer
194
views
Is Diffusion model instable during the training? [closed]
I ran an experiment using a diffusion model (SR3 model) and got good results (experiment using jupyter notebook). Then, after running the same notebook many times with the same configuration, I did ...
- 101
2
votes
2
answers
80
views
Forward Diffusion Process Derivation In Diffusion Models
In papers and other material regarding diffusion models the forward diffusion process is defined by adding a small amount of Gaussian noise to an image $x_0$ for $T$ time steps. In each time step the ...
- 21
1
vote
0
answers
26
views
How is the variance for a diffusion kernel derived for a diffusion model?
So I'm watching this video tutorial from CVPR this year on diffusion models, and I am confused by the variance term in the distribution on the left on the video. I understand that in the forward ...
- 11
10
votes
2
answers
3k
views
Using AI to extend an imagine pattern
I have created some nice patterns using the MidJourney tool. I'd like to find a way to extend these patterns, and I was thinking about an AI tool that takes one of these patterns and extends it in all ...
- 203