We’re rewarding the question askers & reputations are being recalculated! Read more.

Questions tagged [generative-adversarial-networks]

For questions related to generative adversarial networks (GANs), introduced in the paper Generative Adversarial Nets (2014) by J. Goodfellow et al. A GAN is composed of a discriminative model (D) and a generative model (G). The discriminator D needs to distinguish between data generated by the generator G and data in the training set, while the generator G needs to generate data such that the discriminator D is not able to accomplish its task.

Filter by
Sorted by
Tagged with
4
votes
1answer
51 views
+100

Context-based gap-fill face posture-mapper GAN

These images are handmade, not auto-generated like they will be in production. Apologies for inaccuracies in the graph overlay. I am trying to build an AI like that displayed in the diagram: when ...
4
votes
1answer
48 views

Isn't deep fake detection bound to fail?

Deep fakes are a growing concern: the ability to credibly alter a video may have great (negative) impacts on our society. It is so much of a concern, that the biggest tech companies launched a ...
3
votes
1answer
20 views

Why does a Lipschitz continuous discriminator in GANs assure statistical boundedness?

I have been reading the paper which introduced spectral normalization in GANs. At some point the paper mentions the following: The machine learning community has been pointing out recently that ...
2
votes
1answer
32 views

How exactly does adversarial training help in handling mode-collapse in generative networks?

Of my understanding mode-collapse is when there happen to be multiple classes in the dataset and the generative network converges to only one of these classes and generates images only within this ...
3
votes
1answer
33 views

Why is Jensen-Shannon divergence preferred over Kullback-Leibler divergence in measuring the performance of a generative network?

I have read articles on how Jensen-Shannon divergence is preferred over Kullback-Leibler in measuring how good a distribution mapping is learned in a generative network because of the fact that JS-...
0
votes
0answers
15 views

I am building a SGAN for image classfication. It always predicts the output as class1, even if image from training set is given [closed]

I am building a semi-supervised GAN for image classification to classify the images into two classes, so that I can later use it to classify cyberbully. When I load the model and use it for prediction,...
2
votes
0answers
40 views

How to implement loss function of H-GAN model

I was trying to implement the loss function of H-GAN. Here is my code . But it seem somethings wrong, maybe is recognition loss on z (EQ 9). I used the EQ 5 on MISO to calculate it. Here is my code: ...
1
vote
1answer
42 views

Trying to understand the math of GANs with Goodfellows paper and tutorial

In his original GAN paper Goodfellow gives a game theoretic perspective for GANs: \begin{equation} \underset{G}{\min}\, \underset{D}{\max}\, V\left(D,G \right) = \mathbb{E}_{x\sim\mathit{p}_{\...
2
votes
0answers
21 views

How to train a transformer text-to-text model on counterexamples?

Is it possible to update the weights of a vanilla transformer model using counterexamples alongside examples? For example, from the PAWS data set, given the phrases "Although interchangeable, the ...
1
vote
0answers
13 views

Looking for GAN paper with spiral image

I am looking for a GAN paper I have read a while ago, but unfortunately cannot find it again. I think it compared GANs and other methods (like CVAEs) w.r.t. how they handle multi-modal data, not sure ...
1
vote
0answers
34 views

Is there a GAN that can be used for sequence prediction?

I want to use a GAN for sequence prediction, in a similar way that we use RNNs for sequence prediction. I want to test its performance in comparison with RNNs. Is there a GAN that can be used for ...
0
votes
0answers
13 views

Numbers to image regression

I would like to create a machine learnig framework that could predict the 3D heat distribution of a room(of size 120x120x120) , given multiple parameters(position of the heater, orientation, power of ...
1
vote
0answers
39 views

Which approaches are best suited for text deblurring?

I want to deblur text images using deep learning. Which approaches are best suited for the task? Any example networks? Is unsupervised network the best approach? GAN or cycle GAN for these purposes? ...
1
vote
0answers
9 views

How does InfoGAN learn latent categorical codes on MNIST

While reading the InfoGAN paper and implement it taking help from a previous implementation, I'm having some difficulty understanding how it learns the discrete categorical code when trained on MNIST. ...
2
votes
1answer
35 views

How to generate the original image from feature set?

We all know that using CNN, or even simpler functions, like CLD or EHD, we can generate a set of features out of images. Is there any ways or approaches that given a set of features, we can somehow ...
1
vote
0answers
28 views

Is convergence to a local minima more likely with transfer learning?

While doing transfer learning where my two problems are face-generation and car-generation is it likely that, if I use the weights of one problem as the initialization of the weights for the other ...
1
vote
0answers
46 views

Could the Jensen-Shannon divergence and Kullback-Leibler divergence be used as loss functions of non-generation problems?

If I understand correctly, the KL divergence is a measure of information loss between a ground truth distribution $P$ and a predicted distribution $Q$, and the Jensen-Shannon divergence is the mean of ...
2
votes
1answer
42 views

What is the purpose of the noise injection in the generator network of a GAN?

I do not understand why with enough training how the generator cannot learn all images from the training set as a mapping from the latent space - It is the absolute optimal case in training as it ...
0
votes
1answer
39 views

Query regarding the minmax loss function formulation of the training of a Generative Adversarial Network (GAN)

Just needed a clarification on the training procedure for a standard GAN. Of my understanding the loss function to optimize is a min max (max min causing mode collapse due to focus on one class ...
0
votes
1answer
53 views

If the goal of training of a GAN is to have $P_g=P_{data}$, shouldn't this produce the exact same images?

Referring to the blog, Image Completion with Deep Learning in TensorFlow, it clearly says that we would want a generator $g$ whose modeled distribution fits our dataset $data$, in other words, $P_{...
0
votes
0answers
40 views

Why following GAN is not working:

Trying to see, why my big GAN project is not working, i created the small GAN project to see interaction of generator and discriminator. Dummy input is like: ...
1
vote
0answers
34 views

Is it possible to use adversarial training to learn invariant features?

Given a set of time series data that are generated from different sites where all sites are investigating the same objective but with slightly different protocols. Is it possible to use adversarial ...
3
votes
0answers
17 views

What parameters can be tweaked to avoid a generator or discriminator loss collapsing to zero when training a DC-GAN?

Sometimes when I am training a DC-GAN on an image dataset, similar to the DC-GAN PyTorch example (https://pytorch.org/tutorials/beginner/dcgan_faces_tutorial.html), either the Generator or ...
0
votes
0answers
17 views

Not clear about CoordConv

I read the CoordConv paper and I am a bit confused about its implementation for a GAN/VAE. I understand how to add 2 more channels to an image and pass that to a conv net (and there are good online ...
3
votes
1answer
89 views

How is G(z) related to x in GAN proof?

In the proofs for the original GAN paper, it is written: $$∫_x p_{data}(x) \log D(x)dx+∫_zp(z)\log(1−D(G(z)))dz =∫_xp_{data}(x)\log D(x)+p_G(x) \log(1−D(x))dx$$ I've seen some explanations asserting ...
0
votes
0answers
25 views

DCGAN loss determining data normalization problems

I'm working with a DCGAN, a deep CNN for classifying images with a GAN that competes with the classifier to generate images of what we are classifying. The goal of the project at the moment is to ...
2
votes
0answers
16 views

How important is architectural similarity between the discriminator and generator of a GAN?

Shouldn't the discriminator and generator work fine even if they don't process data symmetrically? I mean, they don't only receive the final layer results of each other, they don't use data that from ...
1
vote
1answer
39 views

Why is expectation used instead of simple sum in GANs?

Why do GAN loss functions use expectation(sum + division) instead of a simple sum?
2
votes
0answers
34 views

Can GANs be used to generate matching pairs to inputs?

I have some limited experience with MLPs and CNNs. I am working on a project where I've used a CNN to classify "images" into two classes, 0 and 1. I say "images" as they are not actually images in the ...
0
votes
0answers
27 views

Deep Generative Networks Probability of “Success”

I have built various "successful" GANs or VAEs that can generate realistic images reliably, but in either case the generative step is sampling a latent feature vector from some distribution and ...
0
votes
2answers
78 views

How can I implement a GAN network for text (review) generation?

How can I implement a GAN network for text (review) generation? Please, can someone guide me to resource (code) to help in text generation?
2
votes
0answers
22 views

How do GANs create an image with specific characteristics?

I've seen GANs that do things like convert an image to a painting or this GAN here https://make.girls.moe/#/ that takes in a set of characteristics and generates a waifu with those characteristics. ...
3
votes
2answers
293 views

Why is it called Latent Vector?

I just learned about GAN and I'm a little bit confused about the naming of Latent Vector. First, In my understanding, a definition of a latent variable is a random variable that can't be measured ...
3
votes
2answers
165 views

Why use the output of the generator to train the discriminator in a GAN?

I've been doing some reading about GANs, and although I've seen several excellent examples of implementations, the descriptions of why those patterns were chosen isn't clear to me in many cases. At a ...
1
vote
0answers
39 views

Transposed convolution as upsampling in DCGAN

I read several papers and articles where it is suggested that transposed convolution with 2 strides is better than upsampling then convolution. However implementing such model with the transposed ...
1
vote
0answers
27 views

What is the intuition behind the Label Smoothing?

I was learning about GAN when the term "Label Smoothing" appears. From the video tutorial that I watch, they use the term "label smoothing" to change the binary labels when calculating the loss of ...
2
votes
2answers
96 views

How important is it that the generator of a generative adversarial network doesn't take in information about input classes?

I'm building a generative adversarial network that generates images based on an input image. From the literature I've read on GANs, it seems that the generator takes in a random variable and uses it ...
5
votes
1answer
188 views

Understanding notation of Goodfellow's GAN objective function

What is the meaning of $V(D,G)$? How do we get these expectation parts? I was trying to understand it following this article: Understanding Generative Adversarial Networks (D.Seita), but, after many ...
1
vote
1answer
70 views

How to get good results with GAN and some thousands of images?

I'm trying to generate images at minimum of size 128 x 128 with a Generative Adversarial Network. I already tried a SAGAN pytorch implementation, but I'm not very happy with results. The images look ...
0
votes
0answers
174 views

1D GAN not converging

I am trying to build a 1D GAN able to produce data similar to the input one, which looks like this: I am using pytorch. This is the code for my Discriminator, which takes as input a 1D vector of size ...
0
votes
1answer
49 views

How to study the correlation between GAN's input vector and output image

A generative adversarial network (GAN) takes a vector of numbers as input and generates an image, based on the input. Each element of the vector causes some feature of the image to change, but the ...
2
votes
2answers
417 views

Using GAN's to generate dataset for CNN training

I'm doing bachaleor thesis on traffic sign detection using single shot detector called YOLO. These single shot detectors can perform detection of objects in image and so they have specific way of ...
0
votes
1answer
66 views

Training the generator in a GAN pair with back propagation

For the purposes of this question I am asking about training the generator, assume that training the discriminator is another topic. My understanding of generative adversarial networks is that you ...
2
votes
2answers
345 views

Can we implement GAN (Generative adversarial neural networks) for classication problem like Fraud detecion?

Problem: Fraud detection Task : classifying transactions as either fraud/ Non-fraud using GAN
5
votes
2answers
496 views

Do GAN's come under Supervised Learning or Unsupervised Learning?

My guess is that they come under supervised learning, as we have labelled dataset of images, but I am not sure as there maybe other aspects in GANs which might come into play in the determination of ...
4
votes
2answers
1k views

Why are Variational autoencoder's output is blurred while GANs output is crisp and has sharp edges?

I observed in several papers that the Variational autoencoder's output is blurred while GANs output is crisp and has sharp edges. Can someone please give some intuition why that is the case? I did ...
1
vote
1answer
839 views

Why doesn't VAE suffer mode collapse?

Mode collapse is a common problem faced by GANs. I am curious why doesn't VAE suffer mode collapse?
4
votes
1answer
49 views

Class Restriction in Generative Adversarial Networks

this is my first post here. Our problem setting: We have to do a binary classification of data given a training-dataset D, where the majority of items belongs to class A and some items belong to ...
1
vote
1answer
41 views

why D(x|y) and not D(x,y) in conditional generative networks

In conditional Generative Adversarial Networks (GAN), https://arxiv.org/pdf/1411.1784.pdf, the loss function is, Discriminator and Generator both takes y, the auxiliary information. I am confused as ...
3
votes
2answers
331 views

How to use a Generative Adversarial Network to generate images for developmental analysis?

I want to generate images of childrens' drawings consistent with the developmental state of children of a given age. The training data set will include drawings made by real children in a school ...