Questions tagged [generative-adversarial-networks]

For questions related to generative adversarial networks (GANs), introduced in the paper Generative Adversarial Nets (2014) by J. Goodfellow et al. A GAN is composed of a discriminative model (D) and a generative model (G). The discriminator D needs to distinguish between data generated by the generator G and data in the training set, while the generator G needs to generate data such that the discriminator D is not able to accomplish its task.

Filter by
Sorted by
Tagged with
0
votes
0answers
2 views

Are there any Generative Adversarial Networks without Multi Layer Perceptrons?

Although the main stream research is on Generative Adversarial Networks(GANs) using Multi Layer Percepteons (MLPs). The original paper titled Generative Adversarial Nets clealry says, in abstract, ...
0
votes
0answers
4 views

What is meant by an act of capturing a distribution?

Consider the following statement from the abstract of the paper titled Generative Adversarial Nets We propose a new framework for estimating generative models via an adversarial process, in which we ...
1
vote
1answer
30 views

Why does this paper say that the Nash-equilibrium of GAN is given by a discriminator which is 0 everywhere on the data distribution?

I am facing difficulty in understanding the bolded portion of the following statement from this paper GANs are defined by a min-max two-player game between a discriminative network $D_\Psi(x)$ and ...
1
vote
2answers
35 views

What is Lipschitz constraint and why it is enforced on discriminator?

The following is the abstract for the research paper titled Improved Training of Wasserstein GANs Generative Adversarial Networks (GANs) are powerful generative models, but suffer from training ...
1
vote
1answer
45 views

Classifying generated samples with Wasserstein-GAN as real or fake

I'm quite new to GANs and I am trying to use a Wasserstein GAN as an augmentation technique. I found this article https://www.sciencedirect.com/science/article/pii/S2095809918301127, and would like to ...
1
vote
1answer
90 views

Why does my “entropy generation” RNN do so badly?

I'm new to relatively RNNs, and I'm trying to train generative and guessing neural networks to produce sequences of real numbers that look random. My architecture looks like this (each "circle&...
1
vote
0answers
54 views

Is convergence to a local minima more likely with transfer learning?

While doing transfer learning where my two problems are face-generation and car-generation is it likely that, if I use the weights of one problem as the initialization of the weights for the other ...
1
vote
0answers
89 views

Why is this GAN not converging?

This GAN being trained with CelebA dataset doesn't seem to mode collapse, discriminator is not really over confident, and yet the quality is stuck on these rough Picasso-like generator images. Using ...
1
vote
0answers
24 views

Generation of realistic real-valued sequences using Wasserstein GAN fails

My goal is to generate artificial sequences of real-valued data (e.g. time series) with GANs. Starting simple I tried to generate realistic sine-waves using a Wasserstein GAN. But even on this simple ...
1
vote
1answer
897 views

What is the purpose of the GAN?

The Generative Adversarial Network (GAN) is composed of a generator $G$ and a discriminator $D$. How do these two components interact? What is the intuition behind the GAN, its purpose, and how it is ...
0
votes
2answers
105 views

What is the right way to train a generator in a GAN?

I am not fully understanding how to train a GAN's generator. I have a few questions below, but let me first describe what I am doing. I am using the MNIST dataset. I generate a batch of random images ...
2
votes
2answers
115 views

Recent deep learning textbook (i.e. covering at least GANs, LSTM and transformers and attention)

I am searching for an academic (i.e. with maths formulae) textbook which covers (at least) the following: GAN LSTM and transformers (e.g. seq2seq) Attention mechanism The closest match I got is Deep ...
1
vote
1answer
128 views

Optimum Discriminator for label smoothed GAN

I was reading the paper called Improved Techniques for Training GANs. And, in the one-sided label smoothing part, they said that optimum discriminator with label smoothing is $$ D^*(x)=\frac{\alpha \...
0
votes
1answer
33 views

Is there a performace benefits using VAE-GAN instead of just GAN?

I have read that when using VAE-GANs, first what happens is the VAE's encoder encodes some image to another encoded image, which from GAN's point of view is considered a noise, and then the GAN part ...
0
votes
0answers
20 views

Could an adaptive discriminator augmentation (ADA) be used for a discriminatory task?

Was wondering if I could use an adaptive discriminator augmentation (ADA) on a data set like MNIST (multi-class classification task). It seems that this is focused on generative modeling, so not sure ...
2
votes
1answer
238 views

Training the generator in a GAN pair with back propagation

For the purposes of this question I am asking about training the generator, assume that training the discriminator is another topic. My understanding of generative adversarial networks is that you ...
0
votes
0answers
30 views

GAN performs worse after 50 epochs than after 2

I am training GAN on SVHN dataset (house numbers in Google Street View images, dimensions: 3x32x32 - 3 color channels). The problem is that it performs worse after some training (e.g. after 50 epochs) ...
0
votes
0answers
45 views

Is it possible to mimic someone's handwriting given their sample notes?

I have a pet project, but I'm not very well versed with AI. I posted this question on datascience.stackexchange with no luck. I think this forum is more apt, so can anyone here help me start this in ...
0
votes
0answers
14 views

What is the state of the art in melody generation?

Generative Adversarial Networks can generate realistic photos of people, such as thispersondoesnotexist.com. I wonder whether one can train an artificial intelligence on a batch of plain solo melodies ...
0
votes
0answers
8 views

Using GAN to create multiple images as per multiple input layers

How to use GAN to create multiple images like https://opensea.io/collection/boredapeyachtclub here, each attribute is variable like fur, BG, Expression, Sunglasses, etc. Is there any GAN software to ...
0
votes
0answers
16 views

GAN - relation of input size and hidden layer size

I'm adapting a GAN described here used for generating binary output. It's trained on binarized MNIST data, with a size of 28x28 so 784 values. I want to adapt it to train on and generate 1D vectors ...
0
votes
0answers
21 views

Text to image GANs and failure

My knowledge of GANs is relatively basic at the moment but I seem to remember reading somewhere that GANs that generate images from a text prompt, when they fail to understand some of the text/words ...
0
votes
1answer
61 views

Why is it easier to construct adversarial examples relative to training neural networks?

I was having looking at this lecture by Ian Goodfellow and my doubt is around 18:00 timestamp where he explains generation of adversarial examples using FGSM. He mentions that the there is a linear ...
0
votes
0answers
8 views

GAN unexpected behavior depeding on scaling and generator output activation function

I am training a GAN using data that underwent PCA. When I scale the data between -1 and 1, no matter when I use 'tanh' or 'sigmoid' at the last layer of the generator, the network is not stable. ...
1
vote
0answers
14 views

Hyperparameters for Reproducing the Results of IRGAN on MovieLens 1M

I am trying to reproduce results reported for IRGAN (information retrieval GAN) on the MovieLens 1M dataset. The results I want to reproduce and their sources are listed in the table below. Model ...
2
votes
1answer
65 views

In style transfer, why does the comparison between channels give a good sense of style?

I have been learning about Style Transfer recently. Style is defined as The correlation of activations between channels. I can't seem to understand why that would be true. Intuitively, style seems ...
1
vote
1answer
34 views

Does a better discriminator in GANs mean better sample generation by the generator?

Since the discriminator defines how the generator is updated, then building a discriminator with a higher number of parameters/more layers should lead to a better quality of generated samples. So, ...
4
votes
0answers
38 views

Are generative models actually used in practice for industrial drug design?

I just finished reading this paper MoFlow: An Invertible Flow Model for Generating Molecular Graphs. The paper, which is about generating molecular graphs with certain chemical properties improved the ...
3
votes
1answer
552 views

Can someone explain R1 regularization function in simple terms?

I'm trying to understand the R1 regularization function, both the abstract concept and every symbol in the formula. According to the article, the definition of R1 is: It penalizes the discriminator ...
1
vote
0answers
36 views

What does “shape information” mean in terms of GAN(generative adversarial networks)?

A paper says However, annotations used as inputs to C-GAN are typically based only on shape information, which can result in undesirable intensity distributions in the resulting artificially-...
0
votes
0answers
12 views

Things to consider while adding custom function to generator output in GAN

I am training a GAN model (DCGAN) to generate 128x128 images. Now, I wish to add a function which will take the generator output, perform some pre-defined operations on it, and return the modified ...
1
vote
0answers
34 views

Which approach best suits vector encodings?

I want to build a model that when given two vectors, outputs the probability of one vector being the encoded form of the other. I have 2 strategies for this: (Dataset available) I can directly feed ...
0
votes
1answer
63 views

Decision boundary figure in Least square GAN paper

I currently reading Least Square GAN paper. But, I cannot interpret the one of the its figures. . Explanation of the figure goes like this: Figure 1: Illustration of different behaviors of two loss ...
1
vote
1answer
32 views

Are there architectures to generate pictures from four labels? (VAEs, GANs)

I want to try something with image creation via NNs. I have come across Variational Autoencoders and Generative Adversarial Networks as possible solutions but have only found image creatinon with ...
2
votes
1answer
55 views

Is it possible to use an internal layer's outputs in a loss function?

For a network of the form: Input(10) Dense(200) Dense(100+10) Dense(20) Output() Those +10 outputs are what I want to add to ...
1
vote
1answer
76 views

Explain the difference in graphical patterns between discriminator fake loss and generator loss in GAN

In GAN (generative adversarial networks), let us take "binary cross-entropy" as the loss function for discriminator $$(overall \; loss = -\sum log(D(x_i)) -\sum log(1-D(G(z_i))) $$ $$ where \...
11
votes
1answer
1k views

Understanding notation of Goodfellow's GAN objective function

What is the meaning of $V(D,G)$? How do we get these expectation parts? I was trying to understand it following this article: Understanding Generative Adversarial Networks (D.Seita), but, after many ...
0
votes
0answers
7 views

Feasibility f using Word2Vec embeddings as input for GANs

If I have a dataset of artwork and a list of say, 10-12 words that describe each piece of artwork, how feasible would it be to convert those words into a word2vec embedding and use that (plus lets say ...
2
votes
0answers
38 views

How does the output distribution of a GAN change if the parameters are slightly purturbed?

Suppose $G_{\phi}:\mathcal{Z}\rightarrow \mathcal{X}$ is a generator (neural network, non-invertible) that can sample from some distribution $\pi$ on $\mathcal{X}$. That is, $G_{\phi}(z)\sim \pi$ when ...
2
votes
0answers
106 views

What is the purpose of the DAMSM loss for the generators in AttnGAN?

I am confused about the training part in AttnGan. If you observe page 3. There are two types of losses for generator network: one involving the Deep Attentional Multimodal Similarity Model (DAMSM) ...
0
votes
0answers
14 views

Do dataset sizes matter in a Style GAN?

When working with classifiers, a class imbalance is a huge issue for our models. If we have too many images of class 1 and too few images from ...
1
vote
0answers
38 views

SAGAN - is there a mistake in the original paper?

in the original paper the following scheme of the self-attention appears: https://arxiv.org/pdf/1805.08318.pdf In a later overview: https://arxiv.org/pdf/1906.01529.pdf this scheme appears: ...
2
votes
1answer
49 views

In the MINE paper, why is $\hat{G}_B$ biased, and how does the exponential moving average reduce the bias?

While reading the Mutual Information Neural Estimation (MINE) paper [1] I came across section 3.2 Correcting the bias from the stochastic gradients. The proposed method requires the computation of the ...
3
votes
1answer
58 views

Why do we sample vectors from a standard normal distribution for the generator?

I am new to GANs. I noticed that everybody generates a random vector (usually 100 dimensional) from a standard normal distribution $N(0, 1)$. My question is: why? Why don't they sample these vectors ...
0
votes
1answer
39 views

What to do with a GAN that trained well but got worse over time?

I am training a WGAN-GP network based on the following paper, though I am using a different dataset. Now, for the first ~ 60-70 epochs, my network trained really well, which I could see in the loss ...
4
votes
1answer
66 views

GAN Generator Output w/ Periodic Noise

I am training a Semi-Supervised GAN, using multivariate time-series with window of shape (180*80) with the generator and discriminator architecture below. My data is scaled using Robust Scaler, so I ...
0
votes
0answers
14 views

Why do the inception score and the Fréchet inception distance use the inception network and not another network?

So I was researching about the evaluation of GANs and found these two metrics which seem to be the most popular. I understand that the main ideia is to apply the data to a pre-trained network in order ...
3
votes
0answers
39 views

Best Machine Learning Model for “Predicted” Image Generation

I am currently working on undergraduate research to determine hotspots for hand-surface contact. Ideally, I would like to give the model a depth image as input: Example of synthetic depth image and ...
4
votes
1answer
192 views

Why don't those developing AI Deepfake detectors use two detectors at once so as to catch deepfakes in one or the other?

Why don't those developing AI Deepfake detectors use two differently trained detectors at once that way if the Deepfake was trained to fool one of the detectors the other would catch it and vice-versa?...
1
vote
0answers
18 views

Why does the relativistic discriminator increase the probability that generated data are real and decrease the probability that real data are real?

I was reading the ESRGAN whitepaper, where I came across this line: Relativistic discriminator [2] is developed not only to increase the probability that generated data are real but also to ...