Questions tagged [generative-model]

For questions related to the concept of generative machine learning models, such as the Restricted Boltzmann Machine (RBM), the Variational Autoencoder (VAE), and the Generative Adversarial Network (GAN).

39 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
11
votes
3answers
397 views

Can some one help me understand this paragraph from Nvidia's progressive gan paper?

Furthermore, we observe that mode collapses traditionally plaguing GANs tend to happen very quickly, over the course of a dozen minibatches. Commonly they start when the discriminator overshoots, ...
4
votes
1answer
307 views

What is the input for the prior model of VQ-VAE?

I'm trying to implement the VQ-VAE model. In there, a continuous variable $x$ is encoded in an array $z$ of discrete latent variables $z_i$ that are mapped each to an embedding vector $e_i$. These ...
3
votes
0answers
31 views

Is there any way of generating fixed-length sequences with RNNs?

Is there any way of generating fixed-length sequences with RNNs? I want to tell my character level RNN to generate a name of length 3, 4, 5 and so on. I haven't found anything online like this, but my ...
3
votes
0answers
54 views

Creating an AI than can learn to give instructions

So we think a computer is dumb because it can only follow instructions. Therefor I am trying to create an AI that can give instructions. The idea is this: Create a geometric scene (A) then make a ...
3
votes
0answers
124 views

Speaker Identification / Recognition for less size audio files

I am working on speaker identification problem using GMM (Gaussian Mixture Model). I have to just identify one user present in the given audio, so for second class noise or silent audio may use or not ...
3
votes
0answers
35 views

How do GANs create an image with specific characteristics?

I've seen GANs that do things like convert an image to a painting or this GAN here https://make.girls.moe/#/ that takes in a set of characteristics and generates a waifu with those characteristics. ...
3
votes
0answers
28 views

How do we ensure that training GANs will fall in the desirable Nash equilibrium?

One Nash equilibrium of every GANs model has is when the generator creates perfect samples indistinguishable from the training data and the discriminator just output 1 with probability 1/2. And I ...
2
votes
0answers
102 views

Generating fake faces containing specific features with GANs

I'm trying to understand how DeepFakes are generated and so far I understood that they're mostly generated through the usage of GANs and autoencoders. The autoencoders part is understandable, but what ...
2
votes
0answers
34 views

How to define loss function for Discriminator in GANs?

To train the discriminator network in GANs we set the label for the true samples as $1$ and $0$ for fake ones. Then we use binary cross-entropy loss for training. Since we set the label $1$ for true ...
2
votes
0answers
20 views

Why do hypercube latent spaces perform poorer than Gaussian latent spaces in generative neural networks?

I have a quick question regarding the use of different latent spaces to represent a distribution. Why is it that a Gaussian is usually used to represent the latent space of the generative model ...
2
votes
0answers
54 views

Do I have to downsample the input and upsample the output of the neural network when implementing the NICE algorithm?

Consider that my input is an RGB image. The size of my image is $N\times N$. I'm trying to implement NICE algorithm presented by Dinh. The bijective function $f: \mathbb{R}^d \to \mathbb{R}^d$ maps $X$...
2
votes
0answers
46 views

Should the RL agent be trained in an environment with real-world data or with a synthetic model?

I want to train a reinforcement learning agent in an environment with parameters (for example, the wind speed, sun irradiation, etc.) that change over time. I have recorded a limited amount of data ...
2
votes
0answers
35 views

Suggestion on image inpainting algorithm

Currently, many algorithms are available for image inpainting. In my application, I have some special restriction on training dataset- Let's consider the training dataset of human facial images. ...
2
votes
0answers
17 views

Improving graph decoder network

I have been using a network to generate graphs. The architecture that I have been using is the following: In this figure, $D_1$ is the signal generator and $D_2$ is the graph topology generator, ...
2
votes
0answers
165 views

Are there any general tips for troubleshooting a VAE when apparently it is not learning?

I am trying to train a VAE for anomaly detection. I chose one architecture from this Github repository and I adjusted the input and output to match what I need. In my case, the input (and hence the ...
2
votes
0answers
43 views

Can GANs be used to generate matching pairs to inputs?

I have some limited experience with MLPs and CNNs. I am working on a project where I've used a CNN to classify "images" into two classes, 0 and 1. I say "images" as they are not actually images in the ...
2
votes
0answers
123 views

How do PGMs factor in to modern ML?

I just finished the three-part series of Probabilistic Graphical Models courses from Stanford over on Coursera. I got in to them because I realized there is a certain class of problem for which the ...
2
votes
0answers
54 views

What kind of distributions can be used to model discrete latent variables?

If we take the vanilla variational auto-encoder (VAE), we $p(z)$ is a Gaussian distribution with zero mean and unit variance and we approximate $p(z|x) \approx q(z|x)$ to be a Gaussian distribution as ...
2
votes
0answers
83 views

How do GAN's generator actually work?

I have implemented DCGAN's myself and have been studying GAN's for over a month now. Now I am implementing the pggans but I encountered a sentence When we measure the distance between the ...
2
votes
0answers
111 views

Performance Evaluation Metrics used in Training, Validation and Testing

Which specific performance evaluation metrics are used in training, validation and testing and why? I am thinking error metrics (RMSE, MAE, MSE) are used in validation, and testing should use a wide ...
2
votes
0answers
371 views

Coding CGAN paper model in Keras

I was coding a CGAN model using Keras along with the paper (https://arxiv.org/pdf/1411.1784.pdf) and I wanted to try and match the models to exactly what the paper says. I knew the models presented in ...
1
vote
0answers
54 views

How does NN follows law of energy conservation?

Communication requires energy, and using energy requires communication. According to Shannon, the entropy value of a piece of information provides an absolute limit on the shortest possible average ...
1
vote
0answers
31 views

Concrete example of how transposed convolutions are able to *add* features to an image

Say we have a simple gray scale image. If we use a filter which is just the 3x3 identity matrix (or more pointedly the identity matrix but with -1 instead of the 0 entries), it is fairly easy to see ...
1
vote
0answers
34 views

How do I sample conditionally from deep belief networks?

Deep belief networks (DBNs) are generative models, where, usually, you sample by thermalising the deepest layer (as it's a restricted Boltzmann machine), and then forward propagating a sample towards ...
1
vote
1answer
36 views

Why is this variable in equation 2 of the SQAIR paper a random vector of $n$ ones followed by a zero?

I've been reading the SQAIR paper lately, and the mathematics involved seems a bit complicated. Some background, about the paper: SQAIR stands for Sequential Attend, Infer, Repeat - the paper does ...
1
vote
0answers
14 views

Using DCGAN on a (very small) dataset of art

I am developing a DCGAN using the this tutorial in PyCharm. As my usage of this tutorial suggests, I am quite new to DCGANs as I've previously only had a few experiences with machine learning ...
1
vote
0answers
28 views

Which generative methods are better for generating graphs, while preserving node and edge labels?

I started to dig into the topic of graph generation and I have a question - which out of generative methods (autoregressive, variational autoencoders, GANs, any other?) are better for generating ...
1
vote
0answers
32 views

What's a good generative model for creating valid formats of a person's name?

I'm trying to come up with a generative model that can input a name and output all valid formats of it. For example, "Bob Dylan" could be an input and the gen model will output "Dylan, Bob", "B ...
1
vote
0answers
216 views

Stack for Automatic 3D Mesh Generation

Gist: Should I use LISP for a part of the following project. What are the other options. Me and a friend are planning to create a 3D Modelling Agent where a designer can :- Specify constrains on how ...
0
votes
0answers
32 views

Are there any good tutorials on using continuous normalizing flows (with PyTorch)?

I just have a very general question. Are there any good tutorials on using continuous normalizing flows? I'd say I have a decent understanding of normalizing flows, but not their continuous variant. I'...
0
votes
0answers
12 views

Why do the inception score and the Fréchet inception distance use the inception network and not another network?

So I was researching about the evaluation of GANs and found these two metrics which seem to be the most popular. I understand that the main ideia is to apply the data to a pre-trained network in order ...
0
votes
0answers
10 views

Parametrizing non-analytical functions using generative models

My questions centers around what method is best to use parametrize a response function for an experiment. We are currently using ab initio simulation to model our experiment's response. Unfortunately, ...
0
votes
1answer
56 views

Why is it easier to construct adversarial examples relative to training neural networks?

I was having looking at this lecture by Ian Goodfellow and my doubt is around 18:00 timestamp where he explains generation of adversarial examples using FGSM. He mentions that the there is a linear ...
0
votes
0answers
49 views

How to compare multiple one-class variational autoencoders?

I have trained multiple one-class vanilla variational autoencoders that each learn the distribution of one class and have the same architecture. The classes are mostly discrete, but there are several ...
0
votes
0answers
21 views

Network structure of generative model for classification

I'm trying to model a generative model for classification problem, especially aiming to solve an imbalanced data problem. However, I couldn't get intuitive understanding for generative classifier in ...
0
votes
0answers
9 views

Given a system state, generate a sequence of state changes that lead to it

These systems are discrete and their state changes are rule based. Example: Given a chess position, generate a series of moves that will lead to it (there may be many, one, or none, but I only need ...
0
votes
2answers
89 views

What is the right way to train a generator in a GAN?

I am not fully understanding how to train a GAN's generator. I have a few questions below, but let me first describe what I am doing. I am using the MNIST dataset. I generate a batch of random images ...
0
votes
0answers
23 views

Finding the energy function given update rule of a single layer non-linear neural network

Consider the network with N neurons, each of which takes a $2 \times k$ input specified by the tuple $(\vec c_t, \vec \theta_t)$ to produce output $\vec{R}_t$ through an update rule on the pairwise ...
0
votes
0answers
290 views

Conditional Variational Autoencoder - NON Image Data

First I would like to expand an issue I've been dealing with way too long: Creating a conditional Variational Autoencoder with continuous variables in non-image data ( more specifically, time series). ...