Questions tagged [generative-model]
For questions related to the concept of generative machine learning models, such as the Restricted Boltzmann Machine (RBM), the Variational Autoencoder (VAE), and the Generative Adversarial Network (GAN).
97
questions
0
votes
0answers
10 views
Can Dynamical Variational Auto-encoders be trained on and used to generate static 2D images?
Is it possible to train dynamical variational autoencoders, such as Kalman Variational Autoencoders (KVAE), Recurrent Variational Autoencoders (RVAE), or Disentangled Sequential Autoencoders (DSAE) on ...
1
vote
0answers
25 views
Generative systems based on Schmidhuber's compression framework
In Driven by Compression Progress:
A Simple Principle Explains Essential Aspects of
Subjective Beauty, Novelty, Surprise,
Interestingness, Attention, Curiosity, Creativity,
Art, Science, Music, Jokes ...
0
votes
0answers
14 views
Could current AI models reimagine Star Trek Enterprise to depict space & celestial bodies in the grandiose, astounding style of Nolan's Interstellar?
Post-Interstellar, my aptitude shifted in terms of sci-fi. I no longer can enjoy excessively speculative, unfounded predominantly fantasy subordinately scientific story telling, and imagery. I used to ...
0
votes
0answers
27 views
What is the best way to generate handwritten text documents?
I am new to generative models. I was wondering if it would be better to generate an image of a handwritten text document as a whole (which I don't know how exactly is done), or first generate ...
0
votes
0answers
27 views
Why batch normalization before upsampling is giving worse results?
I am training a model to generate images.
The model contains 5+5 layers:
...
1
vote
0answers
61 views
How to estimate conditional density using neural network?
Conditional Variational Autoencoders (CVAE) and Mixture Density Networks (MDN) are supposed to address this issue. However, these models provide the distribution parameters, e.g., mean and standard ...
1
vote
1answer
104 views
How does the VAE learn a joint distribution?
I found the following paragraph from An Introduction to
Variational Autoencoders sounds relevant, but I am not fully understanding it.
A VAE learns stochastic mappings between an observed $\mathbf{x}$...
3
votes
1answer
66 views
What are the roles of the prior $\mathrm{p}(\mathbf{z})$ in a VAE?
I know the encoder is variational posterior $q_{\phi}(\mathbf{z} \mid \mathbf{x})$.
I also know that the decoder represents the likelihood:
$p_{\theta}(\mathbf{x} \mid \mathbf{z})$.
My question is ...
3
votes
1answer
71 views
How to determine the quality of synthetic data?
I'm working on a VAE model to produce synthetic data of X-Ray diffraction spectrums.
I try to figure out how I can measure the quality of the spectrums. The goal would be to produce synthetic data ...
0
votes
0answers
86 views
Discrepencies between the TimeGan paper and the code?
I recently read the paper Time-Series Generative Neural Networks and found the results that they reported quite promising (https://proceedings.neurips.cc/paper/2019/file/...
2
votes
1answer
44 views
What is the fundamental difference between the synthesis task and sampling task?
Among the list of tasks in machine learning, synthesis and sampling is one of the key task. Consider the following explanation regarding synthesis and sampling task from Chapter 5: Machine Learning ...
0
votes
0answers
12 views
Are ranking models considered discriminative?
I'm developing a model that ranks entries based on cosine similarity to a query. Since it doesn't actually define a boundary between x and y I initially believed that such ranking models are not ...
0
votes
0answers
24 views
Types of decoder parametrizations in VAE for continuous data
I'm wondering what are the different choices of parametrizations available for the decoder in a variational autoencoder. If the data is discrete, you can just output probabilities for each class, so ...
0
votes
1answer
29 views
Is the range of inception score flexible or bounded based on number of classes?
Inception score is used to evaluate the generative models. It is a score given based on quality and diversity of images generated.
I have doubt about the range of inception score because of the reason ...
1
vote
1answer
44 views
Is image generation not existent before generative adversarial networks?
Although the GAN is widely used due to its capability, there were generative models before the GAN which are based on probabilistic graphical models such as Bayesian networks, Markov networks, etc.
It ...
0
votes
1answer
55 views
Is it possible to use deep learning to generate a 2D image from a few numerical values?
Is it possible to train a DL model that will generate a full resolution 2D image based on few numbers describing this image and what type of model or architecture would that be?
What I want to ...
2
votes
1answer
44 views
Book(s) on generative models
Generative models in artificial intelligence span from simple models like Naive Bayes to the advanced deep generative models like current day GANs. This question is not about coding and involves only ...
0
votes
0answers
15 views
What approaches are there to generate complex structures like syntactic trees?
What approaches are there to generate and evaluate complex structures like, let's say, syntactically correct code? I know the approach of Genetic Programming (GP) as a type of Evolutionary Algorithm, ...
2
votes
1answer
54 views
What is the state of the art in melody generation?
Generative Adversarial Networks can generate realistic photos of people, such as thispersondoesnotexist.com. I wonder whether one can train an artificial intelligence on a batch of plain solo melodies ...
0
votes
0answers
23 views
GAN - relation of input size and hidden layer size
I'm adapting a GAN described here used for generating binary output. It's trained on binarized MNIST data, with a size of 28x28 so 784 values. I want to adapt it to train on and generate 1D vectors ...
1
vote
0answers
24 views
Necessity of likelihood in training energy-based models
Lately, I've been getting into energy-based models (EBMs) through some of Yann LeCun's recent talks, where he advocates the use of non-normalized models because it allows for more flexibility in the ...
5
votes
0answers
44 views
Are generative models actually used in practice for industrial drug design?
I just finished reading this paper MoFlow: An Invertible Flow Model for Generating Molecular Graphs.
The paper, which is about generating molecular graphs with certain chemical properties improved the ...
0
votes
1answer
72 views
Decision boundary figure in Least square GAN paper
I currently reading Least Square GAN paper. But, I cannot interpret one of its figures. .
Explanation of the figure goes like this:
Figure 1: Illustration of different behaviors of two loss functions....
0
votes
0answers
103 views
Are there any good tutorials on using continuous normalizing flows (with PyTorch)?
I just have a very general question. Are there any good tutorials on using continuous normalizing flows? I'd say I have a decent understanding of normalizing flows, but not their continuous variant. I'...
0
votes
0answers
18 views
Why do the inception score and the Fréchet inception distance use the inception network and not another network?
So I was researching about the evaluation of GANs and found these two metrics which seem to be the most popular. I understand that the main ideia is to apply the data to a pre-trained network in order ...
2
votes
1answer
70 views
Would it be possible to determine the dataset a neural network was trained on?
Let's say we have a neural network that was trained with a dataset $D$ to solve some task. Would it be possible to "reverse-engineer" this neural network and get a vague idea of the dataset $...
3
votes
2answers
186 views
Where is the mistake in my derivation of the GAN loss function?
I was pondering on the loss function of GAN, and the following thing turned out
\begin{aligned}
L(D, G)
& = \mathbb{E}_{x \sim p_{r}(x)} [\log D(x)] + \mathbb{E}_{x \sim p_g(x)} [\log(1 - D(x)] \...
1
vote
1answer
214 views
Optimum Discriminator for label smoothed GAN
I was reading the paper called Improved Techniques for Training GANs. And, in the one-sided label smoothing part, they said that optimum discriminator with label smoothing is
$$ D^*(x)=\frac{\alpha \...
0
votes
1answer
80 views
Why is it easier to construct adversarial examples relative to training neural networks?
I was having looking at this lecture by Ian Goodfellow and my doubt is around 18:00 timestamp where he explains generation of adversarial examples using FGSM.
He mentions that the there is a linear ...
2
votes
0answers
105 views
Generating fake faces containing specific features with GANs
I'm trying to understand how DeepFakes are generated and so far I understood that they're mostly generated through the usage of GANs and autoencoders.
The autoencoders part is understandable, but what ...
1
vote
0answers
64 views
How does NN follows law of energy conservation?
Communication requires energy, and using energy requires communication. According to Shannon, the entropy value of a piece of information provides an absolute limit on the shortest possible average ...
3
votes
1answer
66 views
How to define loss function for Discriminator in GANs?
To train the discriminator network in GANs we set the label for the true samples as $1$ and $0$ for fake ones. Then we use binary cross-entropy loss for training.
Since we set the label $1$ for true ...
0
votes
2answers
153 views
What is the right way to train a generator in a GAN?
I am not fully understanding how to train a GAN's generator. I have a few questions below, but let me first describe what I am doing.
I am using the MNIST dataset.
I generate a batch of random images ...
1
vote
1answer
112 views
Is it legal to license and sell the output of a neural network that was trained on data that you don't own the license to?
Is it legal to license and sell the output of a neural network that was trained on data that you don't own the license to? For example, suppose you trained WaveNet on a collection of popular music. ...
1
vote
1answer
68 views
What is meant by degrees of freedom of latent variables?
...Designing such a likelihood function is typically challenging; however, we observe that features like spectrogram are effective when latent variables have limited degrees of freedom. This motivates ...
1
vote
0answers
36 views
Concrete example of how transposed convolutions are able to *add* features to an image
Say we have a simple gray scale image. If we use a filter which is just the 3x3 identity matrix (or more pointedly the identity matrix but with -1 instead of the 0 entries), it is fairly easy to see ...
1
vote
1answer
61 views
Is GAIL applicable if the expert's trajectories are for the same task but are in a different environment?
Is the GAIL applicable if the expert's trajectories (sample data) are for the same task but are in a different environment (modified but will not be completely different)?
My gut feeling is, yes, ...
0
votes
2answers
88 views
How to combine several chatbots into one?
I'm in the middle of a project in which I want to generate a TV series script (characters answering to each other, scene by scene) using SOTA models, and I need some guidance to simplify my ...
1
vote
0answers
41 views
How do I sample conditionally from deep belief networks?
Deep belief networks (DBNs) are generative models, where, usually, you sample by thermalising the deepest layer (as it's a restricted Boltzmann machine), and then forward propagating a sample towards ...
2
votes
0answers
23 views
Why do hypercube latent spaces perform poorer than Gaussian latent spaces in generative neural networks?
I have a quick question regarding the use of different latent spaces to represent a distribution. Why is it that a Gaussian is usually used to represent the latent space of the generative model ...
1
vote
1answer
40 views
Why is this variable in equation 2 of the SQAIR paper a random vector of $n$ ones followed by a zero?
I've been reading the SQAIR paper lately, and the mathematics involved seems a bit complicated.
Some background, about the paper: SQAIR stands for Sequential Attend, Infer, Repeat - the paper does ...
1
vote
0answers
18 views
Using DCGAN on a (very small) dataset of art
I am developing a DCGAN using the this tutorial in PyCharm. As my usage of this tutorial suggests, I am quite new to DCGANs as I've previously only had a few experiences with machine learning ...
2
votes
0answers
75 views
Do I have to downsample the input and upsample the output of the neural network when implementing the NICE algorithm?
Consider that my input is an RGB image. The size of my image is $N\times N$. I'm trying to implement NICE algorithm presented by Dinh. The bijective function $f: \mathbb{R}^d \to \mathbb{R}^d$ maps $X$...
3
votes
0answers
32 views
Is there any way of generating fixed-length sequences with RNNs?
Is there any way of generating fixed-length sequences with RNNs? I want to tell my character level RNN to generate a name of length 3, 4, 5 and so on. I haven't found anything online like this, but my ...
2
votes
0answers
50 views
Should the RL agent be trained in an environment with real-world data or with a synthetic model?
I want to train a reinforcement learning agent in an environment with parameters (for example, the wind speed, sun irradiation, etc.) that change over time. I have recorded a limited amount of data ...
2
votes
1answer
60 views
GANs: Should Generator update weights when Discriminator says false continuously
My GANs is like this:
Train an autoencoder (VAE), get the decoder part and use as Generator
Train Discriminator
After training, do the generation in these steps:
Call Generator to generate an image
...
2
votes
0answers
40 views
Suggestion on image inpainting algorithm
Currently, many algorithms are available for image inpainting. In my application, I have some special restriction on training dataset-
Let's consider the training dataset of human facial images.
...
1
vote
0answers
30 views
Which generative methods are better for generating graphs, while preserving node and edge labels?
I started to dig into the topic of graph generation and I have a question - which out of generative methods (autoregressive, variational autoencoders, GANs, any other?) are better for generating ...
2
votes
2answers
97 views
Is it feasible to use GAN for high-quality image synthesis other than human faces?
The famous Nvidia paper Progressive Growing of GANs for Improved Quality, Stability, and Variation, the GAN can generate hyperrealistic human faces. But, in the very same paper, images of other ...
3
votes
0answers
68 views
Creating an AI than can learn to give instructions
So we think a computer is dumb because it can only follow instructions. Therefor I am trying to create an AI that can give instructions.
The idea is this: Create a geometric scene (A) then make a ...
