# All Questions

6,580 questions
Filter by
Sorted by
Tagged with
15 views

### What is a example showing that the tree-based variant for the greedy best-first search is incomplete?

I understand that a tree-based variant will have nodes repeatedly added to the frontier. How do I craft an example where a particular goal node is never found. Is this example valid. On the other ...
18 views

### How can I find the similar non-zero connections between different levels of sparsity of the same network?

I am pruning a neural network (CNN and Dense) and for different sparsity levels, I have different sub-networks. Say for sparsity levels of 20%, 40%, 60% and 80%, I have 4 different sub-networks. Now, ...
10 views

### How to install tensorflow-gpu 2.2 with Nvidia George GTX 1650 (notebook) [closed]

I want to know how do we install tensorflow 2.2 GPU version with NVidia GTX 1650 laptop version graphics card on Windows 10. I want to install in anaconda and I am having a trouble in making a new ...
13 views

### How to save and load a Q-Learning Agent [migrated]

I know this may sound nooby, but how do I save a Deep Q-Learning agent's progress? I mean when I close at i.e. episode 500 when my agent is trained and I restart (in my case a pygame) my agent is ...
25 views

### What are the main differences between sparse autoencoders and convolution autoencoders?

What are the main differences and similarities between sparse autoencoders and convolution autoencoders? When should one be preferred over the other? What are their applications? (References are ...
6 views

### VAE generates blue images [migrated]

I'm trying to train a VAE to generates celebA faces. the problem I'm facing is that the model only generates blue faces and I'm not sure why and how to fix it. The encoder: ...
19 views

### How can I increase the exploration in the Proximal Policy Optimation algorithm?

How can I increase the exploration in the Proximal Policy Optimation reinforcement learning algorithm? Is there a variable assigned for this purpose? I'm using the stable-baseline implementation: ...
56 views

25 views

### What are mono-variable and multi-variable neural networks?

In this document, the terms "Redes Neuronales estáticas monovariables" and "Redes Neuronales estáticas multivariables" are mentioned. What are mono-variable and multi-variable neural networks? Is it ...
28 views

### Can I find a mapping that minimizes the maximum distance ratio of certain vectors?

Let's say we have several vector points. My goal is to distinguish the vectors, so I want to make them far from each other. Some of them are already far from each other, but some of them can be ...
18 views

### How do we choose the filters for the convolutional layer of a convolution neural network?

Since the hidden layers of a CNN work as a trainable feature extractor, more detailed content based on a larger number of pixels shall require bigger filter sizes. But for cases where localized ...
66 views

### How do I derive the gradient with respect to the parameters of the softmax policy?

The gradient of the softmax eligibility trace is given by the following: \begin{align} \nabla_{\theta} \log(\pi_{\theta}(a|s)) &= \phi(s,a) - \mathbb E[\phi (s, \cdot)]\\ &= \phi(s,a) - \sum_{...
30 views

### If agent chooses an action that the environment can't operate, how should I handle this situation?

I'm building a really simple experiment, letting an agent move from the bottom-left corner to the upper-right corner on a 3x3 squared paper. I plan to use DQN to do this. I'm having trouble handling ...
16 views

### Can you use transformer models to do autocomplete tasks?

I've researched online and seen many papers on the use of RNNs (like LSTMs or GRUs) to autocomplete for, say, a search engine, character by character. Which makes sense since it inherently predicts ...
18 views

### Is there any published research on the information-carrying capacity of the human face?

Is there any published research on the information-carrying capacity of the human face? Here I mean "how much information can be conveyed via facial expressions & micro-expressions". This is a ...
16 views

### How can feedforward neural networks act as contraction maps?

In graph neural networks, the Banach fixed-point theorem and Jacobi method it is described that the transition from one state to another be defined by a contraction map with a fixed-point. The autor ...
44 views

### How does the repetition of features across states at different time steps affect learning?

Let's say you are training a neural network in an RL setting, where the state (i.e. features/input data) can be the same for multiple successive steps (~typically around 8 steps) of an episode. For ...
16 views

### How does sampling works in case of imbalanced image datasets?

I am solving a problem of image classification of the image dataset for 3 classes. Dataset is highly imbalanced. How will sampling (either over- or under-sampling) work in that case? Should I remove (...
8 views

### How do CNNs or RNNs “stack the feature of nodes by a specific order”?

I am trying to understand the following statement taken from the paper Graph Neural Networks: A Review of Methods and Applications (2019). Standard neural networks like CNNs and RNNs cannot handle ...
91 views

### What is the difference between a Bayesian Network and a Markov Chain?

I am trying to understand the difference between a Bayesian Network and a Markov Chain. When I search for this one the web, the unanimous solution seems to be that a Bayesian Network is directional (...
31 views

### How do you manage negative rewards in policy gradient reinforcement learning?

The same basic question here, but 3 years old and no definitive answer: Negative reward (penalty) in policy gradient reinforcement learning The question is, if I'm doing policy gradient in keras, ...
56 views

### What is the difference between on-policy and off-policy for continuous environments?

I'm trying to understand RL applied to time series (so with infinite horizon) which have a continous state space and a discrete action space. First, some preliminary questions: in this case, what is ...
11 views

### Methods in training models to minimize distance between statistical summaries of data and samples from model, to get a better approximation function

Introduction: A big problem with deep learning methods involving neural networks is that they tend to do really poorly outside the boundaries of the approximation it has learned from the data it is ...
17 views

### Does the concept of validation loss apply to training deep Q networks?

In deep learning, the concept of validation loss is to ensure that the model being trained is not currently overfitting the data. Is there a similar concept of overfitting in deep q learning? Given ...