# All Questions

9,488 questions
Filter by
Sorted by
Tagged with
5 views

### Random forests - are more estimators always better?

I'm learning about more advanced methods of hyperparameter optimization, such as the Bayesian methods in the scikit-optimize package. I noticed that in some ...
5 views

### Negative rewards with Q-learning and FCN networks

I try to train a fully convolutional network (FCN) network with Q-learning that produces pushing actions similar to Zeng18. I added negative rewards in order to complete the task with minimum number ...
8 views

### Weights initialization once the Neural Network is trained

I am trying to understand how weights are initialized in a Neural Network using Keras deep learning framework and what happens if I train a Neural Network and then I want to train it again: are the ...
21 views

### Why and how can the policy and value iteration methods converge to the OPTIMAL point?

I am reading Reinforcement Learning: An Introduction by Sutton & Barto. According to this textbook, as far as I understood, the authors claim that the policy and value iteration methods converge ...
24 views

### How to get GPT-3 to translate a specific word in a sentence?

I just gave GPT-3 the following prompt (in the playground, using text-davinci-001 with default settings): ...
5 views

### Has someone studied the predictive improvement of images of irises over the classic iris dataset?

The Iris dataset is a classic dataset for teaching classification or clustering algorithms. The four measurements Sepal length Sepal width Petal length Petal width give a very rough sketch of the ...
5 views

### Is this the correct method for how to implement a stratified K fold with grid search SVC?

I'm writing a support vector classifier for a binary class using some toy data. This is the code: ...
14 views

### What should I make for my game? [closed]

I want to make a game based on what an ai tells me, but this is the only ai I can find so can you please tell me what the flipping flip I can do?!
17 views

### Margin of a SVM

I am pretty new to the field. So, if this is the wrong place to ask the following question, please let me know. Currently, I am trying to understand the mathematical of SMVs using the textbook '...
7 views

### Why is the maximal data path of RNNs $O(logk(n))$

On this video https://www.youtube.com/watch?v=OyFJWRnt_AY at about 1:07:00, complexity and maximal data path for transformers and RNNs is compared. What it says about maximal data path : The maximal ...
5 views

### Visualizing entries using backpropagation, deconvnets and guided backpropagation

I recently took a look at this paper: Striving for Simplicity: The All Convolutional Net, introducing some visualization methods to understand a neural network's classification choices. I don't ...
13 views

### How SVM model predict output on the new dataset?

I am using SVM for a binary classification problem. My model accuracy on test data is 87%. The training code is as below: ...
35 views

### how to prove that "w will converge to TD fixed point once A is positive definite"

In Reinforcement Learning: An Introduction 2nd edition section 9.4 (p. 206), it says that when we use TD(0) as target and use semi-gradient method to update : In general, $w_t$ will be reduced ...
23 views

### Impact of imbalanced dataset on CNN model performance

I trained a 1D CNN model to model bacterial plate count based on time series data of water temperature. Bacterial place count is numerical, based on which I created two category variables, namely &...
20 views

### Simple Polynomial Gradient Descent algorithm not working

I am trying to implement a simple 2nd order polynomial gradient descent algorithm in Java. It is not converging and becomes unstable. How do I fix it? ...
23 views

### Why are Directed Graphical Models considered ML methods?

Consider the following problem. The probability of being born in countries [1,2,3,4] is given by [a, b, c, d] respectively. This is a categorical problem. Now, assume that the height of a person ...
24 views

### What kind of test verify that we have made Strong AI? [duplicate]

Let's say we invented Strong AI technology, and made robot with it, how can we proove that it is real autonomous artificial creature? We know that with only deep learning technology, it is not ...
21 views

### What can I infer if my model is converging extremely fast?

I am running a model with fixed hyperparameters. To my surprise/shock, the model converged extremely fast with the least loss possible. I want to know the causes of this phenomenon. I have the ...
61 views

### Why should one focus on spectral operations as a computer vision researcher?

While reading about various types of mathematical operations on tensors, I encountered spectral operations for the first time. The description is as follows (p. 53 of this book) Spectral ops - ...
26 views

### Knowledge representation and reasoning(KRR) over a Image scene: Neurosymbolic AI

What are the ways and SOTA in domain of knowledge representation and reasoning over scene. Suppose there are 3 objects in the scene and which objects needs to be picked first among them is governed by ...
15 views

### Why is the WMT16 dataset favoured for evaluating machine translation models?

The Workshop on Statistical Machine Translation has released translation challenges each year from 2004 on, which feature a dataset of sentence pairs in a variety of languages. Even though the ...
21 views

### When should discretization of observations be considered?

I found some literature regarding the design of action-spaces and that e.g. a discretization of continuous actions in video-game environments can be crucial for successful learning (source: https://...
17 views

### Universal function approximation theorem on 10000 different functions

I have a NN which is trying to learn 10,000 different delay functions based on the coordinates of the matrix it exists in (a 100x100 matrix, each cell containing a different function.) By a different ...
21 views

### How to calculate the gradient (or derivative) of y = f(x) of y w.r.t x where y represents the order statistics divided by median of x?

How to calculate the gradient (or derivative) of y = f(x) of y w.r.t x where y represents the order statistics divided by median of x? For instance x is ...
25 views

### How Come My (D)DQN Fails To Learn?

I am currently trying to teach a (D)DQN algorithm to play a 10x10 GridWorld game, so I can compare the two as I increase the number of moves the agent can take. The rewards are as follows: A step = -1 ...
44 views

### Why doesn't the high precision of neural network weights improve accuracy?

Consider the following paragraph from the subsubsection 3.5.2: A dtype for every occasion chapter named It starts with a tensor from the textbook titled Deep Learning with PyTorch by Eli Stevens et al....
18 views

### How to improve an accuracy of filtering unknown people in face recognition?

I'm trying to make some face recognition. I tried different pretrained models from different repositories. They show good recognition accuracy (~90%) when I use them on my dataset. But I also want to ...
27 views

### What does it mean by "lazy mean" here?

Consider the following paragraph, taken from 3.4: Named tensors of the textbook named Deep Learning with PyTorch by Eli Stevens, Luca Antiga, Thomas Viehmann, regarding the calculation of mean for RGB ...
46 views

### Does AlphaGo play random moves in a real competition?

Alphago and AlphaGo zero use random play to generate data and use the data to train DNN. "Random play" means that there is a positive probability for AlphaGo to play some suboptimal moves ...
51 views

### What Past Approaches is the "Taylor Swift" Paper Referring To? [closed]

(My previous question regarded which theorem of probability was equation (2) referring to). This paper mentions that temporal forecasting is meant to solve an integral equation as denoted by (2) (...
22 views

### How to find Action in an Actor Critic Method with infinite possible actions

I am working on an Actor-Critic Method where there are infinite numbers of possible actions (let’s say movement of a robot, where the possible movement is not just left-right-up-down but every ...
21 views

### What is the role of the observation in the standard Multi-Armed-Bandit?

I'm trying to understand how to model the environment for a MAB problem. I'm following the TensorFlow tutorial on it. In the Introduction and Environment chapter is stated: agents do not model state ...
17 views

### Why does validation accuracy stop rising so soon?

I have implemented a GRU to deal with youtube comment data. I am a bit confused about why the validation score seems to even out around 70% and then keeps rising, this doesn't look like overfitting ...
198 views

### Where are the parentheses in the Bellman update rule?

I'm not having a lot of intuition about the equation. I have this Bellman update rule: $$v_{\pi}(s) =\sum_a \pi(a|s)\sum_{s',r} p(s',r|s,a)[r+ \gamma v_{k}(s')]$$ But where are the parenthesis? Is the ...
15 views

### How can PPO be combined with HER?

I ask because PPO is apparently an on-policy algorithm & the HER paper says that it can be combine with any off-policy algorithm. Yet I see GitHub projects that have combined them somehow? How is ...
20 views

### Minimax evaluation function for games with score instead of loss/draw/win result

I am trying to create minimax evaluation function for the Ms Pacman game. The goal of the player is to maximize score. I have some idea about the features that I would like to use in my evaluation ...
40 views

### The results changed even though seed is fixed [closed]

I am using a reinforcement learning model for some tasks. and for the model, I am using stable_baselin3 and for the environment, I am using the gym. I made a small change in the environment and the ...
14 views

### LSTM - What kind of data should contain every dimension of input LSTM matrix, where does specific dimension points to?

I am a beginner and I have a hard time understanding inputs and outputs of LSTM. So from the begining, I am trying to create multivariate input&output LSTM for time series forecasting. Thankfully ...
23 views

### What I Should Do to Reduce Solution Size for Simulated Annealing Algorithm?

I am trying to find the best solution for radar placement problem with using multi objective simulated annealing algorithm. So there is an area (in real map) and I want to put minimum count of radar ...
68 views

### WGAN-GP loss formulization for pixel-wise

How can I reformulate the GAN loss function WGAN-GP(1) WGAN-GP paper to compute the mean decision over all pixels as below the case of the GAN loss function Vanilla GAN(2). I would like to create a ...
49 views

### Reason why chess neural network might not be training

I've been trying to use a Stockfish-like chess evaluation neural network for the past few weeks but to no avail. I wanted to get some other opinions about why my current methods haven't worked. Input: ...
73 views

### Are multi agent or self-play environments always automatically POMDPs?

As part of my thesis, I'm working on a zero sum game with RL to train an agent. The game is a real-time game, a derivation of pong, one could imagine playing pong with both sides being foosball rods. ...
25 views

### Does a second-order fully-connected layer have any uses?

I was thinking about implementing second-order regression via a fully-connected layer, and I came up with this: $X$ is the input data, shaped $(features, batch\_number)$. $w0$ is the bias, shaped \$(...
124 views

### Is down-sampling the only purpose of using stride?

Stride is used in at least two operations: convolution and pooling. Both operations can be viewed as applying a kernel function on input using a kernel (filter). Stride determines the amount of "...
39 views

### Is there any advantage in viewing weights of a neural network as random variables?

In artificial intelligence, especially in machine learning, the inputs and outputs of neurons in a neural network can be viewed as random variables. And this view is highly useful in many ways. The ...
20 views

### Why are the learned offsets of anchor boxes in the RCNN object detection models scale invariant?

In the original RCNN paper (https://arxiv.org/pdf/1311.2524.pdf) and continued in later RCNN papers such as faster RCNN (https://arxiv.org/pdf/1506.01497.pdf) the learned offsets of the anchor boxes ...
9 views

### Output representation for a neural network to learn grid-based game with multiple units

I have a round based game played on a grid map with multiple units that I would like to control in some fashion using neural network (NN). All of the units are moved at once. Each unit can move in any ...
23 views

### Are these two definitions of regret in RM algorithm equivalent?

(2.1c) on p.1130 of the original paper on regret matching states that $$D_t^i(j,k) = \frac{1}{t} \sum_{\tau=1}^t \big[ u^i(k,s_\tau^{-j}) - u^i(s_\tau) \big] \;.$$ At the end of page 5 of this ...