All Questions

Filter by
Sorted by
Tagged with
0
votes
0answers
5 views

Random forests - are more estimators always better?

I'm learning about more advanced methods of hyperparameter optimization, such as the Bayesian methods in the scikit-optimize package. I noticed that in some ...
-1
votes
0answers
5 views

Negative rewards with Q-learning and FCN networks

I try to train a fully convolutional network (FCN) network with Q-learning that produces pushing actions similar to Zeng18. I added negative rewards in order to complete the task with minimum number ...
0
votes
1answer
8 views

Weights initialization once the Neural Network is trained

I am trying to understand how weights are initialized in a Neural Network using Keras deep learning framework and what happens if I train a Neural Network and then I want to train it again: are the ...
0
votes
1answer
21 views

Why and how can the policy and value iteration methods converge to the OPTIMAL point?

I am reading Reinforcement Learning: An Introduction by Sutton & Barto. According to this textbook, as far as I understood, the authors claim that the policy and value iteration methods converge ...
1
vote
1answer
24 views

How to get GPT-3 to translate a specific word in a sentence?

I just gave GPT-3 the following prompt (in the playground, using text-davinci-001 with default settings): ...
0
votes
0answers
5 views

Has someone studied the predictive improvement of images of irises over the classic iris dataset?

The Iris dataset is a classic dataset for teaching classification or clustering algorithms. The four measurements Sepal length Sepal width Petal length Petal width give a very rough sketch of the ...
0
votes
0answers
5 views

Is this the correct method for how to implement a stratified K fold with grid search SVC?

I'm writing a support vector classifier for a binary class using some toy data. This is the code: ...
-2
votes
0answers
14 views

What should I make for my game? [closed]

I want to make a game based on what an ai tells me, but this is the only ai I can find so can you please tell me what the flipping flip I can do?!
0
votes
0answers
17 views

Margin of a SVM

I am pretty new to the field. So, if this is the wrong place to ask the following question, please let me know. Currently, I am trying to understand the mathematical of SMVs using the textbook '...
0
votes
0answers
7 views

Why is the maximal data path of RNNs $O(logk(n))$

On this video https://www.youtube.com/watch?v=OyFJWRnt_AY at about 1:07:00, complexity and maximal data path for transformers and RNNs is compared. What it says about maximal data path : The maximal ...
0
votes
0answers
5 views

Visualizing entries using backpropagation, deconvnets and guided backpropagation

I recently took a look at this paper: Striving for Simplicity: The All Convolutional Net, introducing some visualization methods to understand a neural network's classification choices. I don't ...
-1
votes
0answers
13 views

How SVM model predict output on the new dataset?

I am using SVM for a binary classification problem. My model accuracy on test data is 87%. The training code is as below: ...
0
votes
0answers
35 views

how to prove that "w will converge to TD fixed point once A is positive definite"

In Reinforcement Learning: An Introduction 2nd edition section 9.4 (p. 206), it says that when we use TD(0) as target and use semi-gradient method to update : In general, $w_t$ will be reduced ...
0
votes
0answers
23 views

Impact of imbalanced dataset on CNN model performance

I trained a 1D CNN model to model bacterial plate count based on time series data of water temperature. Bacterial place count is numerical, based on which I created two category variables, namely &...
-1
votes
1answer
20 views

Simple Polynomial Gradient Descent algorithm not working

I am trying to implement a simple 2nd order polynomial gradient descent algorithm in Java. It is not converging and becomes unstable. How do I fix it? ...
0
votes
1answer
23 views

Why are Directed Graphical Models considered ML methods?

Consider the following problem. The probability of being born in countries [1,2,3,4] is given by [a, b, c, d] respectively. This is a categorical problem. Now, assume that the height of a person ...
0
votes
0answers
24 views

What kind of test verify that we have made Strong AI? [duplicate]

Let's say we invented Strong AI technology, and made robot with it, how can we proove that it is real autonomous artificial creature? We know that with only deep learning technology, it is not ...
0
votes
1answer
21 views

What can I infer if my model is converging extremely fast?

I am running a model with fixed hyperparameters. To my surprise/shock, the model converged extremely fast with the least loss possible. I want to know the causes of this phenomenon. I have the ...
3
votes
1answer
61 views

Why should one focus on spectral operations as a computer vision researcher?

While reading about various types of mathematical operations on tensors, I encountered spectral operations for the first time. The description is as follows (p. 53 of this book) Spectral ops - ...
1
vote
0answers
26 views

Knowledge representation and reasoning(KRR) over a Image scene: Neurosymbolic AI

What are the ways and SOTA in domain of knowledge representation and reasoning over scene. Suppose there are 3 objects in the scene and which objects needs to be picked first among them is governed by ...
0
votes
1answer
15 views

Why is the WMT16 dataset favoured for evaluating machine translation models?

The Workshop on Statistical Machine Translation has released translation challenges each year from 2004 on, which feature a dataset of sentence pairs in a variety of languages. Even though the ...
0
votes
0answers
21 views

When should discretization of observations be considered?

I found some literature regarding the design of action-spaces and that e.g. a discretization of continuous actions in video-game environments can be crucial for successful learning (source: https://...
0
votes
0answers
17 views

Universal function approximation theorem on 10000 different functions

I have a NN which is trying to learn 10,000 different delay functions based on the coordinates of the matrix it exists in (a 100x100 matrix, each cell containing a different function.) By a different ...
0
votes
0answers
21 views

How to calculate the gradient (or derivative) of y = f(x) of y w.r.t x where y represents the order statistics divided by median of x?

How to calculate the gradient (or derivative) of y = f(x) of y w.r.t x where y represents the order statistics divided by median of x? For instance x is ...
0
votes
1answer
25 views

How Come My (D)DQN Fails To Learn?

I am currently trying to teach a (D)DQN algorithm to play a 10x10 GridWorld game, so I can compare the two as I increase the number of moves the agent can take. The rewards are as follows: A step = -1 ...
1
vote
1answer
44 views

Why doesn't the high precision of neural network weights improve accuracy?

Consider the following paragraph from the subsubsection 3.5.2: A dtype for every occasion chapter named It starts with a tensor from the textbook titled Deep Learning with PyTorch by Eli Stevens et al....
-1
votes
0answers
18 views

How to improve an accuracy of filtering unknown people in face recognition?

I'm trying to make some face recognition. I tried different pretrained models from different repositories. They show good recognition accuracy (~90%) when I use them on my dataset. But I also want to ...
0
votes
1answer
27 views

What does it mean by "lazy mean" here?

Consider the following paragraph, taken from 3.4: Named tensors of the textbook named Deep Learning with PyTorch by Eli Stevens, Luca Antiga, Thomas Viehmann, regarding the calculation of mean for RGB ...
1
vote
1answer
46 views

Does AlphaGo play random moves in a real competition?

Alphago and AlphaGo zero use random play to generate data and use the data to train DNN. "Random play" means that there is a positive probability for AlphaGo to play some suboptimal moves ...
0
votes
1answer
51 views

What Past Approaches is the "Taylor Swift" Paper Referring To? [closed]

(My previous question regarded which theorem of probability was equation (2) referring to). This paper mentions that temporal forecasting is meant to solve an integral equation as denoted by (2) (...
-1
votes
0answers
22 views

How to find Action in an Actor Critic Method with infinite possible actions

I am working on an Actor-Critic Method where there are infinite numbers of possible actions (let’s say movement of a robot, where the possible movement is not just left-right-up-down but every ...
0
votes
0answers
21 views

What is the role of the observation in the standard Multi-Armed-Bandit?

I'm trying to understand how to model the environment for a MAB problem. I'm following the TensorFlow tutorial on it. In the Introduction and Environment chapter is stated: agents do not model state ...
0
votes
1answer
17 views

Why does validation accuracy stop rising so soon?

I have implemented a GRU to deal with youtube comment data. I am a bit confused about why the validation score seems to even out around 70% and then keeps rising, this doesn't look like overfitting ...
2
votes
1answer
198 views

Where are the parentheses in the Bellman update rule?

I'm not having a lot of intuition about the equation. I have this Bellman update rule: $$v_{\pi}(s) =\sum_a \pi(a|s)\sum_{s',r} p(s',r|s,a)[r+ \gamma v_{k}(s')]$$ But where are the parenthesis? Is the ...
1
vote
0answers
15 views

How can PPO be combined with HER?

I ask because PPO is apparently an on-policy algorithm & the HER paper says that it can be combine with any off-policy algorithm. Yet I see GitHub projects that have combined them somehow? How is ...
2
votes
0answers
20 views

Minimax evaluation function for games with score instead of loss/draw/win result

I am trying to create minimax evaluation function for the Ms Pacman game. The goal of the player is to maximize score. I have some idea about the features that I would like to use in my evaluation ...
1
vote
0answers
40 views

The results changed even though seed is fixed [closed]

I am using a reinforcement learning model for some tasks. and for the model, I am using stable_baselin3 and for the environment, I am using the gym. I made a small change in the environment and the ...
0
votes
0answers
14 views

LSTM - What kind of data should contain every dimension of input LSTM matrix, where does specific dimension points to?

I am a beginner and I have a hard time understanding inputs and outputs of LSTM. So from the begining, I am trying to create multivariate input&output LSTM for time series forecasting. Thankfully ...
0
votes
0answers
23 views

What I Should Do to Reduce Solution Size for Simulated Annealing Algorithm?

I am trying to find the best solution for radar placement problem with using multi objective simulated annealing algorithm. So there is an area (in real map) and I want to put minimum count of radar ...
-1
votes
0answers
68 views

WGAN-GP loss formulization for pixel-wise

How can I reformulate the GAN loss function WGAN-GP(1) WGAN-GP paper to compute the mean decision over all pixels as below the case of the GAN loss function Vanilla GAN(2). I would like to create a ...
2
votes
1answer
49 views

Reason why chess neural network might not be training

I've been trying to use a Stockfish-like chess evaluation neural network for the past few weeks but to no avail. I wanted to get some other opinions about why my current methods haven't worked. Input: ...
3
votes
1answer
73 views

Are multi agent or self-play environments always automatically POMDPs?

As part of my thesis, I'm working on a zero sum game with RL to train an agent. The game is a real-time game, a derivation of pong, one could imagine playing pong with both sides being foosball rods. ...
1
vote
1answer
25 views

Does a second-order fully-connected layer have any uses?

I was thinking about implementing second-order regression via a fully-connected layer, and I came up with this: $X$ is the input data, shaped $(features, batch\_number)$. $w0$ is the bias, shaped $(...
2
votes
1answer
124 views

Is down-sampling the only purpose of using stride?

Stride is used in at least two operations: convolution and pooling. Both operations can be viewed as applying a kernel function on input using a kernel (filter). Stride determines the amount of "...
0
votes
1answer
39 views

Is there any advantage in viewing weights of a neural network as random variables?

In artificial intelligence, especially in machine learning, the inputs and outputs of neurons in a neural network can be viewed as random variables. And this view is highly useful in many ways. The ...
1
vote
0answers
20 views

Why are the learned offsets of anchor boxes in the RCNN object detection models scale invariant?

In the original RCNN paper (https://arxiv.org/pdf/1311.2524.pdf) and continued in later RCNN papers such as faster RCNN (https://arxiv.org/pdf/1506.01497.pdf) the learned offsets of the anchor boxes ...
1
vote
0answers
9 views

Output representation for a neural network to learn grid-based game with multiple units

I have a round based game played on a grid map with multiple units that I would like to control in some fashion using neural network (NN). All of the units are moved at once. Each unit can move in any ...
0
votes
0answers
23 views

Are these two definitions of regret in RM algorithm equivalent?

(2.1c) on p.1130 of the original paper on regret matching states that $$ D_t^i(j,k) = \frac{1}{t} \sum_{\tau=1}^t \big[ u^i(k,s_\tau^{-j}) - u^i(s_\tau) \big] \;. $$ At the end of page 5 of this ...
0
votes
0answers
20 views

Find companies that offer AI solutions [migrated]

I have a social media app and currently, the feed is simply chronological. I need a personalized recommendation feed like Facebook, Instagram, TikTok, Netflix, Reddit etc. I mean there are many many ...
0
votes
0answers
26 views

How to predict the possible next moves of cars from given first moves?

I want to find the next moves of cars from the previous moves, but I could not figure out what should I use as an algorithm. Can you help me to find a way to solve this problem? I have a lot of car ...

15 30 50 per page
1
2 3 4 5
190