# All Questions

10,201 questions
Filter by
Sorted by
Tagged with
255 views

### How did the OpenAI 5 for Dota concatenate units?

I am no expert in the field of AI so I apologize if this is a simple/easy question. I was trying to implement a network similar to OpenAI's for another game and I noticed that I did not fully ...
1 vote
9 views

### When do you know that your neural network is learning something when metrics are garbage?

When training a neural network for binary classification on highly imbalanced set its training loss decreases however validation loss increase and even though accuracy is very high(due to highly ...
6 views

### Learning an identity function with convolutional networks

I am trying to train networks to achieve what I expected to be a trivial task: learn the identity mapping. However, this is very hard to achieve, and the optimization is hard. Moreover, I don't want ...
19 views

### Choice of LSTM for price prediction

I have a dataset with features (f) for different stocks (S) and want to infer for price using an LSTM model. Here is my df: year S1_price S1_f1 S1_f2 S2_price S2_f1 S2_f2 Sn_price Sn_f1 Sn_f2 2010 ...
14 views

### How can I estimate how long it will take to train a model with P params on D data points?

How can I estimate how long it will take to train a model with P params on D data points? Assuming my GPU can do T teraflops, and I have a neural network with P params, which I wish to train on D data ...
66 views

### How do we make our outputs to have the same size as the true mask?

When we are doing multi-label segmentation tasks, our y_true (the mask) will be (w, h, 3), but, in our model, at the last layer, ...
1 vote
11 views

### How to use NN to generate a model which produces given distributions?

For a non-Markovian random walk, each step can go up or down. And for the $n-th$ step, its step size $s(n)$ may depend on the path of walk, and the probability for going up or down may also depend on ...
1 vote
27 views

### What does "All store and access operations (for S(t) , A(t), and R(t)) can take their index mod n + 1" mean?

It's from the book Introduction to Reinforcement Learning. Second edition, chapter7: n-step Bootstrapping, page 147, n-step Sarsa. I made the algo work, but I still don't understand the phrase. ...
8 views

### Selecting neural network architecture for battery degradation problem

I want to design a neural network capable of detecting the degradation of the capacity of a battery. When the capacity is ok, the battery performs like this (x axis is the time in seconds and y axis ...
1 vote
22 views

### Why do we subtract logsumexp from the outputs of this neural network?

I'm trying to understand this tutorial for Jax. Here's an excerpt. It's for a neural net that is designed to classify MNIST images: ...
39 views

### Why does REINFORCE perform badly at first in Sutton and Barto Figure 13.1?

In Sutton and Barto, 2nd edition, Figure 13.1 applies REINFORCE to the "short corridor with switched actions" environment from Example 13.1. The figure looks like this: My question is, why ...
25 views

### Is AI deductive or inductive [closed]

Is data science, AI( machine learning, deep learning) deductive reasoning or inductive reasoning. What I am I asking is that do AI predict(regression/classification) from a premise/hypothesis or it ...
165 views

### What YOLO algorithm can I use for images with noise as I will implement it in real time?

I want to detect drivers with or without seatbelts at crossroads. For that, as it is real-time, I am going to use the YOLO algorithm/model. For training data sets (the images) I need to collect, I ...
683 views

### When training a CNN, what are the hyperparameters to tune first?

I am training a convolutional neural network for object detection. Apart from the learning rate, what are the other hyperparameters that I should tune? And in what order of importance? Besides, I read ...
1 vote
9 views

### Can boundary value problems be solved with feedforward neural networks?

I'm a mathematician by profession, but recently took an interest in neural networks due to their apparent capacity to solve problems related to my field. I've just built my first neural network in ...
1 vote
76 views

### Are there fundamental learning theories for developing an AI that imitates human behavior?

Most, if not all, AI systems do not imitate humans. Some of them out-perform humans. Examples include using AI to play a game, classification problems, auto-driving, and goal-oriented chatbots. Those ...
11 views

### Can YOLOv3 architecture be clearly separated into feature extractor and classifier parts?

I am new to machine learning and am confused about whether its architecture has clearly defined boundaries which demarcate the feature extraction and classification part. Or is it that it classifies ...
22 views

### Using linear regression for classification

I know experienced people may get annoyed by this question but I haven't found a good answer after pushing quite a bit. Say that we want to binary-classify images where normally - in the simplest case ...
31 views

### Autoencoders: Where does the encoder end and the decoder begin?

Consider a simple Autoencoder neural net: ...
159 views

### Why do I get small probabilities when implementing a multinomial naive Bayes text classification model?

When applying multinomial Naive Bayes text classification, I get very small probabilities (around $10e^{-48}$), so there's no way for me to know which classes are valid predictions and which ones are ...
162 views

### Understanding proof of lemma 1 (policy improvement bound) of the "Trust Region Policy Optimization" paper

In the Trust Region Policy Optimization paper, in Lemma 1 of Appendix A, I did not quite understand the transition from (21) from (20). In going from (20) to (21), $A^\pi(s_t, a_t)$ is substituted ...
20 views

### Can you show me my future success? [closed]

I've been struggling alot with understanding what is meant for me because I cannot see it. Alot of spiritual facts say that I am meant for greatness but I find it hard to perceive what is being said ...
92 views

### How does backpropagation know which weights to change?

I'm currently working on constructing a neural network from scratch (in JavaScript). I'm in the middle of working on the backpropagation, but there's something I don't understand: how does the ...
1 vote
33 views

### Can RL still learn if part of my actions are only used once, at the beginning of the episode?

I am working in an environment with 3-dimensional action space. The first two actions are only used at the first timestep and never again. The third action is used at every timestep. Say, the action ...
71 views

### Can I flip a video to generate more data for action recognition?

There are 8 distinct action classes and around 50+ videos per class. I was wondering if flipping videos from the training set can be a good option to generate additional data. Is it?
25 views

### Can I ignore duplicate records of dataset for training?

I have a a dataset that most of records and their corresponding labels are the same and only timestamp of each records is different from other record. If I ignore duplicate records in for training ...
10 views

### Control variables and cofounding effects in stochastic programming/,model predictive control/reinforcement learning

How can we be sure that confounding variables/control variables don’t pickup the effect our decisions w.r.t decision variables had on the actual control variable? Since the term control variable ...
33 views

### Darknet as a part of Yolo v3

I am pretty new to ML and my question may look strange. Especially the last part of it. 1)As far as I understand Darknet53 is an integral part of Yolo just as Resnet50 is a part of R-CNN Am I right? 2)...
20 views

### combine two features in dataset?

I have a data set contains the number of security gaps and the level of that gap for a specific website. Now suppose I have 2 features in this data set, the first feature is the number of a specific ...
18 views

### Binary Classification Model Comparison - Interpretation of Training, Test and Validation Set Performance

I am looking for some advice regarding the best choice of binary classification model based on training, validation and test set results. Model 1 (results in 1st image) shows better test set results ...
16 views

### Storing training dataset in a platform like mlflow

I am pretty new to Machine learning and would like to know whether there are experiment management platforms that also allow storing and managing training datasets (images, in my case). I am familiar ...
20 views

### ImageNet Dataset (for PyTorch VGG16 training)

Please can someone describe how to properly obtain the ImageNet dataset (to be precise the ImageNet 2012 Classification Dataset). What I attempted so far The ImageNet webpage refers the user to ...
293 views

### Why isn't the loss of my neural network reduced after 2500 iterations?

I have developed a basic feedforward neural network from scratch to classify whether image is of cat or not cat. It works fine, but after 2500 iterations, my cost function is not reducing properly. ...
14 views

### What is the "attack success rate" of an Adversarial Attack?

For a typical adversarial attack, a sample $x_{0}$ is chosen from a training set belonging to class $C_{i}$ and a transformation $A$ is applied such that the adversarial example $x=A(x_{0})$ would be ...
152 views

### Validation accuracy higher than training accurarcy

I implemented the unet in TensorFlow for the segmentation of MRI images of the thigh. I noticed I always get a higher validation accuracy by a small gap, independently of the initial split. One ...
482 views

### Could the normalisation of the inputs make the neural network insensitive to changes in the inputs?

When using neural networks (NNs), we often normalized the inputs. I think this is done to equally capture the changes in any input feature, that is, if any feature takes huge values and other features ...
108 views

### How can I model this problem of delivering assets by choosing a route with reinforcement learning?

I would like to build a model based on reinforcement learning (RL) for the following scenario Recommend the best route (of cities listed for a given country) that satisfies the required criteria (...
37 views

### Why do I have social anxiety? [closed]

I've had social anxiety for 10 years. I don't know why I feel this way. I've tried communicating with people. I've tried talking more. I've tried smiling a lot. But I can't stop faking until I'm alone ...
175 views

### How can I implement the reward function for an 8-DOF robot arm with TRPO?

I need to get an 8-DOF (degrees of freedom) robot arm to move a specified point. I need to implement the TRPO RL code using OpenAI gym. I already have the gazebo environment. But I am unsure of how to ...
17 views

### In the Policy Gradient Theorem proof, why is $d^\pi(s) = \sum_{k=0}^{\infty}\gamma^{k}Pr(s_0 \rightarrow s, k, \pi)$ true?

I was reading the original Policy Gradient Paper. I didn't quiet get the last step of the proof for the policy gradient theorem. The proof given in the paper is below: I don't understand how the last ...
61 views

### Avoid unintentional "merging" in cluttered object detection

I have a problem that has bothered me quite some time. With modern methods object detectors can often be accurately trained, even with small to medium sized datasets. However, there is one thing where ...
145 views

### How much labelling is required for NER with SpaCy?

I have transaction data and I would like to extract the merchant from the transaction description. I am new to this but I just came across Named Entity Recognition and SpaCy. I have hundreds of ...
10 views

### How can i combine xgboost with adaboost? [closed]

I have combined random forest with adaboost as clf = AdaBoostClassifier(n_estimators=10, base_estimator=RandomForestClassifier(n_estimators=10,max_depth=20)) ...
1 vote
15 views

### Why does importance sampling work with latent variable models?

Caveat: importance sampling doesn't actually work for variational auto-encoders, but the question makes sense regardless In "L4 Latent Variable Models (VAE) -- CS294-158-SP20 Deep Unsupervised ...
29 views

### Why do we use mean squared error loss with deep q networks?

For computing the TD error (pseudo) loss in DQNs, we have the following formula - $$L(\theta) = 0.5*(R_{t+1} + \gamma[max_aq_{\theta}(S_{t+1}, a)] - q_{\theta}(S_t, A_t))^2$$ However, in practice, we ...
73 views

### Maximize loss on non-target variable

I have a neural network that should be able to classify documents to target label A. The problem is that the network is actually classifying label B, which is an easier task. To make the problem more ...
15 views

### Are there chatbots which use AI but not machine learning?

I want to see the differences between two chatbots where the first one is based on AI without ML and the second one which is based on ML.
70 views

### Is there a way to update the neural network to fit the new data without the time required for retraining?

I built a basic neural network in MATLAB. The neural network classifies points on the X-Y axis system into two classes (0 and 1). (I try to get the function that represents a shape from this photo) ...
4 views

### linear layer bert sentence embedding

I have a special situation where I need to embed a sentence with bert-sentence transformer and get a numeric value for it. This is not possible with this model, ...