All Questions

Filter by
Sorted by
Tagged with
4 votes
1 answer
255 views

How did the OpenAI 5 for Dota concatenate units?

I am no expert in the field of AI so I apologize if this is a simple/easy question. I was trying to implement a network similar to OpenAI's for another game and I noticed that I did not fully ...
1 vote
1 answer
9 views

When do you know that your neural network is learning something when metrics are garbage?

When training a neural network for binary classification on highly imbalanced set its training loss decreases however validation loss increase and even though accuracy is very high(due to highly ...
0 votes
1 answer
6 views

Learning an identity function with convolutional networks

I am trying to train networks to achieve what I expected to be a trivial task: learn the identity mapping. However, this is very hard to achieve, and the optimization is hard. Moreover, I don't want ...
0 votes
1 answer
19 views

Choice of LSTM for price prediction

I have a dataset with features (f) for different stocks (S) and want to infer for price using an LSTM model. Here is my df: year S1_price S1_f1 S1_f2 S2_price S2_f1 S2_f2 Sn_price Sn_f1 Sn_f2 2010 ...
0 votes
1 answer
14 views

How can I estimate how long it will take to train a model with P params on D data points?

How can I estimate how long it will take to train a model with P params on D data points? Assuming my GPU can do T teraflops, and I have a neural network with P params, which I wish to train on D data ...
0 votes
1 answer
66 views

How do we make our outputs to have the same size as the true mask?

When we are doing multi-label segmentation tasks, our y_true (the mask) will be (w, h, 3), but, in our model, at the last layer, ...
1 vote
0 answers
11 views

How to use NN to generate a model which produces given distributions?

For a non-Markovian random walk, each step can go up or down. And for the $n-th$ step, its step size $s(n)$ may depend on the path of walk, and the probability for going up or down may also depend on ...
1 vote
1 answer
27 views

What does "All store and access operations (for S(t) , A(t), and R(t)) can take their index mod n + 1" mean?

It's from the book Introduction to Reinforcement Learning. Second edition, chapter7: n-step Bootstrapping, page 147, n-step Sarsa. I made the algo work, but I still don't understand the phrase. ...
0 votes
0 answers
8 views

Selecting neural network architecture for battery degradation problem

I want to design a neural network capable of detecting the degradation of the capacity of a battery. When the capacity is ok, the battery performs like this (x axis is the time in seconds and y axis ...
1 vote
1 answer
22 views

Why do we subtract logsumexp from the outputs of this neural network?

I'm trying to understand this tutorial for Jax. Here's an excerpt. It's for a neural net that is designed to classify MNIST images: ...
3 votes
1 answer
39 views

Why does REINFORCE perform badly at first in Sutton and Barto Figure 13.1?

In Sutton and Barto, 2nd edition, Figure 13.1 applies REINFORCE to the "short corridor with switched actions" environment from Example 13.1. The figure looks like this: My question is, why ...
-1 votes
0 answers
25 views

Is AI deductive or inductive [closed]

Is data science, AI( machine learning, deep learning) deductive reasoning or inductive reasoning. What I am I asking is that do AI predict(regression/classification) from a premise/hypothesis or it ...
2 votes
2 answers
165 views

What YOLO algorithm can I use for images with noise as I will implement it in real time?

I want to detect drivers with or without seatbelts at crossroads. For that, as it is real-time, I am going to use the YOLO algorithm/model. For training data sets (the images) I need to collect, I ...
5 votes
1 answer
683 views

When training a CNN, what are the hyperparameters to tune first?

I am training a convolutional neural network for object detection. Apart from the learning rate, what are the other hyperparameters that I should tune? And in what order of importance? Besides, I read ...
1 vote
0 answers
9 views

Can boundary value problems be solved with feedforward neural networks?

I'm a mathematician by profession, but recently took an interest in neural networks due to their apparent capacity to solve problems related to my field. I've just built my first neural network in ...
1 vote
1 answer
76 views

Are there fundamental learning theories for developing an AI that imitates human behavior?

Most, if not all, AI systems do not imitate humans. Some of them out-perform humans. Examples include using AI to play a game, classification problems, auto-driving, and goal-oriented chatbots. Those ...
0 votes
1 answer
11 views

Can YOLOv3 architecture be clearly separated into feature extractor and classifier parts?

I am new to machine learning and am confused about whether its architecture has clearly defined boundaries which demarcate the feature extraction and classification part. Or is it that it classifies ...
0 votes
0 answers
22 views

Using linear regression for classification

I know experienced people may get annoyed by this question but I haven't found a good answer after pushing quite a bit. Say that we want to binary-classify images where normally - in the simplest case ...
0 votes
1 answer
31 views

Autoencoders: Where does the encoder end and the decoder begin?

Consider a simple Autoencoder neural net: ...
2 votes
1 answer
159 views

Why do I get small probabilities when implementing a multinomial naive Bayes text classification model?

When applying multinomial Naive Bayes text classification, I get very small probabilities (around $10e^{-48}$), so there's no way for me to know which classes are valid predictions and which ones are ...
3 votes
1 answer
162 views

Understanding proof of lemma 1 (policy improvement bound) of the "Trust Region Policy Optimization" paper

In the Trust Region Policy Optimization paper, in Lemma 1 of Appendix A, I did not quite understand the transition from (21) from (20). In going from (20) to (21), $A^\pi(s_t, a_t)$ is substituted ...
-4 votes
0 answers
20 views

Can you show me my future success? [closed]

I've been struggling alot with understanding what is meant for me because I cannot see it. Alot of spiritual facts say that I am meant for greatness but I find it hard to perceive what is being said ...
2 votes
1 answer
92 views

How does backpropagation know which weights to change?

I'm currently working on constructing a neural network from scratch (in JavaScript). I'm in the middle of working on the backpropagation, but there's something I don't understand: how does the ...
1 vote
1 answer
33 views

Can RL still learn if part of my actions are only used once, at the beginning of the episode?

I am working in an environment with 3-dimensional action space. The first two actions are only used at the first timestep and never again. The third action is used at every timestep. Say, the action ...
0 votes
1 answer
71 views

Can I flip a video to generate more data for action recognition?

There are 8 distinct action classes and around 50+ videos per class. I was wondering if flipping videos from the training set can be a good option to generate additional data. Is it?
0 votes
1 answer
25 views

Can I ignore duplicate records of dataset for training?

I have a a dataset that most of records and their corresponding labels are the same and only timestamp of each records is different from other record. If I ignore duplicate records in for training ...
0 votes
0 answers
10 views

Control variables and cofounding effects in stochastic programming/,model predictive control/reinforcement learning

How can we be sure that confounding variables/control variables don’t pickup the effect our decisions w.r.t decision variables had on the actual control variable? Since the term control variable ...
0 votes
1 answer
33 views

Darknet as a part of Yolo v3

I am pretty new to ML and my question may look strange. Especially the last part of it. 1)As far as I understand Darknet53 is an integral part of Yolo just as Resnet50 is a part of R-CNN Am I right? 2)...
0 votes
0 answers
20 views

combine two features in dataset?

I have a data set contains the number of security gaps and the level of that gap for a specific website. Now suppose I have 2 features in this data set, the first feature is the number of a specific ...
0 votes
1 answer
18 views

Binary Classification Model Comparison - Interpretation of Training, Test and Validation Set Performance

I am looking for some advice regarding the best choice of binary classification model based on training, validation and test set results. Model 1 (results in 1st image) shows better test set results ...
0 votes
1 answer
16 views

Storing training dataset in a platform like mlflow

I am pretty new to Machine learning and would like to know whether there are experiment management platforms that also allow storing and managing training datasets (images, in my case). I am familiar ...
0 votes
2 answers
20 views

ImageNet Dataset (for PyTorch VGG16 training)

Please can someone describe how to properly obtain the ImageNet dataset (to be precise the ImageNet 2012 Classification Dataset). What I attempted so far The ImageNet webpage refers the user to ...
0 votes
2 answers
293 views

Why isn't the loss of my neural network reduced after 2500 iterations?

I have developed a basic feedforward neural network from scratch to classify whether image is of cat or not cat. It works fine, but after 2500 iterations, my cost function is not reducing properly. ...
0 votes
0 answers
14 views

What is the "attack success rate" of an Adversarial Attack?

For a typical adversarial attack, a sample $x_{0}$ is chosen from a training set belonging to class $C_{i}$ and a transformation $A$ is applied such that the adversarial example $x=A(x_{0})$ would be ...
7 votes
1 answer
152 views

Validation accuracy higher than training accurarcy

I implemented the unet in TensorFlow for the segmentation of MRI images of the thigh. I noticed I always get a higher validation accuracy by a small gap, independently of the initial split. One ...
2 votes
1 answer
482 views

Could the normalisation of the inputs make the neural network insensitive to changes in the inputs?

When using neural networks (NNs), we often normalized the inputs. I think this is done to equally capture the changes in any input feature, that is, if any feature takes huge values and other features ...
0 votes
2 answers
108 views

How can I model this problem of delivering assets by choosing a route with reinforcement learning?

I would like to build a model based on reinforcement learning (RL) for the following scenario Recommend the best route (of cities listed for a given country) that satisfies the required criteria (...
-4 votes
0 answers
37 views

Why do I have social anxiety? [closed]

I've had social anxiety for 10 years. I don't know why I feel this way. I've tried communicating with people. I've tried talking more. I've tried smiling a lot. But I can't stop faking until I'm alone ...
2 votes
1 answer
175 views

How can I implement the reward function for an 8-DOF robot arm with TRPO?

I need to get an 8-DOF (degrees of freedom) robot arm to move a specified point. I need to implement the TRPO RL code using OpenAI gym. I already have the gazebo environment. But I am unsure of how to ...
0 votes
0 answers
17 views

In the Policy Gradient Theorem proof, why is $d^\pi(s) = \sum_{k=0}^{\infty}\gamma^{k}Pr(s_0 \rightarrow s, k, \pi)$ true?

I was reading the original Policy Gradient Paper. I didn't quiet get the last step of the proof for the policy gradient theorem. The proof given in the paper is below: I don't understand how the last ...
0 votes
1 answer
61 views

Avoid unintentional "merging" in cluttered object detection

I have a problem that has bothered me quite some time. With modern methods object detectors can often be accurately trained, even with small to medium sized datasets. However, there is one thing where ...
0 votes
2 answers
145 views

How much labelling is required for NER with SpaCy?

I have transaction data and I would like to extract the merchant from the transaction description. I am new to this but I just came across Named Entity Recognition and SpaCy. I have hundreds of ...
0 votes
0 answers
10 views

How can i combine xgboost with adaboost? [closed]

I have combined random forest with adaboost as clf = AdaBoostClassifier(n_estimators=10, base_estimator=RandomForestClassifier(n_estimators=10,max_depth=20)) ...
1 vote
0 answers
15 views

Why does importance sampling work with latent variable models?

Caveat: importance sampling doesn't actually work for variational auto-encoders, but the question makes sense regardless In "L4 Latent Variable Models (VAE) -- CS294-158-SP20 Deep Unsupervised ...
-1 votes
0 answers
29 views

Why do we use mean squared error loss with deep q networks?

For computing the TD error (pseudo) loss in DQNs, we have the following formula - $$L(\theta) = 0.5*(R_{t+1} + \gamma[max_aq_{\theta}(S_{t+1}, a)] - q_{\theta}(S_t, A_t))^2$$ However, in practice, we ...
2 votes
2 answers
73 views

Maximize loss on non-target variable

I have a neural network that should be able to classify documents to target label A. The problem is that the network is actually classifying label B, which is an easier task. To make the problem more ...
0 votes
0 answers
15 views

Are there chatbots which use AI but not machine learning?

I want to see the differences between two chatbots where the first one is based on AI without ML and the second one which is based on ML.
2 votes
1 answer
70 views

Is there a way to update the neural network to fit the new data without the time required for retraining?

I built a basic neural network in MATLAB. The neural network classifies points on the X-Y axis system into two classes (0 and 1). (I try to get the function that represents a shape from this photo) ...
0 votes
0 answers
4 views

linear layer bert sentence embedding

I have a special situation where I need to embed a sentence with bert-sentence transformer and get a numeric value for it. This is not possible with this model, ...
0 votes
1 answer
65 views

What are some good papers or resources for aspect extraction and opinion modelling from video or audio?

I am quite new to deep learning. I just finished the deep learning specialization by Professor Andrew NG and Deep Learning AI. Now, my professor (instructor) has advised me to look into some classic ...

15 30 50 per page
1
2 3 4 5
205