New answers tagged

4 votes
Accepted

Which epoch is the best for me to choose?

The first question is not well defined. What does normal mean? It is clearly decreasing, so that is good. If you are asking if the fluctuations are normal, yes that is not uncommon. This is not an ...
chessprogrammer's user avatar
0 votes

What is a "multinomial model" in machine learning?

A multinomial model is the statistical terminology for counting n repeated draws according to a softmax classifier (regressor to be precise). Update after @David comment: Categorical and multinomial ...
Georg M. Goerg's user avatar
0 votes

Is it possible that Precision and Recall increase together?

Yes, just look at the fomulas: $$ \begin{align} Prec &= \frac{TP}{TP+FP}\\ Recall &= \frac{TP}{TP+FN}\\ \end{align} $$ And the fixed "constraints": $$ \begin{align} \text{Actual ...
Tran Khanh's user avatar
1 vote

Is it possible that Precision and Recall increase together?

PR curves need not be monotonic. Suppose some model, such as a logistic regression, makes predictions p below and that the true outcomes are ...
Dave's user avatar
  • 548
1 vote

Do GANs have constant running time?

The question is a bit ill defined... usually when we want some bound on the running time, we have to say with respect to what For example: sorting is O(nlogn) wrt the size of the input Transformer is ...
Alberto's user avatar
  • 1,358
2 votes

Is it possible that Precision and Recall increase together?

Often references to the precision-recall trade-off are discussing setting the classification threshold for a probabilistic classifier. A probabilistic classifier is one that returns a probability of ...
Lynn's user avatar
  • 131
0 votes

What is a pipeline in machine learning?

A "pipeline" in machine learning refers to a sequence of data processing and modeling steps that transform raw data into predictions or insights. Pipelines often include stages such as data ...
lkahtz's user avatar
  • 131
3 votes

is there a mathematical explanation of precision and recall tradeoff?

The tradeoff between precision and recall occurs because increasing the threshold for classification will result in fewer false positives (increasing precision) but also more false negatives (...
lkahtz's user avatar
  • 131
0 votes

What kind of ML/AI approach might work well for "edge" detection in a function?

I think Anomaly Detection (AD) applied to timeseries, should do the job. Basically, AD aims at finding anomalies in your data which, in your case, should be local sudden changes along the $y$-axis. ...
Luca Anzalone's user avatar
1 vote

Is it possible to do machine learning on encrypted images?

The short answer is No. The long answer is maybe, if you use Homomorphic encryption. Homomorphic encryption is the conversion ...
not2qubit's user avatar
  • 111
4 votes

What is a pipeline in machine learning?

A data pipeline consists of 3 main steps data collection (e.g. you collect images of cats from different sources) data transformation (e.g. you make the images all have the same dimensions and maybe ...
nbro's user avatar
  • 39.6k
3 votes

What is a pipeline in machine learning?

A "pipeline" typically refers to a chain of methods where the output of the one is used as the input of another method. This could be, e.g., a "preprocessing pipeline" where ...
BanDoP's user avatar
  • 156
1 vote

how to determine the number of units for dense layer for transfer learning?

In adition to @Alberto answer, Start by the same number of layer and units you removed from original model. If the problem is the same, this will be probably the best solution. After that, if the ...
Jonathan Roy's user avatar
2 votes

how to determine the number of units for dense layer for transfer learning?

Not only the units but also the number of layers... you can reason over something like "how complex is your task", but usually we resort to grid search over some educated guesses (like 2/3 ...
Alberto's user avatar
  • 1,358
2 votes
Accepted

NLP "small" model to improve "big" model

When training the model for NLP is it important to get rid of data which has "bad semantic" for learning process? No, this is backwards for classifiers such as the one you are training.* ...
Neil Slater's user avatar
  • 30.3k
1 vote
Accepted

The training process of a conditional GAN

I assume you mean how to label the image and class inputs since the discriminator can reasonably output either "real" or "fake" labels for either of those inputs, and you generally ...
Neil Slater's user avatar
  • 30.3k
0 votes

Why is my agent stuck on the same action in my Twin Delayed Deep Deterministic Policy Gradient (TD3) program?

The primary issue I was having was that I wasn't normalizing the input data before sending it through the system. I can confidently say that it is working now.
CloudZero's user avatar
3 votes
Accepted

Can mini-batches for stochastic gradient be balanced but not representative of the training data?

The problem is, what mathematical definition do you give to "balanced" and "representative"? Balanced usually means that classes are uniformly distributed, but then you are ...
Alberto's user avatar
  • 1,358
2 votes

the best choice to reduce a features vector

Feature selection -- the case in which the features are highly correlated is the prototypical case in which you want to select a subset of independent features that allows for an equal performance. ...
Peblo's user avatar
  • 31
1 vote
Accepted

What is the potential issue of nested neural networks

Isn't this just a very short recurrent neural network? Same issues apply, although they are less severe since you aren't applying as many recurrent iterations. Once you start "nesting" them ...
NikoNyrh's user avatar
  • 737
1 vote
Accepted

In the conditional GAN (cGAN) architecture, why does the discriminator need conditional variable?

Because otherwise there is no conditioning... consider the case where you condition the generator but not the discriminator: given an image and a label, the generator proposes an image, which will be ...
Alberto's user avatar
  • 1,358
4 votes

Why can we have misclassifications for a perfect model in logistic regression?

Since $g$ is your logistic regression model, over data samples $x$, the output of $g(x)$ is a scalar value between $0$ and $1$ that is usually interpreted as a probability value. We have that $g(x)=\...
Luca Anzalone's user avatar
3 votes
Accepted

Regression loss conditioned by the ground-truth values

Your suggestion should work to focus the ML more on larger angle examples. You may want to try a slightly simpler approach of weighting the loss (or the resulting gradient) by a factor depending on ...
Neil Slater's user avatar
  • 30.3k
8 votes
Accepted

Neural network for game

Neural networks do not directly take actions in games. Instead, some code needs to supply the current state of the game to the neural network, interpret its output and take the action. Typically yet ...
Neil Slater's user avatar
  • 30.3k
1 vote

If the unigram precision is (N-1)/N, then the bigram precision is :

Unigram and bigram accuracy is a measure used in machine translation to assess the quality of a machine-generated translation compared to a reference translation. Unigram accuracy is the number of ...
Revolucion for Monica's user avatar
2 votes
Accepted

Generator loss not decreasing while training GAN

Without looking too much at the code, as this is not a place to ask debugging questions, I'll give some advice on how to potentially solve your problems. I'll assume your code is operational (its ...
Robin van Hoorn's user avatar

Top 50 recent answers are included