Questions tagged [machine-learning]

For questions related to machine learning (ML), which is a set of methods that can automatically detect patterns in data, and then use the uncovered patterns to predict future data, or to perform other kinds of decision making under uncertainty (such as planning how to collect more data). ML is usually divided into supervised, unsupervised and reinforcement learning. Deep learning is a subfield of ML that uses deep artificial neural networks.

Filter by
Sorted by
Tagged with
2
votes
1answer
74 views

What is numerical stability?

I came across the phrase "numerical stability" several times. But almost in the same context. I encountered this word mostly in the analytical formula for batch normalization. $$y = \dfrac{...
0
votes
1answer
9 views

Data analysis before feeding to ML pipeline

I'm new to machine learning and I've been working through a dataset of ~3000 records with ~100 features. I've been hand rolling Python and R scripts to analyse the data. For example, plotting the ...
0
votes
0answers
11 views

Weight for Samples on SVM (Support Vector Machine)

There is a option sample_weight in fit(X[, y, sample_weight]) function (OneClassSVM, sklearn library). If I use the option ...
0
votes
0answers
6 views

Why do we transform feature vectors in attention modules for CNNs

If we have a set of feature maps with dimensions [B, C, H, W] (batch, channel, height, width), why do we transform our feature maps before we calculate their affinity/correlation in attention ...
0
votes
0answers
40 views

Is there artificial intelligence capable of drawing?

Small clarification. This is not about neural networks that study millions of pictures from the Internet and simply rearrange different elements of these pictures. It's about something more ...
0
votes
1answer
19 views

Attention mechanism: Why apply multiple different transformations to obtain query, key, value

I have two questions about the structure of attention modules: Since I work with imagery I will be talking about using convolutions on feature maps in order to obtain attention maps. If we have a set ...
0
votes
0answers
16 views

How can I weight each point in one-class SVM?

I want to give weights to some data points Specifically, these are points related to anomalies (I'm implementing one-class SVM for anomaly detection) Exactly, I want to consider some data points that ...
0
votes
0answers
14 views

Is it possible to train a model on files of code and output questions about it?

I want to know if it is feasible to use deep learning to generate homework questions for a course on logic. My input data of programming functions and desired output of respective homework questions ...
-2
votes
0answers
8 views

Which model for Multiclass classification for 9k+ classes

Need help with which machine learning algorithm/model to use for this problem. The dataset is of product categorization for Amazon. Feature Columns are PRODUCT NAME, PRODUCT DESCRIPTION, BULLET_POINTS,...
0
votes
0answers
29 views

How to measure the significance of an input feature for the output of a linear layer in a neural network

Suppose I have a simple linear layer $y = xA^T + b$ that is part of a neural network trained on some dataset. The weight matrix $A$ for this layer has the shape ...
0
votes
0answers
28 views
+50

Backpropagation after N sequential input-output pass

I'm trying to train a Neural Network in a particular situation -- similar to a genetic algorithm domain as far as I know. I have to run a simulation with a length of $K$ steps. I have a neural network ...
0
votes
1answer
20 views

Material(s) for understanding “image channels”

I am pretty confused about the concept of "image channels". I want material that explains the concept of channels from scratch to whatever is required to understand their role in machine ...
0
votes
0answers
21 views

Is there a term for performance metric like prediction time on a new/unseen example?

The performance entry on Google's machine-learning glossary doesn't mention prediction time on a new/unseen example which is important for production use. Is there a term to refer to that metric?
0
votes
0answers
28 views

In general, what are precision, recall, F1 that are reported in papers? [closed]

I used classification_report in sklearn library And, the picture below shows evaluation on my model (anomaly detector) In general, what are precision, recall, F1 ...
0
votes
1answer
27 views

How do I know what a good mean absolute error value is? [closed]

I have just run an MAE calculation for my machine learning models and the results show: SVM MAE = 28.850 deg. Random Forest MAE = 33.832 deg. How do I know what a good MAE value is? What is the ...
0
votes
1answer
21 views

What is the meaning of R2 appearing as a negative in the RandomForestRegressor?

Machine learning model was created by reading an Excel file where data was stored. I applied RandomForestRegressor to create a model that predicts the size of the sieve particles according to pressure,...
2
votes
0answers
20 views

ReLU function converging to local optimum in one case and diverging in the other one

I implemented a simple neural network with 1 hidden layer. I used ReLU as activation function for the hidden layer and the output layer just uses the linear function. To check my implementation I ...
2
votes
1answer
68 views

How to create a neural network from a set of equations?

Say I have these equations: $$x_1 = x_2 + 2y_1 + b$$ $$x_2 = y_2 + c$$ $$y_1 = z + a$$ $$y_2 = y_3 + d$$ $$z = z_1 + e$$ $x_1$ depends on $x_2$ (depends on $y_2$ (depends on $y_3$)) and $y_1$ (depends ...
2
votes
2answers
119 views

Does regularization just mean using an augmented loss function?

We need to use a loss function for training the neural networks. In general, the loss function depends only on the desired output $y$ and actual output $\hat{y}$ and is represented as $L(y, \hat{y})$. ...
0
votes
0answers
24 views

What to do when model stops learning after some epochs

I am training a segmentation model on 3D data, after around 170 epochs which took around 4 days, I notice the model is no more learning and the dice score is at 0.51. What is the best approach at this ...
0
votes
0answers
11 views

Performance metric for multi aspect extraction and sentiment analysis

I created a model that extracts aspects from reviews and predicts the associated sentiments. I'm now trying to evaluate the model. I tried many different approaches because there are no real true ...
-4
votes
0answers
28 views

can you please explain how to code the following problem [closed]

Create a program kb.py that is able to take in a file containing a knowledge base(KB) and a model and returns the truth value of the KB. The KB should be in CNF (that is, OR clauses joined by AND ...
0
votes
1answer
29 views

Why is the exponential loss used in this case?

I am reading a paper "Tracking-by-Segmentation With Online Gradient Boosting Decision Tree". In Section 2.1, the paper says I cannot understand the exponential loss function. In my opinion, ...
0
votes
1answer
21 views

Is there a way to select the subset of most important features using PCA?

Is there a way to select the most important features using PCA? I am not looking for the principal components with the highest scores but a subset of the original features.
0
votes
0answers
21 views

Time series forecasting for multiple objects with common features

I know the title of this question may raise an eyebrow, but I can't find the technical terms to define or investigate the actual problem. To demonstrate my problem with a simple hypothetical scenario: ...
0
votes
0answers
31 views

How to calculate cosine similarity for classification when you have say 10000 samples belonging to two classes have a bunch of samples

Does anyone have experience with using Cosine Similarity for text classification? I see a number of articles on how to find cosine similarity between documents using Doc2Vec, Gensim, etc. I have a ...
0
votes
0answers
11 views

Predicting yes/no questions with input query

If I have information about a person e.g. their lifestyle, how big is their house, where they live, their income history, I can build a model to predict their future income. But what if my task is not ...
0
votes
0answers
15 views

How can I take continuous video input into my model?

Let's say I have designed an ML model that can take video input of a dog running around and give the breed of the dog as output. However, I do not want to wait for the video to finish before it is ...
0
votes
0answers
18 views

What's the effect of increasing hidden nodes?

Topic Demarcation I find many topics on "how to choose the number of hidden nodes". I'm not interested in the answer to that question. What I learned I learned, that if you increase the ...
0
votes
0answers
5 views

How to deal with unbalanced data in multilabel classification problem

I have 3 possible solutions, but I am not sure if they are good. I think they are a bit clunky (especially 1st and 2nd). Use multiple small models. So instead of having the model that can tell you ...
0
votes
0answers
13 views

End-to-end learning using LSTM-AE

I want to use prediction models like LSTM-AE to predict time-series data. The feature that the neural network should learn is in frequency between 40-60Hz. So, in order to learn the feature more ...
0
votes
0answers
3 views

Ensure trained word embeddings get high similarity with particular words

I am trying out my hand at training a Word2Vec model using gensim. I made a simple training file that basically had just one line repeated multiple times ...
2
votes
0answers
24 views

Is optimizing weighted sum multi objective tasks considered a multi-task learning?

I have two sequence prediction tasks, finding $\vec{\pi} \in \Pi$ and $\vec{\psi} \in \Psi$. Each sequence has its own objective function, i.e. $f_1(\vec{\pi})$ and $f_2(\vec{\psi})$. The input for ...
1
vote
1answer
26 views

How can I address missing values for LSTM?

I'm a student and writing my first paper for submission on conference. I have a question there is a dataset below. this is temporal-spatial dataset. ...
1
vote
0answers
35 views

What is meant by decoding in a Hidden Markov Model?

HMM contains two types of states: observable and hidden. Let $\{ h_1,h_2,h_3,\cdots,h_n\}$ be hidden states and $\{o_1,o_2,o_3,\cdots, o_m\}$ be the observable states. Suppose the $n^2$ transition ...
0
votes
0answers
20 views

Computational complexity of a CNN network

In the following network, the convolution operations of convolutional blocks are performed by three 1-D kernels with the sizes 8, 5, and 3 respectively along with stride equal to 1. The final network ...
-1
votes
0answers
20 views

I want to know the effects of angle of view or camera lens on learning images from YOLO or Object Detection

As the title suggests, I would like to know how much the hardware affects YOLO or object Detection If you have a Thesis, please let me know or give your own opinion.
0
votes
1answer
52 views

What is the best way to stay up to date with state of the art machine learning? [duplicate]

Let's say I want to read 1-3 papers a week (irregardless of a specific sub field). How can I continously find the best papers?
1
vote
1answer
67 views

What does it mean by overfitting the test set?

Consider the following statement from p14 of Naive Bayes and Sentiment Classification While the use of a devset avoids overfitting the test set, having a fixed training set, devset, and test set ...
3
votes
1answer
44 views

Can some of the weights be fixed during the training of a neural network?

Is it possible to exclude specific layers from the optimization? For example, let's say I have an input layer, 2 hidden layers, and the output layer. I know there is a perfect solution for my problem ...
0
votes
0answers
10 views

Multiple Entities, Multivariate, Multi-step - Time Series Prediction - Python

My goal is to create a time series model with Multiple Entities - I have multiple products with pre orders and they all have the a similar bell shaped curve peeking at the release date of the product ...
1
vote
3answers
119 views

Can people use neural networks without providing the set of training data?

It seems that neural networks (NNs) can be applied to supervised learning, unsupervised learning and reinforcement learning. Some people even train neural networks without the set of training data. If ...
0
votes
0answers
22 views

Machine learning to find fewest number of “puzzle pieces” that fullfill a certain requirement

Would machine learning be suitable for the following problem, and if so, what kind of learning? I have numerous puzzle pieces, all having a value for identical properties. Example of one puzzle piece: ...
0
votes
0answers
11 views

What are some of the ideas to solve Learning-to-choose problem?

Suppose I want to predict cats and dogs, but with a twist: the model can choose the image to predict. For example: Given a list of 10 images (with both dogs and cats), the model need to choose one ...
0
votes
0answers
14 views

Determining the value of error threshold in summarization of differences in multidimensional aggregates

I have been implementing an OLAP related journal "iDiff : Informative summarization of differences in multidimensional aggregates". In this paper, The author have proposed a methodology ...
0
votes
0answers
14 views

Is it possible to identify multiple queries/intents in an email, check if the reply has addressed all of those queries before sending email?

An email may contain multiple questions related to similar or distinct topics. The person responding the email needs assistance in detecting and informing if all of the questions have been addressed ...
0
votes
2answers
46 views

How to design a neural network with arbitrary input and output length?

I am trying to build a neural network that has an input of $n$ pairs of integer values (where $n$ is random) and a corresponding output of a binary array with length $n$. The input will be a set of ...
1
vote
2answers
71 views

Is there any model that is probabilistic but not statistical?

While studying about the n-gram models, I encountered the terms "statistical model" and "probabilistic model" several times. I got a basic doubt that will there be any ...
0
votes
0answers
16 views

How should an ML model architecture be designed for predicting the order of a sequence?

I've decided to create a model for predicting Formula 1 race results based on driver statistics, to try to improve my ML skills. The first problem I've encountered is the data type of the target ...
0
votes
0answers
16 views

Structure of machine Learning algorithm

I am experimenting on automation on video editing. The idea is obtaining "strange results" and experiments, not looking for any precise result. So, I want to design a simple neural network ...

1
2 3 4 5
38