Questions tagged [machine-learning]

For questions related to machine learning (ML), which is a set of methods that can automatically detect patterns in data, and then use the uncovered patterns to predict future data, or to perform other kinds of decision making under uncertainty (such as planning how to collect more data). ML is usually divided into supervised, unsupervised and reinforcement learning. Deep learning is a subfield of ML that uses deep artificial neural networks.

Filter by
Sorted by
Tagged with
0
votes
1answer
25 views

Extracting keywords from messages

I'm starting a project where I want to extract keywords from given messages. The keywords are for example something like: "hard disk", "watch" or other technical components. I'm ...
1
vote
1answer
41 views

What are the 'noisy factors' leading to overfitting?

Consider the following excerpt from section 5.5 Regularization (p. 13) of this chapter Logistic Regression. There is a problem with learning weights that make the model perfectly match the training ...
1
vote
0answers
40 views

Identifying rotating and resizing letters with background noise

I'm trying to complete a captcha, and here is what it looks like: Between captchas the calligraphy of the letters is the same, but the letters may be resized and rotated. And the background noise (...
1
vote
0answers
14 views

How could an attacker poision the training data?

I came across the following definition of Backdoor attack (in this paper): These attacks are accomplished in two steps. First, special patterns are embedded in the targeted model during the training ...
1
vote
0answers
14 views

How could poisoning attacks be prevented in adversarial Machine Learning

How we could prevent poisoning attacks in adversarial Machine Learning? I read it from this link and other sources. As per my understanding, poisoning could be done after the ML algorithm has been ...
1
vote
0answers
27 views

Text matching: fuzzy names matching with learning

I'm new to AI/ML and I want to research and learn about techniques that could help me to solve this complex task. Any hint would be appreciated. Let me explain it with an example: Let's look at two ...
1
vote
1answer
21 views

What to do when you have massive amount of data but you don't have enough computation power for training a machine learning model?

For example, I have a massive amount of data, but I have limited computational resources and time to train on the full data. Other cases may include, I have huge amounts of 360-degree images, where I ...
0
votes
1answer
83 views

What is the difference between the definition of "accuracy" in machine learning and federated learning?

What is the difference between the definition of "accuracy" in machine learning and federated learning? In particular, how is the accuracy calculated in the following paper: Cai, Lingshuang,...
0
votes
0answers
11 views

Inconsistent Classification Accuracy between Classification Network & Object Detection

I have been working on an object detection and classification problem, and I am having understanding a discrepancy in my results. I am try to detect and classify 2 classes. These objects are ...
0
votes
0answers
17 views

How to use Tensorflow Recommenders' Retrieval task with Keras data generators

I've recently started working with the package to build recommender systems, and so far, I've successfully built a Ranking task that takes the inputs from a Keras Data Generator. However, I could not ...
0
votes
0answers
29 views

Why the collection of background/negative image dataset is not taught in object detection tutorials and books?

While I was doing an object detection project, I have encountered the problem of getting FALSE POSITIVES and FALSE NEGATIVES. After days of research on StackOverflow, I figured out that I need to ...
1
vote
3answers
219 views

How much statistics is involved in AI?

I am a 3rd-year math major, who is interested in computer science, particularly algorithms and competitive programming (did some olympiads in high school, ACM ICPC in university, etc.), and I have ...
0
votes
1answer
75 views

Can you use a graph as input for a neural network?

We want to try and distinguish real voices from (deep)fake voices using the graphs generated by a discrete fourier transform (generated from .wav audio files). We know from each image if it is a real ...
0
votes
0answers
18 views

Understanding manual test cases

I have a large number of manual test cases which are designed to test a web application's functionality. I want to automate these and I have been exploring NLP to structurize the test cases. These ...
1
vote
0answers
30 views

How to learn transition type in a 1-hour extended DJ Mix?

How would you design a model which learns the transitions in a given 1-hour DJ Mix? To be specific, the model should be able to learn transitions, specify the occurring time and the type (Crossfade, ...
1
vote
2answers
303 views

What is the difference between "ground truth" and "ground-truth labels"?

I'm aware that the ground-truth of the example at the top left-hand corner of the image below is "zero" However, I am confused about the meaning of the terms ground truth and ground-truth ...
-1
votes
1answer
48 views

how to go from mathematical problem to neural network (and back)?

I am a little confused on how, you can find online papers that describe complex Machine Learning formulas in a mathematical/probabilistic way, and, in the other hands, easy tutorials that teach you ...
0
votes
2answers
55 views

Best way to use/learn ML for board-game reinforcement learning

I am relatively new to Python but I taught myself enough to code a two-player board game that is similar to chess. It has a simple Tkinter UI. Now I am dipping into machine learning, and I want to ...
2
votes
0answers
70 views

Loss function to minimize the distance between sets

Are there references or links to examples about loss functions "Distance Metrics" which could be used to minimize the distance between two sets for a neural network. More precisely, this ...
0
votes
0answers
16 views

Train a model for different scenario and gather performance results in a single place

Recently, I extend a master's thesis. I am now in a training phase for the model associated with it. I have access to many node GPUs. I would like to train this model on different scenarios, e.g. ...
0
votes
1answer
84 views

Is it possible to overfit a model on infinite amounts of data?

This is a theoretical question. Is it possible to overfit a model on infinite amounts of data? Let me clarify there are no duplicates. Say, we have a generator function that produces data, with the ...
0
votes
1answer
44 views

Fitting a Gaussian distribution into another distribution

Assume we have two vectors, containing random samples (maybe audio data?). Their distribution can be approximated to a normal distribution, so we can calculate their mean and standard deviation. I am ...
3
votes
1answer
183 views

Where do the feature extraction and representation learning differ?

Feature selection is a process of selecting a subset of features that contribute the most. Feature extraction allows getting new features that are not actually present in the given set of features. ...
4
votes
1answer
49 views

Does elitism cause premature convergence in genetic algorithms?

I have a genetic algorithm which is working fairly well. It's got all the standard operators, including initial random population, crossover ratio, mutation rate, degree of mutation, etc. This works ...
0
votes
1answer
53 views

How to perform multi-class text classification with a dataset of 80 documents?

I have a training dataset of 80 text documents with an average number of characters in each document of 25000 and 210 unique tags. How can I perform multi-class text classification with such a small ...
0
votes
1answer
46 views

Which loss function could I use to solve a regression problem as a classification problem (where we discretize the labels into buckets)?

I am considering a rather typical regression problem, but, for practice, I am trying to implement this as a classification problem. The setup is as follows. I have $\mathbb{R}$-valued labels $y_i \in [...
1
vote
0answers
23 views

Necessity of likelihood in training energy-based models

Lately, I've been getting into energy-based models (EBMs) through some of Yann LeCun's recent talks, where he advocates the use of non-normalized models because it allows for more flexibility in the ...
0
votes
0answers
13 views

ML model to predict values from text (a lot of training training data)

I have around 1M entries of the type: id | big5_openness | big5_conscientiousness | big5_extraversion | big5_agreeableness | big5_neuroticism | input_text Where <...
0
votes
0answers
35 views

How can my CNN produce an "unknown" label?

I have a dataset of 20k images of infected mango. I have built a web-based app using Flask, where a user can upload a picture, and my CNN model detects the disease. I have 6 classes in the model, ...
0
votes
1answer
68 views

What is the difference between the "equal error rate" and "detection cost function" metrics?

I was designing a multi-speaker identification model, so I searched for some metrics that one may use. I found two metrics: EER (equal error rate) DCF (detection cost function) What is the ...
0
votes
0answers
13 views

What is the recommended metric to use for Multi-Speaker Identification?

I was designing a model for multi-speaker identification and I was wondering what is the best/recommended/or widely used metrics for this task? I search a lot and found many results for speaker ...
2
votes
1answer
83 views

Do we ever need more then 1 hidden layer in a binary classification problem with ANNs? If yes why?

I have read about the universal approximation theorem. So, why do we need more than 1 layer? Is it somehow computationally efficient to add layers instead of more neurons in the hidden layer?
0
votes
0answers
13 views

How to organizre features with attributes and sub-attributes in vectors for Neural Network?

I have a dataset of 500 instances, each instance represents a 60x60 grid, each grid cell has attributes and sub-attributes. The attribute for each cell is text value, like this: Grass, tree, building, ...
0
votes
0answers
27 views

Doesn't imbalanced data affect input variables too?

I was thinking today about how biased data affects machine learning performance, and I begin to wonder why class imbalance (or data imbalance in general) is only talked about in a classification ...
2
votes
1answer
74 views

In style transfer, why does the comparison between channels give a good sense of style?

I have been learning about Style Transfer recently. Style is defined as The correlation of activations between channels. I can't seem to understand why that would be true. Intuitively, style seems ...
2
votes
2answers
152 views

Why is the equation $\mathbb{E} \left[ (Y - \hat{Y})^2 \right] = \left(f(X) - \hat{f}(X) \right)^2 + \operatorname{Var} (\epsilon)$ true?

In the book An Introduction to Statistical Learning, the authors claim (equation 2.3, p. 19, chapter 2) $$\mathbb{E} \left[ (Y - \hat{Y})^2 \right] = \left(f(X) - \hat{f}(X) \right)^2 + \operatorname{...
4
votes
4answers
235 views

What are the typical sizes of practical/commercial artificial neural networks?

I'm interested in artificial neural networks (ANN) and I wonder how big ANNs in practical use are, for example, Tesla Autopilot, Google Translate, and others. The only thing I found about Tesla is ...
0
votes
1answer
29 views

Tensforflow schedule - does not change boundaries [closed]

I'm trying to manipulate the learning rate with tf PiecewiseConstantDecay. I can easily check if the algorithm switches learning rate values, because one rate is extremely low 1e-20 !! However, NO ...
0
votes
0answers
31 views

Do the training and test datasets need to be equally preprocessed as one whole dataset?

I have developed, trained and tested an NLP model. It is persisted in a pickle file. The model contains the data preprocessing function that includes text cleaning and new features engineered with ...
0
votes
1answer
38 views

Cnn for Combination of both digits and letters(small and capital) [closed]

Hi I am new to machine learning can anyone suggest open dataset consists of both digits and letters(small,capital) I want images consisisting of both digits and letters to train my cnn model and make ...
2
votes
0answers
17 views

Predicting the the motion of a 3D object when the motion of a set of markers is known

trying to figure out where to get started with this: I have a few hundred CT images where certain three-dimensional features in the image (anatomy) are moving in a correlated fashion with a set of ...
0
votes
0answers
7 views

How can we use Deep Learning for Faults Tolerence in Distributed System?

Cloud Computing is the best example of Distributed Systems. The devices or nodes used in Distributed Systems consume and produce Big Datas, Hence there are chances of fault occurence from any end ...
1
vote
0answers
30 views

Is there literature on Neural Network with activation functions of bounded domain?

I think to have found a somewhat interesting connection between neural networks and another area of mathematics. However, it requires the activation functions in the network to have a bounded - ...
1
vote
2answers
64 views

What would be the reason behind using plots (such as box-plots or histograms) for ML development?

I've been learning Python machine-learning using this project report and the guy who wrote it begins by visualizing his data using various statistical analysis methods: histograms, density plots, box ...
2
votes
3answers
154 views

How would you intuitively but rigorously explain what the VC dimension is?

The VC dimension is a very important concept in computational/statistical learning theory. However, the first time you read its definition, you may not immediately understand what it really represents ...
1
vote
0answers
71 views

How to train a machine learning model with multiple attributes and one target value?

I'm working on a machine learning problem where I need to guess which customers will churn and which of them will continue to be customers. I have $X_0, X_1, X_2, X_3, X_4, X_5$ and $X_6$ attributes ...
2
votes
0answers
36 views

Is there a technique for analyzing the relationship between time-series clusters?

I have two time-series datasets (temperature and speed of the vehicle). I will use Agglomerative Hierarchical Clustering and DTW to cluster both datasets. I am looking for a technique (like regression ...
0
votes
0answers
31 views

How to detect dynamic hand gestures?

I already know how to detect static hand gestures like a fist, peace, etc. However, how would one detect dynamic hand gestures, like swipe left/right or "draw" circle with the hand? Is some ...
0
votes
0answers
17 views

Can I use the phi coefficient to compare predictions by two different classifiers?

Can I use the Matthews correlation coefficient (aka phi coefficient) to compare predictions by two different classifiers? That is, is this code correct if I want to check how diverse/correlated my two ...
1
vote
0answers
13 views

Does distribution of data augmentation parameters matter?

Idea Let's say we have simple pictures dataset containing 40x40 images of digits. We have only one image of each digit. We want to use that as training set, but we need more data, so we use data ...

1
3 4
5
6 7
38