Questions tagged [machine-learning]

For questions related to machine learning (ML), which is a set of methods that can automatically detect patterns in data, and then use the uncovered patterns to predict future data, or to perform other kinds of decision making under uncertainty (such as planning how to collect more data). ML is usually divided into supervised, unsupervised and reinforcement learning. Deep learning is a subfield of ML that uses deep artificial neural networks.

Filter by
Sorted by
Tagged with
0
votes
0answers
70 views

Why is val accuracy 100% within 2 epochs and incorrectly predicting new images? (1,000 images per class when training)

My CNN tensorflow model reports 100% validation accuracy within 2 epochs. But it incorrectly predicts on single new images. (It is multiclass problem. I have 3 classes). How to resolve this? Can you ...
0
votes
0answers
13 views

How to find the accuracy of LDA model?

I am working on topic modeling using the latent Dirichlet allocation model. I have a dataset that contains tweets and topics corresponding to these tweets. In total, there are 65 different topics. I ...
2
votes
1answer
61 views

Why do Transformers have a sequence limit at inference time?

As far as I understand, Transformer's time complexity increases quadratically with respect to the sequence length. As a result, during training to make training feasible, a maximum sequence limit is ...
1
vote
1answer
38 views

Are derived or computed inputs bad for CNNs?

I am building a CNN and am wondering if inputting derived or computed inputs are generally bad for the effectiveness of CNNs? Or just NNs in general? By derived or computed values I mean data that is ...
0
votes
0answers
22 views

What loss function should be used for negative log likelihood labels

I am trying to build a ranking CNN model for document - query pairs using MS Marco dataset and python pytorch. My supervisor suggested to use the same CNN to extract feature vector for document and ...
0
votes
2answers
44 views

How much labelling is required for NER with SpaCy?

I have transaction data and I would like to extract the merchant from the transaction description. I am new to this but I just came across Named Entity Recognition and SpaCy. I have hundreds of ...
3
votes
0answers
57 views

Which algorithms are used to locate objects in a 3d space?

I can see mobile apps that can locate a 3D object on a surface with a mobile camera and you can turn around that object. What is the name of the algorithm(s) that is used for that purpose? Or, is ...
1
vote
1answer
34 views

Test accuracy decreases during my train process

I want to train a neural network model with the arcface loss function and try to combine it with domain adaption. But when the training process continues, I find the test accuracy first increases and ...
1
vote
1answer
37 views

Feature Extraction for printer classification

I need some advice. I am currently trying to do a printer classification with ML/DL. What do I have? 11 colored-images with high resolution from 8 different inkjet-printers (in total 88 images) I have ...
3
votes
1answer
188 views

What is the "temperature" in the GPT models?

What does the temperature parameter mean when talking about the GPT models? I know that a higher temperature value means more randomness, but I want to know how randomness is introduced. Does ...
0
votes
0answers
16 views

How to improve the PMI (Pointwise Mutual Information) Quality for document based PMI

Generating word embeddings from the PMI is well understood and known to be equivalent to SGNS (skipgram negative-sampling) under certain conditions. I was able to get good quality word embedding using ...
1
vote
0answers
24 views

Derive information for sub-scoring from one scoring model

I am currently working in Python with a random forest algorithm to perform a scoring. My output is binary. The idea now is to derive sub-scores from the above model that give an opinion on different ...
-2
votes
1answer
42 views

Is it possible to train an RL agent using images?

I have an image which consists of a start and an end point, the journey has some obstacles which have to be avoided. Is it possible to train an RL agent using such images to find the best path ...
0
votes
1answer
51 views

Which introductory courses (preferably video lectures) could I use to learn ML for applying ML to black hole simulations? [closed]

I am a Ph.D. candidate in High Energy Physics and my research involves numerical simulations and data analysis. I am interested to learn Artificial Intelligence and Machine Learning from the basics so ...
4
votes
2answers
216 views

Why is gradient descent used over the conjugate gradient method?

Based on some preliminary research, the conjugate gradient method is almost exactly the same as gradient descent, except the search direction must be orthogonal to the previous step. From what I've ...
0
votes
0answers
19 views

Which AI algorithm to use for identifying API for a specific use from a list of APIs?

We have a legacy code solution in C#. We have to change the code so that it fetches internal data via APIs and not via DB calls. E.g. if the current code GETS Payment object from DB, we have to ...
0
votes
1answer
27 views

Multiple labels for the same rectbox?

My goal is to identify the horse in a photo. I'm dealing with about 500 unique horses. My feeling is that the best way to distinguish one horse from another is by its face. So I trained Yolov5 ...
1
vote
2answers
141 views

Are there any resources that introduce the basics of online machine learning?

Are there any resources (either books, articles, or tutorials) that introduce the basics of online machine learning? For example, this website has nice lecture notes (from lec16) on some of the ...
4
votes
2answers
395 views

How should I read a deep learning paper?

I have a background in mathematics and I am accustomed to reading papers with lemma and proofs. When I see a deep learning paper, they seem to be of practical nature. How can I improve my reading and ...
0
votes
1answer
31 views

Which is more popular/common way of representing a gradient in AI community: as a row or column vector?

Consider the following remark about writing gradients from the chapter named Vector Calculus from the test book titled Mathematics for Machine Learning by Marc Peter Deisenroth et al. Remark (...
0
votes
0answers
24 views

Masked Autoencoder Structure

In the following structure when we use MADE due to the constraints for making a masked autoencoder, it seems some inputs do not have any connection to the next layer, and also there is the output that ...
0
votes
1answer
29 views

How to arrange test dataset distribution for an imbalanced classification problem?

I have a dataset that contains 560 datapoints, and I would like to do binary classification on it. 400 datapoints belong to class 1, and 160 points belong to class 2. In the case of an imbalanced ...
0
votes
2answers
51 views

Is there any other (possibly less popular) approach to create AI apart from statistical methods?

From what I have gathered so far, an AI has some prior (stored in the form of some probability distribution), and, based on experiences/data, changes the distribution (via Bayes rule) accordingly. ...
0
votes
0answers
13 views

Self-Supervised learning model that labels the similar/not similar output?

I want to first reference the following SimCLR framework illustration to explain better what I'm asking. Lets say that after I found out of the image is not similar to the cat, can I actually predict ...
1
vote
1answer
45 views

Is there a way to update the neural network to fit the new data without the time required for retraining?

I built a basic neural network in MATLAB. The neural network classifies points on the X-Y axis system into two classes (0 and 1). (I try to get the function that represents a shape from this photo) ...
2
votes
0answers
36 views

Decreasing number of neurons in CNN

the conventional way of creating a CNN is using increasing number of neurons: ...
1
vote
1answer
26 views

Is it possible to use stochastic gradient descent at the beginning, then switch to batch gradient descent with only a few training examples?

Batch gradient descent is extremely slow for large datasets, but it can find the lowest possible value for the cost function. Stochastic gradient descent is relatively fast, but it kind of finds the ...
0
votes
0answers
54 views

Is the graph considered as overfit?

I have a training dataset of 2000 images and 500 images for validation. I have executed 50 epochs, however I realized that my graph seems to be different as my accuracy is smaller than my loss. I am ...
3
votes
2answers
419 views

When can I call an entity a hyperparameter?

As per my knowledge, any entity that is learnable by a training algorithm can be called a parameter. Weights of a neural network are called parameters because of this reason only. But I have doubts ...
0
votes
0answers
36 views

Is a test accuracy of 0.74 good enough, given a dataset of about 700 samples, and, if not, how can I improve it?

I am new to neural networks. I am trying to solve a binary classification problem. Specifically, I want to determine whether a patient has or not a certain disease based on the dataset. The dataset ...
0
votes
0answers
68 views

What algorithms minimize the log likelihood of sequential latent probabilistic models?

I am reading this paper, wherein they represent their model using a POMDP. Here is their latent probabilistic model that they have fit to the training data - Over here, $z_t \in Z$ represents the ...
1
vote
0answers
31 views

Can people without a background in STEM go into the field of AI?

I've recently become very interested in the potential AI holds for the future of society. I believe it has the potential to truly alter the way we live our lives in the not-too-distant future. I've ...
1
vote
0answers
28 views

Is there any way to remove background of an image fully with the help of post-processor techniques(like edge detector) after deep learning based model

I'm using a deep learning-based model (deep lab v3+ with xception as the backbone) for image segmentation and removing the background. The subject of the image will be a person. And my target is to ...
2
votes
1answer
39 views

Can RL still learn in a scenario where current state and the next state are independant?

I am trying to implement reinforcement learning into my real-world problem. One thing making me hesitant to apply RL is that this real-world problem of mine is unique in a way how every state is ...
0
votes
0answers
24 views

Feature Descriptor for Range Doppler Maps

I would like to know which is the best feature descriptor for a sequence of Range Doppler Maps: I have some suggestions like hog features, haar features, SIFT and SURF. Any other suggestion? For the ...
0
votes
0answers
29 views

Connection between multi-label classification and multi-class classification

For a dataset with multi-label judgment, e.g., coco dataset but where we only want to predict the most possible label. There're multiple ways: train as multi-label learning and predict as a multi-...
1
vote
1answer
45 views

What kind of algorithm or approach can I use to find a specific type of object in an image?

What kind of algorithm or approach can I use to find a specific type of object in an image? In particular, I am interested in finding an object like a windmill in an image taken, for example, from ...
5
votes
1answer
136 views

How to decide a train-test split?

In almost every ML model, a train-test (or train-test-val split) is critical to assess the model's performance. However, I have always wondered what the rationale is to decide a particular train-test ...
1
vote
1answer
27 views

A recommender system based on millions of fields including text and number

I want to train a model based on millions of fields, including text and number, that are stored in a SQL database and recommend a perfect match based on some inputs. Now, which algorithm is the best ...
1
vote
1answer
36 views

What is the best open source python repo for facial recognition? [closed]

I am looking for best open source python repo for facial recognition. Best if it uses tensorflow backend. I know you can train images to recognize. Yolo can be used if trained on face. To name the ...
0
votes
0answers
12 views

How sensitive are LSTM's to random zero values in its target feature when training?

I have worked with lstm's in the past, specifically for time series forecasting. However, the target feature in these time series were relatively "stable". With the loosely defined "...
1
vote
0answers
26 views

How do you decide that you have tested enough hyper-parameter combinations for a specific neural network architecture?

How do you decide that you have tested enough hyper-parameter combinations for a specific neural network architecture to discard it and move on to a new model? Do you have a structured (generic) ...
0
votes
0answers
29 views

How to proof that the square of the half-margin of maximum-margin SVM is equal to the summation of lagrange multipliers given by SVM dual?

Can be show that the square of the half-margin of maximum-margin SVM is equal to the summation of Lagrange multipliers given by SVM dual? i.e, Let $ \rho = \dfrac{1}{w}\\ $ Show that: $$ \dfrac{1}{\...
0
votes
0answers
46 views

Should training be done in number of episodes or number of timesteps?

In the past few deep reinforcement learning projects I've worked with, a problem I have encountered is whether to frame training time in terms of number of episodes or number of timesteps. For ...
5
votes
4answers
3k views

How can I predict the next number in a non-obvious sequence?

I've got an array of integers ranging from -3 to +3. Example: [1, 3, -2, 0, 0, 1] The array has no obvious pattern since it represents bipolar disorder mood swings. What is the most suitable approach ...
2
votes
0answers
40 views

Which method can accurately detect circular/angular shapes? (attached example)

Is there a method to detect shapes like these accurately and efficiently? I have tried the OpenCv Haar Casacade Classifier which does not work well. These shapes should all be the same class object ...
0
votes
1answer
53 views

Appropriate ML algorithm to solve a cutting pattern problem

I have a rectangular area, where I need to place some 2 dimensional geometrical shapes - like a square or circle or a little more complicated shapes. And after the arrangement these shapes should be ...
0
votes
0answers
19 views

Algorithm to separate audio source that Andrew Ng did in his ML Course

Hey I was doing the ML course of Andrew Ng's ML course. In a video he shows a algorithm that can separate two audio source and separate voice from music. Has any one tried such an algorithm? Though he ...
0
votes
0answers
23 views

"Hot Word Detection", bur for different applications

I have been looking in detecting a specific rhythm/pattern within the temporal domain for a time-series signal. For this purpose, how "Wake Up" words work for devices like Alexa have gained ...
1
vote
0answers
26 views

Recommended way to spilt image sequence for training/validation/testing

For object detection tasks I have a few minutes of video footage from a surveillance camera, converted to a sequence of images and ground truth bounding boxes for all people walking by. Now what's the ...

1
2
3 4 5
38