Questions tagged [accuracy]

For questions related to the accuracy metric/measure, which is the number of correct predictions divided by the total number of predictions.

Filter by
Sorted by
Tagged with
1
vote
0answers
35 views

What causes high differences in neural network accuracy each run?

I trained a CNN using Keras in R to multi-dimensional image data for image classification of five classes. I realized that each run (I retrained the network on the same data for ten times), although I ...
2
votes
1answer
1k views

Should I continue training if the neural network attains 100% training accuracy?

I have a neural network where there are two hidden layers. Each hidden layer has 128 neurons. The input layer has 20 inputs, and the output layer has 3 outputs. I have 1 million records of data. 80% ...
0
votes
1answer
61 views

What is the difference between the definition of “accuracy” in machine learning and federated learning?

What is the difference between the definition of "accuracy" in machine learning and federated learning? In particular, how is the accuracy calculated in the following paper: Cai, Lingshuang,...
0
votes
1answer
35 views

Is it ok to have an accuracy of 65% and a sensitivity of 90% with Naive Bayes for sentiment analysis?

I am creating a sentiment analysis model using Naive Bayes. When I test the model, I get an average accuracy of 65%; however, the sensitivity of the model is much higher, 90%. So, I am wondering if ...
1
vote
1answer
41 views

Is it a good practice to pad signal before feature extraction?

Is padding, before feature extraction with VGGish, a good practice? Our padding technique is to find the longest signal (which is loaded .wav signal), and then, in ...
0
votes
2answers
26 views

Do larger numbers of hidden layers have a bigger effect on a classification model's accuracy?

I trained different classification models using Keras with different numbers of hidden layers and the same number of neurons in each layer. What I found was the accuracy of the models decreased as the ...
0
votes
2answers
62 views

Accuracy Not Going Above 30%

I am trying to make a big classification model using the coco2017 dataset. Here is my code: ...
0
votes
1answer
46 views

Is it possible that the model is overfitting when the training and validation accuracy increase?

I am aware of similar questions that have been asked, and I have gone through many. I want to bring my case to SE to understand better what my results are. I am working with a large dataset (around ...
0
votes
1answer
55 views

What are possible ways to combat overfitting or improve the test accuracy in my case?

I have asked a question here, and one of the comments suggested that this is a case of severe overfitting. I made a neural network, which uses residual boosting (which is done via a KNN), and I am ...
0
votes
2answers
76 views

Could I just choose the other (non-predicted) class when the accuracy is low?

I have a binary classification problem. My neural network is getting between 10% and 45% accuracy on the validation set and 80% on the training set. Now, if I have a 10% accuracy and I just take the ...
0
votes
0answers
25 views

Why is my siamese network learning very well in e.g. 1 out of every 5 runs?

Why is my siamese network learning very well in e.g. 1 out of every 5 runs? The rest of the time it's not learning and maintains an accuracy of 0.5. Any explanations? Is the contrastive loss taken in ...
1
vote
0answers
23 views

Is there a way, while training (with contrastive learning) the embedding network, to find the test accuracy?

I aim to do action recognition in videos on a private dataset. To compare with the existing state-of-the-art implementations, other guys published their code on Github, like the one here (for the ...
0
votes
0answers
47 views

Why would my neural network have either an accuracy of 90% or 10% on the validation data, given a random initialization?

I'm making a custom neural network framework (in C++, if that is of any help). When I train the model on MNIST, depending on how happy the network is feeling, it'll give me either 90%+ accuracy, or ...
3
votes
2answers
40 views

Accuracy metric for Clustering

I have a model that outputs a latent N-dimensional embedding for all data points, trained in a way that clusters data-points from the same class together, while being separated from other clusters ...
0
votes
0answers
30 views

What is the effect of too harsh regularization?

While training a CNN model, I used an l1_l2 regularization (i.e. I applied both $L_1$ and $L_2$ regularization) on the final layers. While training, I saw the ...
2
votes
0answers
57 views

Why do I get higher average dice accuracy for less data

I am working on image segmentation of MRI thigh images with deep learning (Unet). I noticed that I get a higher average dice accuracy over my predicted masks if I have less samples in the test data ...
1
vote
1answer
67 views

Why does the accuracy drop while the loss decrease, as the number of epochs increases?

I've been trying to find the optimal number of epochs that I should train my neural network (that I just implemented) for. The visualizations below show the neural network being run with a variable ...
1
vote
0answers
36 views

Why does loss and accuracy for a multi label classification ann does not change overtime?

I have run into a strange behavior of my multi label classification ANN ...
1
vote
0answers
66 views

Keras model accuracy not improving beyond threshold

I am currently working on a public project for the National Weather Model. We are experimenting with using a recurrent neural network to replace the output of a quadratic formula that is in use. The ...
0
votes
0answers
49 views

ConvNet - What to improve regarding architecture, procedure and technique?

I have a dataset of 180k images of license plates (so, not necessary to localize the license plate at first) for which I try to recognize the characters on the images (License plate recognition). All ...
0
votes
1answer
150 views

Which kind of data does sigmoid kernel performance well?

While I was playing with some hyperparameters, I came to a wired situation. My dataset is IRIS dataset to be specific. SVM algorithm has some hyperparameters that we can tune, such as Kernels, and C ...
1
vote
0answers
28 views

Low accuracy during training for text summarization

I am trying to implement an extractive text summarization model. I am using keras and tensorflow. I have used bert sentence embeddings and the embeddings are fed into an LSTM layer and then to a Dense ...
1
vote
0answers
39 views

Why is the accuracy of my model very low on a separate dataset from the training and test datasets?

I am working on stock price prediction project, I am using the support vector regression (SVR) model for it. As I am splitting my data into train and test, I am getting high accuracy while predicting ...
2
votes
1answer
61 views

Accuracy dropped when I ran the program the second time

I was following a tutorial about Feed Forward Networks and wrote this code for a simple FFN : ...
2
votes
1answer
243 views

Why am I getting a difference between training accuracy and accuracy calculated with Keras' predict_classes on a subset of the training data?

I'm trying to solve a binary classification problem with AlexNet. I split the original dataset into training and validation datasets using a 70/30 ratio. I have trained my neural network with a ...
3
votes
1answer
81 views

Why is there more than one way of calculating the accuracy?

Some sources consider the true negatives (TN) when computing the accuracy, while some don't. Source 1: https://medium.com/greyatom/performance-metrics-for-classification-problems-in-machine-learning-...
1
vote
1answer
46 views

Choosing Data Augmentation smartly for different application

I'm trying to understand the role of data augmentation and how it can affect the performance/accuracy of a deep model. My target application is fire detection (on video frames), with almost 15K ...
1
vote
2answers
125 views

Training accuracy vs validation accuracy on deep models

I'm training a deep network in Keras on some images for a binary classification (I have around 12K images). Once in a while, I collect some false positives and add ...
1
vote
1answer
42 views

Evaluate precision and recall results

The following table shows the precision and recall values I obtained for three object detection models. I evaluate the first two models as the following. The target is to find the best object ...
8
votes
2answers
2k views

Effect of batch size and number of GPUs on model accuracy

I have a data set which was split using a fixed random seed and I am going to use 80% of data for training and rest on validation. Here are my GPU and batch size configurations use ...
1
vote
1answer
72 views

Can we calculate mean recall and precision

I'm evaluating the accuracy in detecting objects for my image data set using three deep learning algorithms. I have selected a sample of 30 images. To measure the accuracy, I manually count the number ...
1
vote
0answers
38 views

Sample size for the evaluation of Deep Learning Models

I'm evaluating the performance and accuracy in detecting objects for my data set using three deep learning algorithms. In total there are 24,085 images. I measure the performance in terms of time ...
2
votes
1answer
42 views

Accuracy scores in a Deep Learning project

I'm using three pre-trained deep learning models to detect vehicles and count from an image data set. The vehicles belong to one of these classes ['car', 'truck', 'motorcycle', 'bus']. So, for a ...
1
vote
1answer
53 views

How to explain peak in training history of a convolutional neural network?

I am training a simple convolutional neural network to recognize two types of 1024-point frequency spectra (FFT). This is the model I'm using: ...
1
vote
2answers
862 views

Why don't people always use TensorFlow Lite, if it doesn't decrease the accuracy of the models?

I have been exploring edge computation for AI, and I came across multiple libraries or frameworks, which can help to convert the model into a lite format, which is suitable for edge devices. ...
2
votes
1answer
35 views

What does top N accuracy mean?

Places205-VGG, a CNN trained model for 205 scene categories of Places Database with 2.5 million images Places205 dataset has ...
2
votes
2answers
361 views

How to express accuracy of a regression ANN that uses MSE loss function?

I have a regression MLP network with all input values between 0 and 1, and am using MSE for the loss function. The minimum MSE over the validation sample set comes to 0.019. So how to express the '...
9
votes
3answers
2k views

Should I choose a model with the smallest loss or highest accuracy?

I have two Machine Learning models (I use LSTM) that have a different result on the validation set (~100 samples data): Model A: Accuracy: ~91%, Loss: ~0.01 Model B: Accuracy: ~83%, Loss: ~0.003 The ...