Questions tagged [roc-auc]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1
vote
1answer
28 views

How to calculate sensitivity and specificity given AUC score?

I couldn't find any relevant information on how to calculate sensitivity and specificity with AUC score. There is one picture that presents what I want, however I wasn't able to interpret it for my ...
0
votes
0answers
21 views

How can I calculate and draw an average AUC?

I am working on a face verification problem, for 100 persons. I need to calculate the verification performance. The input to the Matlab function is the similarity scores and true labels, and the ...
0
votes
0answers
11 views

How to compute an AUROC score using the Mahalanobis distance?

I was reading this paper: A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attacks. The core idea is, given a test sample $x$, and a set of classes $C$, to compute ...
0
votes
0answers
27 views

Is it normal that we get different AUC results after running with various seeds?

We are working on optimizing a CNN made for binary image classification (by that I mean to classify each image to group A or group B). It is based on InceptionV3, using PyTorch. We saw that choosing ...
0
votes
0answers
5 views

Evaluating a CNN -multi class model with two separate thresholds

I have a model that outputs three classes. But here instead of one threshold, it depends on a combination of two (user input threshold). One threshold varies from 0.1 to 1.0 and the other varies from ...
0
votes
0answers
12 views

Evaluation metric for time-series anomaly detection

My dataset is time-series sensor data and anomaly ratio is between 5% and 6% 1. For time-series anomaly detection evaluation, which one is better, precision/recall/F1 or ROC-AUC ? When empirically ...
0
votes
0answers
19 views

Defining optimal false-positives and false-negatives balance with a cost function

My attempt to solve the problem below: $$\text{cost function} = C = (TP \cdot CTP) + (FN \cdot CFN) + (FP \cdot CFP) + (TN \cdot CTN) = ((1 - (1 - FP)^2) \cdot 1000) + (FN \cdot CFN) + (FP \cdot ...
4
votes
0answers
265 views

When computing the ROC-AUC score for multi-class classification problems, when should we use One-vs-Rest and One-vs-One?

The sklearn's documentation of the method roc_auc_score states that the parameter multi_class can take the value ...