Questions tagged [roc-auc]

The tag has no usage guidance.

8 questions
Filter by
Sorted by
Tagged with
28 views

How to calculate sensitivity and specificity given AUC score?

I couldn't find any relevant information on how to calculate sensitivity and specificity with AUC score. There is one picture that presents what I want, however I wasn't able to interpret it for my ...
21 views

How can I calculate and draw an average AUC?

I am working on a face verification problem, for 100 persons. I need to calculate the verification performance. The input to the Matlab function is the similarity scores and true labels, and the ...
11 views

How to compute an AUROC score using the Mahalanobis distance?

I was reading this paper: A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attacks. The core idea is, given a test sample $x$, and a set of classes $C$, to compute ...
27 views

Is it normal that we get different AUC results after running with various seeds?

We are working on optimizing a CNN made for binary image classification (by that I mean to classify each image to group A or group B). It is based on InceptionV3, using PyTorch. We saw that choosing ...
5 views

Evaluating a CNN -multi class model with two separate thresholds

I have a model that outputs three classes. But here instead of one threshold, it depends on a combination of two (user input threshold). One threshold varies from 0.1 to 1.0 and the other varies from ...
12 views

Evaluation metric for time-series anomaly detection

My dataset is time-series sensor data and anomaly ratio is between 5% and 6% 1. For time-series anomaly detection evaluation, which one is better, precision/recall/F1 or ROC-AUC ? When empirically ...
My attempt to solve the problem below: \text{cost function} = C = (TP \cdot CTP) + (FN \cdot CFN) + (FP \cdot CFP) + (TN \cdot CTN) = ((1 - (1 - FP)^2) \cdot 1000) + (FN \cdot CFN) + (FP \cdot ...