It's done first draft wahoo

This commit is contained in:
2026-08-31 23:58:01 +03:00
parent 275e29bde0
commit d217b2356a
10 changed files with 90 additions and 100 deletions
+3 -3
View File
@@ -1,10 +1,10 @@
\section{Problem Statement}
Real-world data is hardly ever perfect. Many real-world datasets suffer a myriad of problems. One such common problem is improper labeling. While we would like our models to learn based off of an exact ground truth, often the labels with which we train our classifiers have errors themselves. Label-noise plagues many datasets for a variety of reasons. In datasets such as CIFAR-10N, a benchmark of natural images across 10 object classes, labels were collected from crowdworker annotators, who are prone to mistakes. In ChestX-ray14, a dataset of medical chest X-rays, labels were given by a natural language processing algorithm, since labelling each image by hand was deemed impractical. Such automatic labeling gave way to relatively high label error rates.
Real-world data is hardly ever perfect. Many real-world datasets suffer a myriad of problems. One such common problem is improper labeling. While we would like our models to learn based on an exact ground truth, often the labels with which we train our classifiers have errors themselves. Label-noise plagues many datasets for a variety of reasons. In datasets such as CIFAR-10N, labels were collected from crowdworker annotators, who are often prone to mistakes. In ChestXray14, a dataset of medical chest X-rays, labels were given by a natural language processing algorithm, since labelling each image by hand was deemed impractical. Such automatic labeling gave way to relatively high label error rates. In other cases, labels may only be assigned to part of the data, due to high effort needed to label, or the labels might be based on other data entirely, causing some misalignment.
Gradient based learning methods, like those used to train neural networks, have trouble dealing with such datasets. Standard, per-sample losses (BCE, focal-loss), are confused easily by mislabeled points, as they produce a very large gradient which throws off training. Current attempts at noise-robust losses (GCE, MAE) help smooth these large gradients, yet still optimize on a per-sample basis, targeting per-sample accuracy rather than ranking quality --- leaving them misaligned with AUC even when they do reduce noise sensitivity.
Gradient based learning methods, like those used to train neural networks, have trouble dealing with such datasets. Mislabeled data points are often assigned a score that is very far from the label itself. While this makes sense, the data point is very different from the class it is assigned, this mismatch can create a very large corrective gradient for training, a corrective gradient steering the model in the wrong direction. Current attempts at noise-robust losses (GCE, MAE) help smooth these large gradients, yet still optimize on a per-sample basis, targeting per-sample accuracy rather than ranking quality. This leaves them misaligned with AUC even when they do reduce noise sensitivity.
Direct AUC optimization is a natural direction here: ranking-based objectives are determined by the relative ordering of scores rather than their absolute values, making them structurally less sensitive to isolated mislabeled samples. Per-sample losses optimize each sample independently, while AUC losses optimize sample ranking across the whole population, allowing the model to make principled tradeoffs even in the presence of label errors.
Direct AUC optimization is a natural direction here: ranking-based objectives are determined by the relative ordering of scores rather than their absolute values, making them less sensitive to isolated mislabeled samples. Per-sample losses optimize each sample independently, while AUC losses optimize sample ranking across the whole population, allowing the model to make principled tradeoffs even in the presence of label errors.
\section{Contribution}