6.4 KiB
6.4 KiB
thesis/work-history/recent
2026-08-31 Mon
- Added roll_aoc_roc.py figure (ROC curve with green AUC / red AOC shading, 10 sampled threshold points) to illustrate ROLL-AOC; inserted \begin{figure} in method.tex after the ROLL-AOC gradient equation
- Added Food-101N results to thesis: new bib entry (lee2018cleannet), dataset description item, updated episode-count note, narrative analysis, and table row in tab:results:large (roll-aoc leads at 0.867, libauc second at 0.857)
- Full thesis re-read via subagent: identified and fixed ~20 issues across all chapters
- Fixed all \textsc{Roll} → \textsc{ROLL} across experiments.tex, discussion.tex, appendix_keel_noise.tex
- Fixed ChestX-ray14 → ChestXray14 everywhere for consistent naming
- Fixed symmetric vs asymmetric noise contradiction: table captions and discussion.tex now all say "symmetric label noise"
- Fixed BCE-W margin number in CIFAR-10N results (0.047 → 0.083)
- Removed broken \Cref{fig:density-fit-comparison} (figure never inserted)
- Fixed duplicate "interchangeable at the implementation level" clause in method.tex
- Fixed typos: "reffer", "w.r.t the", "At it's core", "round about", "based off of" (×3), "32x32" → $32\times32$, duplicate \cite, "throwing distance" → academic phrasing
- Removed related_work TODO comment (AUC/ROC formalization now present)
- Fixed incomplete sentence "by fitting." in method.tex problem formulation
- Ran parallel 4-agent bibliography verification across all 36 entries
- Fixes from bib verification: feng2020can author Fengmei → Fengmao Lv; oakdenrayner2020exploring author Lauren → Luke; removed jigsaw-puzzle template leftovers (demaine2007jigsaw, altman1989solving)
- Fixed broken \Cref{rem:aoc-coverage} rendering as "?? 3.3.2.0.1": added missing ≠wtheorem{remark}[theorem]{Remark} and \Crefname{remark}{Remark}{Remarks} to main.tex
2026-08-29 Sat
- Investigated label noise claims for large tabular datasets (Bank Marketing, Credit Card Fraud, Home Credit) via web search; confirmed Credit Card Fraud has structural "hidden fraud" (class-conditional false negatives), found no evidence of inherent label noise in Bank Marketing or Home Credit
- Updated Credit Card Fraud dataset description to note undetected fraud as structural source of class-conditional false negatives; removed blanket "All labels clean" claim from large tabular paragraph
- Researched NIH ChestX-ray14 ~20% noise figure — found it unsourced; Wang 2017 claims >90% accuracy, Oakden-Rayner 2019 audit found PPV 10–30pp lower; rewrote description to cite both with a defensible formulation instead of asserting a specific percentage
- Added bib entries: wang2017chestxray14 (CVPR 2017), oakdenrayner2020exploring (Academic Radiology 2020)
- Replaced all \cite{TODO} in experiments.tex with real citations; added 8 new bib entries: alcalafdez2011keel, wei2022cifar10n, moro2014bank, dalpozzolo2015calibrating, tittelfitz2023fpr, homecredit2018kaggle, cohen2022torchxrayvision, lin2017focal
- Merged standalone "Label-Noise Robustness on KEEL" section into KEEL Benchmark subsection; integrated protocol description inline; removed duplicate content
- Replaced aggregate KEEL noise table (methods × 4 noise levels) with three full per-dataset tables (5%, 10%, 20%), computed from raw results-final CSVs; updated discussion to reference all three and added 20%-noise win-count observation (Roll-AoC leads 6/12 datasets)
- Fixed stale back-reference in ChestX-ray14 results (sec:experiments:noise → sec:results:keel); updated stale ~20% noise mentions in results body and table caption
- Added TODOs: audit bold/emphasis in all result tables; review KEEL noise tables for main body vs appendix; remove Roll-TPR from large datasets table; reword Bank Marketing after rerun (suspected bug in current results)
2026-08-28 Thu
- Pivoted Ch. 3 (method.tex) from TPR@FPR to AUC as primary objective: rewrote Problem Formulation with AUC integral as eq:objective-auc, fixed TPR/FPR notation to functions of τ, demoted single-threshold objectives to special case
- Reframed ROLL Framework intro to lead with AUC-via-numerical-integration story; NP framing moved to subordinate paragraph
- Renamed "General ROLL Formulation and Derivation" → "Per-Threshold ROLL Loss"; renamed "ROLL variant - direct AUC optimisation" → "ROLL-AOC: AUC Optimization" with rewritten intro positioning it as the primary objective
- Added ROLL-AOC framing sentence to each distribution instantiation (Gaussian, Beta, KDE)
- Added Corollary (gradient balance under ROLL-AOC) and Remark (gradient coverage broadening under ROLL-AOC) to Properties section; requalified Observation as single-threshold
- Explored all results-final CSVs; verified existing tables (KEEL clean, CIFAR-10N, large datasets) are correct — no changes needed
- Computed KEEL noise experiment aggregates (asymmetric noise at 5/10/20%, 10 episodes each, 12 datasets)
- Key finding: ROLL-AOC drops 3.7% from 0→20% noise; GCE/MAE drop 6–8% despite being designed for noise robustness; ROLL-AOC is #1 at 20% noise
- Renamed Ch. 4 "Label-Noise Poisoning Experiment" → "Label-Noise Robustness on KEEL"; wrote protocol and results prose; added tab:results:keel-noise with 4 noise levels × 8 methods
- Updated Summary section comments in experiments.tex with actual findings to synthesize
- Created thesis/experiments org-roam subnode with full data source map, key numbers table, and section status
- Restructured Ch. 2 (related_work.tex): new section order — ROC/AUC (2.1) → Noisy Labels (2.2) → KDE (2.3) → Imbalanced Classification (2.4) → NP (2.5) — to foreground AUC + noise as thesis core
- Dropped section 2.3 (Partial AUC and TPR@FPR) entirely; TPR@FPR objective absorbed into Imbalanced section, NP moved up
- Moved NP section from end of chapter to position 2.2, then later to 2.5 after deciding AUC+noise should open the chapter
- Wrote Section 2.2 (Connection to Neyman-Pearson / The Neyman-Pearson Lemma) with subsections: lemma statement, practical gap
- Fixed NP section typos: likelihood, cite, that
- Rewrote NP practical gap subsection for clarity and precision
- Fixed NP opening paragraph: corrected imprecise claim that AUC maximizes TPR at every FPR
- Added yuan2021auc bib entry (Yuan et al., ICCV 2021, LibAUC/PESG) and wired citations in AUC optimization in literature subsection and imbalanced classification section
- Added neyman1933ix bib entry (original 1933 NP paper)