Browse State-of-the-Art › Learning with noisy labels
Learning with noisy labels
143 papers with code · 20 benchmarks · 16 datasets archive 2025-07-28
Learning with noisy labels means When we say "noisy labels," we mean that an adversary has intentionally messed up the labels, which would have come from a "clean" distribution otherwise. This setting can also be used to cast learning from only positive and unlabeled data.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
20 leaderboard tables shown for this task, 20 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted. 10 shown of 20 until expanded.
Syntology 2 newer papers were judged to report on this task's benchmarks so far (Claude Sonnet 4.5, reading their tables: a model's judgement, not a result; 0 placed): ANIMAL (1 judged, 0 placed), Clothing1M (1 judged, 0 placed), Food-101 (1 judged, 0 placed), CIFAR-10N (1 judged, 0 placed). Drawn from 8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read).
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
16 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 249 · with a code link: 143 · where Syntology ran a sample: 50 (41 with a run with no instrument failure, 9 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (50 of 249 tagged: 41 with a run with no instrument failure, 9 where every run was a failure of Syntology's instrument)
Page 1 of 3: papers 1 to 100 of 249, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
3 Oct 2020 18 repositories listed Syntology official (archive's flag): 7 ran · 15 ran (of which 6 constructed an object rather than computing a result; 13 with no instrument failure: 0 honoured, 0 violated, 13 with no contract checked; 2 where Syntology's instrument failed) · 5 unverified (of 20 harvested samples) · 6 pointer-only (licence)In today's heavily overparameterized models, the value of the training loss provides few guarantees on model generalization ability.
-
18 Apr 2018 5 repositories listed Syntology community repositories only · 7 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 6 where Syntology's instrument failed) · 0 unverified (of 7 harvested samples) · 7 pointer-only (licence)Deep learning with noisy labels is practically challenging, as the capacity of deep models is so high that they can totally memorize these noisy labels sooner or later during training.
-
25 Jun 2022 4 repositories listedThis paper proposes Protoformer, a novel self-learning framework for Transformers that can leverage problematic samples for text classification.
-
22 Oct 2021 4 repositories listedThese observations require us to rethink the treatment of noisy labels, and we hope the availability of these two datasets would facilitate the development and evaluation of future learning with noisy label solutions.
-
21 Jun 2021 4 repositories listed Syntology official (archive's flag): 9 ran · 17 ran (of which 5 constructed an object rather than computing a result; 10 with no instrument failure: 1 honoured, 1 violated, 8 with no contract checked; 7 where Syntology's instrument failed) · 12 unverified (of 29 harvested samples) · 29 pointer-only (licence)Learning with noisy labels is a practically challenging problem in weakly supervised learning.
-
24 Jun 2020 4 repositories listed Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 12 harvested samples)However, in practice, simply being robust is not sufficient for a loss function to train accurate DNNs.
-
31 Oct 2019 4 repositories listed Syntology official (archive's flag): 2 ran · 21 ran (of which 0 constructed an object rather than computing a result; 17 with no instrument failure: 0 honoured, 0 violated, 17 with no contract checked; 4 where Syntology's instrument failed) · 8 unverified (of 29 harvested samples) · 3 pointer-only (licence)Confident learning (CL) is an alternative approach which focuses instead on label quality by characterizing and identifying label errors in datasets, based on the principles of pruning noisy data, counting with…
-
16 Aug 2019 4 repositories listedIn this paper, we show that DNN learning with Cross Entropy (CE) exhibits overfitting to noisy labels on some classes ("easy" classes), but more surprisingly, it also suffers from significant under learning on some…
-
20 May 2018 4 repositories listedHere, we present a theoretically grounded set of noise-robust loss functions that can be seen as a generalization of MAE and CCE.
-
19 Mar 2019 3 repositories listed Syntology official (archive's flag): 1 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples) · 4 pointer-only (licence)Deep learning has achieved excellent performance in various computer vision tasks, but requires a lot of training examples with clean labels.
-
14 Jan 2019 3 repositories listedLearning with noisy labels is one of the hottest problems in weakly-supervised learning.
-
7 Jun 2018 3 repositories listedDatasets with significant proportions of noisy (incorrect) class labels present challenges for training accurate Deep Neural Networks (DNNs).
-
4 Mar 2024 2 repositories listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples) · 8 pointer-only (licence)Despite the success of the carefully-annotated benchmarks, the effectiveness of existing graph neural networks (GNNs) can be considerably impaired in practice when the real-world graph data is noisily labeled.
-
16 Mar 2023 2 repositories listedWe introduce a novel method for training machine learning models in the presence of noisy labels, which are prevalent in domains such as medical diagnosis and autonomous driving and have the potential to degrade a…
-
2 May 2022 2 repositories listed Syntology official (archive's flag): 3 ran · 6 ran (of which 2 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 7 unverified (of 13 harvested samples) · 6 pointer-only (licence)We suggest a new branch of method, Noisy Prediction Calibration (NPC) in learning with noisy labels.
-
11 Sep 2021 2 repositories listedWith the development of deep learning, medical image classification has been significantly improved.
-
10 Feb 2021 2 repositories listed Syntology official: harvested, nothing ran · 0 ran · 9 unverified (of 9 harvested samples)Nonetheless, finding anchor points remains a non-trivial task, and the estimation accuracy is also often throttled by the number of available anchor points.
-
7 Nov 2020 2 repositories listedWe show when maximizing a properly defined f-divergence measure with respect to a classifier's predictions and the supervised labels is robust with label noise.
-
30 Jun 2020 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)In contrast with existing approaches, which use the model output during early learning to detect the examples with clean labels, and either ignore or attempt to correct the false labels, we take a different route and…
-
5 Mar 2020 2 repositories listedThe state-of-the-art approaches "Decoupling" and "Co-teaching+" claim that the "disagreement" strategy is crucial for alleviating the problem of learning with noisy labels.
-
18 Feb 2020 2 repositories listed Syntology official: harvested, nothing ran · 0 ran · 2 unverified (of 2 harvested samples) · 2 pointer-only (licence)Two prominent directions include learning with noisy labels and semi-supervised learning by exploiting unlabeled data.
-
8 Oct 2019 2 repositories listed Syntology 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 4 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples)In this work, we introduce a new family of loss functions that we name as peer loss functions, which enables learning from noisy labels and does not require a priori specification of the noise rates.
-
8 Sep 2019 2 repositories listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples) · 5 pointer-only (licence)To the best of our knowledge, ℒ_(DMI) is the first loss function that is provably robust to instance-independent label noise, regardless of noise pattern, and it can be applied to any existing classification neural…
-
13 Sep 2016 2 repositories listed Syntology official (archive's flag): 1 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)We present a theoretically grounded approach to train deep neural networks, including recurrent networks, subject to class-dependent label noise.
-
25 May 2025 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples)In Stage I, the model perfectly fits all the clean samples (i. e., samples without label noise) while ignoring the noisy ones (i. e., samples with noisy labels).
-
19 May 2025 1 repository listedOur method identifies potentially noisy samples based on their loss distribution.
-
16 Apr 2025 1 repository listedAs an open research topic in the field of deep learning, learning with noisy labels has attracted much attention and grown rapidly over the past ten years.
-
11 Feb 2025 1 repository listedEarly stopping methods in deep learning face the challenge of balancing the volume of training and validation data, especially in the presence of label noise.
-
19 Jan 2025 1 repository listedLearning with Noisy Labels (LNL) aims to improve the model generalization when facing data with noisy labels, and existing methods generally assume that noisy labels come from known classes, called closed-set noise.
-
18 Dec 2024 1 repository listedAccordingly, their effectiveness is significantly influenced by the precision of the separated clean set, prior knowledge of noise, and the robustness of SSL.
-
3 Dec 2024 1 repository listed
-
2 Dec 2024 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 9 harvested samples) · 9 pointer-only (licence)
-
3 Nov 2024 1 repository listed
-
26 Aug 2024 1 repository listed
-
19 Aug 2024 1 repository listed
-
8 Jul 2024 1 repository listed
-
24 Jun 2024 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
16 Jun 2024 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
21 May 2024 1 repository listed
-
28 Apr 2024 1 repository listed Syntology official (archive's flag): 13 ran · 13 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 5 where Syntology's instrument failed) · 0 unverified (of 13 harvested samples) · 1 pointer-only (licence)
-
1 Apr 2024 1 repository listed
-
5 Mar 2024 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples)
-
1 Mar 2024 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples) · 6 pointer-only (licence)
-
27 Feb 2024 1 repository listed
-
24 Jan 2024 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
13 Jan 2024 1 repository listed Syntology official (archive's flag): 15 ran · 15 ran (of which 1 constructed an object rather than computing a result; 7 with no instrument failure: 3 honoured, 0 violated, 4 with no contract checked; 8 where Syntology's instrument failed) · 5 unverified (of 20 harvested samples) · 20 pointer-only (licence)
-
10 Jan 2024 1 repository listed
-
20 Dec 2023 1 repository listed
-
19 Dec 2023 1 repository listed
-
11 Dec 2023 1 repository listed Syntology official (archive's flag): 5 ran · 6 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 5 where Syntology's instrument failed) · 6 unverified (of 12 harvested samples) · 2 pointer-only (licence)
-
8 Dec 2023 1 repository listed
-
30 Nov 2023 1 repository listed
-
2 Sep 2023 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
26 Aug 2023 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
8 Aug 2023 1 repository listed
-
2 Aug 2023 1 repository listed
-
28 Jul 2023 1 repository listed
-
3 Jul 2023 1 repository listed
-
20 Jun 2023 1 repository listed
-
20 Jun 2023 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 12 harvested samples)
-
20 Jun 2023 1 repository listed
-
7 Jun 2023 1 repository listed
-
22 May 2023 1 repository listed
-
22 May 2023 1 repository listed
-
18 May 2023 1 repository listed
-
25 Apr 2023 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 1 pointer-only (licence)
-
26 Mar 2023 1 repository listed
-
13 Mar 2023 1 repository listed
-
19 Feb 2023 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 2 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
14 Feb 2023 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
2 Jan 2023 1 repository listed
-
1 Jan 2023 1 repository listed
-
1 Jan 2023 1 repository listed
-
2 Dec 2022 1 repository listed
-
22 Nov 2022 1 repository listed
-
21 Nov 2022 1 repository listed
-
8 Nov 2022 1 repository listed
-
17 Oct 2022 1 repository listed
-
2 Sep 2022 1 repository listed
-
24 Aug 2022 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
19 Aug 2022 1 repository listed
-
5 Aug 2022 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
25 Jul 2022 1 repository listed
-
21 Jul 2022 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
21 Jul 2022 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
27 Jun 2022 1 repository listed
-
16 Jun 2022 1 repository listed
-
2 May 2022 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)
-
30 Apr 2022 1 repository listed
-
20 Apr 2022 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples)
-
12 Apr 2022 1 repository listed
-
28 Mar 2022 1 repository listed Syntology official (archive's flag): 12 ran · 12 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 0 violated, 7 with no contract checked; 4 where Syntology's instrument failed) · 3 unverified (of 15 harvested samples) · 4 pointer-only (licence)
-
15 Mar 2022 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
8 Mar 2022 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
3 Mar 2022 1 repository listed
-
28 Feb 2022 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (of 8 harvested samples) · 1 pointer-only (licence)
-
9 Feb 2022 1 repository listed
-
4 Feb 2022 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
5 Dec 2021 1 repository listed
-
2 Dec 2021 1 repository listed
Syntology lines on 41 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections