Datasets › CIFAR-100N

CIFAR-100N (Real-World Human Annotations)

Introduced by Jiaheng Wei et al. in Learning with Noisy Labels Revisited: A Study Using Real-World Human Annotations22 Oct 2021 archive 2025-07-28

This work presents two new benchmark datasets (CIFAR-10N, CIFAR-100N), equipping the training dataset of CIFAR-10 and CIFAR-100 with human-annotated real-world noisy labels that we collect from Amazon Mechanical Turk.

Benchmarks archive 2025-07-28

All 1 leaderboard whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

First row (archive order)PaperCode
Learning with noisy labels CIFAR-100N PGDF Accuracy (mean) 74.08 Sample Prior Guided Robust Model Learning to Suppress... bupt-ai-cz/PGDF 24 Compare

Papers archive 2025-07-28

papers with a benchmark row: 20 · with a code link: 19 · where Syntology ran a sample: 8 (6 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument) Syntology

Show: all papers with a benchmark rowonly where code ran (8 of 20 with a benchmark row: 6 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument)

Page 1 of 1: papers 1 to 20 of 20 with a leaderboard row on this dataset's benchmarks, newest first by the archive's date (ties by slug; undated papers last).

The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset, not that list; the archive's count for this dataset is 66. The Syntology column is from Syntology's graph, stated per sample; it is not part of any archive number. A line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified” (C is a part of N, never taken away from it); the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. When the archive marks a repository official for the paper, the cell starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record.

PaperCodeResultsDateSamples run Syntology
PSSCL: A progressive sample selection framework with contrastive loss designed for noisy labels 1 1 18 Dec 2024 not harvested
Imprecise Label Learning: A Unified Framework for Learning with Various Imprecise Label Configurations 1 1 22 May 2023 not harvested
ProMix: Combating Label Noise via Maximizing Clean Sample Utility 1 1 21 Jul 2022 official: harvested, nothing ran · 0 ran · 1 unverified
Robust Training under Label Noise by Over-parameterization 1 1 28 Feb 2022 official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (1 pointer-only for licence)
Sample Prior Guided Robust Model Learning to Suppress Noisy Labels 1 1 2 Dec 2021 not harvested
To Smooth or Not? When Label Smoothing Meets Noisy Labels 1 1 8 Jun 2021 official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (3 pointer-only for licence)
Clusterability as an Alternative to Anchor Points When Learning with Noisy Labels 2 1 10 Feb 2021 official: harvested, nothing ran · 0 ran · 9 unverified
Provably End-to-end Label-Noise Learning without Anchor Points 1 1 4 Feb 2021 not harvested
When Optimizing f-divergence is Robust with Label Noise 2 1 7 Nov 2020 not harvested
Learning with Instance-Dependent Label Noise: A Sample Sieve Approach 1 2 5 Oct 2020 official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (4 pointer-only for licence)
Early-Learning Regularization Prevents Memorization of Noisy Labels 2 2 30 Jun 2020 official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified
Combating noisy labels by agreement: A joint training method with co-regularization 2 1 5 Mar 2020 not harvested
Does label smoothing mitigate label noise? 0 1 5 Mar 2020 not harvested
DivideMix: Learning with Noisy Labels as Semi-supervised Learning 2 1 18 Feb 2020 official: harvested, nothing ran · 0 ran · 2 unverified (2 pointer-only for licence)
Peer Loss Functions: Learning from Noisy Labels without Knowing Noise Rates 2 1 8 Oct 2019 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 4 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified
Are Anchor Points Really Indispensable in Label-Noise Learning? 1 1 1 Jun 2019 official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (3 pointer-only for licence)
How does Disagreement Help Generalization against Label Corruption? 3 1 14 Jan 2019 not harvested
Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labels 4 1 20 May 2018 not harvested
Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labels 5 1 18 Apr 2018 community repositories only · 7 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 6 where Syntology's instrument failed) · 0 unverified (7 pointer-only for licence)
Making Deep Neural Networks Robust to Label Noise: a Loss Correction Approach 2 2 13 Sep 2016 official (archive's flag): 1 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (2 pointer-only for licence)

Dataset loaders archive 2025-07-28

2 loaders as listed in the archive; links are outbound and not re-checked here.

Tasks archive 2025-07-28

License archive 2025-07-28

No licence recorded in the archive. Absence here is not a statement about the dataset's terms.

Modalities archive 2025-07-28

No modality tagged.

Languages archive 2025-07-28

No language tagged.

Variants archive 2025-07-28

  • CIFAR-100N

1 variant name, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections