Datasets › VizWiz-Classification

VizWiz-Classification

Introduced by Reza Akbarian Bafghi et al. in A New Dataset Based on Images Taken by Blind People for Testing the Robustness of Image Classification Models Trained for ImageNet Categories1 Jan 2023 archive 2025-07-28

Our goal is to improve upon the status quo for designing image classification models trained in one domain that perform well on images from another domain. Complementing existing work in robustness testing, we introduce the first test dataset for this purpose which comes from an authentic use case where photographers wanted to learn about the content in their images. We built a new test set using 8,900 images taken by people who are blind for which we collected metadata to indicate the presence versus absence of 200 ImageNet object categories. We call this dataset VizWiz-Classification.

Benchmarks archive 2025-07-28

All 3 leaderboards whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

First row (archive order)PaperCode
Domain Generalization VizWiz-Classification VOLO-D5 Accuracy - All Images 57.2 VOLO: Vision Outlooker for Visual Recognition rwightman/pytorch-image-models +6 90 Compare
Image Classification VizWiz-Classification VOLO-D5 Accuracy 57.2 VOLO: Vision Outlooker for Visual Recognition rwightman/pytorch-image-models +6 1 Compare
Multi-Label Image Classification VizWiz-Classification ResNet151 Accuracy 47.5 Deep Residual Learning for Image Recognition tensorflow/models +483 1 Compare

Papers archive 2025-07-28

papers with a benchmark row: 19 · with a code link: 19 · where Syntology ran a sample: 16 (13 with a run with no instrument failure, 3 where every run was a failure of Syntology's instrument) Syntology

Show: all papers with a benchmark rowonly where code ran (16 of 19 with a benchmark row: 13 with a run with no instrument failure, 3 where every run was a failure of Syntology's instrument)

Page 1 of 1: papers 1 to 19 of 19 with a leaderboard row on this dataset's benchmarks, newest first by the archive's date (ties by slug; undated papers last).

The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset, not that list; the archive's count for this dataset is 22. The Syntology column is from Syntology's graph, stated per sample; it is not part of any archive number. A line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified” (C is a part of N, never taken away from it); the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. When the archive marks a repository official for the paper, the cell starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record.

PaperCodeResultsDateSamples run Syntology
A ConvNet for the 2020s 54 1 10 Jan 2022 community repositories only · 57 ran (of which 39 constructed an object rather than computing a result; 49 with no instrument failure: 2 honoured, 0 violated, 47 with no contract checked; 8 where Syntology's instrument failed) · 23 unverified (12 pointer-only for licence)
ResNet strikes back: An improved training procedure in timm 14 1 1 Oct 2021 official: harvested for another paper · 0 ran · 3 unverified
VOLO: Vision Outlooker for Visual Recognition 7 2 24 Jun 2021 official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale 158 2 22 Oct 2020 official: harvested, nothing ran · 307 ran (of which 165 constructed an object rather than computing a result; 286 with no instrument failure: 8 honoured, 2 violated, 276 with no contract checked; 21 where Syntology's instrument failed) · 112 unverified (154 pointer-only for licence)
Measuring Robustness to Natural Distribution Shifts in Image Classification 1 13 1 Jul 2020 not harvested
The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalization 1 2 29 Jun 2020 official (archive's flag): 14 ran · 14 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 12 where Syntology's instrument failed) · 0 unverified
AugMix: A Simple Data Processing Method to Improve Robustness and Uncertainty 15 1 5 Dec 2019 official (archive's flag): 12 ran · 46 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 4 honoured, 2 violated, 3 with no contract checked; 37 where Syntology's instrument failed) · 5 unverified (25 pointer-only for licence)
Adversarial Examples Improve Image Recognition 6 9 21 Nov 2019 community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified
RandAugment: Practical automated data augmentation with a reduced search space 19 2 30 Sep 2019 58 ran (of which 1 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 1 violated, 6 with no contract checked; 51 where Syntology's instrument failed) · 7 unverified (17 pointer-only for licence)
AutoAugment: Learning Augmentation Strategies From Data 3 4 1 Jun 2019 not harvested
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks 144 6 28 May 2019 official: no sample here; runs from other or unrecorded repositories · 198 ran (of which 73 constructed an object rather than computing a result; 157 with no instrument failure: 26 honoured, 2 violated, 129 with no contract checked; 41 where Syntology's instrument failed) · 104 unverified (113 pointer-only for licence)
Adversarial Training for Free! 6 1 29 Apr 2019 official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (1 pointer-only for licence)
Making Convolutional Networks Shift-Invariant Again 7 27 25 Apr 2019 official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (3 pointer-only for licence)
Bag of Tricks for Image Classification with Convolutional Neural Networks 28 1 4 Dec 2018 community repositories only · 11 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 2 honoured, 0 violated, 7 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified (5 pointer-only for licence)
ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustness 7 3 29 Nov 2018 community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified
AutoAugment: Learning Augmentation Policies from Data 33 4 24 May 2018 community repositories only · 25 ran (of which 0 constructed an object rather than computing a result; 22 with no instrument failure: 1 honoured, 2 violated, 19 with no contract checked; 3 where Syntology's instrument failed) · 18 unverified (4 pointer-only for licence)
Aggregated Residual Transformations for Deep Neural Networks 61 1 16 Nov 2016 community repositories only · 51 ran (of which 7 constructed an object rather than computing a result; 31 with no instrument failure: 0 honoured, 0 violated, 31 with no contract checked; 20 where Syntology's instrument failed) · 29 unverified (13 pointer-only for licence)
Deep Residual Learning for Image Recognition 484 4 10 Dec 2015 official: no sample here; runs from other or unrecorded repositories · 254 ran (of which 108 constructed an object rather than computing a result; 163 with no instrument failure: 3 honoured, 1 violated, 159 with no contract checked; 91 where Syntology's instrument failed) · 123 unverified (193 pointer-only for licence)
Very Deep Convolutional Networks for Large-Scale Image Recognition 305 8 4 Sep 2014 81 ran (of which 0 constructed an object rather than computing a result; 69 with no instrument failure: 0 honoured, 0 violated, 69 with no contract checked; 12 where Syntology's instrument failed) · 41 unverified (8 pointer-only for licence)

Dataset loaders archive 2025-07-28

1 loader as listed in the archive; links are outbound and not re-checked here.

Tasks archive 2025-07-28

License archive 2025-07-28

No licence recorded in the archive. Absence here is not a statement about the dataset's terms.

Modalities archive 2025-07-28

Languages archive 2025-07-28

No language tagged.

Variants archive 2025-07-28

  • VizWiz-Classification

1 variant name, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections