| 1 |
VOLO-D5 |
57.2 | 51.8 | 59.7 | – |
Paper |
Code |
2021 |
official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified |
report |
| 2 |
ConvNeXt-B |
53.5 | 46.9 | 56 | ✓ |
Paper |
Code |
2022 |
community repositories only · 57 ran (of which 39 constructed an object rather than computing a result; 49 with no instrument failure: 2 honoured, 0 violated, 47 with no contract checked; 8 where Syntology's instrument failed) · 23 unverified |
report |
| 3 |
ResNeXt-101 32x16d |
51.7 | 48.1 | 54.8 | ✓ |
Paper |
Code |
2016 |
community repositories only · 51 ran (of which 7 constructed an object rather than computing a result; 31 with no instrument failure: 0 honoured, 0 violated, 31 with no contract checked; 20 where Syntology's instrument failed) · 29 unverified |
report |
| 4 |
EfficientNet-B8 (advprop+autoaug) |
50.5 | 45.8 | 53.2 | – |
Paper |
Code |
2019 |
community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified |
report |
| 5 |
EfficientNet-B7 (advprop+autoaug) |
49.7 | 45 | 52 | – |
Paper |
Code |
2019 |
community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified |
report |
| 6 |
EfficientNet-B6 (advprop+autoaug) |
49.6 | 44.7 | 53.2 | – |
Paper |
Code |
2019 |
community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified |
report |
| 7 |
EfficientNet-B5 (advprop+autoaug) |
49.1 | 44 | 51.7 | – |
Paper |
Code |
2019 |
community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified |
report |
| 8 |
ViT-16/L-224 |
49 | | | ✓ |
Paper |
Code |
2020 |
official: harvested, nothing ran · 307 ran (of which 165 constructed an object rather than computing a result; 286 with no instrument failure: 8 honoured, 2 violated, 276 with no contract checked; 21 where Syntology's instrument failed) · 112 unverified |
report |
| 9 |
ResNet-50 (gn) |
48.9 | 39.1 | 44.4 | – |
Paper |
Code |
2021 |
official: harvested for another paper · 0 ran · 3 unverified |
report |
| 10 |
EfficientNet-B4 (advprop+autoaug) |
48.1 | 42.5 | 51.4 | – |
Paper |
Code |
2019 |
community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified |
report |
| 11 |
ResNet-152 |
47.5 | 43.3 | 51.3 | – |
Paper |
Code |
2015 |
official: no sample here; runs from other or unrecorded repositories · 254 ran (of which 108 constructed an object rather than computing a result; 163 with no instrument failure: 3 honoured, 1 violated, 159 with no contract checked; 91 where Syntology's instrument failed) · 123 unverified |
report |
| 12 |
ResNet-101 |
46.3 | 40.5 | 50.1 | – |
Paper |
Code |
2015 |
official: no sample here; runs from other or unrecorded repositories · 254 ran (of which 108 constructed an object rather than computing a result; 163 with no instrument failure: 3 honoured, 1 violated, 159 with no contract checked; 91 where Syntology's instrument failed) · 123 unverified |
report |
| 13 |
EfficientNet-B6 (autoaug) |
45.8 | 39.3 | 50.7 | – |
Paper |
Code |
2019 |
linked, not harvested |
report |
| 14 |
EfficientNet-B5 (autoaug) |
45.7 | 39.8 | 50.2 | – |
Paper |
Code |
2019 |
linked, not harvested |
report |
| 15 |
EfficientNet-B3 (advprop+autoaug) |
45.5 | 39.8 | 49.5 | – |
Paper |
Code |
2019 |
community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified |
report |
| 16 |
EfficientNet-B7 (autoaug) |
45 | 39.1 | 49.9 | – |
Paper |
Code |
2019 |
linked, not harvested |
report |
| 17 |
EfficientNet-B7 (randaug) |
45 | 38.9 | 48.7 | – |
Paper |
Code |
2019 |
58 ran (of which 1 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 1 violated, 6 with no contract checked; 51 where Syntology's instrument failed) · 7 unverified |
report |
| 18 |
EfficientNet-B4 (autoaug) |
44.3 | 38.2 | 48.6 | – |
Paper |
Code |
2019 |
linked, not harvested |
report |
| 19 |
EfficientNet-B2 (advprop+autoaug) |
44.3 | 38.2 | 48 | – |
Paper |
Code |
2019 |
community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified |
report |
| 20 |
ResNet-50 |
42.9 | 37.1 | 47.7 | – |
Paper |
Code |
2015 |
official: no sample here; runs from other or unrecorded repositories · 254 ran (of which 108 constructed an object rather than computing a result; 163 with no instrument failure: 3 honoured, 1 violated, 159 with no contract checked; 91 where Syntology's instrument failed) · 123 unverified |
report |
| 21 |
EfficientNet-B5 |
42.8 | 37 | 47.3 | – |
Paper |
Code |
2019 |
official: no sample here; runs from other or unrecorded repositories · 198 ran (of which 73 constructed an object rather than computing a result; 157 with no instrument failure: 26 honoured, 2 violated, 129 with no contract checked; 41 where Syntology's instrument failed) · 104 unverified |
report |
| 22 |
EfficientNet-B3 (autoaug) |
42.6 | 34.9 | 47.5 | – |
Paper |
Code |
2018 |
community repositories only · 25 ran (of which 0 constructed an object rather than computing a result; 22 with no instrument failure: 1 honoured, 2 violated, 19 with no contract checked; 3 where Syntology's instrument failed) · 18 unverified |
report |
| 23 |
EfficientNet-B1 (advprop+autoaug) |
42.4 | 36.2 | 46.7 | – |
Paper |
Code |
2019 |
community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified |
report |
| 24 |
ResNet-50 (augmix) |
42.2 | 35.9 | 46.4 | – |
Paper |
Code |
2019 |
official (archive's flag): 12 ran · 46 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 4 honoured, 2 violated, 3 with no contract checked; 37 where Syntology's instrument failed) · 5 unverified |
report |
| 25 |
EfficientNet-B5 (randaug) |
42.1 | 35.5 | 47.3 | – |
Paper |
Code |
2019 |
58 ran (of which 1 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 1 violated, 6 with no contract checked; 51 where Syntology's instrument failed) · 7 unverified |
report |
| 26 |
ResNet-101 (lpf3) |
41.7 | 35.7 | 46.1 | – |
Paper |
Code |
2019 |
official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified |
report |
| 27 |
EfficientNet-B4 |
41.7 | 35.6 | 46.4 | – |
Paper |
Code |
2019 |
official: no sample here; runs from other or unrecorded repositories · 198 ran (of which 73 constructed an object rather than computing a result; 157 with no instrument failure: 26 honoured, 2 violated, 129 with no contract checked; 41 where Syntology's instrument failed) · 104 unverified |
report |
| 28 |
EfficientNet-B2 (autoaug) |
41.6 | 34.3 | 45.8 | – |
Paper |
Code |
2018 |
community repositories only · 25 ran (of which 0 constructed an object rather than computing a result; 22 with no instrument failure: 1 honoured, 2 violated, 19 with no contract checked; 3 where Syntology's instrument failed) · 18 unverified |
report |
| 29 |
ResNet-50 (lpf5) |
41.5 | 35.2 | 45.3 | – |
Paper |
Code |
2019 |
official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified |
report |
| 30 |
ResNet-50 (deepaugment) |
41.3 | 34.9 | 46 | – |
Paper |
Code |
2020 |
official (archive's flag): 14 ran · 14 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 12 where Syntology's instrument failed) · 0 unverified |
report |
| 31 |
ResNet-101 (lpf2) |
41.1 | 35.1 | 45.2 | – |
Paper |
Code |
2019 |
official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified |
report |
| 32 |
ResNet-101 (lpf5) |
41 | 34.8 | 45.8 | – |
Paper |
Code |
2019 |
official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified |
report |
| 33 |
EfficientNet-B3 |
40.7 | 34.2 | 45.3 | – |
Paper |
Code |
2019 |
official: no sample here; runs from other or unrecorded repositories · 198 ran (of which 73 constructed an object rather than computing a result; 157 with no instrument failure: 26 honoured, 2 violated, 129 with no contract checked; 41 where Syntology's instrument failed) · 104 unverified |
report |
| 34 |
EfficientNet-B0 (advprop+autoaug) |
40.5 | 34.2 | 44.9 | – |
Paper |
Code |
2019 |
community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified |
report |
| 35 |
ResNet-50 (deepaugment+augmix) |
40.3 | 34.1 | 44.5 | – |
Paper |
Code |
2020 |
official (archive's flag): 14 ran · 14 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 12 where Syntology's instrument failed) · 0 unverified |
report |
| 36 |
ResNet-50 (lpf2) |
40.3 | 33.4 | 45.1 | – |
Paper |
Code |
2019 |
official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified |
report |
| 37 |
ResNet-50 (lpf3) |
40 | 34.3 | 44.7 | – |
Paper |
Code |
2019 |
official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified |
report |
| 38 |
ResNet-26-D |
39.7 | 35.8 | 43.5 | – |
Paper |
Code |
2018 |
community repositories only · 11 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 2 honoured, 0 violated, 7 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified |
report |
| 39 |
EfficientNet-B1 (autoaug) |
39.7 | 32.8 | 44.4 | – |
Paper |
Code |
2018 |
community repositories only · 25 ran (of which 0 constructed an object rather than computing a result; 22 with no instrument failure: 1 honoured, 2 violated, 19 with no contract checked; 3 where Syntology's instrument failed) · 18 unverified |
report |
| 40 |
ResNet-50 (SIN_IN_IN) |
39.2 | 32.4 | 44.6 | – |
Paper |
Code |
2018 |
community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified |
report |
| 41 |
ResNet-50 (IN-C) |
38.8 | 33.6 | 42.9 | – |
Paper |
Code |
2020 |
linked, not harvested |
report |
| 42 |
ResNet-50 (IN-C_brightness) |
38.8 | 32.5 | 43.5 | – |
Paper |
Code |
2020 |
linked, not harvested |
report |
| 43 |
DenseNet121 (lpf5) |
38.7 | 32 | 42.7 | – |
Paper |
Code |
2019 |
official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified |
report |
| 44 |
ResNet-34 (lpf2) |
38.3 | 32.4 | 42.8 | – |
Paper |
Code |
2019 |
official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified |
report |
| 45 |
DenseNet-121 (lpf3) |
38.3 | 32.3 | 42.8 | – |
Paper |
Code |
2019 |
official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified |
report |
| 46 |
ResNet-34 (lpf3) |
38.3 | 31.9 | 42.9 | – |
Paper |
Code |
2019 |
official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified |
report |
| 47 |
DenseNet-121 (lpf2) |
38.3 | 31.7 | 43.1 | – |
Paper |
Code |
2019 |
official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified |
report |
| 48 |
ResNet-50 (IN-C_spatter) |
38.3 | 31.4 | 42.7 | – |
Paper |
Code |
2020 |
linked, not harvested |
report |
| 49 |
ResNet-50 (SIN_IN) |
38.2 | 32.5 | 42.7 | – |
Paper |
Code |
2018 |
community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified |
report |
| 50 |
ResNet-50 (IN-C_saturate) |
38.2 | 32.4 | 42.4 | – |
Paper |
Code |
2020 |
linked, not harvested |
report |
| 51 |
EfficientNet-B2 |
38.1 | 31.4 | 42.8 | – |
Paper |
Code |
2019 |
official: no sample here; runs from other or unrecorded repositories · 198 ran (of which 73 constructed an object rather than computing a result; 157 with no instrument failure: 26 honoured, 2 violated, 129 with no contract checked; 41 where Syntology's instrument failed) · 104 unverified |
report |
| 52 |
ResNet-50 (IN-C_pixelate) |
37.4 | 30.9 | 41.4 | – |
Paper |
Code |
2020 |
linked, not harvested |
report |
| 53 |
VGG-16 BN (lpf2) |
37.2 | 31.3 | 41.8 | – |
Paper |
Code |
2019 |
official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified |
report |
| 54 |
ResNet-34 (lpf5) |
37.2 | 29.9 | 42.5 | – |
Paper |
Code |
2019 |
official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified |
report |
| 55 |
VGG-16 BN (lpf5) |
37 | 30.8 | 41.7 | – |
Paper |
Code |
2019 |
official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified |
report |
| 56 |
VGG-16 BN (lpf3) |
36.9 | 30.6 | 42.1 | – |
Paper |
Code |
2019 |
official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified |
report |
| 57 |
VGG-16 BN |
36.7 | 31.1 | 41.1 | – |
Paper |
Code |
2014 |
81 ran (of which 0 constructed an object rather than computing a result; 69 with no instrument failure: 0 honoured, 0 violated, 69 with no contract checked; 12 where Syntology's instrument failed) · 41 unverified |
report |
| 58 |
EfficientNet-B1 |
36.7 | 30.9 | 41.5 | – |
Paper |
Code |
2019 |
official: no sample here; runs from other or unrecorded repositories · 198 ran (of which 73 constructed an object rather than computing a result; 157 with no instrument failure: 26 honoured, 2 violated, 129 with no contract checked; 41 where Syntology's instrument failed) · 104 unverified |
report |
| 59 |
ResNet-50 (IN-C_contrast) |
36.5 | 30.7 | 40.9 | – |
Paper |
Code |
2020 |
linked, not harvested |
report |
| 60 |
ResNet-50 (IN-C_jpeg_compression) |
36.5 | 30.3 | 41.3 | – |
Paper |
Code |
2020 |
linked, not harvested |
report |
| 61 |
ResNet-50 (IN-C_gaussian_noise) |
36.4 | 30.2 | 40.6 | – |
Paper |
Code |
2020 |
linked, not harvested |
report |
| 62 |
VGG-19 BN |
36.2 | 29.4 | 40.8 | – |
Paper |
Code |
2014 |
81 ran (of which 0 constructed an object rather than computing a result; 69 with no instrument failure: 0 honoured, 0 violated, 69 with no contract checked; 12 where Syntology's instrument failed) · 41 unverified |
report |
| 63 |
ResNet-50 (IN-C_frost) |
36.1 | 29.7 | 40 | – |
Paper |
Code |
2020 |
linked, not harvested |
report |
| 64 |
MobileNetV2 (lpf3) |
36 | 30.4 | 40.3 | – |
Paper |
Code |
2019 |
official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified |
report |
| 65 |
ResNet-50 (IN-C_fog_aws) |
35.9 | 30.3 | 39.9 | – |
Paper |
Code |
2020 |
linked, not harvested |
report |
| 66 |
MobileNetV2 (lpf5) |
35.8 | 29.1 | 40.1 | – |
Paper |
Code |
2019 |
official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified |
report |
| 67 |
ResNet-50 (IN-C_motion_blur) |
35.7 | 30.2 | 39.6 | – |
Paper |
Code |
2020 |
linked, not harvested |
report |
| 68 |
ResNet-18 (lpf3) |
35.6 | 28.5 | 39.5 | – |
Paper |
Code |
2019 |
official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified |
report |
| 69 |
MobileNetV2 (lpf2) |
35.5 | 30.3 | 39.2 | – |
Paper |
Code |
2019 |
official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified |
report |
| 70 |
ResNet-18 (lpf2) |
35.5 | 28.7 | 40.1 | – |
Paper |
Code |
2019 |
official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified |
report |
| 71 |
VGG-16 (lpf3) |
35.1 | 28.2 | 40 | – |
Paper |
Code |
2019 |
official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified |
report |
| 72 |
EfficientNet-B0 (autoaug) |
34.9 | 27.3 | 40.1 | – |
Paper |
Code |
2018 |
community repositories only · 25 ran (of which 0 constructed an object rather than computing a result; 22 with no instrument failure: 1 honoured, 2 violated, 19 with no contract checked; 3 where Syntology's instrument failed) · 18 unverified |
report |
| 73 |
VGG-19 |
34.7 | 29 | 39.3 | – |
Paper |
Code |
2014 |
81 ran (of which 0 constructed an object rather than computing a result; 69 with no instrument failure: 0 honoured, 0 violated, 69 with no contract checked; 12 where Syntology's instrument failed) · 41 unverified |
report |
| 74 |
VGG-16 |
34.7 | 28.5 | 39.5 | – |
Paper |
Code |
2014 |
81 ran (of which 0 constructed an object rather than computing a result; 69 with no instrument failure: 0 honoured, 0 violated, 69 with no contract checked; 12 where Syntology's instrument failed) · 41 unverified |
report |
| 75 |
ResNet-18 (lpf5) |
34.7 | 27.7 | 38.9 | – |
Paper |
Code |
2019 |
official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified |
report |
| 76 |
VGG-16 (lpf5) |
34.5 | 27.8 | 39.4 | – |
Paper |
Code |
2019 |
official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified |
report |
| 77 |
EfficientNet-B0 |
34.2 | 27.4 | 38.4 | – |
Paper |
Code |
2019 |
official: no sample here; runs from other or unrecorded repositories · 198 ran (of which 73 constructed an object rather than computing a result; 157 with no instrument failure: 26 honoured, 2 violated, 129 with no contract checked; 41 where Syntology's instrument failed) · 104 unverified |
report |
| 78 |
VGG-13 BN |
33.7 | 28.3 | 38.4 | – |
Paper |
Code |
2014 |
81 ran (of which 0 constructed an object rather than computing a result; 69 with no instrument failure: 0 honoured, 0 violated, 69 with no contract checked; 12 where Syntology's instrument failed) · 41 unverified |
report |
| 79 |
VGG-16 (lpf2) |
33.5 | 26.7 | 38.5 | – |
Paper |
Code |
2019 |
official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified |
report |
| 80 |
VGG-11 BN |
32.9 | 25.8 | 37.1 | – |
Paper |
Code |
2014 |
81 ran (of which 0 constructed an object rather than computing a result; 69 with no instrument failure: 0 honoured, 0 violated, 69 with no contract checked; 12 where Syntology's instrument failed) · 41 unverified |
report |
| 81 |
ResNet-50 (IN-C_zoom_blur) |
32.7 | 28.3 | 36.6 | – |
Paper |
Code |
2020 |
linked, not harvested |
report |
| 82 |
VGG-13 |
32.4 | 26.4 | 36.5 | – |
Paper |
Code |
2014 |
81 ran (of which 0 constructed an object rather than computing a result; 69 with no instrument failure: 0 honoured, 0 violated, 69 with no contract checked; 12 where Syntology's instrument failed) · 41 unverified |
report |
| 83 |
VGG-11 |
31.5 | 25.2 | 36.1 | – |
Paper |
Code |
2014 |
81 ran (of which 0 constructed an object rather than computing a result; 69 with no instrument failure: 0 honoured, 0 violated, 69 with no contract checked; 12 where Syntology's instrument failed) · 41 unverified |
report |
| 84 |
ResNet-50 (IN-C_greyscale) |
30.2 | 24.3 | 34.3 | – |
Paper |
Code |
2020 |
linked, not harvested |
report |
| 85 |
ResNet-50 (adv-train-free) |
26.7 | 20.5 | 30.9 | – |
Paper |
Code |
2019 |
official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified |
report |
| 86 |
ResNet-50 (SIN) |
25.3 | 20.4 | 30 | – |
Paper |
Code |
2018 |
community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified |
report |
| 87 |
AlexNet (lpf3) |
23.1 | 17.5 | 26.8 | – |
Paper |
Code |
2019 |
official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified |
report |
| 88 |
AlexNet (lpf2) |
22.8 | 18.2 | 26.8 | – |
Paper |
Code |
2019 |
official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified |
report |
| 89 |
AlexNet (lpf5) |
22.7 | 18.4 | 26.8 | – |
Paper |
Code |
2019 |
official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified |
report |
| 90 |
ViT-8/B-224 |
| | 450 | ✓ |
Paper |
Code |
2020 |
official: harvested, nothing ran · 307 ran (of which 165 constructed an object rather than computing a result; 286 with no instrument failure: 8 honoured, 2 violated, 276 with no contract checked; 21 where Syntology's instrument failed) · 112 unverified |
report |