Methods › General › Stochastic Optimization › SGD with Momentum
SGD with Momentum
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
Why SGD with Momentum?
In deep learning, we have used stochastic gradient descent as one of the optimizers because at the end we will find the minimum weight and bias at which the model loss is lowest. In the SGD we have some issues in which the SGD does not work perfectly because in deep learning we got a non-convex cost function graph and if use the simple SGD then it leads to low performance. There are 3 main reasons why it does not work:
1) We end up in local minima and not able to reach global minima At the start, we randomly start at some point and we are going to end up at the local minimum and not able to reach the global minimum.
2) Saddle Point will be the stop for reaching global minima A saddle point is a point where in one direction the surface goes in the upward direction and in another direction it goes downwards. So that the slope is changing very gradually so the speed of changing is going to slow and as result, the training also going to slow.
3) High curvature can be a reason The larger radius leads to low curvature and vice-versa. It will be difficult to traverse in the large curvature which was generally high in non-convex optimization. By using the SGD with Momentum optimizer we can overcome the problems like high curvature, consistent gradient, and noisy gradient.
What is SGD with Momentum?
SGD with Momentum is an optimization technique designed to improve the performance of neural networks. To understand the intuition behind it, consider the analogy of a ball rolling down a slope. As it rolls, the ball gains speed over time due to momentum.
Suppose we have a starting point A and want to reach B. If we are uncertain about the correct direction, we can ask four other points that have already reached B. If all four indicate the same direction, we can move more confidently and at a faster pace. This is the key idea behind SGD with Momentum.
How does SGD with Momentum work?
To understand its working, we must first explore the concept of the Exponentially Weighted Moving Average (EWMA), a technique used to identify trends in time-series data. The formula for EWMA is:
In the formula, β represents the weightage that is going to assign to the past values of the gradient. The values of β is from 0 < β < 1. If the value of the beta is 0.5 then it means that the 1/1–0.5 = 2 so it represents that the calculated average was from the previous 2 readings.
The value of Vt depends on β. The higher the value of β the more we try to get an average of more past data and vice-versa. For example, let's take the value of β 0.98 and 0.5 for two different scenarios so if we do 1/1-β then we get 50 and 10 respectively so it was clear that to calculate the average we take past 50 and 10 outcomes respectively for both cases. Now in SGD with Momentum, we use the same concept of EWMA. Here we introduce the term velocity v which is used to denote the change in the gradient to get to the global minima. The change in the weights is denoted by the formula:
the β part of the V formula denotes and is useful to compute the confidence or we can say the past velocity for calculating Vt we have to calculate Vt-1 and for calculating Vt-1 we have to calculate Vt-2 and likewise. So we are using the history of velocity to calculate the momentum and this is the part that provides acceleration to the formula.
Here we have to consider two cases: 1. β=0 then, as per the formula weight updating is going to just work as a Stochastic gradient descent. Here we called β a decaying factor because it is defining the speed of past velocity.
- β=1 then, there will be no decay. It involves the dynamic equilibrium which is not desired so we generally use the value of β like 0.9,0.99or 0.5 only.
Advantages of SGD with Momentum
- Faster Convergence: Momentum accelerates training, making it faster than standard SGD.
- Escaping Local Minima: Momentum helps the optimizer overcome small local minima and reach the global minimum.
In the following visualization, purple represents SGD with Momentum, while light blue represents standard SGD. As shown, SGD with Momentum successfully reaches the global minimum, whereas standard SGD gets stuck in local minima.
However, momentum itself can sometimes be problematic. When the optimizer reaches the global minimum, excessive momentum may cause oscillations before stabilizing, leading to longer training times. Despite this, SGD with Momentum remains significantly faster than standard SGD and is widely used in optimization.
In Syntology name not resolved (unknown_name). The lookup matched no method, paper or venue by this name; that asserts nothing about whether code exists.
Near matches the lookup lists, each a different name: Cayley SGD with momentum; Frequency Stochastic Gradient Descent with Momentum (FSGDM); ∞-SGD; SGD-KV; INO-SGD; FBi-SGD; badr-sgd; DP-SGD-RC.
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
Papers archive 2025-07-28
archive papers tagged: 144 · with a code link: 121 · where Syntology ran a sample: 72 (61 with a run with no instrument failure, 11 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (72 of 144 tagged: 61 with a run with no instrument failure, 11 where every run was a failure of Syntology's instrument)
Page 1 of 2: papers 1 to 100 of 144, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
AdamS: Momentum Itself Can Be A Normalizer for LLM Pretraining and Post-training 22 May 2025 · 1 repository · arXiv:2505.16363Syntology official: no sample here; runs from other or unrecorded repositories · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Understanding Gradient Orthogonalization for Deep Learning via Non-Euclidean Trust-Region Optimization 16 Mar 2025 · 0 repositories · arXiv:2503.12645
-
Algorithmic Stability of Stochastic Gradient Descent with Momentum under Heavy-Tailed Noise 2 Feb 2025 · 0 repositories · arXiv:2502.00885
-
SOFIM: Stochastic Optimization Using Regularized Fisher Information Matrix 5 Mar 2024 · 0 repositories · arXiv:2403.02833
-
Should I try multiple optimizers when fine-tuning pre-trained Transformers for NLP tasks? Should I tune their hyperparameters? 10 Feb 2024 · 0 repositories · arXiv:2402.06948
-
Momentum Does Not Reduce Stochastic Noise in Stochastic Gradient Descent 4 Feb 2024 · 0 repositories · arXiv:2402.02325
-
AdaPlus: Integrating Nesterov Momentum and Precise Stepsize Adjustment on AdamW Basis 5 Sep 2023 · 1 repository · arXiv:2309.01966
-
When and Why Momentum Accelerates SGD:An Empirical Study 15 Jun 2023 · 0 repositories · arXiv:2306.09000
-
Fast Diffusion Model 12 Jun 2023 · 1 repository · arXiv:2306.06991Syntology official (archive's flag): 14 ran · 14 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 4 honoured, 0 violated, 1 with no contract checked; 9 where Syntology's instrument failed) · 3 unverified (of 17 harvested samples) · 9 pointer-only (licence)
-
Layer-wise Adaptive Step-Sizes for Stochastic First-Order Methods for Deep Learning 23 May 2023 · 0 repositories · arXiv:2305.13664
-
MoMo: Momentum Models for Adaptive Learning Rates 12 May 2023 · 1 repository · arXiv:2305.07583Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
A view of mini-batch SGD via generating functions: conditions of convergence, phase transitions, benefit from negative momenta 22 Jun 2022 · 1 repository · arXiv:2206.11124Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Computing the Variance of Shuffling Stochastic Gradient Algorithms via Power Spectral Density Analysis 1 Jun 2022 · 1 repository · arXiv:2206.00632
-
An Adaptive Gradient Method with Energy and Momentum 23 Mar 2022 · 1 repository · arXiv:2203.12191
-
Does Momentum Change the Implicit Regularization on Separable Data? 8 Oct 2021 · 0 repositories · arXiv:2110.03891
-
Using a one dimensional parabolic model of the full-batch loss to estimate learning rates during training 31 Aug 2021 · 1 repository · arXiv:2108.13880
-
On the Hyperparameters in Stochastic Gradient Descent with Momentum 9 Aug 2021 · 0 repositories · arXiv:2108.03947
-
A New Adaptive Gradient Method with Gradient Decomposition 18 Jul 2021 · 0 repositories · arXiv:2107.08377
-
LRTuner: A Learning Rate Tuner for Deep Neural Networks 30 May 2021 · 2 repositories · arXiv:2105.14526
-
Fast Federated Learning by Balancing Communication Trade-Offs 23 May 2021 · 2 repositories · arXiv:2105.11028
-
Positive-Negative Momentum: Manipulating Stochastic Gradient Noise to Improve Generalization 31 Mar 2021 · 1 repository · arXiv:2103.17182Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)
-
Bottleneck Transformers for Visual Recognition 27 Jan 2021 · 13 repositories · arXiv:2101.11605Syntology 26 ran (of which 9 constructed an object rather than computing a result; 19 with no instrument failure: 1 honoured, 0 violated, 18 with no contract checked; 7 where Syntology's instrument failed) · 23 unverified (of 49 harvested samples) · 8 pointer-only (licence)
-
The Ikshana Hypothesis of Human Scene Understanding 21 Jan 2021 · 2 repositories · arXiv:2101.10837
-
RepVGG: Making VGG-style ConvNets Great Again 11 Jan 2021 · 25 repositories · arXiv:2101.03697Syntology official (archive's flag): 2 ran · 13 ran (of which 7 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 5 where Syntology's instrument failed) · 3 unverified (of 16 harvested samples) · 6 pointer-only (licence)
-
MAGNeto: An Efficient Deep Learning Method for the Extractive Tags Summarization Problem 9 Nov 2020 · 1 repository · arXiv:2011.04349
-
Dual Averaging is Surprisingly Effective for Deep Learning Optimization 20 Oct 2020 · 0 repositories · arXiv:2010.10502
-
AEGD: Adaptive Gradient Descent with Energy 10 Oct 2020 · 1 repository · arXiv:2010.05109
-
Regularizing Neural Networks via Adversarial Model Perturbation 10 Oct 2020 · 1 repository · arXiv:2010.04925Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 12 harvested samples)
-
Momentum via Primal Averaging: Theoretical Insights and Learning Rate Schedules for Non-Convex Optimization 1 Oct 2020 · 1 repository · arXiv:2010.00406
-
Optimization of Graph Neural Networks with Natural Gradient Descent 21 Aug 2020 · 1 repository · arXiv:2008.09624
-
SpinalNet: Deep Neural Network with Gradual Input 7 Jul 2020 · 3 repositories · arXiv:2007.03347
-
Adaptive Braking for Mitigating Gradient Delay 2 Jul 2020 · 0 repositories · arXiv:2007.01397
-
SQuARM-SGD: Communication-Efficient Momentum SGD for Decentralized Optimization 13 May 2020 · 0 repositories · arXiv:2005.07041
-
Supervised Contrastive Learning 23 Apr 2020 · 26 repositories · arXiv:2004.11362Syntology community repositories only · 17 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 2 honoured, 0 violated, 10 with no contract checked; 5 where Syntology's instrument failed) · 6 unverified (of 23 harvested samples) · 5 pointer-only (licence)
-
YOLOv4: Optimal Speed and Accuracy of Object Detection 23 Apr 2020 · 223 repositories · arXiv:2004.10934Syntology community repositories only · 142 ran (of which 0 constructed an object rather than computing a result; 128 with no instrument failure: 8 honoured, 0 violated, 120 with no contract checked; 14 where Syntology's instrument failed) · 42 unverified (of 184 harvested samples) · 21 pointer-only (licence)
-
ResNeSt: Split-Attention Networks 19 Apr 2020 · 36 repositories · arXiv:2004.08955Syntology official (archive's flag): 5 ran · 28 ran (of which 0 constructed an object rather than computing a result; 21 with no instrument failure: 0 honoured, 0 violated, 21 with no contract checked; 7 where Syntology's instrument failed) · 20 unverified (of 48 harvested samples) · 23 pointer-only (licence)
-
Designing Network Design Spaces 30 Mar 2020 · 26 repositories · arXiv:2003.13678Syntology community repositories only · 48 ran (of which 0 constructed an object rather than computing a result; 41 with no instrument failure: 4 honoured, 0 violated, 37 with no contract checked; 7 where Syntology's instrument failed) · 5 unverified (of 53 harvested samples) · 7 pointer-only (licence)
-
Hit-Detector: Hierarchical Trinity Architecture Search for Object Detection 26 Mar 2020 · 1 repository · arXiv:2003.11818
-
Revisiting the Sibling Head in Object Detector 17 Mar 2020 · 2 repositories · arXiv:2003.07540
-
Improved Baselines with Momentum Contrastive Learning 9 Mar 2020 · 36 repositories · arXiv:2003.04297Syntology official: no sample here; runs from other or unrecorded repositories · 28 ran (of which 0 constructed an object rather than computing a result; 21 with no instrument failure: 0 honoured, 1 violated, 20 with no contract checked; 7 where Syntology's instrument failed) · 15 unverified (of 43 harvested samples) · 15 pointer-only (licence)
-
Momentum Improves Normalized SGD 9 Feb 2020 · 0 repositories · arXiv:2002.03305
-
Compounding the Performance Improvements of Assembled Techniques in a Convolutional Neural Network 17 Jan 2020 · 1 repository · arXiv:2001.06268Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 8 unverified (of 11 harvested samples)
-
Training Deep Networks with Stochastic Gradient Normalized by Layerwise Adaptive Second Moments 1 Jan 2020 · 0 repositories
-
Big Transfer (BiT): General Visual Representation Learning 24 Dec 2019 · 9 repositories · arXiv:1912.11370Syntology community repositories only · 9 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 1 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 10 harvested samples)
-
PointRend: Image Segmentation as Rendering 17 Dec 2019 · 14 repositories · arXiv:1912.08193Syntology community repositories only · 16 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 5 where Syntology's instrument failed) · 2 unverified (of 18 harvested samples)
-
SpineNet: Learning Scale-Permuted Backbone for Recognition and Localization 10 Dec 2019 · 13 repositories · arXiv:1912.05027
-
Bridging the Gap Between Anchor-based and Anchor-free Detection via Adaptive Training Sample Selection 5 Dec 2019 · 13 repositories · arXiv:1912.02424Syntology community repositories only · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
What's Hidden in a Randomly Weighted Neural Network? 29 Nov 2019 · 4 repositories · arXiv:1911.13299Syntology official (archive's flag): 5 ran · 9 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples) · 5 pointer-only (licence)
-
CSPNet: A New Backbone that can Enhance Learning Capability of CNN 27 Nov 2019 · 123 repositories · arXiv:1911.11929
-
GhostNet: More Features from Cheap Operations 27 Nov 2019 · 33 repositories · arXiv:1911.11907Syntology community repositories only · 19 ran (of which 0 constructed an object rather than computing a result; 16 with no instrument failure: 3 honoured, 0 violated, 13 with no contract checked; 3 where Syntology's instrument failed) · 4 unverified (of 23 harvested samples) · 5 pointer-only (licence)
-
Learning Spatial Fusion for Single-Shot Object Detection 21 Nov 2019 · 1 repository · arXiv:1911.09516
-
EfficientDet: Scalable and Efficient Object Detection 20 Nov 2019 · 64 repositories · arXiv:1911.09070Syntology official (archive's flag): 1 ran · 55 ran (of which 1 constructed an object rather than computing a result; 48 with no instrument failure: 4 honoured, 0 violated, 44 with no contract checked; 7 where Syntology's instrument failed) · 15 unverified (of 70 harvested samples) · 7 pointer-only (licence)
-
CenterMask : Real-Time Anchor-Free Instance Segmentation 15 Nov 2019 · 8 repositories · arXiv:1911.06667Syntology official (archive's flag): 1 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
Momentum Contrast for Unsupervised Visual Representation Learning 13 Nov 2019 · 44 repositories · arXiv:1911.05722Syntology community repositories only · 28 ran (of which 16 constructed an object rather than computing a result; 23 with no instrument failure: 0 honoured, 0 violated, 23 with no contract checked; 5 where Syntology's instrument failed) · 14 unverified (of 42 harvested samples) · 19 pointer-only (licence)
-
An Exponential Learning Rate Schedule for Deep Learning 16 Oct 2019 · 0 repositories · arXiv:1910.07454
-
Demon: Improved Neural Network Training with Momentum Decay 11 Oct 2019 · 2 repositories · arXiv:1910.04952
-
ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks 8 Oct 2019 · 13 repositories · arXiv:1910.03151Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified (of 8 harvested samples) · 1 pointer-only (licence)
-
Deformable Kernels: Adapting Effective Receptive Fields for Object Deformation 7 Oct 2019 · 2 repositories · arXiv:1910.02940
-
RandAugment: Practical automated data augmentation with a reduced search space 30 Sep 2019 · 19 repositories · arXiv:1909.13719Syntology 58 ran (of which 1 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 1 violated, 6 with no contract checked; 51 where Syntology's instrument failed) · 7 unverified (of 65 harvested samples) · 17 pointer-only (licence)
-
diffGrad: An Optimization Method for Convolutional Neural Networks 12 Sep 2019 · 1 repository · arXiv:1909.11015
-
LIP: Local Importance-based Pooling 12 Aug 2019 · 1 repository · arXiv:1908.04156
-
Attentive Normalization 4 Aug 2019 · 2 repositories · arXiv:1908.01259
-
MoGA: Searching Beyond MobileNetV3 4 Aug 2019 · 2 repositories · arXiv:1908.01314
-
Compact Global Descriptor for Neural Networks 23 Jul 2019 · 1 repository · arXiv:1907.09665
-
Densely Connected Search Space for More Flexible Neural Architecture Search 23 Jun 2019 · 1 repository · arXiv:1906.09607Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Contrastive Multiview Coding 13 Jun 2019 · 8 repositories · arXiv:1906.05849Syntology official (archive's flag): 1 ran · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 2 pointer-only (licence)
-
Stochastic Gradient Methods with Layer-wise Adaptive Moments for Training of Deep Networks 27 May 2019 · 3 repositories · arXiv:1905.11286Syntology 13 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 0 violated, 12 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 16 harvested samples) · 1 pointer-only (licence)
-
Spatial Group-wise Enhance: Improving Semantic Feature Learning in Convolutional Networks 23 May 2019 · 3 repositories · arXiv:1905.09646Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features 13 May 2019 · 30 repositories · arXiv:1905.04899Syntology community repositories only · 17 ran (of which 6 constructed an object rather than computing a result; 10 with no instrument failure: 2 honoured, 0 violated, 8 with no contract checked; 7 where Syntology's instrument failed) · 7 unverified (of 24 harvested samples) · 5 pointer-only (licence)
-
On the Linear Speedup Analysis of Communication Efficient Momentum SGD for Distributed Non-Convex Optimization 9 May 2019 · 0 repositories · arXiv:1905.03817
-
Billion-scale semi-supervised learning for image classification 2 May 2019 · 4 repositories · arXiv:1905.00546
-
GCNet: Non-local Networks Meet Squeeze-Excitation Networks and Beyond 25 Apr 2019 · 9 repositories · arXiv:1904.11492
-
Attention Augmented Convolutional Networks 22 Apr 2019 · 14 repositories · arXiv:1904.09925Syntology 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples) · 1 pointer-only (licence)
-
Data-Driven Neuron Allocation for Scale Aggregation Networks 20 Apr 2019 · 1 repository · arXiv:1904.09460
-
FoveaBox: Beyond Anchor-based Object Detector 8 Apr 2019 · 7 repositories · arXiv:1904.03797
-
Adaptive NMS: Refining Pedestrian Detection in a Crowd 7 Apr 2019 · 0 repositories · arXiv:1904.03629
-
Exploring Randomly Wired Neural Networks for Image Recognition 2 Apr 2019 · 9 repositories · arXiv:1904.01569Syntology 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 21 unverified (of 31 harvested samples) · 1 pointer-only (licence)
-
FCOS: Fully Convolutional One-Stage Object Detection 2 Apr 2019 · 87 repositories · arXiv:1904.01355Syntology official: no sample here; runs from other or unrecorded repositories · 37 ran (of which 0 constructed an object rather than computing a result; 30 with no instrument failure: 2 honoured, 2 violated, 26 with no contract checked; 7 where Syntology's instrument failed) · 3 unverified (of 40 harvested samples) · 19 pointer-only (licence)
-
Res2Net: A New Multi-scale Backbone Architecture 2 Apr 2019 · 34 repositories · arXiv:1904.01169Syntology 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 4 unverified (of 9 harvested samples) · 9 pointer-only (licence)
-
Feature Intertwiner for Object Detection 28 Mar 2019 · 2 repositories · arXiv:1903.11851
-
ThunderNet: Towards Real-time Generic Object Detection 28 Mar 2019 · 3 repositories · arXiv:1903.11752
-
DetNAS: Backbone Search for Object Detection 26 Mar 2019 · 2 repositories · arXiv:1903.10979Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples) · 3 pointer-only (licence)
-
SRM : A Style-based Recalibration Module for Convolutional Neural Networks 26 Mar 2019 · 1 repository · arXiv:1903.10829Syntology 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 2 pointer-only (licence)
-
Feature Selective Anchor-Free Module for Single-Shot Object Detection 2 Mar 2019 · 4 repositories · arXiv:1903.00621Syntology 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 6 unverified (of 8 harvested samples)
-
RetinaMask: Learning to predict masks improves state-of-the-art single-shot detection for free 10 Jan 2019 · 53 repositories · arXiv:1901.03353
-
ELASTIC: Improving CNNs with Dynamic Scaling Policies 13 Dec 2018 · 1 repository · arXiv:1812.05262Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 7 unverified (of 10 harvested samples) · 1 pointer-only (licence)
-
FBNet: Hardware-Aware Efficient ConvNet Design via Differentiable Neural Architecture Search 9 Dec 2018 · 5 repositories · arXiv:1812.03443Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Pelee: A Real-Time Object Detection System on Mobile Devices 1 Dec 2018 · 2 repositories
-
Grid R-CNN 29 Nov 2018 · 2 repositories · arXiv:1811.12030Syntology 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Deformable ConvNets v2: More Deformable, Better Results 27 Nov 2018 · 26 repositories · arXiv:1811.11168Syntology 10 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 1 honoured, 0 violated, 8 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 13 harvested samples) · 4 pointer-only (licence)
-
M2Det: A Single-Shot Object Detector based on Multi-Level Feature Pyramid Network 12 Nov 2018 · 11 repositories · arXiv:1811.04533Syntology 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Biologically-plausible learning algorithms can scale to large datasets 8 Nov 2018 · 2 repositories · arXiv:1811.03567
-
Kalman Gradient Descent: Adaptive Variance Reduction in Stochastic Optimization 29 Oct 2018 · 1 repository · arXiv:1810.12273
-
PSANet: Point-wise Spatial Attention Network for Scene Parsing 1 Sep 2018 · 4 repositories
-
A Unified Analysis of AdaGrad with Weighted Aggregation and Momentum Acceleration 10 Aug 2018 · 0 repositories · arXiv:1808.03408
-
Acquisition of Localization Confidence for Accurate Object Detection 30 Jul 2018 · 4 repositories · arXiv:1807.11590Syntology community repositories only · 17 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 0 honoured, 0 violated, 13 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 18 harvested samples) · 2 pointer-only (licence)
-
CBAM: Convolutional Block Attention Module 17 Jul 2018 · 31 repositories · arXiv:1807.06521Syntology 13 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 1 honoured, 0 violated, 9 with no contract checked; 3 where Syntology's instrument failed) · 9 unverified (of 22 harvested samples) · 3 pointer-only (licence)
-
Representation Learning with Contrastive Predictive Coding 10 Jul 2018 · 28 repositories · arXiv:1807.03748Syntology 35 ran (of which 21 constructed an object rather than computing a result; 30 with no instrument failure: 1 honoured, 0 violated, 29 with no contract checked; 5 where Syntology's instrument failed) · 10 unverified (of 45 harvested samples) · 22 pointer-only (licence)
-
Interpolatron: Interpolation or Extrapolation Schemes to Accelerate Optimization for Deep Neural Networks 17 May 2018 · 0 repositories · arXiv:1805.06753
-
Exploring the Limits of Weakly Supervised Pretraining 2 May 2018 · 4 repositories · arXiv:1805.00932
Tasks archive 2025-07-28
20 shown of 137 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections