Methods › General › Learning Rate Schedules › Exponential Decay
Exponential Decay
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
Exponential Decay is a learning rate schedule where we decay the learning rate with more iterations using an exponential function:
lr = lr₀exp(-kt)
Image Credit: Suki Lau
In Syntology name not resolved (unknown_name). The lookup matched no method, paper or venue by this name; that asserts nothing about whether code exists.
Near matches the lookup lists, each a different name: Decay RNN; exponential reward; pruning mask decay; exponential tilting; exponential tilting; Low-Rank Decay (LRD); Temporal-Decay Shapley; sparse structure decay.
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
Papers archive 2025-07-28
archive papers tagged: 110 · with a code link: 32 · where Syntology ran a sample: 15 (11 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (15 of 110 tagged: 11 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument)
Page 1 of 2: papers 1 to 100 of 110, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
The Debugging Decay Index: Rethinking Debugging Strategies for Code LLMs 23 Jun 2025 · 0 repositories · arXiv:2506.18403
-
Compact Amplified Laser Power Stabilization Using Robust Active Disturbance Rejection Control with Sensor Noise Decoupling 10 Jun 2025 · 0 repositories · arXiv:2506.08404
-
Towards Data-Driven Model-Free Safety-Critical Control 7 Jun 2025 · 0 repositories · arXiv:2506.06931
-
Asymptotically Optimal Linear Best Feasible Arm Identification with Fixed Budget 3 Jun 2025 · 0 repositories · arXiv:2506.02386
-
Beyond Exponential Decay: Rethinking Error Accumulation in Large Language Models 30 May 2025 · 0 repositories · arXiv:2505.24187
-
Continuous-Time Attention: PDE-Guided Mechanisms for Long-Sequence Transformers 27 May 2025 · 0 repositories · arXiv:2505.20666
-
Incremental Attractor Neural Network Modelling of the Lifespan Retrieval Curve 20 Apr 2025 · 0 repositories · arXiv:2504.14528
-
On Oversquashing in Graph Neural Networks Through the Lens of Dynamical Systems 11 Apr 2025 · 1 repository
-
Temporal Model On Quantum Logic 9 Feb 2025 · 0 repositories · arXiv:2502.07817
-
Uniform-in-time weak propagation of chaos for consensus-based optimization 1 Feb 2025 · 0 repositories · arXiv:2502.00582
-
Contextual Online Decision Making with Infinite-Dimensional Functional Regression 30 Jan 2025 · 0 repositories · arXiv:2501.18359
-
Hellinger-Kantorovich Gradient Flows: Global Exponential Decay of Entropy Functionals 28 Jan 2025 · 0 repositories · arXiv:2501.17049
-
The Stabilizer Bootstrap of Quantum Machine Learning with up to 10000 qubits 16 Dec 2024 · 0 repositories · arXiv:2412.11356
-
Modelling Networked Dynamical System by Temporal Graph Neural ODE with Irregularly Partial Observed Time-series Data 29 Nov 2024 · 0 repositories · arXiv:2412.00165
-
Scalable spectral representations for multi-agent reinforcement learning in network MDPs 22 Oct 2024 · 0 repositories · arXiv:2410.17221
-
Nonlinear second-order dynamics describe labial constriction trajectories across languages and contexts 10 Oct 2024 · 0 repositories · arXiv:2410.08351
-
Efficient 1-bit tensor approximations 2 Oct 2024 · 0 repositories · arXiv:2410.01799
-
Koopman Operator in the Weighted Function Spaces and its Learning for the Estimation of Lyapunov and Zubov Functions 30 Sep 2024 · 0 repositories · arXiv:2410.00223
-
Super Level Sets and Exponential Decay: A Synergistic Approach to Stable Neural Network Training 25 Sep 2024 · 0 repositories · arXiv:2409.16769
-
Quasi-potential and drift decomposition in stochastic systems by sparse identification 10 Sep 2024 · 0 repositories · arXiv:2409.06886
-
From Few to More: Scribble-based Medical Image Segmentation via Masked Context Modeling and Continuous Pseudo Labels 23 Aug 2024 · 0 repositories · arXiv:2408.12814
-
Unsupervised Blind Joint Dereverberation and Room Acoustics Estimation with Diffusion Models 14 Aug 2024 · 0 repositories · arXiv:2408.07472
-
Bridging Smoothness and Approximation: Theoretical Insights into Over-Smoothing in Graph Neural Networks 1 Jul 2024 · 0 repositories · arXiv:2407.01281
-
Losing Visual Needles in Image Haystacks: Vision Language Models are Easily Distracted in Short and Long Contexts 24 Jun 2024 · 0 repositories · arXiv:2406.16851
-
Finite Time Analysis of Temporal Difference Learning for Mean-Variance in a Discounted MDP 12 Jun 2024 · 0 repositories · arXiv:2406.07892
-
BUDDy: Single-Channel Blind Unsupervised Dereverberation with Diffusion Models 7 May 2024 · 1 repository · arXiv:2405.04272
-
Tackling Graph Oversquashing by Global and Local Non-Dissipativity 2 May 2024 · 0 repositories · arXiv:2405.01009
-
Contextual Categorization Enhancement through LLMs Latent-Space 25 Apr 2024 · 0 repositories · arXiv:2404.16442
-
Gradformer: Graph Transformer with Exponential Decay 24 Apr 2024 · 1 repository · arXiv:2404.15729Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples) · 9 pointer-only (licence)
-
LEMDA: A Novel Feature Engineering Method for Intrusion Detection in IoT Systems 20 Apr 2024 · 0 repositories · arXiv:2404.16870
-
An Improved Strategy for Blood Glucose Control Using Multi-Step Deep Reinforcement Learning 12 Mar 2024 · 0 repositories · arXiv:2403.07566
-
Mean-Field Analysis for Learning Subspace-Sparse Polynomials with Gaussian Input 14 Feb 2024 · 0 repositories · arXiv:2402.08948
-
On the Robustness of Deep Learning-aided Symbol Detectors to Varying Conditions and Imperfect Channel Knowledge 23 Jan 2024 · 0 repositories · arXiv:2401.12645
-
Preoperative Prediction of Catheter Ablation Outcome in Persistent Atrial Fibrillation Patients through Spectral Organization Analysis of the Surface Fibrillatory Waves 18 Jan 2024 · 0 repositories · arXiv:2401.10081
-
Reassessing the Exon-Foldon correspondence using Frustration Analysis 4 Jan 2024 · 1 repository · arXiv:2401.02371
-
Quantum Langevin Dynamics for Optimization 27 Nov 2023 · 0 repositories · arXiv:2311.15587
-
Risk Bounds of Accelerated SGD for Overparameterized Linear Regression 23 Nov 2023 · 0 repositories · arXiv:2311.14222
-
Hessian Eigenvectors and Principal Component Analysis of Neural Network Weight Matrices 1 Nov 2023 · 0 repositories · arXiv:2311.00452
-
Sub-linear Regret in Adaptive Model Predictive Control 7 Oct 2023 · 0 repositories · arXiv:2310.04842
-
Granger Causal Inference in Multivariate Hawkes Processes by Minimum Message Length 5 Sep 2023 · 1 repository · arXiv:2309.02027
-
TransNormerLLM: A Faster and Better Large Language Model with Improved TransNormer 27 Jul 2023 · 2 repositories · arXiv:2307.14995Syntology community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples) · 3 pointer-only (licence)
-
Smoothed f-Divergence Distributionally Robust Optimization 24 Jun 2023 · 0 repositories · arXiv:2306.14041
-
Non-Asymptotic Performance of Social Machine Learning Under Limited Data 15 Jun 2023 · 0 repositories · arXiv:2306.09397
-
Sparse Cholesky Factorization for Solving Nonlinear PDEs via Gaussian Processes 3 Apr 2023 · 1 repository · arXiv:2304.01294Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 10 harvested samples)
-
Temporal Graph Neural Networks for Irregular Data 16 Feb 2023 · 1 repository · arXiv:2302.08415
-
Learning Discretized Neural Networks under Ricci Flow 7 Feb 2023 · 0 repositories · arXiv:2302.03390
-
Extending SIRS epidemics to allow for gradual waning of immunity 16 Nov 2022 · 0 repositories · arXiv:2211.09062
-
Application of Hawkes volatility in the observation of filtered high-frequency price process in tick structures 13 Jul 2022 · 0 repositories · arXiv:2207.05939
-
On uniform-in-time diffusion approximation for stochastic gradient descent 11 Jul 2022 · 0 repositories · arXiv:2207.04922
-
Evidential Temporal-aware Graph-based Social Event Detection via Dempster-Shafer Theory 24 May 2022 · 0 repositories · arXiv:2205.12179
-
Gradient Descent, Stochastic Optimization, and Other Tales 2 May 2022 · 0 repositories · arXiv:2205.00832
-
NARX Identification using Derivative-Based Regularized Neural Networks 12 Apr 2022 · 0 repositories · arXiv:2204.05892
-
Analytic theory for the dynamics of wide quantum neural networks 30 Mar 2022 · 0 repositories · arXiv:2203.16711
-
Dealing with collinearity in large-scale linear system identification using Bayesian regularization 25 Mar 2022 · 0 repositories · arXiv:2203.13633
-
NESTANets: Stable, accurate and efficient neural networks for analysis-sparse inverse problems 2 Mar 2022 · 1 repository · arXiv:2203.00804
-
Instant Neural Graphics Primitives with a Multiresolution Hash Encoding 16 Jan 2022 · 17 repositories · arXiv:2201.05989Syntology official (archive's flag): 2 ran · 30 ran (of which 6 constructed an object rather than computing a result; 21 with no instrument failure: 3 honoured, 1 violated, 17 with no contract checked; 9 where Syntology's instrument failed) · 14 unverified (of 44 harvested samples) · 11 pointer-only (licence)
-
New volatility evolution model after extreme events 10 Jan 2022 · 0 repositories · arXiv:2201.03213
-
Programming Knowledge Tracing: A Comprehensive Dataset and A New Model 11 Dec 2021 · 0 repositories · arXiv:2112.08273
-
Deep Learning Based Automated COVID-19 Classification from Computed Tomography Images 22 Nov 2021 · 2 repositories · arXiv:2111.11191
-
Sequential Community Mode Estimation 16 Nov 2021 · 0 repositories · arXiv:2111.08535
-
Importance of Kernel Bandwidth in Quantum Machine Learning 9 Nov 2021 · 1 repository · arXiv:2111.05451
-
Efficient Bi-level Optimization for Non-smooth Optimization 29 Sep 2021 · 0 repositories
-
Ensemble Learning using Error Correcting Output Codes: New Classification Error Bounds 18 Sep 2021 · 0 repositories · arXiv:2109.08967
-
Mean-Field Multi-Agent Reinforcement Learning: A Decentralized Network Approach 5 Aug 2021 · 0 repositories · arXiv:2108.02731
-
The Limit Order Book Recreation Model (LOBRM): An Extended Analysis 1 Jul 2021 · 1 repository · arXiv:2107.00534
-
Slower is Better: Revisiting the Forgetting Mechanism in LSTM for Slower Information Decay 12 May 2021 · 0 repositories · arXiv:2105.05944
-
Bayesian inference and superstatistics to describe long memory processes of financial time series 10 May 2021 · 0 repositories · arXiv:2105.04171
-
SE-Harris and eSUSAN: Asynchronous Event-Based Corner Detection Using Megapixel Resolution CeleX-V Camera 2 May 2021 · 0 repositories · arXiv:2105.00480
-
Simultaneous Denoising and Localization Network for Photoacoustic Target Localization 30 Apr 2021 · 0 repositories · arXiv:2104.14713
-
The Butterfly Effect in Primary Visual Cortex 15 Apr 2021 · 0 repositories · arXiv:2104.07257
-
Surfacing Estimation Uncertainty in the Decay Parameters of Hawkes Processes with Exponential Kernels 2 Apr 2021 · 0 repositories · arXiv:2104.01029
-
Towards Deepening Graph Neural Networks: A GNTK-based Optimization Perspective 3 Mar 2021 · 0 repositories · arXiv:2103.03113
-
Theory of Low Frequency Contamination from Nonstationarity and Misspecification: Consequences for HAR Inference 2 Mar 2021 · 0 repositories · arXiv:2103.01604
-
Robust Asynchronous and Network-Independent Cooperative Learning 20 Oct 2020 · 0 repositories · arXiv:2010.09993
-
Noise-Induced Barren Plateaus in Variational Quantum Algorithms 28 Jul 2020 · 1 repository · arXiv:2007.14384
-
Context-Aware Attentive Knowledge Tracing 24 Jul 2020 · 3 repositories · arXiv:2007.12324Syntology official (archive's flag): 1 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
Calibration of chemical sensors in mobile wireless networks 17 Jun 2020 · 0 repositories · arXiv:2006.12381
-
Scalable Multi-Agent Reinforcement Learning for Networked Systems with Average Reward 11 Jun 2020 · 0 repositories · arXiv:2006.06626
-
A New Deep Neural Architecture Search Pipeline for Face Recognition 12 May 2020 · 0 repositories
-
Revisiting Regex Generation for Modeling Industrial Applications by Incorporating Byte Pair Encoder 6 May 2020 · 0 repositories · arXiv:2005.02558
-
Supervised Contrastive Learning 23 Apr 2020 · 26 repositories · arXiv:2004.11362Syntology community repositories only · 17 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 2 honoured, 0 violated, 10 with no contract checked; 5 where Syntology's instrument failed) · 6 unverified (of 23 harvested samples) · 5 pointer-only (licence)
-
RYANSQL: Recursively Applying Sketch-based Slot Fillings for Complex Text-to-SQL in Cross-Domain Databases 7 Apr 2020 · 1 repository · arXiv:2004.03125Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)
-
Scalable Gradients for Stochastic Differential Equations 5 Jan 2020 · 4 repositories · arXiv:2001.01328Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 5 harvested samples) · 2 pointer-only (licence)
-
Momentum Contrast for Unsupervised Visual Representation Learning 13 Nov 2019 · 44 repositories · arXiv:1911.05722Syntology community repositories only · 28 ran (of which 16 constructed an object rather than computing a result; 23 with no instrument failure: 0 honoured, 0 violated, 23 with no contract checked; 5 where Syntology's instrument failed) · 14 unverified (of 42 harvested samples) · 19 pointer-only (licence)
-
Learning pairwise Markov network structures using correlation neighborhoods 30 Oct 2019 · 1 repository · arXiv:1910.13832
-
Global exponential stability of primal-dual gradient flow dynamics based on the proximal augmented Lagrangian: A Lyapunov-based approach 2 Oct 2019 · 0 repositories · arXiv:1910.00783
-
Augmented Memory for Correlation Filters in Real-Time UAV Tracking 24 Sep 2019 · 1 repository · arXiv:1909.10989
-
Asymptotically Optimal One- and Two-Sample Testing with Kernels 27 Aug 2019 · 0 repositories · arXiv:1908.10037
-
Learning the Model Update for Siamese Trackers 2 Aug 2019 · 1 repository · arXiv:1908.00855
-
Supervised Symbolic Music Style Translation Using Synthetic Data 4 Jul 2019 · 1 repository · arXiv:1907.02265
-
XNAS: Neural Architecture Search with Expert Advice 19 Jun 2019 · 2 repositories · arXiv:1906.08031
-
Neural Architecture Search for Deep Face Recognition 21 Apr 2019 · 0 repositories · arXiv:1904.09523
-
ASAP: Architecture Search, Anneal and Prune 8 Apr 2019 · 1 repository · arXiv:1904.04123
-
sharpDARTS: Faster and More Accurate Differentiable Architecture Search 23 Mar 2019 · 2 repositories · arXiv:1903.09900Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
Concentration bounds for CVaR estimation: The cases of light-tailed and heavy-tailed distributions 4 Jan 2019 · 0 repositories · arXiv:1901.00997
-
K-nearest Neighbor Search by Random Projection Forests 31 Dec 2018 · 0 repositories · arXiv:1812.11689
-
Shortcut Matrix Product States and its applications 13 Dec 2018 · 0 repositories · arXiv:1812.05248
-
Predicting Recall Probability to Adaptively Prioritize Study 28 Feb 2018 · 0 repositories · arXiv:1803.00111
-
Exponentially Consistent Kernel Two-Sample Tests 23 Feb 2018 · 0 repositories · arXiv:1802.08407
-
Universal Hypothesis Testing with Kernels: Asymptotically Optimal Tests for Goodness of Fit 21 Feb 2018 · 0 repositories · arXiv:1802.07581
Tasks archive 2025-07-28
20 shown of 107 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections