Browse State-of-the-Art › Sparse Learning
Sparse Learning
52 papers with code · 3 benchmarks · 3 datasets archive 2025-07-28
Benchmarks archive 2025-07-28
3 leaderboard tables shown for this task, 3 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| ImageNet (9 rows) | Resnet-50: 80% Sparse | Rigging the Lottery: Making All Tickets Winners | code | Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified | Compare |
| CINIC-10 (1 row) | Resnet18 | Adaptive Neural Connections for Sparsity Learning | — | — | Compare |
| ImageNet32 (1 row) | Resnet18 | Adaptive Neural Connections for Sparsity Learning | — | — | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
3 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 185 · with a code link: 52 · where Syntology ran a sample: 12 (10 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (12 of 185 tagged: 10 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument)
Page 1 of 2: papers 1 to 100 of 185, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
19 Jan 2017 15 repositories listed Syntology 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples)We explore a recently proposed Variational Dropout technique that provided an elegant Bayesian interpretation to Gaussian Dropout.
-
25 Nov 2019 11 repositories listed Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)There is a large body of work on training dense networks to yield sparse networks for inference, but this limits the size of the largest trainable sparse model to that of the largest trainable dense model.
-
25 Feb 2019 6 repositories listedWe rigorously evaluate three state-of-the-art techniques for inducing sparsity in deep neural networks on two large-scale learning tasks: Transformer trained on WMT 2014 English-to-German, and ResNet-50 trained on…
-
4 Feb 2021 4 repositories listedBy starting from a random sparse network and continuously exploring sparse connectivities during training, we can perform an Over-Parameterization in the space-time manifold, closing the gap in the expressibility…
-
18 Mar 2013 4 repositories listed Syntology 9 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 12 harvested samples)A commonly used approach is the Multi-Stage (MS) convex relaxation (or DC programming), which relaxes the original non-convex problem to a sequence of convex problems.
-
8 Aug 2022 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)The performance of trained neural networks is robust to harsh levels of pruning.
-
19 Oct 2021 2 repositories listedIn addition, a user-friendly R library is available at the Comprehensive R Archive Network.
-
19 Jun 2021 2 repositories listed Syntology community repositories only · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)Works on lottery ticket hypothesis (LTH) and single-shot network pruning (SNIP) have raised a lot of attention currently on post-training pruning (iterative magnitude pruning), and before-training pruning (pruning at…
-
13 Apr 2020 2 repositories listed Syntology official (archive's flag): 9 ran · 12 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 0 violated, 12 with no contract checked; 0 where Syntology's instrument failed) · 6 unverified (of 18 harvested samples)In this work, we present a new exact MIP framework for ℓ₀ℓ₂-regularized regression that can scale to p ∼10⁷, achieving speedups of at least 5000x, compared to state-of-the-art exact methods.
-
10 Jul 2019 2 repositories listed Syntology official: harvested for another paper · 0 ran · 1 unverified (of 1 harvested sample)We demonstrate the possibility of what we call sparse learning: accelerated training of deep neural networks that maintain sparse weights throughout training while achieving dense performance levels.
-
15 Jul 2017 2 repositories listed Syntology official (archive's flag): 1 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)Through the success of deep learning in various domains, artificial neural networks are currently among the most used artificial intelligence methods.
-
29 Jan 2016 2 repositories listedTo facilitate and promote the research in this community, we also present an open-source feature selection repository that consists of most of the popular feature selection algorithms (http://featureselection.asu.edu/).
-
25 Jun 2025 1 repository listedThis paper closes the gap with a new ℓ₀ regularized method for LMM subset selection that can run on datasets containing thousands of predictors in seconds to minutes.
-
9 Jan 2025 1 repository listedThe computational core of MyESL is written in C++, which offers model building with or without group sparsity, while the pre- and post-processing of inputs and model outputs is performed using customized functions…
-
13 Sep 2024 1 repository listedTo leverage these valuable resources, we propose a retrieval-and-demonstration approach to enhance rare word translation accuracy in direct ST models.
-
2 Sep 2024 1 repository listedFor statistical modeling wherein the data regime is unfavorable in terms of dimensionality relative to the sample size, finding hidden sparsity in the ground truth can be critical in formulating an accurate statistical…
-
22 Aug 2024 1 repository listedBack-propagation (BP) is a major source of computational expense during training deep learning models.
-
5 Aug 2024 1 repository listedOur proposed model, named DRFormer, is evaluated on various real-world datasets, and experimental results demonstrate its superiority compared to existing methods.
-
4 Jun 2024 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 6 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 2 pointer-only (licence)In this work, we propose to parameterize the weights as a sum of low-rank and sparse matrices for pretraining, which we call SLTrain.
-
29 Apr 2024 1 repository listedHowever, this principle results in a diffuse distribution of updates throughout the model, as it promotes updates for weights that haven't been previously updated, while a sparse update distribution is preferred to…
-
7 Feb 2024 1 repository listedThis paper introduces a novel prior called Diversified Block Sparse Prior to characterize the widespread block sparsity phenomenon in real-world data.
-
Building explainable graph neural network by sparse learning for the drug-protein binding prediction27 Aug 2023 1 repository listedDue to the use of the chemical-substructure-based graph, it is guaranteed that any subgraphs in a drug identified by our SLGNN are chemically valid structures.
-
14 Aug 2023 1 repository listed Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 13 harvested samples) · 3 pointer-only (licence)Sparse neural networks are a key factor in developing resource-efficient machine learning applications.
-
9 Aug 2023 1 repository listedWe propose an improved end-to-end Minimax optimization method for this sparse learning problem to better balance the model performance and the computation efficiency.
-
27 Feb 2023 1 repository listedSuper-Resolution from a single motion Blurred image (SRB) is a severely ill-posed problem due to the joint degradation of motion blurs and low spatial resolution.
-
19 Feb 2023 1 repository listedWhile recent progress in video-text retrieval has been advanced by the exploration of better representation learning, in this paper, we present a novel multi-grained sparse learning framework, S3MA, to learn an aligned…
-
27 Aug 2022 1 repository listedA possible solution to this problem is to utilize off-the-shelf sparse learning algorithms at the clients to meet their resource budget.
-
24 May 2022 1 repository listedStandard fine-tuning of large pre-trained language models (PLMs) for downstream tasks requires updating hundreds of millions to billions of parameters, and storing a large copy of the PLM weights for every task…
-
4 Apr 2022 1 repository listedWith the latest advances in deep learning, there has been a lot of focus on the online learning paradigm due to its relevance in practical settings.
-
10 Feb 2022 1 repository listedWe present L0Learn: an open-source package for sparse linear regression and classification using ℓ₀ regularization.
-
7 Nov 2021 1 repository listed
-
27 Oct 2021 1 repository listed
-
14 Apr 2021 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
15 Dec 2020 1 repository listed
-
9 Dec 2020 1 repository listed
-
1 Dec 2020 1 repository listed
-
22 Sep 2020 1 repository listed
-
25 Aug 2020 1 repository listed
-
16 Jul 2020 1 repository listed
-
29 Jun 2020 1 repository listed
-
27 Jun 2020 1 repository listed
-
7 Jan 2020 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 3 samples that ran constructed an object rather than computing a result (of 4 harvested samples) · 4 pointer-only (licence)
-
21 Oct 2019 1 repository listed
-
16 Jul 2019 1 repository listed
-
10 Jun 2019 1 repository listed
-
29 May 2019 1 repository listed
-
1 Sep 2018 1 repository listed
-
5 Mar 2018 1 repository listed
-
6 Dec 2017 1 repository listed Syntology 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
10 Aug 2017 1 repository listed
-
13 May 2017 1 repository listed
-
21 Mar 2017 1 repository listed
-
Learning Sparsity for Effective and Efficient Music Performance Question Answering2 Jun 2025 0 repositories listed
-
Optimizing Hard Thresholding for Sparse Model Discovery28 Apr 2025 0 repositories listed
-
STARS: Sparse Learning Correlation Filter with Spatio-temporal Regularization and Super-resolution Reconstruction for Thermal Infrared Target Tracking20 Apr 2025 0 repositories listed
-
Sparsified-Learning for Heavy-Tailed Locally Stationary Processes8 Apr 2025 0 repositories listed
-
Low-Rank Matrix Regression via Least-Angle Regression13 Mar 2025 0 repositories listed
-
Deep Weight Factorization: Sparse Learning Through the Lens of Artificial Symmetries4 Feb 2025 0 repositories listed
-
Nonparametric Sparse Online Learning of the Koopman Operator27 Jan 2025 0 repositories listed
-
Pushing the Limits of Sparsity: A Bag of Tricks for Extreme Pruning20 Nov 2024 0 repositories listed
-
GUIDE: Real-Time Human-Shaped Agents19 Oct 2024 0 repositories listed
-
Scaling Continuous Kernels with Sparse Fourier Domain Learning15 Sep 2024 0 repositories listed
-
Quasi-potential and drift decomposition in stochastic systems by sparse identification10 Sep 2024 0 repositories listed
-
Multi-SIGATnet: A multimodal schizophrenia MRI classification algorithm using sparse interaction mechanisms and graph attention networks25 Aug 2024 0 repositories listed
-
Generative Adversarial Networks for Imputing Sparse Learning Performance26 Jul 2024 0 repositories listed
-
Towards Efficient Deep Spiking Neural Networks Construction with Spiking Activity based Pruning3 Jun 2024 0 repositories listed
-
Nonparametric Sparse Online Learning of the Koopman Operator13 May 2024 0 repositories listed
-
CRB Analysis for Mixed-ADC Based DOA Estimation14 Mar 2024 0 repositories listed
-
Dynamic Sparse Learning: A Novel Paradigm for Efficient Recommendation5 Feb 2024 0 repositories listed
-
Dynamic Incremental Optimization for Best Subset Selection4 Feb 2024 0 repositories listed
-
Sparse Learning and Class Probability Estimation with Weighted Support Vector Machines17 Dec 2023 0 repositories listed
-
Sketching for Convex and Nonconvex Regularized Least Squares with Sharp Guarantees3 Nov 2023 0 repositories listed
-
Smoothing the Edges: Smooth Optimization for Sparse Regularization using Hadamard Overparametrization7 Jul 2023 0 repositories listed
-
Discovering stochastic partial differential equations from limited data using variational Bayes inference28 Jun 2023 0 repositories listed
-
Classical Verification of Quantum Learning8 Jun 2023 0 repositories listed
-
Sparse Representer Theorems for Learning in Reproducing Kernel Banach Spaces21 May 2023 0 repositories listed
-
The ART of Transfer Learning: An Adaptive and Robust Pipeline30 Apr 2023 0 repositories listed
-
Channel Estimation for Underwater Visible Light Communication: A Sparse Learning Perspective13 Mar 2023 0 repositories listed
-
Joint Edge-Model Sparse Learning is Provably Efficient for Graph Neural Networks6 Feb 2023 0 repositories listed
-
SuperGF: Unifying Local and Global Features for Visual Localization23 Dec 2022 0 repositories listed
-
Zeroth-Order Hard-Thresholding: Gradient Error vs. Expansivity11 Oct 2022 0 repositories listed
-
Learning sparse auto-encoders for green AI image coding9 Sep 2022 0 repositories listed
-
Learning governing physics from output only measurements11 Aug 2022 0 repositories listed
-
AMS-Net: Adaptive Multiscale Sparse Neural Network with Interpretable Basis Expansion for Multiphase Flow Problems24 Jul 2022 0 repositories listed
-
Attribute Graphs Underlying Molecular Generative Models: Path to Learning with Limited Data14 Jul 2022 0 repositories listed
-
Sparsifying Binary Networks11 Jul 2022 0 repositories listed
-
Best Subset Selection with Efficient Primal-Dual Algorithm5 Jul 2022 0 repositories listed
-
A bio-inspired implementation of a sparse-learning spike-based hippocampus memory model10 Jun 2022 0 repositories listed
-
Infinite-dimensional optimization and Bayesian nonparametric learning of stochastic differential equations30 May 2022 0 repositories listed
-
SAFARI: Sparsity enabled Federated Learning with Limited and Unreliable Communications5 Apr 2022 0 repositories listed
-
Infinite-Dimensional Sparse Learning in Linear System Identification28 Mar 2022 0 repositories listed
-
ERNIE-SPARSE: Learning Hierarchical Efficient Transformer Through Regularized Self-Attention23 Mar 2022 0 repositories listed
-
Analysis of Generalized Bregman Surrogate Algorithms for Nonsmooth Nonconvex Statistical Learning16 Dec 2021 0 repositories listed
-
ERNIE-SPARSE: Learning Hierarchical Efficient Transformer Through Regularized Self-Attention16 Nov 2021 0 repositories listed
-
Multi-Slice Dense-Sparse Learning for Efficient Liver and Tumor Segmentation15 Aug 2021 0 repositories listed
-
High Dimensional Differentially Private Stochastic Optimization with Heavy-tailed Data23 Jul 2021 0 repositories listed
-
Towards Low-Latency Energy-Efficient Deep SNNs via Attention-Guided Compression16 Jul 2021 0 repositories listed
-
Improving Sequential Recommendation Consistency with Self-Supervised Imitation26 Jun 2021 0 repositories listed
-
Surrogate assisted active subspace and active subspace assisted surrogate -- A new paradigm for high dimensional structural reliability analysis11 May 2021 0 repositories listed
-
Learning where to learn13 Mar 2021 0 repositories listed
Syntology lines on 13 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections