Browse State-of-the-Art › Low-rank compression
Low-rank compression
14 papers with code · 0 benchmarks · 0 datasets archive 2025-07-28
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
No dataset record in the archive lists this task.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 34 · with a code link: 14 · where Syntology ran a sample: 3 (3 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3 of 34 tagged: 3 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 34 of 34, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
23 Jul 2021 2 repositories listed Syntology official: harvested, nothing ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 9 unverified (of 12 harvested samples)We present a novel global compression framework for deep neural networks that automatically analyzes each layer to identify the optimal per-layer compression ratio, while simultaneously achieving the desired overall…
-
4 Sep 2017 2 repositories listedWe show that domain transfer leads to large shifts in network activations and that it is desirable to take this into account when compressing.
-
30 May 2025 1 repository listedRecent methods have explored reducing the hidden dimensions of the KV cache, but many introduce additional computation through projection layers or suffer from significant performance degradation under high compression…
-
27 Feb 2025 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 2 harvested samples)Modern automatic speech recognition (ASR) models, such as OpenAI's Whisper, rely on deep encoder-decoder architectures, and their encoders are a critical bottleneck for efficient deployment due to high computational…
-
8 Oct 2024 1 repository listedModel Inversion Attacks (MIAs) aim at recovering privacy-sensitive training data from the knowledge encoded in the released machine learning models.
-
28 May 2024 1 repository listedTo address these challenges, we propose a unified low-rank decomposition framework for compressing CTR prediction models.
-
15 Jan 2024 1 repository listedThis paper presents a novel gradient compression method for federated learning (FL) in wireless systems.
-
28 Aug 2023 1 repository listed Syntology official (archive's flag): 15 ran · 15 ran (of which 1 constructed an object rather than computing a result; 11 with no instrument failure: 2 honoured, 2 violated, 7 with no contract checked; 4 where Syntology's instrument failed) · 3 unverified (of 18 harvested samples)Deep Neural Networks (DNNs) have been a large driver for AI breakthroughs in recent years.
-
30 Sep 2022 1 repository listedLearning neural fields has been an active topic in deep learning research, focusing, among other issues, on finding more compact and easy-to-fit representations.
-
12 Apr 2022 1 repository listedWe theoretically show that energy transfer eases the trend of gradient vanishing caused by projection.
-
9 Jul 2021 1 repository listedHowever, VGG nets can be better compressed by combining low-rank with a few floating point weights.
-
1 Jun 2020 1 repository listedNeural net compression can be achieved by approximating each layer's weight matrix by a low-rank matrix.
-
15 May 2020 1 repository listedWe propose a software framework based on the ideas of the Learning-Compression (LC) algorithm, that allows a user to compress a neural network or other machine learning model using different compression schemes with…
-
29 Oct 2019 1 repository listedCompressing DNNs is important for the real-world applications operating on resource-constrained devices.
-
MLorc: Momentum Low-rank Compression for Large Language Model Adaptation2 Jun 2025 0 repositories listedWith increasing size of large language models (LLMs), full-parameter fine-tuning imposes substantial memory demands.
-
Dynamical Low-Rank Compression of Neural Networks with Robustness under Adversarial Attacks12 May 2025 0 repositories listedDeployment of neural networks on resource-constrained devices demands models that are both compact and robust to adversarial inputs.
-
Cognitive Memory in Large Language Models3 Apr 2025 0 repositories listedThis paper examines memory mechanisms in Large Language Models (LLMs), emphasizing their importance for context-rich responses, reduced hallucinations, and improved efficiency.
-
Penrose Tiled Low-Rank Compression and Section-Wise Q&A Fine-Tuning: A General Framework for Domain-Specific Large Language Model Adaptation28 Mar 2025 0 repositories listedLarge language models (LLMs) hold great promise for specialized scientific domains such as materials science, yet adapting them efficiently and accurately to domain-specific knowledge remains challenging due to limited…
-
Low-Rank Compression for IMC Arrays10 Feb 2025 0 repositories listedIn this study, we address the challenge of low-rank model compression in the context of in-memory computing (IMC) architectures.
-
Theoretical Guarantees for Low-Rank Compression of Deep Neural Networks4 Feb 2025 0 repositories listedDeep neural networks have achieved state-of-the-art performance across numerous applications, but their high memory and computational demands present significant challenges, particularly in resource-constrained…
-
Adaptive Pruning of Pretrained Transformer via Differential Inclusions6 Jan 2025 0 repositories listedLarge transformers have demonstrated remarkable success, making it necessary to compress these models to reduce inference costs while preserving their perfor-mance.
-
LoRC: Low-Rank Compression for LLMs KV Cache with a Progressive Compression Strategy4 Oct 2024 0 repositories listedThe Key-Value (KV) cache is a crucial component in serving transformer-based autoregressive large language models (LLMs), enabling faster inference by storing previously computed KV vectors.
-
Basis Selection: Low-Rank Decomposition of Pretrained Large Language Models for Target Applications24 May 2024 0 repositories listedLarge language models (LLMs) significantly enhance the performance of various applications, but they are computationally intensive and energy-demanding.
-
Feature-based Low-Rank Compression of Large Language Models via Bayesian Optimization17 May 2024 0 repositories listedTo address the challenges of low-rank compression in LLMs, we conduct empirical research on the low-rank characteristics of large models.
-
ELRT: Efficient Low-Rank Training for Compact Convolutional Neural Networks18 Jan 2024 0 repositories listedLow-rank compression, a popular model compression technique that produces compact convolutional neural networks (CNNs) with low rankness, has been well-studied in the literature.
-
HALOC: Hardware-Aware Automatic Low-Rank Compression for Compact Neural Networks20 Jan 2023 0 repositories listedLow-rank compression is an important model compression strategy for obtaining compact neural network models.
-
DRONE: Data-aware Low-rank Compression for Large NLP Models1 Dec 2021 0 repositories listedThe representations learned by large-scale NLP models such as BERT have been widely used in various tasks.
-
A Highly Effective Low-Rank Compression of Deep Neural Networks with Modified Beam-Search and Modified Stable Rank30 Nov 2021 0 repositories listedCompression has emerged as one of the essential deep learning research topics, especially for the edge devices that have limited computation power and storage capacity.
-
FedHM: Efficient Federated Learning for Heterogeneous Models via Low-rank Factorization29 Nov 2021 0 repositories listedOne underlying assumption of recent federated learning (FL) paradigms is that all local models usually share the same network architecture and size, which becomes impractical for devices with different hardware…
-
Semi-tensor Product-based TensorDecomposition for Neural Network Compression30 Sep 2021 0 repositories listedThe existing tensor networks adopt conventional matrix product for connection.
-
Communication-Efficient Federated Learning with Dual-Side Low-Rank Compression26 Apr 2021 0 repositories listed
-
Data-aware Low-Rank Compression for Large NLP Models1 Jan 2021 0 repositories listed
-
AntMan: Sparse Low-Rank Compression to Accelerate RNN inference2 Oct 2019 0 repositories listed
-
Approximate FPGA-based LSTMs under Computation Time Constraints7 Jan 2018 0 repositories listed
Syntology lines on 3 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections