Browse State-of-the-Art › Low-rank compression

Low-rank compression

14 papers with code · 0 benchmarks · 0 datasets archive 2025-07-28

Computer Code

Benchmarks archive 2025-07-28

No benchmark for this task in the archive.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

No dataset record in the archive lists this task.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Papers archive 2025-07-28

archive papers tagged: 34 · with a code link: 14 · where Syntology ran a sample: 3 (3 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (3 of 34 tagged: 3 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument)

Page 1 of 1: papers 1 to 34 of 34, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.

Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.

  • We present a novel global compression framework for deep neural networks that automatically analyzes each layer to identify the optimal per-layer compression ratio, while simultaneously achieving the desired overall…
  • 4 Sep 2017 2 repositories listed
    We show that domain transfer leads to large shifts in network activations and that it is desirable to take this into account when compressing.
  • 30 May 2025 1 repository listed
    Recent methods have explored reducing the hidden dimensions of the KV cache, but many introduce additional computation through projection layers or suffer from significant performance degradation under high compression…
  • Modern automatic speech recognition (ASR) models, such as OpenAI's Whisper, rely on deep encoder-decoder architectures, and their encoders are a critical bottleneck for efficient deployment due to high computational…
  • 8 Oct 2024 1 repository listed
    Model Inversion Attacks (MIAs) aim at recovering privacy-sensitive training data from the knowledge encoded in the released machine learning models.
  • 28 May 2024 1 repository listed
    To address these challenges, we propose a unified low-rank decomposition framework for compressing CTR prediction models.
  • 15 Jan 2024 1 repository listed
    This paper presents a novel gradient compression method for federated learning (FL) in wireless systems.
  • Deep Neural Networks (DNNs) have been a large driver for AI breakthroughs in recent years.
  • 30 Sep 2022 1 repository listed
    Learning neural fields has been an active topic in deep learning research, focusing, among other issues, on finding more compact and easy-to-fit representations.
  • 12 Apr 2022 1 repository listed
    We theoretically show that energy transfer eases the trend of gradient vanishing caused by projection.
  • 9 Jul 2021 1 repository listed
    However, VGG nets can be better compressed by combining low-rank with a few floating point weights.
  • 1 Jun 2020 1 repository listed
    Neural net compression can be achieved by approximating each layer's weight matrix by a low-rank matrix.
  • 15 May 2020 1 repository listed
    We propose a software framework based on the ideas of the Learning-Compression (LC) algorithm, that allows a user to compress a neural network or other machine learning model using different compression schemes with…
  • 29 Oct 2019 1 repository listed
    Compressing DNNs is important for the real-world applications operating on resource-constrained devices.
  • MLorc: Momentum Low-rank Compression for Large Language Model Adaptation
    2 Jun 2025 0 repositories listed
    With increasing size of large language models (LLMs), full-parameter fine-tuning imposes substantial memory demands.
  • Dynamical Low-Rank Compression of Neural Networks with Robustness under Adversarial Attacks
    12 May 2025 0 repositories listed
    Deployment of neural networks on resource-constrained devices demands models that are both compact and robust to adversarial inputs.
  • Cognitive Memory in Large Language Models
    3 Apr 2025 0 repositories listed
    This paper examines memory mechanisms in Large Language Models (LLMs), emphasizing their importance for context-rich responses, reduced hallucinations, and improved efficiency.
  • Penrose Tiled Low-Rank Compression and Section-Wise Q&A Fine-Tuning: A General Framework for Domain-Specific Large Language Model Adaptation
    28 Mar 2025 0 repositories listed
    Large language models (LLMs) hold great promise for specialized scientific domains such as materials science, yet adapting them efficiently and accurately to domain-specific knowledge remains challenging due to limited…
  • Low-Rank Compression for IMC Arrays
    10 Feb 2025 0 repositories listed
    In this study, we address the challenge of low-rank model compression in the context of in-memory computing (IMC) architectures.
  • Theoretical Guarantees for Low-Rank Compression of Deep Neural Networks
    4 Feb 2025 0 repositories listed
    Deep neural networks have achieved state-of-the-art performance across numerous applications, but their high memory and computational demands present significant challenges, particularly in resource-constrained…
  • Adaptive Pruning of Pretrained Transformer via Differential Inclusions
    6 Jan 2025 0 repositories listed
    Large transformers have demonstrated remarkable success, making it necessary to compress these models to reduce inference costs while preserving their perfor-mance.
  • LoRC: Low-Rank Compression for LLMs KV Cache with a Progressive Compression Strategy
    4 Oct 2024 0 repositories listed
    The Key-Value (KV) cache is a crucial component in serving transformer-based autoregressive large language models (LLMs), enabling faster inference by storing previously computed KV vectors.
  • Basis Selection: Low-Rank Decomposition of Pretrained Large Language Models for Target Applications
    24 May 2024 0 repositories listed
    Large language models (LLMs) significantly enhance the performance of various applications, but they are computationally intensive and energy-demanding.
  • Feature-based Low-Rank Compression of Large Language Models via Bayesian Optimization
    17 May 2024 0 repositories listed
    To address the challenges of low-rank compression in LLMs, we conduct empirical research on the low-rank characteristics of large models.
  • ELRT: Efficient Low-Rank Training for Compact Convolutional Neural Networks
    18 Jan 2024 0 repositories listed
    Low-rank compression, a popular model compression technique that produces compact convolutional neural networks (CNNs) with low rankness, has been well-studied in the literature.
  • HALOC: Hardware-Aware Automatic Low-Rank Compression for Compact Neural Networks
    20 Jan 2023 0 repositories listed
    Low-rank compression is an important model compression strategy for obtaining compact neural network models.
  • DRONE: Data-aware Low-rank Compression for Large NLP Models
    1 Dec 2021 0 repositories listed
    The representations learned by large-scale NLP models such as BERT have been widely used in various tasks.
  • A Highly Effective Low-Rank Compression of Deep Neural Networks with Modified Beam-Search and Modified Stable Rank
    30 Nov 2021 0 repositories listed
    Compression has emerged as one of the essential deep learning research topics, especially for the edge devices that have limited computation power and storage capacity.
  • FedHM: Efficient Federated Learning for Heterogeneous Models via Low-rank Factorization
    29 Nov 2021 0 repositories listed
    One underlying assumption of recent federated learning (FL) paradigms is that all local models usually share the same network architecture and size, which becomes impractical for devices with different hardware…
  • Semi-tensor Product-based TensorDecomposition for Neural Network Compression
    30 Sep 2021 0 repositories listed
    The existing tensor networks adopt conventional matrix product for connection.
  • Communication-Efficient Federated Learning with Dual-Side Low-Rank Compression
    26 Apr 2021 0 repositories listed
  • Data-aware Low-Rank Compression for Large NLP Models
    1 Jan 2021 0 repositories listed
  • AntMan: Sparse Low-Rank Compression to Accelerate RNN inference
    2 Oct 2019 0 repositories listed
  • Approximate FPGA-based LSTMs under Computation Time Constraints
    7 Jan 2018 0 repositories listed

Syntology lines on 3 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections