Methods › Computer Vision › Generative Models › Sparse Autoencoder
Sparse Autoencoder
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
A Sparse Autoencoder is a type of autoencoder that employs sparsity to achieve an information bottleneck. Specifically the loss function is constructed so that activations are penalized within a layer. The sparsity constraint can be imposed with L1 regularization or a KL divergence between expected average neuron activation to an ideal distribution p.
Image: Jeff Jordan. Read his blog post (click) for a detailed summary of autoencoders.
In Syntology name not resolved (unknown_name). The lookup matched no method, paper or venue by this name; that asserts nothing about whether code exists.
Near matches the lookup lists, each a different name: sparse autoencoders; Rational Sparse Autoencoder; Expander Sparse Autoencoders; Sparse, Geometric Autoencoder; BatchTopK sparse autoencoders; Chunk-Level Sparse Autoencoders; Aligned Sparse Autoencoder (SAE); Multilingual Sparse Autoencoders.
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
Papers archive 2025-07-28
archive papers tagged: 57 · with a code link: 21 · where Syntology ran a sample: 9 (7 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (9 of 57 tagged: 7 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 57 of 57, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Bridging Compositional and Distributional Semantics: A Survey on Latent Semantic Geometry via AutoEncoder 25 Jun 2025 · 0 repositories · arXiv:2506.20083
-
CWGAN-GP Augmented CAE for Jamming Detection in 5G-NR in Non-IID Datasets 18 Jun 2025 · 0 repositories · arXiv:2506.15075
-
Resa: Transparent Reasoning Models via SAEs 11 Jun 2025 · 1 repository · arXiv:2506.09967
-
Model Unlearning via Sparse Autoencoder Subspace Guided Projections 30 May 2025 · 0 repositories · arXiv:2505.24428
-
SAE-FiRE: Enhancing Earnings Surprise Predictions Through Sparse Autoencoder Feature Selection 20 May 2025 · 0 repositories · arXiv:2505.14420
-
Interpretable Risk Mitigation in LLM Agent Systems 15 May 2025 · 1 repository · arXiv:2505.10670
-
Are Sparse Autoencoders Useful for Java Function Bug Detection? 15 May 2025 · 1 repository · arXiv:2505.10375
-
Beyond Input Activations: Identifying Influential Latents by Gradient Sparse Autoencoders 12 May 2025 · 0 repositories · arXiv:2505.08080Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
Decoding Futures Price Dynamics: A Regularized Sparse Autoencoder for Interpretable Multi-Horizon Forecasting and Factor Discovery 11 May 2025 · 0 repositories · arXiv:2505.06795
-
Geospatial Mechanistic Interpretability of Large Language Models 6 May 2025 · 1 repository · arXiv:2505.03368
-
FineScope : Precision Pruning for Domain-Specialized Large Language Models Using SAE-Guided Self-Data Cultivation 1 May 2025 · 0 repositories · arXiv:2505.00624
-
Towards Understanding the Nature of Attention with Low-Rank Sparse Decomposition 29 Apr 2025 · 1 repository · arXiv:2504.20938
-
Prisma: An Open Source Toolkit for Mechanistic Interpretability in Vision and Video 28 Apr 2025 · 2 repositories · arXiv:2504.19475Syntology official (archive's flag): 2 ran · 13 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 16 harvested samples)
-
A real-time anomaly detection method for robots based on a flexible and sparse latent space 15 Apr 2025 · 1 repository · arXiv:2504.11170
-
Dissecting and Mitigating Diffusion Bias via Mechanistic Interpretability 26 Mar 2025 · 1 repository · arXiv:2503.20483Syntology 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
-
Sparse Autoencoder as a Zero-Shot Classifier for Concept Erasing in Text-to-Image Diffusion Models 12 Mar 2025 · 1 repository · arXiv:2503.09446
-
Route Sparse Autoencoder to Interpret Large Language Models 11 Mar 2025 · 1 repository · arXiv:2503.08200Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)
-
Self-Regularization with Latent Space Explanations for Controllable LLM-based Classification 19 Feb 2025 · 0 repositories · arXiv:2502.14133
-
LLM Pretraining with Continuous Concepts 12 Feb 2025 · 0 repositories · arXiv:2502.08524
-
Sparse Autoencoders for Hypothesis Generation 5 Feb 2025 · 1 repository · arXiv:2502.04382Syntology official (archive's flag): 2 ran · 2 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
LF-Steering: Latent Feature Activation Steering for Enhancing Semantic Consistency in Large Language Models 19 Jan 2025 · 0 repositories · arXiv:2501.11036
-
Steering Large Language Models with Feature Guided Activation Additions 17 Jan 2025 · 0 repositories · arXiv:2501.09929
-
Causal Graph Guided Steering of LLM Values via Prompts and Sparse Autoencoders 31 Dec 2024 · 0 repositories · arXiv:2501.00581
-
Sparse autoencoders reveal selective remapping of visual concepts during adaptation 6 Dec 2024 · 1 repository · arXiv:2412.05276Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)
-
VISTA: A Panoramic View of Neural Representations 3 Dec 2024 · 0 repositories · arXiv:2412.02412
-
Direct Preference Optimization Using Sparse Feature-Level Constraints 12 Nov 2024 · 0 repositories · arXiv:2411.07618
-
Llama Scope: Extracting Millions of Features from Llama-3.1-8B with Sparse Autoencoders 27 Oct 2024 · 1 repository · arXiv:2410.20526Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
Investigating Sensitive Directions in GPT-2: An Improved Baseline and Comparative Analysis of SAEs 16 Oct 2024 · 0 repositories · arXiv:2410.12555
-
Residual Stream Analysis with Multi-Layer SAEs 6 Sep 2024 · 1 repository · arXiv:2409.04185Syntology official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
Learning biologically relevant features in a pathology foundation model using sparse autoencoders 15 Jul 2024 · 0 repositories · arXiv:2407.10785
-
A novel fault localization with data refinement for hydroelectric units 30 May 2024 · 0 repositories · arXiv:2405.19665
-
Discretization of continuous input spaces in the hippocampal autoencoder 23 May 2024 · 1 repository · arXiv:2405.14600
-
Improving Dictionary Learning with Gated Sparse Autoencoders 24 Apr 2024 · 2 repositories · arXiv:2404.16014
-
Diabetes detection using deep learning techniques with oversampling and feature augmentation 3 Feb 2024 · 0 repositories · arXiv:2402.02188
-
Electroencephalogram Sensor Data Compression Using An Asymmetrical Sparse Autoencoder With A Discrete Cosine Transform Layer 15 Sep 2023 · 0 repositories · arXiv:2309.12201
-
Are We Using Autoencoders in a Wrong Way? 4 Sep 2023 · 1 repository · arXiv:2309.01532
-
Health Monitoring of Movement Disorder Subject based on Diamond Stacked Sparse Autoencoder Ensemble Model 15 Mar 2023 · 0 repositories · arXiv:2303.08538
-
Deep Neural Networks based Meta-Learning for Network Intrusion Detection 18 Feb 2023 · 0 repositories · arXiv:2302.09394
-
Fast Data Driven Estimation of Cluster Number in Multiplex Images using Embedded Density Outliers 21 Jul 2022 · 0 repositories · arXiv:2207.10469
-
Composite Code Sparse Autoencoders for first stage retrieval 14 Apr 2022 · 0 repositories · arXiv:2204.07023
-
Deep Point Cloud Reconstruction 23 Nov 2021 · 0 repositories · arXiv:2111.11704
-
Towards improving discriminative reconstruction via simultaneous dense and sparse coding 16 Jun 2020 · 1 repository · arXiv:2006.09534Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples)
-
Unsupervised clustering of Roman pottery profiles from their SSAE representation 4 Jun 2020 · 0 repositories · arXiv:2006.03156
-
Representation Learning with Autoencoders for Electronic Health Records: A Comparative Study 24 Aug 2019 · 0 repositories · arXiv:1908.09174
-
Deep ensemble learning for Alzheimers disease classification 30 May 2019 · 0 repositories · arXiv:1905.12827
-
A deep learning approach for analyzing the composition of chemometric data 7 May 2019 · 0 repositories · arXiv:1905.03420
-
Active Transfer Learning Network: A Unified Deep Joint Spectral-Spatial Feature Learning Model For Hyperspectral Image Classification 4 Apr 2019 · 0 repositories · arXiv:1904.02454
-
DASPS: A Database for Anxious States based on a Psychological Stimulation 9 Jan 2019 · 0 repositories · arXiv:1901.02942
-
Relational Autoencoder for Feature Extraction 9 Feb 2018 · 2 repositories · arXiv:1802.03145
-
Transfer Learning for Improving Speech Emotion Classification Accuracy 19 Jan 2018 · 1 repository · arXiv:1801.06353
-
Representation Learning with Autoencoders for Electronic Health Records: A Comparative Study 6 Jan 2018 · 0 repositories · arXiv:1801.02961
-
Representation and Reinforcement Learning for Personalized Glycemic Control in Septic Patients 2 Dec 2017 · 0 repositories · arXiv:1712.00654
-
Unsupervised Learning For Effective User Engagement on Social Media 11 Nov 2016 · 0 repositories · arXiv:1611.03894
-
3D Keypoint Detection Based on Deep Neural Network with Sparse Autoencoder 30 Apr 2016 · 0 repositories · arXiv:1605.00129
-
Recovering 6D Object Pose and Predicting Next-Best-View in the Crowd 23 Dec 2015 · 0 repositories · arXiv:1512.07506
-
Sparse Code Formation with Linear Inhibition 13 Mar 2015 · 0 repositories · arXiv:1503.04115
-
Building high-level features using large scale unsupervised learning 29 Dec 2011 · 1 repository · arXiv:1112.6209
Tasks archive 2025-07-28
20 shown of 78 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
| Task | Papers |
|---|---|
| Classification | 4 |
| Denoising | 4 |
| General Classification | 4 |
| Dictionary Learning | 3 |
| Language Modeling | 3 |
| Language Modelling | 3 |
| Representation Learning | 3 |
| regression | 3 |
| Anomaly Detection | 2 |
| Clustering | 2 |
| Decoder | 2 |
| Diagnostic | 2 |
| Dimensionality Reduction | 2 |
| EEG | 2 |
| Electroencephalogram (EEG) | 2 |
| Generative Adversarial Network | 2 |
| Image Classification | 2 |
| Large Language Model | 2 |
| Small Data Image Classification | 2 |
| Transfer Learning | 2 |
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections