Methods › General › Attention Mechanisms › Attention
Attention Is All You Need
Attention
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
The archive carries no description for this method.
In Syntology name not resolved (unknown_name). Other entries in Syntology's graph carry this name; the lookup's note below says what that means for this name.
From the lookup's note on this name: Nothing resolved to this name, but 2 entries in Syntology's graph carry it; the most cited is the paper “Attention: Marginal Probability is All You Need?” (arXiv:2304.04556, 4 citations). None of them is well cited, so for any better known sense of the name this is still a gap in coverage; they are listed so you can judge, not as a substitute. For arXiv:2304.04556: ask the lookup about it.
Near matches the lookup lists, each a different name: SS-Attention; TF-ATTENTION; VC-Attention; TC-ATTENTION; EL-Attention; Attention-MoA; DFC attention; max-attention.
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
Papers archive 2025-07-28
archive papers tagged: 31,583 · with a code link: 13,473 · where Syntology ran a sample: 3,998 (3,242 with a run with no instrument failure, 756 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3,998 of 31,583 tagged: 3,242 with a run with no instrument failure, 756 where every run was a failure of Syntology's instrument)
Page 1 of 316: papers 1 to 100 of 31,583, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
TCANet: A Temporal Convolutional Attention Network for Motor Imagery EEG Decoding 15 Jun 2025 · 1 repository
-
BSA: Ball Sparse Attention for Large-scale Geometries 14 Jun 2025 · 1 repository · arXiv:2506.12541Syntology official (archive's flag): 2 ran · 2 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
FAME: A Lightweight Spatio-Temporal Network for Model Attribution of Face-Swap Deepfakes 13 Jun 2025 · 1 repository · arXiv:2506.11477
-
Augmenting Large Language Models with Static Code Analysis for Automated Code Quality Improvements 12 Jun 2025 · 0 repositories · arXiv:2506.10330
-
PAL: Probing Audio Encoders via LLMs -- A Study of Information Transfer from Audio Encoders to LLMs 12 Jun 2025 · 0 repositories · arXiv:2506.10423
-
Edit360: 2D Image Edits to 3D Assets from Any Angle 12 Jun 2025 · 0 repositories · arXiv:2506.10507
-
Understanding In-Context Learning on Structured Manifolds: Bridging Attention to Kernel Methods 12 Jun 2025 · 0 repositories · arXiv:2506.10959
-
ALBERT: Advanced Localization and Bidirectional Encoder Representations from Transformers for Automotive Damage Evaluation 12 Jun 2025 · 0 repositories · arXiv:2506.10524
-
Asymmetric price adjustment over the business cycle 12 Jun 2025 · 0 repositories · arXiv:2506.10640
-
Beyond Attention or Similarity: Maximizing Conditional Diversity for Token Pruning in MLLMs 12 Jun 2025 · 1 repository · arXiv:2506.10967Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 7 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples) · 1 pointer-only (licence)
-
CIIR@LiveRAG 2025: Optimizing Multi-Agent Retrieval Augmented Generation through Self-Training 12 Jun 2025 · 1 repository · arXiv:2506.10844
-
Constructing and Evaluating Declarative RAG Pipelines in PyTerrier 12 Jun 2025 · 1 repository · arXiv:2506.10802
-
Context-Adaptive Graph Neural Networks for Next POI Recommendation 12 Jun 2025 · 0 repositories · arXiv:2506.10329
-
ContextRefine-CLIP for EPIC-KITCHENS-100 Multi-Instance Retrieval Challenge 2025 12 Jun 2025 · 1 repository · arXiv:2506.10550
-
Contrastive Matrix Completion with Denoising and Augmented Graph Views for Robust Recommendation 12 Jun 2025 · 1 repository · arXiv:2506.10658
-
Conversational Search: From Fundamentals to Frontiers in the LLM Era 12 Jun 2025 · 0 repositories · arXiv:2506.10635
-
DART: Differentiable Dynamic Adaptive Region Tokenizer for Vision Transformer and Mamba 12 Jun 2025 · 1 repository · arXiv:2506.10390
-
Decomposing MLP Activations into Interpretable Features via Semi-Nonnegative Matrix Factorization 12 Jun 2025 · 1 repository · arXiv:2506.10920
-
Enhancing Deepfake Detection using SE Block Attention with CNN 12 Jun 2025 · 0 repositories · arXiv:2506.10683
-
FaceLiVT: Face Recognition using Linear Vision Transformer with Structural Reparameterization For Mobile Device 12 Jun 2025 · 0 repositories · arXiv:2506.10361
-
Fine-Grained Perturbation Guidance via Attention Head Selection 12 Jun 2025 · 0 repositories · arXiv:2506.10978
-
Flick: Few Labels Text Classification using K-Aware Intermediate Learning in Multi-Task Low-Resource Languages 12 Jun 2025 · 0 repositories · arXiv:2506.10292
-
FSATFusion: Frequency-Spatial Attention Transformer for Infrared and Visible Image Fusion 12 Jun 2025 · 1 repository · arXiv:2506.10366
-
Heterogeneous-IRS-Assisted MIMO Systems: Channel Estimation and Beamforming 12 Jun 2025 · 0 repositories · arXiv:2506.10350
-
Improving Medical Visual Representation Learning with Pathological-level Cross-Modal Alignment and Correlation Exploration 12 Jun 2025 · 0 repositories · arXiv:2506.10573
-
J-DDL: Surface Damage Detection and Localization System for Fighter Aircraft 12 Jun 2025 · 0 repositories · arXiv:2506.10505
-
LightKG: Efficient Knowledge-Aware Recommendations with Simplified GNN Architecture 12 Jun 2025 · 1 repository · arXiv:2506.10347
-
MF2Summ: Multimodal Fusion for Video Summarization with Temporal Alignment 12 Jun 2025 · 0 repositories · arXiv:2506.10430
-
MSTAR: Box-free Multi-query Scene Text Retrieval with Attention Recycling 12 Jun 2025 · 1 repository · arXiv:2506.10609Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
NeuralNexus at BEA 2025 Shared Task: Retrieval-Augmented Prompting for Mistake Identification in AI Tutors 12 Jun 2025 · 1 repository · arXiv:2506.10627
-
Non-stationary Online Learning for Curved Losses: Improved Dynamic Regret via Mixability 12 Jun 2025 · 0 repositories · arXiv:2506.10616
-
PiPViT: Patch-based Visual Interpretable Prototypes for Retinal Image Analysis 12 Jun 2025 · 1 repository · arXiv:2506.10669
-
Reasoning RAG via System 1 or System 2: A Survey on Reasoning Agentic Retrieval-Augmented Generation for Industry Challenges 12 Jun 2025 · 0 repositories · arXiv:2506.10408
-
Rethinking Random Masking in Self Distillation on ViT 12 Jun 2025 · 0 repositories · arXiv:2506.10582
-
SceneCompleter: Dense 3D Scene Completion for Generative Novel View Synthesis 12 Jun 2025 · 0 repositories · arXiv:2506.10981
-
Semantic Localization Guiding Segment Anything Model For Reference Remote Sensing Image Segmentation 12 Jun 2025 · 0 repositories · arXiv:2506.10503
-
Sequential-Parallel Duality in Prefix Scannable Models 12 Jun 2025 · 0 repositories · arXiv:2506.10918
-
SLICK: Selective Localization and Instance Calibration for Knowledge-Enhanced Car Damage Segmentation in Automotive Insurance 12 Jun 2025 · 0 repositories · arXiv:2506.10528
-
SpectralAR: Spectral Autoregressive Visual Generation 12 Jun 2025 · 0 repositories · arXiv:2506.10962
-
Spelling-out is not Straightforward: LLMs' Capability of Tokenization from Token to Characters 12 Jun 2025 · 0 repositories · arXiv:2506.10641
-
TableRAG: A Retrieval Augmented Generation Framework for Heterogeneous Document Reasoning 12 Jun 2025 · 1 repository · arXiv:2506.10380
-
The Role of Generative AI in Facilitating Social Interactions: A Scoping Review 12 Jun 2025 · 0 repositories · arXiv:2506.10927
-
Think before You Simulate: Symbolic Reasoning to Orchestrate Neural Computation for Counterfactual Question Answering 12 Jun 2025 · 1 repository · arXiv:2506.10753
-
Towards Robust Multimodal Emotion Recognition under Missing Modalities and Distribution Shifts 12 Jun 2025 · 1 repository · arXiv:2506.10452
-
Towards Understanding Bias in Synthetic Data for Evaluation 12 Jun 2025 · 1 repository · arXiv:2506.10301
-
Retrieval of Surface Solar Radiation through Implicit Albedo Recovery from Temporal Context 11 Jun 2025 · 1 repository · arXiv:2506.10174
-
Fine-Grained control over Music Generation with Activation Steering 11 Jun 2025 · 0 repositories · arXiv:2506.10225
-
A new type of federated clustering: A non-model-sharing approach 11 Jun 2025 · 0 repositories · arXiv:2506.10244
-
A Novel Lightweight Transformer with Edge-Aware Fusion for Remote Sensing Image Captioning 11 Jun 2025 · 0 repositories · arXiv:2506.09429
-
Attention, Please! Revisiting Attentive Probing for Masked Image Modeling 11 Jun 2025 · 1 repository · arXiv:2506.10178
-
Auto-Compressing Networks 11 Jun 2025 · 0 repositories · arXiv:2506.09714
-
Detecção da Psoríase Utilizando Visão Computacional: Uma Abordagem Comparativa Entre CNNs e Vision Transformers 11 Jun 2025 · 0 repositories · arXiv:2506.10119
-
DGS-LRM: Real-Time Deformable 3D Gaussian Reconstruction From Monocular Videos 11 Jun 2025 · 0 repositories · arXiv:2506.09997
-
ELBO-T2IAlign: A Generic ELBO-Based Method for Calibrating Pixel-level Text-Image Alignment in Diffusion Models 11 Jun 2025 · 0 repositories · arXiv:2506.09740
-
Error-Guided Pose Augmentation: Enhancing Rehabilitation Exercise Assessment through Targeted Data Generation 11 Jun 2025 · 0 repositories · arXiv:2506.09833
-
Exposure-slot: Exposure-centric representations learning with Slot-in-Slot Attention for Region-aware Exposure Correction 11 Jun 2025 · 1 repository
-
Formalizing Neuromorphic Control Systems: A General Proposal and A Rhythmic Case Study 11 Jun 2025 · 0 repositories · arXiv:2506.10203
-
From Judgment to Interference: Early Stopping LLM Harmful Outputs via Streaming Content Monitoring 11 Jun 2025 · 0 repositories · arXiv:2506.09996
-
Generalization Error Analysis for Attack-Free and Byzantine-Resilient Decentralized Learning with Data Heterogeneity 11 Jun 2025 · 0 repositories · arXiv:2506.09438
-
Generalizing Supervised Contrastive learning: A Projection Perspective 11 Jun 2025 · 0 repositories · arXiv:2506.09810
-
How attention simplifies mental representations for planning 11 Jun 2025 · 0 repositories · arXiv:2506.09520
-
Learning Efficient and Generalizable Graph Retriever for Knowledge-Graph Question Answering 11 Jun 2025 · 1 repository · arXiv:2506.09645
-
Learning to Optimize Package Picking for Large-Scale, Real-World Robot Induction 11 Jun 2025 · 0 repositories · arXiv:2506.09765
-
LLM-Powered CPI Prediction Inference with Online Text Time Series 11 Jun 2025 · 1 repository · arXiv:2506.09516
-
Measuring Corporate Human Capital Disclosures: Lexicon, Data, Code, and Research Opportunities 11 Jun 2025 · 0 repositories · arXiv:2506.10155
-
Multiverse: Your Language Models Secretly Decide How to Parallelize and Merge Generation 11 Jun 2025 · 0 repositories · arXiv:2506.09991
-
On-the-Fly Adaptive Distillation of Transformer to Dual-State Linear Attention 11 Jun 2025 · 1 repository · arXiv:2506.09316
-
Q-SAM2: Accurate Quantization for Segment Anything Model 2 11 Jun 2025 · 0 repositories · arXiv:2506.09782
-
Query-Focused Retrieval Heads Improve Long-Context Reasoning and Re-ranking 11 Jun 2025 · 1 repository · arXiv:2506.09944Syntology official (archive's flag): 16 ran · 16 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 5 where Syntology's instrument failed) · 2 unverified (of 18 harvested samples)
-
SparseSSM: Efficient Selective Structured State Space Models Can Be Pruned in One-Shot 11 Jun 2025 · 0 repositories · arXiv:2506.09613
-
Survival Analysis as Imprecise Classification with Trainable Kernels 11 Jun 2025 · 1 repository · arXiv:2506.10140
-
Synergizing Reinforcement Learning and Genetic Algorithms for Neural Combinatorial Optimization 11 Jun 2025 · 0 repositories · arXiv:2506.09404
-
Towards Bridging the Reward-Generation Gap in Direct Alignment Algorithms 11 Jun 2025 · 0 repositories · arXiv:2506.09457
-
You Are What You Say: Exploiting Linguistic Content for VoicePrivacy Attacks 11 Jun 2025 · 0 repositories · arXiv:2506.09521
-
MD-ViSCo: A Unified Model for Multi-Directional Vital Sign Waveform Conversion 10 Jun 2025 · 1 repository · arXiv:2506.08357
-
The interplay of robustness and generalization in quantum machine learning 10 Jun 2025 · 1 repository · arXiv:2506.08455
-
DCD: A Semantic Segmentation Model for Fetal Ultrasound Four-Chamber View 10 Jun 2025 · 0 repositories · arXiv:2506.08534
-
Safeguarding Multimodal Knowledge Copyright in the RAG-as-a-Service Environment 10 Jun 2025 · 1 repository · arXiv:2506.10030
-
FastFLUX: Pruning FLUX with Block-wise Replacement and Sandwich Training 10 Jun 2025 · 0 repositories · arXiv:2506.10035
-
AdversariaL attacK sAfety aLIgnment(ALKALI): Safeguarding LLMs through GRACE: Geometric Representation-Aware Contrastive Enhancement- Introducing Adversarial Vulnerability Quality Index (AVQI) 10 Jun 2025 · 0 repositories · arXiv:2506.08885
-
AraReasoner: Evaluating Reasoning-Based LLMs for Arabic NLP 10 Jun 2025 · 0 repositories · arXiv:2506.08768
-
Atomic-to-Compositional Generalization for Mobile Agents with A New Benchmark and Scheduling System 10 Jun 2025 · 0 repositories · arXiv:2506.08972
-
BioLangFusion: Multimodal Fusion of DNA, mRNA, and Protein Language Models 10 Jun 2025 · 0 repositories · arXiv:2506.08936
-
CC-RAG: Structured Multi-Hop Reasoning via Theme-Based Causal Graphs 10 Jun 2025 · 0 repositories · arXiv:2506.08364
-
Convergence of Spectral Principal Paths: How Deep Networks Distill Linear Representations from Noisy Inputs 10 Jun 2025 · 0 repositories · arXiv:2506.08543
-
DEAL: Disentangling Transformer Head Activations for LLM Steering 10 Jun 2025 · 0 repositories · arXiv:2506.08359
-
Draft-based Approximate Inference for LLMs 10 Jun 2025 · 1 repository · arXiv:2506.08373Syntology official (archive's flag): 3 ran · 8 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 5 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples) · 5 pointer-only (licence)
-
DRAGged into Conflicts: Detecting and Addressing Conflicting Sources in Search-Augmented LLMs 10 Jun 2025 · 1 repository · arXiv:2506.08500
-
ECMNet:Lightweight Semantic Segmentation with Efficient CNN-Mamba Network 10 Jun 2025 · 0 repositories · arXiv:2506.08629
-
Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving 10 Jun 2025 · 1 repository · arXiv:2506.08349Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
FaithfulRAG: Fact-Level Conflict Modeling for Context-Faithful Retrieval-Augmented Generation 10 Jun 2025 · 1 repository · arXiv:2506.08938
-
FedRAG: A Framework for Fine-Tuning Retrieval-Augmented Generation Systems 10 Jun 2025 · 1 repository · arXiv:2506.09200
-
Fine-Grained Spatially Varying Material Selection in Images 10 Jun 2025 · 0 repositories · arXiv:2506.09023
-
FloorplanMAE:A self-supervised framework for complete floorplan generation from partial inputs 10 Jun 2025 · 0 repositories · arXiv:2506.08363
-
Graph Attention-based Decentralized Actor-Critic for Dual-Objective Control of Multi-UAV Swarms 10 Jun 2025 · 0 repositories · arXiv:2506.09195
-
Graph signal aware decomposition of dynamic networks via latent graphs 10 Jun 2025 · 0 repositories · arXiv:2506.08519
-
Hierarchical Neural Collapse Detection Transformer for Class Incremental Object Detection 10 Jun 2025 · 0 repositories · arXiv:2506.08562
-
Hyperspectral Image Classification via Transformer-based Spectral-Spatial Attention Decoupling and Adaptive Gating 10 Jun 2025 · 1 repository · arXiv:2506.08324
-
Inherently Faithful Attention Maps for Vision Transformers 10 Jun 2025 · 1 repository · arXiv:2506.08915
-
JoFormer (Journey-based Transformer): Theory and Empirical Analysis on the Tiny Shakespeare Dataset 10 Jun 2025 · 1 repository · arXiv:2506.08652
Tasks archive 2025-07-28
20 shown of 2,757 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
| Task | Papers |
|---|---|
| Language Modelling | 3,282 |
| Language Modeling | 2,605 |
| Retrieval | 1,932 |
| Question Answering | 1,607 |
| Decoder | 1,589 |
| Sentence | 1,392 |
| RAG | 1,344 |
| Retrieval-augmented Generation | 1,178 |
| Semantic Segmentation | 1,131 |
| Translation | 1,073 |
| Large Language Model | 976 |
| Machine Translation | 956 |
| Object Detection | 875 |
| Text Generation | 826 |
| Transfer Learning | 822 |
| Image Classification | 818 |
| Segmentation | 814 |
| object-detection | 802 |
| Representation Learning | 793 |
| Classification | 689 |
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections