Methods › General › Attention Mechanisms › Global-Local Attention
Global-Local Attention
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
Global-Local Attention is a type of attention mechanism used in the ETC architecture. ETC receives two separate input sequences: the global input xᵍ = (xᵍ₁, …, xᵍ_(n_g)) and the long input xˡ = (xˡ₁, …xˡ_(nₗ)). Typically, the long input contains the input a standard Transformer would receive, while the global input contains a much smaller number of auxiliary tokens (n_g ≪nₗ). Attention is then split into four separate pieces: global-to-global (g2g), global-tolong (g2l), long-to-global (l2g), and long-to-long (l2l). Attention in the l2l piece (the most computationally expensive piece) is restricted to a fixed radius r ≪nₗ. To compensate for this limited attention span, the tokens in the global input have unrestricted attention, and thus long input tokens can transfer information to each other through global input tokens. Accordingly, g2g, g2l, and l2g pieces of attention are unrestricted.
In Syntology name not resolved (unknown_name). The lookup matched no method, paper or venue by this name; that asserts nothing about whether code exists.
Near matches the lookup lists, each a different name: Global and Local Topology-Aware Attention; Global-to-Local Graph Attention Network Soft Actor-Critic Algorithm; Global-Local model; Local-Global SIRENs; local-global approach; global-local transform; Global-Local Tree Search; Local Self-Attention Block.
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
Papers archive 2025-07-28
archive papers tagged: 56 · with a code link: 13 · where Syntology ran a sample: 5 (4 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (5 of 56 tagged: 4 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 56 of 56, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Koopman-Based Event-Triggered Control from Data 19 Apr 2025 · 0 repositories · arXiv:2504.14334
-
Integrating Locality-Aware Attention with Transformers for General Geometry PDEs 18 Apr 2025 · 0 repositories · arXiv:2504.13480
-
Imitating Radiological Scrolling: A Global-Local Attention Model for 3D Chest CT Volumes Multi-Label Anomaly Classification 26 Mar 2025 · 0 repositories · arXiv:2503.20652
-
A Diffusion Model and Knowledge Distillation Framework for Robust Coral Detection in Complex Underwater Environments 6 Jan 2025 · 1 repository
-
Performance-Barrier Event-Triggered PDE Control of Traffic Flow 1 Jan 2025 · 0 repositories · arXiv:2501.00722
-
Automated Toll Management System Using RFID and Image Processing 2 Dec 2024 · 0 repositories · arXiv:2412.01728
-
DELTA: Dense Efficient Long-range 3D Tracking for any video 31 Oct 2024 · 0 repositories · arXiv:2410.24211
-
Hierarchical Event-Triggered Systems: Safe Learning of Quasi-Optimal Deadline Policies 15 Sep 2024 · 0 repositories · arXiv:2409.09812
-
MicroEmo: Time-Sensitive Multimodal Emotion Recognition with Micro-Expression Dynamics in Video Dialogues 23 Jul 2024 · 0 repositories · arXiv:2407.16552
-
Performance-Barrier Event-Triggered Control of a Class of Reaction-Diffusion PDEs 11 Jul 2024 · 0 repositories · arXiv:2407.08178
-
A Global-Local Attention Mechanism for Relation Classification 1 Jul 2024 · 0 repositories · arXiv:2407.01424
-
SCKansformer: Fine-Grained Classification of Bone Marrow Cells via Kansformer Backbone and Hierarchical Attention Mechanisms 14 Jun 2024 · 1 repository · arXiv:2406.09931
-
Contextual Dynamic Pricing: Algorithms, Optimality, and Local Differential Privacy Constraints 4 Jun 2024 · 0 repositories · arXiv:2406.02424
-
A Challenge Dataset and Effective Models for Conversational Stance Detection 17 Mar 2024 · 1 repository · arXiv:2403.11145
-
Event-Triggered Robust Cooperative Output Regulation for a Class of Linear Multi-Agent Systems with an Unknown Exosystem 1 Mar 2024 · 0 repositories · arXiv:2403.00645
-
Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models 29 Feb 2024 · 4 repositories · arXiv:2402.19427Syntology 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 10 harvested samples)
-
InverseMatrixVT3D: An Efficient Projection Matrix-Based Approach for 3D Occupancy Prediction 23 Jan 2024 · 1 repository · arXiv:2401.12422
-
DGL: Dynamic Global-Local Prompt Tuning for Text-Video Retrieval 19 Jan 2024 · 2 repositories · arXiv:2401.10588Syntology official (archive's flag): 1 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 2 harvested samples) · 1 pointer-only (licence)
-
Replication-proof Bandit Mechanism Design with Bayesian Agents 28 Dec 2023 · 0 repositories · arXiv:2312.16896
-
Learning-based Scheduling for Information Accuracy and Freshness in Wireless Networks 24 Oct 2023 · 0 repositories · arXiv:2310.15705
-
DeformUX-Net: Exploring a 3D Foundation Backbone for Medical Image Segmentation with Depthwise Deformable Convolution 30 Sep 2023 · 1 repository · arXiv:2310.00199
-
Listen to Minority: Encrypted Traffic Classification for Class Imbalance with Contrastive Pre-Training 31 Aug 2023 · 0 repositories · arXiv:2308.16453
-
Integrating a Heterogeneous Graph with Entity-aware Self-attention using Relative Position Labels for Reading Comprehension Model 19 Jul 2023 · 0 repositories · arXiv:2307.10443
-
High-dimensional Contextual Bandit Problem without Sparsity 19 Jun 2023 · 0 repositories · arXiv:2306.11017
-
Permutation Decision Trees 5 Jun 2023 · 0 repositories · arXiv:2306.02617
-
An Improved Heart Disease Prediction Using Stacked Ensemble Method 12 Apr 2023 · 0 repositories · arXiv:2304.06015
-
Asynchronous Event-Triggered Control for Non-Linear Systems 25 Nov 2022 · 0 repositories · arXiv:2211.13846
-
LittleBird: Efficient Faster & Longer Transformer for Question Answering 21 Oct 2022 · 0 repositories · arXiv:2210.11870
-
Short Text Pre-training with Extended Token Classification for E-commerce Query Understanding 8 Oct 2022 · 0 repositories · arXiv:2210.03915
-
Embed to Control Partially Observed Systems: Representation Learning with Provable Sample Efficiency 26 May 2022 · 0 repositories · arXiv:2205.13476
-
Thompson Sampling for Bandit Learning in Matching Markets 26 Apr 2022 · 1 repository · arXiv:2204.12048
-
Pay "Attention" to Adverse Weather: Weather-aware Attention-based Object Detection 22 Apr 2022 · 0 repositories · arXiv:2204.10803
-
ETCetera: beyond Event-Triggered Control 3 Mar 2022 · 0 repositories · arXiv:2203.01623
-
Formal Analysis of the Sampling Behaviour of Stochastic Event-Triggered Control 21 Feb 2022 · 0 repositories · arXiv:2202.10178
-
Chaos and order in event-triggered control 12 Jan 2022 · 0 repositories · arXiv:2201.04462
-
Detecting Extratropical Cyclones of the Northern Hemisphere with Single Shot Detector 1 Dec 2021 · 0 repositories · arXiv:2112.01283
-
Global-Local Attention for Emotion Recognition 7 Nov 2021 · 1 repository · arXiv:2111.04129
-
Bandits with Dynamic Arm-acquisition Costs 23 Oct 2021 · 0 repositories · arXiv:2110.12118
-
Computing the average inter-sample time of event-triggered control using quantitative automata 29 Sep 2021 · 0 repositories · arXiv:2109.14391
-
UNetFormer: A UNet-like Transformer for Efficient Semantic Segmentation of Remote Sensing Urban Scene Imagery 18 Sep 2021 · 1 repository · arXiv:2109.08937Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
A Multimodal Framework for Video Ads Understanding 29 Aug 2021 · 0 repositories · arXiv:2108.12868
-
Uncertainties and output feedback in rollout event-triggered control 20 Aug 2021 · 0 repositories · arXiv:2108.09125
-
Rollout event-triggered control: reconciling event- and time-triggered control 6 Aug 2021 · 0 repositories · arXiv:2108.02994
-
Debiasing Samples from Online Learning Using Bootstrap 31 Jul 2021 · 0 repositories · arXiv:2108.00236
-
All the attention you need: Global-local, spatial-channel attention for image retrieval 16 Jul 2021 · 0 repositories · arXiv:2107.08000
-
Model Selection for Generic Contextual Bandits 7 Jul 2021 · 0 repositories · arXiv:2107.03455
-
Abstracting the Sampling Behaviour of Stochastic Linear Periodic Event-Triggered Control Systems 25 Mar 2021 · 0 repositories · arXiv:2103.13839
-
The Wireless Control Bus: Enabling Efficient Multi-hop Event-Triggered Control with Concurrent Transmissions 26 Jan 2021 · 0 repositories · arXiv:2101.10961
-
RealFormer: Transformer Likes Residual Attention 21 Dec 2020 · 5 repositories · arXiv:2012.11747
-
Weakly-Supervised Action Localization and Action Recognition using Global-Local Attention of 3D CNN 17 Dec 2020 · 0 repositories · arXiv:2012.09542
-
Abstracting the Traffic of Nonlinear Event-Triggered Control Systems 23 Oct 2020 · 0 repositories · arXiv:2010.12341
-
Machine Learning in Event-Triggered Control: Recent Advances and Open Issues 27 Sep 2020 · 0 repositories · arXiv:2009.12783
-
ISIA Food-500: A Dataset for Large-Scale Food Recognition via Stacked Global-Local Attention Network 13 Aug 2020 · 0 repositories · arXiv:2008.05655
-
Learning Visual Commonsense for Robust Scene Graph Generation 17 Jun 2020 · 2 repositories · arXiv:2006.09623Syntology 9 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 11 harvested samples) · 1 pointer-only (licence)
-
Region-Based Self-Triggered Control for Perturbed and Uncertain Nonlinear Systems 1 May 2020 · 0 repositories · arXiv:2005.00473
-
ETC: Encoding Long and Structured Inputs in Transformers 17 Apr 2020 · 2 repositories · arXiv:2004.08483Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
Tasks archive 2025-07-28
20 shown of 92 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections