Browse State-of-the-Art › Rgb-T Tracking
Rgb-T Tracking
25 papers with code · 4 benchmarks · 2 datasets archive 2025-07-28
RGBT tracking, or RGB-Thermal tracking, is a sophisticated method utilized in computer vision for tracking objects across both RGB and thermal infrared modalities. This technique combines information from both RGB and thermal imagery to enhance object detection and tracking performance, particularly in challenging environments where lighting conditions may vary or be limited. By integrating data from these two modalities, RGBT tracking systems can effectively compensate for the limitations of each individual modality, such as the inability of RGB cameras to capture clear images in low-light or adverse weather conditions, and the inability of thermal cameras to accurately identify object details. RGBT tracking algorithms typically involve sophisticated fusion techniques to combine information from RGB and thermal sensors, enabling robust and accurate object tracking in diverse scenarios ranging from surveillance and security applications to autonomous vehicles and search and rescue operations.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
4 leaderboard tables shown for this task, 4 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| RGBT234 (42 rows) | SUTrack-L224 | SUTrack: Towards Simple and Unified Single Object Tracking | code | — | Compare |
| LasHeR (39 rows) | FlexTrack | — | — | — | Compare |
| RGBT210 (19 rows) | PromptTrack | — | — | — | Compare |
| GTOT (15 rows) | MambaVT-M256 | MambaVT: Spatio-Temporal Contextual Modeling for robust RGB-T Tracking | code | — | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
2 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 55 · with a code link: 25 · where Syntology ran a sample: 4 (4 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (4 of 55 tagged: 4 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 55 of 55, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
9 Mar 2024 4 repositories listedCurrent event-/frame-event based trackers undergo evaluation on short-term tracking datasets, however, the tracking of real-world scenarios involves long-term tracking, and the performance of existing tracking…
-
26 Jan 2022 2 repositories listedRGBT tracking usually suffers from various challenging factors of fast motion, scale variation, illumination variation, thermal crossover and occlusion, to name a few.
-
22 Jul 2021 2 repositories listedThe visible and thermal filters will be used to conduct a dynamic convolutional operation on their corresponding input feature maps respectively.
-
8 Dec 2020 2 repositories listedVisual object tracking, as a fundamental task in computer vision, has drawn much attention in recent years.
-
6 May 2025 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 5 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples) · 8 pointer-only (licence)GDSTrack dynamically fuses the modalities of neighboring frames, treats them as distractor noise, and leverages the denoising capability of a generative model.
-
26 Dec 2024 1 repository listedIt consolidates five SOT tasks (RGB-based, RGB-Depth, RGB-Thermal, RGB-Event, RGB-Language Tracking) into a unified model trained in a single session.
-
20 Dec 2024 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 0 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples) · 1 pointer-only (licence)These temporal information tokens are used to guide the localization of the target in the next time state, establish long-range contextual relationships between video frames, and capture the temporal trajectory of the…
-
15 Oct 2024 1 repository listedTo handle this issue, we take original RGB and TIR networks as the teachers, and distill their content knowledge into two student networks respectively by the style-content orthogonal feature decoupling scheme.
-
15 Aug 2024 1 repository listedExisting RGB-T tracking algorithms have made remarkable progress by leveraging the global interaction capability and extensive pre-trained models of the Transformer architecture.
-
6 May 2024 1 repository listedThe former does not fully exploit the potential of using only RGB and TIR information of the template or search region for channel and spatial feature fusion, and the latter lacks direct interaction between the template…
-
4 May 2024 1 repository listedIn particular, we design a fusion structure space based on the hierarchical attention network, each attention-based fusion unit corresponding to a fusion operation and a combination of these attention units…
-
30 Apr 2024 1 repository listedWe propose a new method based on a mixture of experts, namely MoETrack, as a baseline fusion strategy.
-
24 Mar 2024 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)Multimodal Visual Object Tracking (VOT) has recently gained significant attention due to its robustness.
-
17 Dec 2023 1 repository listedTo handle this problem, we propose a novel multi-modal visual prompt tracking model based on a universal bi-directional adapter, cross-prompting multiple modalities mutually.
-
27 Nov 2023 1 repository listedIn practice, most existing RGB trackers learn a single set of parameters to use them across datasets and applications.
-
4 Sep 2023 1 repository listedIn this context, we seek to uncover the potential of harnessing generative techniques to address the critical challenge, information fusion, in multi-modal tracking.
-
31 Aug 2023 1 repository listedObject tracking based on the fusion of visible and thermal im-ages, known as RGB-T tracking, has gained increasing atten-tion from researchers in recent years.
-
26 Aug 2023 1 repository listedWith this structure, the network can extract fusion features of the template and search region under the mutual interaction of modalities.
-
27 Apr 2023 1 repository listedIn this paper, we introduce a new sequence-to-sequence learning framework for RGB-based and multi-modal object tracking.
-
20 Mar 2023 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample)To inherit the powerful representations of the foundation model, a natural modus operandi for multi-modal tracking is full fine-tuning on the RGB-based parameters.
-
1 Jan 2023 1 repository listedTo alleviate these limitations, we propose a novel Template-Bridged Search region Interaction (TBSI) module which exploits templates as the medium to bridge the cross-modal interaction between RGB and TIR search regions…
-
8 Apr 2022 1 repository listedWith the popularity of multi-modal sensors, visible-thermal (RGB-T) object tracking is to achieve robust performance and wider application scenarios with the guidance of objects' temperature information.
-
27 Apr 2021 1 repository listedRGBT tracking receives a surge of interest in the computer vision community, but this research field lacks a large-scale and high-diversity benchmark dataset, which is essential for both the training of deep RGBT…
-
30 Aug 2019 1 repository listedOur tracker is trained in an end-to-end manner, enabling the components to learn how to fuse the information from both modalities.
-
1 Sep 2018 1 repository listedTo address this problem, this paper presents a novel approach to suppress background effects for RGB-T tracking.
-
Lightweight RGB-T Tracking with Mobile Vision Transformers23 Jun 2025 0 repositories listedSingle-modality object tracking (e.g., RGB-only) encounters difficulties in challenging imaging conditions, such as low illumination and adverse weather conditions.
-
14 Mar 2025 0 repositories listedCurrent RGBT tracking methods often overlook the impact of fusion location on mitigating modality gap, which is key factor to effective tracking.
-
10 Feb 2025 0 repositories listedRecently, many multi-modal trackers prioritize RGB as the dominant modality, treating other modalities as auxiliary, and fine-tuning separately various multi-modal tasks.
-
BTMTrack: Robust RGB-T Tracking via Dual-template Bridging and Temporal-Modal Candidate Elimination7 Jan 2025 0 repositories listedRGB-T tracking leverages the complementary strengths of RGB and thermal infrared (TIR) modalities to address challenging scenarios such as low illumination and adverse weather.
-
PURA: Parameter Update-Recovery Test-Time Adaption for RGB-T Tracking1 Jan 2025 0 repositories listedMaintaining stable tracking of objects in domain shift scenarios is crucial for RGB-T tracking, prompting us to explore the use of unlabeled test sample information for effective online model adaptation.
-
30 Aug 2024 0 repositories listed
-
16 Aug 2024 0 repositories listed
-
5 Aug 2024 0 repositories listed
-
27 Mar 2024 0 repositories listed
-
25 Mar 2024 0 repositories listed
-
14 Mar 2024 0 repositories listed
-
3 Jan 2024 0 repositories listed
-
2 Jan 2024 0 repositories listed
-
EANet: Enhanced Attribute-based RGBT Tracker Network4 Jul 2023 0 repositories listed
-
RGB-T Tracking Based on Mixed Attention9 Apr 2023 0 repositories listed
-
Self-Supervised RGB-T Tracking with Cross-Input Consistency26 Jan 2023 0 repositories listed
-
1 Jan 2023 0 repositories listed
-
29 Jul 2022 0 repositories listed
-
19 Jun 2022 0 repositories listed
-
16 Sep 2021 0 repositories listed
-
Siamese Infrared and Visible Light Fusion Network for RGB-T Tracking12 Mar 2021 0 repositories listed
-
14 Nov 2020 0 repositories listed
-
14 Nov 2020 0 repositories listed
-
MIRNet: Learning multiple identities representations in overlapped speech4 Aug 2020 0 repositories listed
-
26 Jul 2020 0 repositories listed
-
4 Jul 2020 0 repositories listed
-
1 Jun 2020 0 repositories listed
-
Learning Target-oriented Dual Attention for Robust RGB-T Tracking12 Aug 2019 0 repositories listed
-
FANet: Quality-Aware Feature Aggregation Network for Robust RGB-T Tracking24 Nov 2018 0 repositories listed
-
23 May 2018 0 repositories listed
Syntology lines on 4 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections