Browse State-of-the-Art › Referring Video Object Segmentation
Referring Video Object Segmentation
50 papers with code · 5 benchmarks · 4 datasets archive 2025-07-28
Referring video object segmentation aims at segmenting an object in video with language expressions. Unlike the previous video object segmentation, the task exploits a different type of supervision, language expressions, to identify and segment an object referred by the given language expressions in a video.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
5 leaderboard tables shown for this task, 5 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
Syntology 3 newer papers were judged to report on this task's benchmarks so far (Claude Sonnet 4.5, reading their tables: a model's judgement, not a result; 0 placed): Refer-YouTube-VOS (1 judged, 0 placed), MeViS (3 judged, 0 placed), Ref-DAVIS17 (1 judged, 0 placed), ReVOS (1 judged, 0 placed), Long-RVOS (1 judged, 0 placed). Drawn from 8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read).
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| Refer-YouTube-VOS (18 rows) | FindTrack | Find First, Track Next: Decoupling Identification and Propagation... | code | — | Compare |
| MeViS (16 rows) | MPG-SAM 2 | MPG-SAM 2: Adapting SAM 2 with Mask Priors and Global Context for... | code | Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 1 violated, 4 with no contract checked; 4 where Syntology's instrument failed) · 6 unverified | Compare |
| Ref-DAVIS17 (11 rows) | FindTrack | Find First, Track Next: Decoupling Identification and Propagation... | code | — | Compare |
| ReVOS (9 rows) | VRS-HQ (Chat-UniVi-13B) | The Devil is in Temporal Token: High Quality Video Reasoning Segmentation | code | — | Compare |
| Long-RVOS (7 rows) | ReferMo | Long-RVOS: A Comprehensive Benchmark for Long-term Referring Video... | — | — | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
4 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 74 · with a code link: 50 · where Syntology ran a sample: 22 (19 with a run with no instrument failure, 3 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (22 of 74 tagged: 19 with a run with no instrument failure, 3 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 74 of 74, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
16 Jul 2024 2 repositories listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)In this paper, we introduce a new task, Reasoning Video Object Segmentation (ReasonVOS).
-
25 Dec 2023 2 repositories listed Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 7 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples) · 2 pointer-only (licence)We evaluate our unified models on various benchmarks.
-
1 Aug 2023 2 repositories listedIn this work, we propose a new segmentation task -- reasoning segmentation.
-
29 Nov 2021 2 repositories listed Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 5 where Syntology's instrument failed) · 2 unverified (of 11 harvested samples) · 6 pointer-only (licence)Due to the complex nature of this multimodal task, which combines text reasoning, video understanding, instance segmentation and tracking, existing approaches typically rely on sophisticated pipelines in order to tackle…
-
5 Jun 2025 1 repository listedCurrent video-based approaches, while proficient in tracking, lack the sophisticated reasoning capabilities of large language models, limiting their contextual understanding and generalization.
-
18 Apr 2025 1 repository listedReferring video object segmentation (RVOS) aims to segment objects in videos guided by natural language descriptions.
-
10 Apr 2025 1 repository listed Syntology 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 9 unverified; every one of the 3 samples that ran constructed an object rather than computing a result (of 12 harvested samples) · 12 pointer-only (licence)This paper proposes a novel framework utilizing multi-modal large language models (MLLMs) for referring video object segmentation (RefVOS).
-
7 Apr 2025 1 repository listedMotion expression video segmentation is designed to segment objects in accordance with the input motion expressions.
-
1 Apr 2025 1 repository listedReferring video object segmentation (RVOS) is a challenging task that requires the model to segment the object in a video given the language description.
-
30 Mar 2025 1 repository listedThis task has attracted increasing attention in the field of computer vision due to its promising applications in video editing and human-agent interaction.
-
5 Mar 2025 1 repository listedThis reference is then utilized by a dedicated propagation module to track and segment the object across the entire video.
-
23 Jan 2025 1 repository listed Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 1 violated, 4 with no contract checked; 4 where Syntology's instrument failed) · 6 unverified (of 16 harvested samples) · 1 pointer-only (licence)Referring video object segmentation (RVOS) aims to segment objects in a video according to textual descriptions, which requires the integration of multimodal information and temporal dynamics perception.
-
21 Jan 2025 1 repository listedThis paper aims to improve the performance of video multimodal large language models (MLLM) via long and rich context (LRC) modeling.
-
15 Jan 2025 1 repository listedExisting methods for Video Reasoning Segmentation rely heavily on a single special token to represent the object in the keyframe or the entire video, inadequately capturing spatial complexity and inter-frame motion.
-
9 Jan 2025 1 repository listedThe Aligner removes noise from queries and aligns them to achieve query consistency.
-
7 Jan 2025 1 repository listedThis work presents Sa2VA, the first unified model for dense grounded understanding of both images and videos.
-
1 Jan 2025 1 repository listedWe identify three critical challenges: (C1) insufficient quantitative representation of textual numerical data, (C2) repetitive and degraded response templates for spatiotemporal referencing, and (C3) loss of visual…
-
2 Dec 2024 1 repository listedReferring video object segmentation (RVOS) requires tracking and segmenting an object throughout a video according to a given natural language expression, demanding both complex motion understanding and the alignment of…
-
26 Nov 2024 1 repository listed Syntology official (archive's flag): 13 ran · 13 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 4 honoured, 2 violated, 2 with no contract checked; 5 where Syntology's instrument failed) · 4 unverified (of 17 harvested samples) · 2 pointer-only (licence)This paper aims to address universal segmentation for image and video perception with the strong reasoning ability empowered by Visual Large Language Models (VLLMs).
-
26 Nov 2024 1 repository listedReferring Video Object Segmentation (RVOS) relies on natural language expressions to segment an object in a video clip.
-
29 Sep 2024 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 6 where Syntology's instrument failed) · 8 unverified (of 16 harvested samples) · 1 pointer-only (licence)We introduce VideoLISA, a video-based multimodal large language model designed to tackle the problem of language-instructed reasoning segmentation in videos.
-
10 Jul 2024 1 repository listed Syntology official (archive's flag): 14 ran · 14 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 2 honoured, 1 violated, 1 with no contract checked; 10 where Syntology's instrument failed) · 1 unverified (of 15 harvested samples) · 15 pointer-only (licence)Experimental results on VISOR dataset reveal that ActionVOS significantly reduces the mis-segmentation of inactive objects, confirming that actions help the ActionVOS model understand objects' involvement.
-
11 Jun 2024 1 repository listedMotion Expression guided Video Segmentation (MeViS), as an emerging task, poses many new challenges to the field of referring video object segmentation (RVOS).
-
12 Apr 2024 1 repository listedThe complexity of this task increases with the intricacy of the sentences provided.
-
4 Apr 2024 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 7 pointer-only (licence)In fact, static cues can sometimes interfere with temporal perception by overshadowing motion cues.
-
28 Mar 2024 1 repository listed Syntology official (archive's flag): 14 ran · 14 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 3 violated, 0 with no contract checked; 10 where Syntology's instrument failed) · 1 unverified (of 15 harvested samples) · 4 pointer-only (licence)Referring Video Object Segmentation (R-VOS) methods face challenges in maintaining consistent object segmentation due to temporal context variability and the presence of other visually similar objects.
-
18 Mar 2024 1 repository listed Syntology official (archive's flag): 16 ran · 16 ran (of which 5 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 0 violated, 7 with no contract checked; 8 where Syntology's instrument failed) · 4 unverified (of 20 harvested samples) · 20 pointer-only (licence)We hypothesize that the latent representation learned from a pretrained generative T2V model encapsulates rich semantics and coherent temporal correspondences, thereby naturally facilitating video understanding.
-
28 Feb 2024 1 repository listed Syntology official (archive's flag): 12 ran · 12 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 1 violated, 8 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 14 harvested samples) · 14 pointer-only (licence)Despite the recent advances in unified image segmentation (IS), developing a unified video segmentation (VS) model remains a challenge.
-
1 Jan 2024 1 repository listedThe recent transformer-based models have dominated the Referring Video Object Segmentation (RVOS) task due to the superior performance.
-
29 Dec 2023 1 repository listedThe perception component then generates the tracking results based on the embeddings.
-
14 Dec 2023 1 repository listed Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 9 where Syntology's instrument failed) · 2 unverified (of 13 harvested samples) · 3 pointer-only (licence)
-
7 Sep 2023 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 10 harvested samples) · 10 pointer-only (licence)
-
5 Sep 2023 1 repository listed
-
16 Aug 2023 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples)
-
25 Jul 2023 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples) · 9 pointer-only (licence)
-
18 Jul 2023 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 4 pointer-only (licence)
-
3 Jul 2023 1 repository listed
-
14 Jun 2023 1 repository listed
-
26 May 2023 1 repository listed
-
25 May 2023 1 repository listed
-
12 Mar 2023 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 2 pointer-only (licence)
-
27 Dec 2022 1 repository listed
-
28 Oct 2022 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples)
-
26 Jul 2022 1 repository listed
-
4 Jul 2022 1 repository listed
-
8 Jun 2022 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 3 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples)
-
18 Mar 2022 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
3 Jan 2022 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples) · 8 pointer-only (licence)
-
1 Aug 2020 1 repository listed
-
9 Apr 2019 1 repository listed
-
InterRVOS: Interaction-aware Referring Video Object Segmentation3 Jun 2025 0 repositories listed
-
19 May 2025 0 repositories listed
-
24 Jan 2025 0 repositories listed
-
Decoupled Motion Expression Video Segmentation1 Jan 2025 0 repositories listed
-
Semantic and Sequential Alignment for Referring Video Object Segmentation1 Jan 2025 0 repositories listed
-
LSVOS Challenge Report: Large-scale Complex and Long Video Object Segmentation9 Sep 2024 0 repositories listed
-
The 2nd Solution for LSVOS Challenge RVOS Track: Spatial-temporal Refinement for Consistent Semantic Segmentation22 Aug 2024 0 repositories listed
-
The Instance-centric Transformer for the RVOS Track of LSVOS Challenge: 3rd Place Solution20 Aug 2024 0 repositories listed
-
UNINEXT-Cutie: The 1st Solution for LSVOS Challenge RVOS Track19 Aug 2024 0 repositories listed
-
2nd Place Solution for MeViS Track in CVPR 2024 PVUW Workshop: Motion Expression guided Video Segmentation20 Jun 2024 0 repositories listed
-
18 Jun 2024 0 repositories listed
-
3rd Place Solution for MeViS Track in CVPR 2024 PVUW workshop: Motion Expression guided Video Segmentation7 Jun 2024 0 repositories listed
-
17 May 2024 0 repositories listed
-
Fully Transformer-Equipped Architecture for End-to-End Referring Video Object Segmentation21 Sep 2023 0 repositories listed
-
Temporal Collection and Distribution for Referring Video Object Segmentation7 Sep 2023 0 repositories listed
-
8 Aug 2023 0 repositories listed
-
Learning Referring Video Object Segmentation from Weak Annotation4 Aug 2023 0 repositories listed
-
Bidirectional Correlation-Driven Inter-Frame Interaction Transformer for Referring Video Object Segmentation2 Jul 2023 0 repositories listed
-
1 Jan 2023 0 repositories listed
-
Robust Referring Video Object Segmentation with Cyclic Structural Consensus1 Jan 2023 0 repositories listed
-
1 Jan 2023 0 repositories listed
-
The Second Place Solution for The 4th Large-scale Video Object Segmentation Challenge--Track 3: Referring Video Object Segmentation24 Jun 2022 0 repositories listed
-
1 Jan 2022 0 repositories listed
-
Rethinking Cross-modal Interaction from a Top-down Perspective for Referring Video Object Segmentation2 Jun 2021 0 repositories listed
Syntology lines on 22 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections