Browse State-of-the-Art › Reasoning Segmentation
Reasoning Segmentation
25 papers with code · 0 benchmarks · 0 datasets archive 2025-07-28
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
No dataset record in the archive lists this task.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 52 · with a code link: 25 · where Syntology ran a sample: 12 (10 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (12 of 52 tagged: 10 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 52 of 52, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
17 May 2025 3 repositories listed Syntology official (archive's flag): 14 ran · 14 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 0 honoured, 0 violated, 13 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 15 harvested samples)Large vision-language models exhibit inherent capabilities to handle diverse visual perception tasks.
-
9 Mar 2025 3 repositories listedTraditional methods for reasoning segmentation rely on supervised fine-tuning with categorical labels and simple descriptions, limiting its out-of-domain generalization and lacking explicit reasoning processes.
-
27 Jun 2025 2 repositories listed Syntology official (archive's flag): 6 ran · 22 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 2 honoured, 0 violated, 5 with no contract checked; 15 where Syntology's instrument failed) · 1 unverified (of 23 harvested samples) · 4 pointer-only (licence)We present Seg-R1, a preliminary exploration of using reinforcement learning (RL) to enhance the pixel-level understanding and reasoning capabilities of large multimodal models (LMMs).
-
16 Jul 2024 2 repositories listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)In this paper, we introduce a new task, Reasoning Video Object Segmentation (ReasonVOS).
-
1 Aug 2023 2 repositories listedIn this work, we propose a new segmentation task -- reasoning segmentation.
-
5 Jun 2025 1 repository listedAlthough perception systems have made remarkable advancements in recent years, particularly in 2D reasoning segmentation, these systems still rely on explicit human instruction or pre-defined categories to identify…
-
17 May 2025 1 repository listedVisual reasoning, the capability to interpret visual input in response to implicit text query through multi-step reasoning, remains a challenge for deep learning models due to the lack of relevant benchmarks.
-
17 Apr 2025 1 repository listedThe key innovations of SmartFreeEdit include:(1)the introduction of region aware tokens and a mask embedding paradigm that enhance the spatial understanding of complex scenes;(2) a reasoning segmentation pipeline…
-
18 Mar 2025 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)To address this gap, we construct a large-scale dataset called Multi-target and Multi-granularity Reasoning (MMR).
-
3 Mar 2025 1 repository listedGeneralist models have achieved remarkable success in both language and vision-language tasks, showcasing the potential of unified modeling.
-
13 Feb 2025 1 repository listedTo establish a benchmark for this novel task, we build a Pixel-level ReasonIng Segmentation Dataset Based on Multi-Turn Conversations (PRIST), comprising 24k utterances from 8.
-
15 Jan 2025 1 repository listedExisting methods for Video Reasoning Segmentation rely heavily on a single special token to represent the object in the keyframe or the entire video, inadequately capturing spatial complexity and inter-frame motion.
-
1 Jan 2025 1 repository listedThis paper aims to address universal segmentation for image and video perception with the strong reasoning ability empowered by Visual Large Language Models (VLLMs).
-
18 Dec 2024 1 repository listed Syntology official (archive's flag): 12 ran · 12 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 2 honoured, 1 violated, 5 with no contract checked; 4 where Syntology's instrument failed) · 2 unverified (of 14 harvested samples) · 1 pointer-only (licence)Boosted by Multi-modal Large Language Models (MLLMs), text-guided universal segmentation models for the image and video domains have made rapid progress recently.
-
26 Nov 2024 1 repository listed Syntology official (archive's flag): 13 ran · 13 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 4 honoured, 2 violated, 2 with no contract checked; 5 where Syntology's instrument failed) · 4 unverified (of 17 harvested samples) · 2 pointer-only (licence)This paper aims to address universal segmentation for image and video perception with the strong reasoning ability empowered by Visual Large Language Models (VLLMs).
-
29 Sep 2024 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 6 where Syntology's instrument failed) · 8 unverified (of 16 harvested samples) · 1 pointer-only (licence)We introduce VideoLISA, a video-based multimodal large language model designed to tackle the problem of language-instructed reasoning segmentation in videos.
-
20 Sep 2024 1 repository listedObserving the lack of a benchmark for model training and evaluation over the MGSC task, we establish a benchmark with aligned masks and captions in multi-granularity using our customized automated annotation pipeline.
-
16 Aug 2024 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 1 pointer-only (licence)With this novel design, we advocate a flexible system, hierarchical reasoning capabilities, and a transparent decision-making pipeline, all of which contribute to its ability to emulate human-like cognitive processes in…
-
2 Aug 2024 1 repository listed Syntology official (archive's flag): 12 ran · 12 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 7 where Syntology's instrument failed) · 3 unverified (of 15 harvested samples) · 15 pointer-only (licence)In this paper, we propose an efficient and effective multi-task visual grounding (EEVG) framework based on Transformer Decoder to address this issue, which reduces the cost in both language and visual aspects.
-
18 Jul 2024 1 repository listedTo bridge the gap between image and video, in this work, we propose a new video segmentation task - video reasoning segmentation.
-
27 May 2024 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 7 pointer-only (licence)This foundational estimation facilitates a detailed, coarse-to-fine segmentation strategy that significantly enhances the precision of object identification and segmentation.
-
12 Apr 2024 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)In this work, we delve into reasoning segmentation, a novel task that enables segmentation system to reason and interpret implicit user intention via large language model reasoning and then segment the corresponding…
-
8 Apr 2024 1 repository listed Syntology official (archive's flag): 3 ran · 5 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 8 unverified (of 13 harvested samples) · 13 pointer-only (licence)We believe that the act of reasoning segmentation should mirror the cognitive stages of human visual search, where each step is a progressive refinement of thought toward the final object.
-
28 Dec 2023 1 repository listed Syntology 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 8 unverified (of 14 harvested samples) · 2 pointer-only (licence)While LISA effectively bridges the gap between segmentation and large language models to enable reasoning segmentation, it poses certain limitations: unable to distinguish different instances of the target region, and…
-
4 Dec 2023 1 repository listed Syntology 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)PixelLM excels across various pixel-level image reasoning and understanding tasks, outperforming well-established methods in multiple benchmarks, including MUSE, single- and multi-referring segmentation.
-
HRSeg: High-Resolution Visual Perception and Enhancement for Reasoning Segmentation17 Jul 2025 0 repositories listedThe reasoning segmentation task involves segmenting objects within an image by interpreting implicit user instructions, which may encompass subtleties such as contextual cues and open-world knowledge.
-
MedSeg-R: Reasoning Segmentation in Medical Images with Multimodal Large Language Models12 Jun 2025 0 repositories listedMedical image segmentation is crucial for clinical diagnosis, yet existing models are limited by their reliance on explicit human instructions and lack the active reasoning capabilities to understand complex clinical…
-
Decoupling the Image Perception and Multimodal Reasoning for Reasoning Segmentation with Digital Twin Representations9 Jun 2025 0 repositories listedReasoning Segmentation (RS) is a multimodal vision-text task that requires segmenting objects based on implicit text queries, demanding both precise visual perception and vision-text reasoning capabilities.
-
RSVP: Reasoning Segmentation via Visual Prompting and Multi-modal Chain-of-Thought4 Jun 2025 0 repositories listedMulti-modal Large Language Models (MLLMs) have demonstrated remarkable reasoning capability while lack explicit mechanisms for visual grounding and segmentation, creating a gap between cognitive reasoning and visual…
-
PixelThink: Towards Efficient Chain-of-Pixel Reasoning29 May 2025 0 repositories listedExisting reasoning segmentation approaches typically fine-tune multimodal large language models (MLLMs) using image-text pairs and corresponding mask labels.
-
Reasoning Segmentation for Images and Videos: A Survey24 May 2025 0 repositories listed
-
PRS-Med: Position Reasoning Segmentation with Vision-Language Model in Medical Imaging17 May 2025 0 repositories listed
-
LISAT: Language-Instructed Segmentation Assistant for Satellite Imagery5 May 2025 0 repositories listed
-
LVLM_CSP: Accelerating Large Vision Language Models via Clustering, Scattering, and Pruning for Reasoning Segmentation15 Apr 2025 0 repositories listed
-
MediSee: Reasoning-based Pixel-level Perception in Medical Images15 Apr 2025 0 repositories listed
-
Online Reasoning Video Segmentation with Just-in-Time Digital Twins27 Mar 2025 0 repositories listed
-
Operating Room Workflow Analysis via Reasoning Segmentation over Digital Twins26 Mar 2025 0 repositories listed
-
MLLM-For3D: Adapting Multimodal Large Language Model for 3D Reasoning Segmentation23 Mar 2025 0 repositories listed
-
VEGGIE: Instructional Editing and Reasoning Video Concepts with Grounded Generation18 Mar 2025 0 repositories listed
-
Unveiling the Invisible: Reasoning Complex Occlusions Amodally with AURA13 Mar 2025 0 repositories listed
-
Think Before You Segment: High-Quality Reasoning Segmentation with GPT Chain of Thoughts10 Mar 2025 0 repositories listed
-
POPEN: Preference-Based Optimization and Ensemble for LVLM-Based Reasoning Segmentation1 Jan 2025 0 repositories listed
-
PRIMA: Multi-Image Vision-Language Models for Reasoning Segmentation19 Dec 2024 0 repositories listed
-
Multimodal 3D Reasoning Segmentation with Complex Scenes21 Nov 2024 0 repositories listed
-
Motion-Grounded Video Reasoning: Understanding and Perceiving Motion at Pixel Level15 Nov 2024 0 repositories listed
-
SegLLM: Multi-round Reasoning Segmentation24 Oct 2024 0 repositories listed
-
One Framework to Rule Them All: Unifying Multimodal Tasks with LLM Neural-Tuning6 Aug 2024 0 repositories listed
-
Reasoning3D -- Grounding and Reasoning in 3D: Fine-Grained Zero-Shot Open-Vocabulary 3D Reasoning Part Segmentation via Large Vision-Language Models29 May 2024 0 repositories listed
-
Empowering Segmentation Ability to Multi-modal Large Language Models21 Mar 2024 0 repositories listed
-
FoodLMM: A Versatile Food Assistant using Large Multi-modal Model22 Dec 2023 0 repositories listed
-
Beyond Segmentation: Road Network Generation with Multi-Modal LLMs15 Oct 2023 0 repositories listed
-
Transferring Foundation Models for Generalizable Robotic Manipulation9 Jun 2023 0 repositories listed
Syntology lines on 14 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections