{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/dvis-decoupled-video-instance-segmentation","title":"DVIS: Decoupled Video Instance Segmentation Framework","arxiv_id":"2306.03413","date":"2023-06-06","proceeding":"ICCV 2023 1","authors":["Tao Zhang","Xingye Tian","Yu Wu","Shunping Ji","Xuebo Wang","Yuan Zhang","Pengfei Wan"],"abstract":"Video instance segmentation (VIS) is a critical task with diverse applications, including autonomous driving and video editing. Existing methods often underperform on complex and long videos in real world, primarily due to two factors. Firstly, offline methods are limited by the tightly-coupled modeling paradigm, which treats all frames equally and disregards the interdependencies between adjacent frames. Consequently, this leads to the introduction of excessive noise during long-term temporal alignment. Secondly, online methods suffer from inadequate utilization of temporal information. To tackle these challenges, we propose a decoupling strategy for VIS by dividing it into three independent sub-tasks: segmentation, tracking, and refinement. The efficacy of the decoupling strategy relies on two crucial elements: 1) attaining precise long-term alignment outcomes via frame-by-frame association during tracking, and 2) the effective utilization of temporal information predicated on the aforementioned accurate alignment outcomes during refinement. We introduce a novel referring tracker and temporal refiner to construct the \\textbf{D}ecoupled \\textbf{VIS} framework (\\textbf{DVIS}). DVIS achieves new SOTA performance in both VIS and VPS, surpassing the current SOTA methods by 7.3 AP and 9.6 VPQ on the OVIS and VIPSeg datasets, which are the most challenging and realistic benchmarks. Moreover, thanks to the decoupling strategy, the referring tracker and temporal refiner are super light-weight (only 1.69\\% of the segmenter FLOPs), allowing for efficient training and inference on a single GPU with 11G memory. The code is available at \\href{https://github.com/zhang-tao-whu/DVIS}{https://github.com/zhang-tao-whu/DVIS}.","url_abs":"https://arxiv.org/abs/2306.03413v3","url_pdf":"https://arxiv.org/pdf/2306.03413v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"dvis-decoupled-video-instance-segmentation","repo_url":"https://github.com/zhang-tao-whu/DVIS","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"autonomous-driving","task_name":"Autonomous Driving"},{"task_slug":null,"task_name":"GPU"},{"task_slug":"instance-segmentation","task_name":"Instance Segmentation"},{"task_slug":"segmentation","task_name":"Segmentation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"},{"task_slug":"video-editing","task_name":"Video Editing"},{"task_slug":"video-instance-segmentation","task_name":"Video Instance Segmentation"},{"task_slug":"video-panoptic-segmentation","task_name":"Video Panoptic Segmentation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/video-instance-segmentation-on-ovis-1","task":"Video Instance Segmentation","dataset":"OVIS validation","model":"DVIS(Swin-L, Offline)","rank_in_archive_order":5,"of":44,"metrics":{"AP50":"75.9","AP75":"53.0","AR1":"19.4","AR10":"55.3","mask AP":"49.9"},"uses_additional_data":false},{"leaderboard":"/sota/video-instance-segmentation-on-ovis-1","task":"Video Instance Segmentation","dataset":"OVIS validation","model":"DVIS(Swin-L, Online)","rank_in_archive_order":8,"of":44,"metrics":{"AP50":"71.9","AP75":"49.2","AR1":"19.4","AR10":"52.5","mask AP":"47.1"},"uses_additional_data":false},{"leaderboard":"/sota/video-instance-segmentation-on-youtube-vis-2","task":"Video Instance Segmentation","dataset":"YouTube-VIS 2021","model":"DVIS(Swin-L)","rank_in_archive_order":8,"of":26,"metrics":{"AP50":"83.0","AP75":"68.4","AR1":"47.7","AR10":"65.7","mask AP":"60.1"},"uses_additional_data":true},{"leaderboard":"/sota/video-instance-segmentation-on-youtube-vis-1","task":"Video Instance Segmentation","dataset":"YouTube-VIS validation","model":"DVIS","rank_in_archive_order":3,"of":44,"metrics":{"AP50":"88.0","AP75":"72.7","AR1":"56.5","AR10":"70.3","mask AP":"64.9"},"uses_additional_data":true},{"leaderboard":"/sota/video-instance-segmentation-on-youtube-vis-3","task":"Video Instance Segmentation","dataset":"Youtube-VIS 2022 Validation","model":"DVIS(Swin-L)","rank_in_archive_order":4,"of":7,"metrics":{"AP50_L":"69.0","AP75_L":"48.8","AR10_L":"51.8","AR1_L":"37.2","mAP_L":"45.9"},"uses_additional_data":true},{"leaderboard":"/sota/video-panoptic-segmentation-on-vipseg","task":"Video Panoptic Segmentation","dataset":"VIPSeg","model":"DVIS(Swin-L)","rank_in_archive_order":4,"of":12,"metrics":{"STQ":"55.3","VPQ":"57.6"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2306.03413","atlas_url":"https://app.syntology.ai/?focus=2306.03413","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"2306.03413"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"2306.03413\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"2306.03413"},"call":"get_concepts_for_paper(arxiv_id=\"2306.03413\")"}],"by_repo":[{"repo":"zhang-tao-whu/DVIS","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0,"harvested_for_other_papers":1,"harvested_for":["2404.00086"],"harvested_for_calls":[{"arxiv_id":"2404.00086","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"2404.00086"},"call":"get_harvested_code_for_paper(arxiv_id=\"2404.00086\")"}]}],"by_repo_harvested_for_is":"harvested_for: the arXiv ids (as Syntology's graph holds them) of every paper whose samples Syntology's graph links to this repository, in arXiv-id order, complete; the page names the first 3 and says how many more. A link only: it does not say the papers are the same work, that one copied the other, or that the code implements this paper's method; harvested_for_calls gives the get_harvested_code_for_paper call for each arXiv-shaped id among them","by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"af379ebf0253b11ed10c4d8426969a3b0cc6c66c6da135aa8c77306d677ebf20","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}