Datasets › YouTube-VOS 2018

YouTube-VOS 2018 (Youtube Video Object Segmentation)

Introduced in YouTube-VOS: A Large-Scale Video Object Segmentation Benchmark1 Jan 2018 archive 2025-07-28

Youtube-VOS is a Video Object Segmentation dataset that contains 4,453 videos - 3,471 for training, 474 for validation, and 508 for testing. The training and validation videos have pixel-level ground truth annotations for every 5th frame (6 fps). It also contains Instance Segmentation annotations. It has more than 7,800 unique objects, 190k high-quality manual annotations and more than 340 minutes in duration.

Source: CapsuleVOS: Semi-Supervised Video Object Segmentation Using Capsule Routing Image Source: https://youtube-vos.org/

Benchmarks archive 2025-07-28

All 10 leaderboards whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

First row (archive order)PaperCode
Semi-Supervised Video Object Segmentation YouTube-VOS 2018 Cutie+ (base, MEGA) Overall 87.5 Putting the Object Back into Video Object Segmentation hkchengrex/Cutie 53 Compare
Semi-Supervised Video Object Segmentation YouTube-VOS 2019 Cutie+ (base, MEGA) Overall 87.5 Putting the Object Back into Video Object Segmentation hkchengrex/Cutie 22 Compare
Video Object Segmentation YouTube-VOS 2018 XMem (BL30K, MS) Mean Jaccard & F-Measure 86.9 XMem: Long-Term Video Object Segmentation with an... hkchengrex/XMem +1 17 Compare
Video Inpainting YouTube-VOS 2018 ProPainter PSNR 34.43 ProPainter: Improving Propagation and Transformer for... sczhou/propainter +2 10 Compare
Video Object Segmentation YouTube-VOS 2019 XMem (BL30K,MS) Mean Jaccard & F-Measure 86.8 XMem: Long-Term Video Object Segmentation with an... hkchengrex/XMem +1 10 Compare
Visual Object Tracking YouTube-VOS 2018 OSVOS O (Average of Measures) 58.8 One-Shot Video Object Segmentation kmaninis/OSVOS-PyTorch +7 9 Compare
One-shot visual object segmentation YouTube-VOS 2018 OSVOS F-Measure (Seen) 60.5 One-Shot Video Object Segmentation kmaninis/OSVOS-PyTorch +7 2 Compare
Video Inpainting YouTube-VOS FGT++ LPIPS 0.025 Exploiting Optical Flow Guidance for Transformer-Based... hitachinsk/fgt +1 2 Compare
Visual Object Tracking YouTube-VOS AOC-MF F-Measure (Seen) 87.4 Towards Robust Video Object Segmentation with Adaptive... jerryx1110/robust-video-object-segmentation 2 Compare
One-shot visual object segmentation YouTube-VOS RVOS-Mask-ST+ F-Measure (Seen) 67.2 RVOS: End-to-End Recurrent Network for Video Object Segmentation imatge-upc/rvos 1 Compare

Papers archive 2025-07-28

papers with a benchmark row: 48 · with a code link: 43 · where Syntology ran a sample: 20 (17 with a run with no instrument failure, 3 where every run was a failure of Syntology's instrument) Syntology

Show: all papers with a benchmark rowonly where code ran (20 of 48 with a benchmark row: 17 with a run with no instrument failure, 3 where every run was a failure of Syntology's instrument)

Page 1 of 1: papers 1 to 48 of 48 with a leaderboard row on this dataset's benchmarks, newest first by the archive's date (ties by slug; undated papers last).

The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset, not that list; the archive's count for this dataset is 203. The Syntology column is from Syntology's graph, stated per sample; it is not part of any archive number. A line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified” (C is a part of N, never taken away from it); the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. When the archive marks a repository official for the paper, the cell starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record.

PaperCodeResultsDateSamples run Syntology
UniVS: Unified and Universal Video Segmentation with Prompts as Queries 1 1 28 Feb 2024 official (archive's flag): 12 ran · 12 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 1 violated, 8 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (14 pointer-only for licence)
Putting the Object Back into Video Object Segmentation 1 2 19 Oct 2023 official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified
ProPainter: Improving Propagation and Transformer for Video Inpainting 3 1 7 Sep 2023 official (archive's flag): 10 ran · 20 ran (of which 10 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 0 violated, 12 with no contract checked; 8 where Syntology's instrument failed) · 14 unverified (16 pointer-only for licence)
Tracking Anything in High Quality 1 1 26 Jul 2023 not harvested
Deficiency-Aware Masked Transformer for Video Inpainting 1 1 17 Jul 2023 not harvested
TrickVOS: A Bag of Tricks for Video Object Segmentation 0 2 27 Jun 2023 not harvested
MobileVOS: Real-Time Video Object Segmentation Contrastive Learning meets Knowledge Distillation 0 1 14 Mar 2023 not harvested
Exploiting Optical Flow Guidance for Transformer-Based Video Inpainting 2 2 24 Jan 2023 not harvested
Decoupling Features in Hierarchical Propagation for Video Object Segmentation 2 12 18 Oct 2022 not harvested
BATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation 0 19 1 Aug 2022 not harvested
Region Aware Video Object Segmentation with Deep Motion Modeling 0 1 21 Jul 2022 not harvested
Learning Quality-aware Dynamic Memory for Video Object Segmentation 1 1 16 Jul 2022 official: harvested, nothing ran · 0 ran · 1 unverified (1 pointer-only for licence)
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model 2 12 14 Jul 2022 official: harvested, nothing ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (2 pointer-only for licence)
Towards Robust Video Object Segmentation with Adaptive Object Calibration 1 2 2 Jul 2022 official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (4 pointer-only for licence)
Towards An End-to-End Framework for Flow-Guided Video Inpainting 2 1 6 Apr 2022 official (archive's flag): 5 ran · 5 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (6 pointer-only for licence)
Scalable Video Object Segmentation with Identification Mechanism 2 11 22 Mar 2022 not harvested
Reliable Propagation-Correction Modulation for Video Object Segmentation 1 4 6 Dec 2021 official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 1 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (1 pointer-only for licence)
Hierarchical Memory Matching Network for Video Object Segmentation 1 1 23 Sep 2021 official (archive's flag): 5 ran · 5 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (8 pointer-only for licence)
FuseFormer: Fusing Fine-Grained Information in Transformers for Video Inpainting 1 1 7 Sep 2021 official (archive's flag): 10 ran · 10 ran (of which 8 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (11 pointer-only for licence)
Self-Supervised Video Object Segmentation by Motion-Aware Mask Propagation 1 1 27 Jul 2021 official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified
Rethinking Space-Time Networks with Improved Memory Coverage for Efficient Video Object Segmentation 3 4 9 Jun 2021 official: harvested, nothing ran · 6 ran (of which 6 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified; every one of the 6 samples that ran constructed an object rather than computing a result (2 pointer-only for licence)
Associating Objects with Transformers for Video Object Segmentation 2 13 4 Jun 2021 not harvested
Efficient Regional Memory Network for Video Object Segmentation 1 1 24 Mar 2021 official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified
Modular Interactive Video Object Segmentation: Interaction-to-Mask, Propagation and Difference-Aware Fusion 5 1 14 Mar 2021 official (archive's flag): 2 ran · 10 ran (of which 3 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 5 where Syntology's instrument failed) · 8 unverified
Separable Structure Modeling for Semi-supervised Video Object Segmentation 1 1 18 Feb 2021 not harvested
SSTVOS: Sparse Spatiotemporal Transformers for Video Object Segmentation 1 2 21 Jan 2021 official (archive's flag): 5 ran · 5 ran (of which 5 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified; every one of the 5 samples that ran constructed an object rather than computing a result (7 pointer-only for licence)
Make One-Shot Video Object Segmentation Efficient Again 4 1 3 Dec 2020 not harvested
Delving into the Cyclic Mechanism in Semi-supervised Video Object Segmentation 1 1 23 Oct 2020 not harvested
Video Object Segmentation with Adaptive Feature Bank and Uncertain-Region Refinement 1 1 15 Oct 2020 not harvested
Collaborative Video Object Segmentation by Multi-Scale Foreground-Background Integration 1 1 13 Oct 2020 official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified
Flow-edge Guided Video Completion 1 1 3 Sep 2020 not harvested
Learning Joint Spatial-Temporal Transformations for Video Inpainting 2 1 20 Jul 2020 official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified
Kernelized Memory Network for Video Object Segmentation 1 1 16 Jul 2020 not harvested
Collaborative Video Object Segmentation by Foreground-Background Integration 2 2 18 Mar 2020 not harvested
Learning Fast and Robust Target Models for Video Object Segmentation 2 1 27 Feb 2020 not harvested
CapsuleVOS: Semi-Supervised Video Object Segmentation Using Capsule Routing 1 1 30 Sep 2019 not harvested
Copy-and-Paste Networks for Deep Video Inpainting 1 1 30 Aug 2019 not harvested
Learnable Gated Temporal Shift Module for Deep Video Inpainting 2 1 2 Jul 2019 not harvested
Proposal, Tracking and Segmentation (PTS): A Cascaded Network for Video Object Segmentation 1 1 2 Jul 2019 not harvested
Deep Flow-Guided Video Inpainting 2 1 8 May 2019 official (archive's flag): 1 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified
Deep Video Inpainting 2 1 5 May 2019 official (archive's flag): 1 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (2 pointer-only for licence)
Video Object Segmentation using Space-Time Memory Networks 3 1 1 Apr 2019 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified
RVOS: End-to-End Recurrent Network for Video Object Segmentation 1 2 13 Mar 2019 not harvested
Fast Online Object Tracking and Segmentation: A Unifying Approach 3 1 12 Dec 2018 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (1 pointer-only for licence)
YouTube-VOS: Sequence-to-Sequence Video Object Segmentation 4 2 3 Sep 2018 not harvested
Efficient Video Object Segmentation via Network Modulation 1 3 4 Feb 2018 not harvested
Online Adaptation of Convolutional Neural Networks for Video Object Segmentation 0 1 28 Jun 2017 not harvested
One-Shot Video Object Segmentation 8 3 16 Nov 2016 not harvested

Dataset loaders archive 2025-07-28

No loader listed in the archive.

Tasks archive 2025-07-28

License archive 2025-07-28

CC BY 4.0

Modalities archive 2025-07-28

Languages archive 2025-07-28

No language tagged.

Variants archive 2025-07-28

  • YouTube-VOS 2018
  • YouTube-VOS
  • YouTube-VOS 2019

3 variant names, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections