Browse State-of-the-Art › Video-to-Video Synthesis

Video-to-Video Synthesis

10 papers with code · 2 benchmarks · 1 dataset archive 2025-07-28

Computer Vision

Benchmarks archive 2025-07-28

2 leaderboard tables shown for this task, 2 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.

DatasetBest model (first row in archive order)PaperCodeSyntologyCompare
Street Scene (1 row) Few-shot Video-to-Video Few-shot Video-to-Video Synthesis code — Compare
YouTube Dancing (1 row) Few-shot Video-to-Video Few-shot Video-to-Video Synthesis code — Compare

Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.

Libraries

Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.

Datasets archive 2025-07-28

1 dataset whose archive record lists this task, ordered by the archive's paper count.

Subtasks archive 2025-07-28

No subtask under this task in the archive's task tree.

Parent tasks archive 2025-07-28

Papers archive 2025-07-28

archive papers tagged: 18 · with a code link: 10 · where Syntology ran a sample: 2 (1 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument) Syntology

Show: all tagged papersonly where code ran (2 of 18 tagged: 1 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument)

Page 1 of 1: papers 1 to 18 of 18, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.

Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from.

  • 20 Aug 2018 10 repositories listed
    We study the problem of video-to-video synthesis, whose goal is to learn a mapping function from an input source video (e. g., a sequence of semantic segmentation masks) to an output photorealistic video that precisely…
  • 28 Oct 2019 6 repositories listed
    To address the limitations, we propose a few-shot vid2vid framework, which learns to synthesize videos of previously unseen subjects or scenes by leveraging few example images of the target at test time.
  • Video inpainting aims to fill spatio-temporal holes with plausible content in a video.
  • 7 Jun 2024 1 repository listed
    This enables a greater number of cross-frame attentions over more frames within the same computational budget, thereby enhancing both video quality and temporal coherence.
  • 3 Apr 2024 1 repository listed
    We demonstrate that mesh stylization is a promising approach for creating realistic simulations for downstream tasks such as training networks and preoperative planning.
  • 1 Sep 2022 1 repository listed
    We propose a problem formulation that more closely adheres to the standard workflow of animation.
  • 11 Jul 2022 1 repository listed
    In this paper, we present a spatial-temporal compression framework, Fast-Vid2Vid, which focuses on data aspects of generative models.
  • Our generative model for this task (AG2Vid) disentangles motion and appearance features, and by incorporating a scheduling mechanism for actions facilitates a timely and coordinated video generation.
  • 10 Jun 2020 1 repository listed
    We do hope that this series will provide you a big overview of the field, so that you will not need to read all the literature by yourself, independent of your background on GANs.
  • 8 May 2019 1 repository listed
    Blind video decaptioning is a problem of automatically removing text overlays and inpainting the occluded parts in videos without any input masks.
  • Video to Video Generative Adversarial Network for Few-shot Learning Based on Policy Gradient
    28 Oct 2024 0 repositories listed
    The development of sophisticated models for video-to-video synthesis has been facilitated by recent advances in deep reinforcement learning and generative adversarial networks (GANs).
  • Translation-based Video-to-Video Synthesis
    3 Apr 2024 0 repositories listed
    Translation-based Video Synthesis (TVS) has emerged as a vital research area in computer vision, aiming to facilitate the transformation of videos between distinct domains while preserving both temporal continuity and…
  • FlowVid: Taming Imperfect Optical Flows for Consistent Video-to-Video Synthesis
    29 Dec 2023 0 repositories listed
    Diffusion models have transformed the image-to-image (I2I) synthesis and are now permeating into videos.
  • Fairy: Fast Parallelized Instruction-Guided Video-to-Video Synthesis
    20 Dec 2023 0 repositories listed
    In this paper, we introduce Fairy, a minimalist yet robust adaptation of image-editing diffusion models, enhancing them for video editing applications.
  • Unsupervised Action Localization Crop in Video Retargeting for 3D ConvNets
    14 Nov 2021 0 repositories listed
    Untrimmed videos on social media or those captured by robots and surveillance cameras are of varied aspect ratios.
  • World-Consistent Video-to-Video Synthesis
    16 Jul 2020 0 repositories listed
    Video-to-video synthesis (vid2vid) aims for converting high-level semantic inputs to photorealistic videos.
  • ReenactNet: Real-time Full Head Reenactment
    22 May 2020 0 repositories listed
    Video-to-video synthesis is a challenging problem aiming at learning a translation function between a sequence of semantic maps and a photo-realistic video depicting the characteristics of a driving video.
  • Learning Joint Wasserstein Auto-Encoders for Joint Distribution Matching
    27 Sep 2018 0 repositories listed
    We study the joint distribution matching problem which aims at learning bidirectional mappings to match the joint distribution of two domains.

Syntology lines on 2 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections