{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/video-to-video-synthesis","title":"Video-to-Video Synthesis","arxiv_id":"1808.06601","date":"2018-08-20","proceeding":"NeurIPS 2018 12","authors":["Ting-Chun Wang","Ming-Yu Liu","Jun-Yan Zhu","Guilin Liu","Andrew Tao","Jan Kautz","Bryan Catanzaro"],"abstract":"We study the problem of video-to-video synthesis, whose goal is to learn a\nmapping function from an input source video (e.g., a sequence of semantic\nsegmentation masks) to an output photorealistic video that precisely depicts\nthe content of the source video. While its image counterpart, the\nimage-to-image synthesis problem, is a popular topic, the video-to-video\nsynthesis problem is less explored in the literature. Without understanding\ntemporal dynamics, directly applying existing image synthesis approaches to an\ninput video often results in temporally incoherent videos of low visual\nquality. In this paper, we propose a novel video-to-video synthesis approach\nunder the generative adversarial learning framework. Through carefully-designed\ngenerator and discriminator architectures, coupled with a spatio-temporal\nadversarial objective, we achieve high-resolution, photorealistic, temporally\ncoherent video results on a diverse set of input formats including segmentation\nmasks, sketches, and poses. Experiments on multiple benchmarks show the\nadvantage of our method compared to strong baselines. In particular, our model\nis capable of synthesizing 2K resolution videos of street scenes up to 30\nseconds long, which significantly advances the state-of-the-art of video\nsynthesis. Finally, we apply our approach to future video prediction,\noutperforming several state-of-the-art competing systems.","url_abs":"http://arxiv.org/abs/1808.06601v2","url_pdf":"http://arxiv.org/pdf/1808.06601v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"video-to-video-synthesis","repo_url":"https://github.com/NVIDIA/vid2vid","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"video-to-video-synthesis","repo_url":"https://github.com/BUTIYO/vid2vid-test","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"video-to-video-synthesis","repo_url":"https://github.com/Sjunna9819/My-First-Project","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"video-to-video-synthesis","repo_url":"https://github.com/divyanshpuri02/Nvidia","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"video-to-video-synthesis","repo_url":"https://github.com/divyanshpuri02/divyansh.github.io","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"video-to-video-synthesis","repo_url":"https://github.com/eric-erki/vid2vid","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"video-to-video-synthesis","repo_url":"https://github.com/fniroui/depth2room","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"video-to-video-synthesis","repo_url":"https://github.com/freedombenLiu/vid2vid","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"video-to-video-synthesis","repo_url":"https://github.com/sakshamgupta006/video-to-video-synthesis","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"video-to-video-synthesis","repo_url":"https://github.com/yawayo/vid2vid","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}}],"tasks":[{"task_slug":"2k","task_name":"2k"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"},{"task_slug":"video-prediction","task_name":"Video Prediction"},{"task_slug":"video-deraining","task_name":"Video deraining"},{"task_slug":"video-to-video-synthesis","task_name":"Video-to-Video Synthesis"}],"methods":[],"datasets_introduced":[{"slug":"kayifamilytv-video-solution","name":"KayifamilyTv Video Solution","full_name":"KayifamilyTv Video Solution: Scalable Video-Mining Pipeline"}],"methods_introduced":[],"results":[{"leaderboard":"/sota/video-deraining-on-video-waterdrop-removal","task":"Video deraining","dataset":"Video Waterdrop Removal Dataset","model":"Vid2Vid","rank_in_archive_order":4,"of":5,"metrics":{"PSNR":"28.73","SSIM":"0.9542"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/1808.06601","atlas_url":"https://app.syntology.ai/?focus=1808.06601","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1808.06601"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1808.06601\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1808.06601"},"call":"get_concepts_for_paper(arxiv_id=\"1808.06601\")"}],"by_repo":[{"repo":"NVIDIA/vid2vid","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"BUTIYO/vid2vid-test","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"Sjunna9819/My-First-Project","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"divyanshpuri02/Nvidia","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"divyanshpuri02/divyansh.github.io","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"eric-erki/vid2vid","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"fniroui/depth2room","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"freedombenLiu/vid2vid","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"sakshamgupta006/video-to-video-synthesis","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"yawayo/vid2vid","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"4ce80d469e6a969307af7a3d6c70aeeb11d504e5bc33e4dc8eb350422ca45108","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}