{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/unsupervised-flow-aligned-sequence-to","title":"Unsupervised Flow-Aligned Sequence-to-Sequence Learning for Video Restoration","arxiv_id":"2205.10195","date":"2022-05-20","proceeding":null,"authors":["Jing Lin","Xiaowan Hu","Yuanhao Cai","Haoqian Wang","Youliang Yan","Xueyi Zou","Yulun Zhang","Luc van Gool"],"abstract":"How to properly model the inter-frame relation within the video sequence is an important but unsolved challenge for video restoration (VR). In this work, we propose an unsupervised flow-aligned sequence-to-sequence model (S2SVR) to address this problem. On the one hand, the sequence-to-sequence model, which has proven capable of sequence modeling in the field of natural language processing, is explored for the first time in VR. Optimized serialization modeling shows potential in capturing long-range dependencies among frames. On the other hand, we equip the sequence-to-sequence model with an unsupervised optical flow estimator to maximize its potential. The flow estimator is trained with our proposed unsupervised distillation loss, which can alleviate the data discrepancy and inaccurate degraded optical flow issues of previous flow-based methods. With reliable optical flow, we can establish accurate correspondence among multiple frames, narrowing the domain difference between 1D language and 2D misaligned frames and improving the potential of the sequence-to-sequence model. S2SVR shows superior performance in multiple VR tasks, including video deblurring, video super-resolution, and compressed video quality enhancement. Code and models are publicly available at https://github.com/linjing7/VR-Baseline","url_abs":"https://arxiv.org/abs/2205.10195v2","url_pdf":"https://arxiv.org/pdf/2205.10195v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"unsupervised-flow-aligned-sequence-to","repo_url":"https://github.com/linjing7/VR-Baseline","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}}],"tasks":[{"task_slug":"deblurring","task_name":"Deblurring"},{"task_slug":"optical-flow-estimation","task_name":"Optical Flow Estimation"},{"task_slug":"super-resolution","task_name":"Super-Resolution"},{"task_slug":"video-deblurring","task_name":"Video Deblurring"},{"task_slug":"video-enhancement","task_name":"Video Enhancement"},{"task_slug":"video-restoration","task_name":"Video Restoration"},{"task_slug":"video-super-resolution","task_name":"Video Super-Resolution"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/deblurring-on-gopro","task":"Deblurring","dataset":"GoPro","model":"S2SVR","rank_in_archive_order":40,"of":56,"metrics":{"PSNR":"31.82","SSIM":"0.923"},"uses_additional_data":false},{"leaderboard":"/sota/video-enhancement-on-mfqe-v2","task":"Video Enhancement","dataset":"MFQE v2","model":"S2SVR","rank_in_archive_order":2,"of":6,"metrics":{"Incremental PSNR":"0.93"},"uses_additional_data":false},{"leaderboard":"/sota/video-super-resolution-on-vimeo90k","task":"Video Super-Resolution","dataset":"Vimeo90K","model":"S2SVR","rank_in_archive_order":3,"of":3,"metrics":{"PSNR":"37.63"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2205.10195","atlas_url":"https://app.syntology.ai/?focus=2205.10195","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"2205.10195"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"2205.10195\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"2205.10195"},"call":"get_concepts_for_paper(arxiv_id=\"2205.10195\")"}],"by_repo":[{"repo":"linjing7/VR-Baseline","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0,"harvested_for_other_papers":1,"harvested_for":["2201.01893"],"harvested_for_calls":[{"arxiv_id":"2201.01893","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"2201.01893"},"call":"get_harvested_code_for_paper(arxiv_id=\"2201.01893\")"}]}],"by_repo_harvested_for_is":"harvested_for: the arXiv ids (as Syntology's graph holds them) of every paper whose samples Syntology's graph links to this repository, in arXiv-id order, complete; the page names the first 3 and says how many more. A link only: it does not say the papers are the same work, that one copied the other, or that the code implements this paper's method; harvested_for_calls gives the get_harvested_code_for_paper call for each arXiv-shaped id among them","by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"23bd98fbc033bb2d6c6e57832deaaa783832693bf004e3a7f01821f0996e4fbe","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}