{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/hierarchical-video-generation-from-orthogonal","title":"Hierarchical Video Generation from Orthogonal Information: Optical Flow and Texture","arxiv_id":"1711.09618","date":"2017-11-27","proceeding":null,"authors":["Katsunori Ohnishi","Shohei Yamamoto","Yoshitaka Ushiku","Tatsuya Harada"],"abstract":"Learning to represent and generate videos from unlabeled data is a very\nchallenging problem. To generate realistic videos, it is important not only to\nensure that the appearance of each frame is real, but also to ensure the\nplausibility of a video motion and consistency of a video appearance in the\ntime direction. The process of video generation should be divided according to\nthese intrinsic difficulties. In this study, we focus on the motion and\nappearance information as two important orthogonal components of a video, and\npropose Flow-and-Texture-Generative Adversarial Networks (FTGAN) consisting of\nFlowGAN and TextureGAN. In order to avoid a huge annotation cost, we have to\nexplore a way to learn from unlabeled data. Thus, we employ optical flow as\nmotion information to generate videos. FlowGAN generates optical flow, which\ncontains only the edge and motion of the videos to be begerated. On the other\nhand, TextureGAN specializes in giving a texture to optical flow generated by\nFlowGAN. This hierarchical approach brings more realistic videos with plausible\nmotion and appearance consistency. Our experiments show that our model\ngenerates more plausible motion videos and also achieves significantly improved\nperformance for unsupervised action classification in comparison to previous\nGAN works. In addition, because our model generates videos from two independent\ninformation, our model can generate new combinations of motion and attribute\nthat are not seen in training data, such as a video in which a person is doing\nsit-up in a baseball ground.","url_abs":"http://arxiv.org/abs/1711.09618v2","url_pdf":"http://arxiv.org/pdf/1711.09618v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"hierarchical-video-generation-from-orthogonal","repo_url":"https://github.com/mil-tokyo/FTGAN","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"unanswered"}},{"paper_slug":"hierarchical-video-generation-from-orthogonal","repo_url":"https://github.com/synce1234/FTGAN_custom","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"unanswered"}},{"paper_slug":"hierarchical-video-generation-from-orthogonal","repo_url":"https://github.com/vikramjit-sidhu/hlcv_project","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"unanswered"}}],"tasks":[{"task_slug":"action-classification","task_name":"Action Classification"},{"task_slug":"attribute","task_name":"Attribute"},{"task_slug":"optical-flow-estimation","task_name":"Optical Flow Estimation"},{"task_slug":"video-generation","task_name":"Video Generation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1711.09618","atlas_url":"https://app.syntology.ai/?focus=1711.09618","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1711.09618"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1711.09618\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1711.09618"},"call":"get_concepts_for_paper(arxiv_id=\"1711.09618\")"}],"by_repo":[{"repo":"mil-tokyo/FTGAN","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"synce1234/FTGAN_custom","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"vikramjit-sidhu/hlcv_project","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"27a37888194798615f4e9c6cc919c13fd8d97e162dab5bbd1c70981484dfe7b2","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}