{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/image-generation-from-sketch-constraint-using","title":"Image Generation from Sketch Constraint Using Contextual GAN","arxiv_id":"1711.08972","date":"2017-11-24","proceeding":"ECCV 2018 9","authors":["Yongyi Lu","Shangzhe Wu","Yu-Wing Tai","Chi-Keung Tang"],"abstract":"In this paper we investigate image generation guided by hand sketch. When the\ninput sketch is badly drawn, the output of common image-to-image translation\nfollows the input edges due to the hard condition imposed by the translation\nprocess. Instead, we propose to use sketch as weak constraint, where the output\nedges do not necessarily follow the input edges. We address this problem using\na novel joint image completion approach, where the sketch provides the image\ncontext for completing, or generating the output image. We train a generated\nadversarial network, i.e, contextual GAN to learn the joint distribution of\nsketch and the corresponding image by using joint images. Our contextual GAN\nhas several advantages. First, the simple joint image representation allows for\nsimple and effective learning of joint distribution in the same image-sketch\nspace, which avoids complicated issues in cross-domain learning. Second, while\nthe output is related to its input overall, the generated features exhibit more\nfreedom in appearance and do not strictly align with the input features as\nprevious conditional GANs do. Third, from the joint image's point of view,\nimage and sketch are of no difference, thus exactly the same deep joint image\ncompletion network can be used for image-to-sketch generation. Experiments\nevaluated on three different datasets show that our contextual GAN can generate\nmore realistic images than state-of-the-art conditional GANs on challenging\ninputs and generalize well on common categories.","url_abs":"http://arxiv.org/abs/1711.08972v2","url_pdf":"http://arxiv.org/pdf/1711.08972v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"image-generation-from-sketch-constraint-using","repo_url":"https://github.com/elliottwu/stext2image","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"unanswered"}}],"tasks":[{"task_slug":"image-generation","task_name":"Image Generation"},{"task_slug":"image-to-image-translation","task_name":"Image-to-Image Translation"},{"task_slug":"translation","task_name":"Translation"}],"methods":[{"method_slug":"convolution","method_name":"Convolution"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1711.08972","atlas_url":"https://app.syntology.ai/?focus=1711.08972","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1711.08972"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1711.08972\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1711.08972"},"call":"get_concepts_for_paper(arxiv_id=\"1711.08972\")"}],"by_repo":[{"repo":"elliottwu/stext2image","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"79f05252e53587b1479df5cd9813c4cd4e78e30776985222bc77036dacf86145","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}