{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/semstyle-learning-to-generate-stylised-image","title":"SemStyle: Learning to Generate Stylised Image Captions using Unaligned Text","arxiv_id":"1805.07030","date":"2018-05-18","proceeding":"CVPR 2018 6","authors":["Alexander Mathews","Lexing Xie","Xuming He"],"abstract":"Linguistic style is an essential part of written communication, with the\npower to affect both clarity and attractiveness. With recent advances in vision\nand language, we can start to tackle the problem of generating image captions\nthat are both visually grounded and appropriately styled. Existing approaches\neither require styled training captions aligned to images or generate captions\nwith low relevance. We develop a model that learns to generate visually\nrelevant styled captions from a large corpus of styled text without aligned\nimages. The core idea of this model, called SemStyle, is to separate semantics\nand style. One key component is a novel and concise semantic term\nrepresentation generated using natural language processing techniques and frame\nsemantics. In addition, we develop a unified language model that decodes\nsentences with diverse word choices and syntax for different styles.\nEvaluations, both automatic and manual, show captions from SemStyle preserve\nimage semantics, are descriptive, and are style shifted. More broadly, this\nwork provides possibilities to learn richer image descriptions from the\nplethora of linguistic data available on the web.","url_abs":"http://arxiv.org/abs/1805.07030v1","url_pdf":"http://arxiv.org/pdf/1805.07030v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"semstyle-learning-to-generate-stylised-image","repo_url":"https://github.com/computationalmedia/semstyle","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"descriptive","task_name":"Descriptive"},{"task_slug":"image-captioning","task_name":"Image Captioning"},{"task_slug":"language-modeling","task_name":"Language Modeling"},{"task_slug":"language-modelling","task_name":"Language Modelling"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1805.07030","atlas_url":"https://app.syntology.ai/?focus=1805.07030","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1805.07030"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1805.07030\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1805.07030"},"call":"get_concepts_for_paper(arxiv_id=\"1805.07030\")"}],"by_repo":[{"repo":"computationalmedia/semstyle","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"30906932658f5c750952ebb61dbad64710d12355a5b59d0178c7ba90ea470e09","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}