{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/face-cap-image-captioning-using-facial","title":"Face-Cap: Image Captioning using Facial Expression Analysis","arxiv_id":"1807.02250","date":"2018-07-06","proceeding":null,"authors":["Omid Mohamad Nezami","Mark Dras","Peter Anderson","Len Hamey"],"abstract":"Image captioning is the process of generating a natural language description\nof an image. Most current image captioning models, however, do not take into\naccount the emotional aspect of an image, which is very relevant to activities\nand interpersonal relationships represented therein. Towards developing a model\nthat can produce human-like captions incorporating these, we use facial\nexpression features extracted from images including human faces, with the aim\nof improving the descriptive ability of the model. In this work, we present two\nvariants of our Face-Cap model, which embed facial expression features in\ndifferent ways, to generate image captions. Using all standard evaluation\nmetrics, our Face-Cap models outperform a state-of-the-art baseline model for\ngenerating image captions when applied to an image caption dataset extracted\nfrom the standard Flickr 30K dataset, consisting of around 11K images\ncontaining faces. An analysis of the captions finds that, perhaps surprisingly,\nthe improvement in caption quality appears to come not from the addition of\nadjectives linked to emotional aspects of the images, but from more variety in\nthe actions described in the captions.","url_abs":"http://arxiv.org/abs/1807.02250v2","url_pdf":"http://arxiv.org/pdf/1807.02250v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"face-cap-image-captioning-using-facial","repo_url":"https://github.com/omidmn/Face-Cap","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[{"task_slug":"descriptive","task_name":"Descriptive"},{"task_slug":"image-captioning","task_name":"Image Captioning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers","held":null,"reason":"arxiv_id_not_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"by_repo":[{"repo":"omidmn/Face-Cap","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"f1bc5e34f6f4f00b17a68f430a24f47309df4ab4091e6649f4e62aa84a143ef4","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}