{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/dense-captioning-with-joint-inference-and","title":"Dense Captioning with Joint Inference and Visual Context","arxiv_id":"1611.06949","date":"2016-11-21","proceeding":"CVPR 2017 7","authors":["Linjie Yang","Kevin Tang","Jianchao Yang","Li-Jia Li"],"abstract":"Dense captioning is a newly emerging computer vision topic for understanding\nimages with dense language descriptions. The goal is to densely detect visual\nconcepts (e.g., objects, object parts, and interactions between them) from\nimages, labeling each with a short descriptive phrase. We identify two key\nchallenges of dense captioning that need to be properly addressed when tackling\nthe problem. First, dense visual concept annotations in each image are\nassociated with highly overlapping target regions, making accurate localization\nof each visual concept challenging. Second, the large amount of visual concepts\nmakes it hard to recognize each of them by appearance alone. We propose a new\nmodel pipeline based on two novel ideas, joint inference and context fusion, to\nalleviate these two challenges. We design our model architecture in a\nmethodical manner and thoroughly evaluate the variations in architecture. Our\nfinal model, compact and efficient, achieves state-of-the-art accuracy on\nVisual Genome for dense captioning with a relative gain of 73\\% compared to the\nprevious best algorithm. Qualitative experiments also reveal the semantic\ncapabilities of our model in dense captioning.","url_abs":"http://arxiv.org/abs/1611.06949v2","url_pdf":"http://arxiv.org/pdf/1611.06949v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"dense-captioning-with-joint-inference-and","repo_url":"https://github.com/linjieyangsc/densecap","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":{"status":"ok","spdx":"NOASSERTION"}}],"tasks":[{"task_slug":"dense-captioning","task_name":"Dense Captioning"},{"task_slug":"descriptive","task_name":"Descriptive"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1611.06949","atlas_url":"https://app.syntology.ai/?focus=1611.06949","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1611.06949"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1611.06949\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1611.06949"},"call":"get_concepts_for_paper(arxiv_id=\"1611.06949\")"}],"by_repo":[{"repo":"linjieyangsc/densecap","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"8346b62b336aef2e2c8fda18797dbfc5b52b95c1bb7962bd63e0b608ff8a0190","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}