{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/heterogeneous-semantic-transfer-for-multi","title":"Heterogeneous Semantic Transfer for Multi-label Recognition with Partial Labels","arxiv_id":"2205.11131","date":"2022-05-23","proceeding":null,"authors":["Tianshui Chen","Tao Pu","Lingbo Liu","Yukai Shi","Zhijing Yang","Liang Lin"],"abstract":"Multi-label image recognition with partial labels (MLR-PL), in which some labels are known while others are unknown for each image, may greatly reduce the cost of annotation and thus facilitate large-scale MLR. We find that strong semantic correlations exist within each image and across different images, and these correlations can help transfer the knowledge possessed by the known labels to retrieve the unknown labels and thus improve the performance of the MLR-PL task (see Figure 1). In this work, we propose a novel heterogeneous semantic transfer (HST) framework that consists of two complementary transfer modules that explore both within-image and cross-image semantic correlations to transfer the knowledge possessed by known labels to generate pseudo labels for the unknown labels. Specifically, an intra-image semantic transfer (IST) module learns an image-specific label co-occurrence matrix for each image and maps the known labels to complement the unknown labels based on these matrices. Additionally, a cross-image transfer (CST) module learns category-specific feature-prototype similarities and then helps complement the unknown labels that have high degrees of similarity with the corresponding prototypes. Finally, both the known and generated pseudo labels are used to train MLR models. Extensive experiments conducted on the Microsoft COCO, Visual Genome, and Pascal VOC 2007 datasets show that the proposed HST framework achieves superior performance to that of current state-of-the-art algorithms. Specifically, it obtains mean average precision (mAP) improvements of 1.4%, 3.3%, and 0.4% on the three datasets over the results of the best-performing previously developed algorithm.","url_abs":"https://arxiv.org/abs/2205.11131v4","url_pdf":"https://arxiv.org/pdf/2205.11131v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"heterogeneous-semantic-transfer-for-multi","repo_url":"https://github.com/hcplab-sysu/hcp-mlr-pl","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"multi-label-image-recognition","task_name":"Multi-Label Image Recognition"},{"task_slug":"multi-label-image-recognition-with-partial","task_name":"Multi-label Image Recognition with Partial Labels"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/multi-label-image-recognition-with-partial","task":"Multi-label Image Recognition with Partial Labels","dataset":"MS-COCO-2014","model":"HST","rank_in_archive_order":5,"of":6,"metrics":{"Average mAP":"77.9"},"uses_additional_data":false},{"leaderboard":"/sota/multi-label-image-recognition-with-partial-1","task":"Multi-label Image Recognition with Partial Labels","dataset":"PASCAL VOC 2007","model":"HST","rank_in_archive_order":4,"of":6,"metrics":{"Average mAP":"90.9"},"uses_additional_data":false},{"leaderboard":"/sota/multi-label-image-recognition-with-partial-2","task":"Multi-label Image Recognition with Partial Labels","dataset":"Visual Genome","model":"HST","rank_in_archive_order":3,"of":4,"metrics":{"Average mAP":"44.8"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2205.11131","atlas_url":"https://app.syntology.ai/?focus=2205.11131","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"2205.11131"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"2205.11131\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"2205.11131"},"call":"get_concepts_for_paper(arxiv_id=\"2205.11131\")"}],"by_repo":[{"repo":"hcplab-sysu/hcp-mlr-pl","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0,"harvested_for_other_papers":1,"harvested_for":["2203.02172"],"harvested_for_calls":[{"arxiv_id":"2203.02172","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"2203.02172"},"call":"get_harvested_code_for_paper(arxiv_id=\"2203.02172\")"}]}],"by_repo_harvested_for_is":"harvested_for: the arXiv ids (as Syntology's graph holds them) of every paper whose samples Syntology's graph links to this repository, in arXiv-id order, complete; the page names the first 3 and says how many more. A link only: it does not say the papers are the same work, that one copied the other, or that the code implements this paper's method; harvested_for_calls gives the get_harvested_code_for_paper call for each arXiv-shaped id among them","by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"2cb71c8264b69005aae5226e8cd481f998f0748d33f465650b6142df8df0c3eb","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}