{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/detector-free-weakly-supervised-grounding-by","title":"Detector-Free Weakly Supervised Grounding by Separation","arxiv_id":"2104.09829","date":"2021-04-20","proceeding":"ICCV 2021 10","authors":["Assaf Arbelle","Sivan Doveh","Amit Alfassy","Joseph Shtok","Guy Lev","Eli Schwartz","Hilde Kuehne","Hila Barak Levi","Prasanna Sattigeri","Rameswar Panda","Chun-Fu Chen","Alex Bronstein","Kate Saenko","Shimon Ullman","Raja Giryes","Rogerio Feris","Leonid Karlinsky"],"abstract":"Nowadays, there is an abundance of data involving images and surrounding free-form text weakly corresponding to those images. Weakly Supervised phrase-Grounding (WSG) deals with the task of using this data to learn to localize (or to ground) arbitrary text phrases in images without any additional annotations. However, most recent SotA methods for WSG assume the existence of a pre-trained object detector, relying on it to produce the ROIs for localization. In this work, we focus on the task of Detector-Free WSG (DF-WSG) to solve WSG without relying on a pre-trained detector. We directly learn everything from the images and associated free-form text pairs, thus potentially gaining an advantage on the categories unsupported by the detector. The key idea behind our proposed Grounding by Separation (GbS) method is synthesizing `text to image-regions' associations by random alpha-blending of arbitrary image pairs and using the corresponding texts of the pair as conditions to recover the alpha map from the blended image via a segmentation network. At test time, this allows using the query phrase as a condition for a non-blended query image, thus interpreting the test image as a composition of a region corresponding to the phrase and the complement region. Using this approach we demonstrate a significant accuracy improvement, of up to $8.5\\%$ over previous DF-WSG SotA, for a range of benchmarks including Flickr30K, Visual Genome, and ReferIt, as well as a significant complementary improvement (above $7\\%$) over the detector-based approaches for WSG.","url_abs":"https://arxiv.org/abs/2104.09829v1","url_pdf":"https://arxiv.org/pdf/2104.09829v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"detector-free-weakly-supervised-grounding-by","repo_url":"https://github.com/aarbelle/GroundingBySeparation","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}}],"tasks":[{"task_slug":"phrase-grounding","task_name":"Phrase Grounding"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/phrase-grounding-on-flickr30k","task":"Phrase Grounding","dataset":"Flickr30k","model":"GBS Ensemble + 12-in-1","rank_in_archive_order":1,"of":3,"metrics":{"Pointing Game Accuracy":"85.9"},"uses_additional_data":false},{"leaderboard":"/sota/phrase-grounding-on-flickr30k","task":"Phrase Grounding","dataset":"Flickr30k","model":"GbS Ensemble MS-COCO","rank_in_archive_order":2,"of":3,"metrics":{"Pointing Game Accuracy":"75.6"},"uses_additional_data":false},{"leaderboard":"/sota/phrase-grounding-on-referit","task":"Phrase Grounding","dataset":"ReferIt","model":"GbS Ensemble MS-COCO","rank_in_archive_order":2,"of":3,"metrics":{"Pointing Game Accuracy":"58.21"},"uses_additional_data":false},{"leaderboard":"/sota/phrase-grounding-on-visual-genome","task":"Phrase Grounding","dataset":"Visual Genome","model":"GbS VG","rank_in_archive_order":1,"of":3,"metrics":{"Pointing Game Accuracy":"55.91"},"uses_additional_data":false},{"leaderboard":"/sota/phrase-grounding-on-visual-genome","task":"Phrase Grounding","dataset":"Visual Genome","model":"GbS Ensemble MS-COCO","rank_in_archive_order":3,"of":3,"metrics":{"Pointing Game Accuracy":"54.55"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2104.09829","atlas_url":"https://app.syntology.ai/?focus=2104.09829","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"2104.09829"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"2104.09829\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"2104.09829"},"call":"get_concepts_for_paper(arxiv_id=\"2104.09829\")"}],"by_repo":[{"repo":"aarbelle/GroundingBySeparation","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"df74ed32a6206b9c59eec304c28be2bf316c353dd4839913545c442508079197","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}