{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/190600817","title":"Zero-Shot Semantic Segmentation","arxiv_id":"1906.00817","date":"2019-06-03","proceeding":"NeurIPS 2019 12","authors":["Maxime Bucher","Tuan-Hung Vu","Matthieu Cord","Patrick Pérez"],"abstract":"Semantic segmentation models are limited in their ability to scale to large numbers of object classes. In this paper, we introduce the new task of zero-shot semantic segmentation: learning pixel-wise classifiers for never-seen object categories with zero training examples. To this end, we present a novel architecture, ZS3Net, combining a deep visual segmentation model with an approach to generate visual representations from semantic word embeddings. By this way, ZS3Net addresses pixel classification tasks where both seen and unseen categories are faced at test time (so called \"generalized\" zero-shot classification). Performance is further improved by a self-training step that relies on automatic pseudo-labeling of pixels from unseen classes. On the two standard segmentation datasets, Pascal-VOC and Pascal-Context, we propose zero-shot benchmarks and set competitive baselines. For complex scenes as ones in the Pascal-Context dataset, we extend our approach by using a graph-context encoding to fully leverage spatial context priors coming from class-wise segmentation maps.","url_abs":"https://arxiv.org/abs/1906.00817v2","url_pdf":"https://arxiv.org/pdf/1906.00817v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"190600817","repo_url":"https://github.com/valeoai/ZS3","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"190600817","repo_url":"https://github.com/bcmi/CaGNetv2-Zero-Shot-Semantic-Segmentation","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"classification","task_name":"General Classification"},{"task_slug":"segmentation","task_name":"Segmentation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"},{"task_slug":"word-embeddings","task_name":"Word Embeddings"},{"task_slug":"zero-shot-learning","task_name":"Zero-Shot Learning"},{"task_slug":"zero-shot-semantic-segmentation","task_name":"Zero-Shot Semantic Segmentation"},{"task_slug":null,"task_name":"zero-shot-classification"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/zero-shot-learning-on-pascal-context","task":"Zero-Shot Learning","dataset":"PASCAL Context","model":"ZS3Net","rank_in_archive_order":1,"of":1,"metrics":{"k=10 mIOU":"26.3"},"uses_additional_data":false},{"leaderboard":"/sota/zero-shot-semantic-segmentation-on-coco-stuff","task":"Zero-Shot Semantic Segmentation","dataset":"COCO-Stuff","model":"ZS5","rank_in_archive_order":12,"of":15,"metrics":{"Inductive Setting hIoU":"15.0","Transductive Setting hIoU":"16.2"},"uses_additional_data":false},{"leaderboard":"/sota/zero-shot-semantic-segmentation-on-pascal-voc","task":"Zero-Shot Semantic Segmentation","dataset":"PASCAL VOC","model":"ZS5","rank_in_archive_order":11,"of":13,"metrics":{"Transductive Setting hIoU":"33.8"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/1906.00817","atlas_url":"https://app.syntology.ai/?focus=1906.00817","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1906.00817"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1906.00817\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1906.00817"},"call":"get_concepts_for_paper(arxiv_id=\"1906.00817\")"}],"by_repo":[{"repo":"valeoai/ZS3","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"bcmi/CaGNetv2-Zero-Shot-Semantic-Segmentation","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"457b862bcf808bc5e39e87d152a0033344ac2278dd52a298924f8aa5e51605ed","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}