{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/exploring-data-efficiency-in-zero-shot","title":"Exploring Data Efficiency in Zero-Shot Learning with Diffusion Models","arxiv_id":"2406.02929","date":"2024-06-05","proceeding":null,"authors":["Zihan Ye","Shreyank N. Gowda","Xiaobo Jin","Xiaowei Huang","Haotian Xu","Yaochu Jin","Kaizhu Huang"],"abstract":"Zero-Shot Learning (ZSL) aims to enable classifiers to identify unseen classes by enhancing data efficiency at the class level. This is achieved by generating image features from pre-defined semantics of unseen classes. However, most current approaches heavily depend on the number of samples from seen classes, i.e. they do not consider instance-level effectiveness. In this paper, we demonstrate that limited seen examples generally result in deteriorated performance of generative models. To overcome these challenges, we propose ZeroDiff, a Diffusion-based Generative ZSL model. This unified framework incorporates diffusion models to improve data efficiency at both the class and instance levels. Specifically, for instance-level effectiveness, ZeroDiff utilizes a forward diffusion chain to transform limited data into an expanded set of noised data. For class-level effectiveness, we design a two-branch generation structure that consists of a Diffusion-based Feature Generator (DFG) and a Diffusion-based Representation Generator (DRG). DFG focuses on learning and sampling the distribution of cross-entropy-based features, whilst DRG learns the supervised contrastive-based representation to boost the zero-shot capabilities of DFG. Additionally, we employ three discriminators to evaluate generated features from various aspects and introduce a Wasserstein-distance-based mutual learning loss to transfer knowledge among discriminators, thereby enhancing guidance for generation. Demonstrated through extensive experiments on three popular ZSL benchmarks, our ZeroDiff not only achieves significant improvements over existing ZSL methods but also maintains robust performance even with scarce training data. Code will be released upon acceptance.","url_abs":"https://arxiv.org/abs/2406.02929v1","url_pdf":"https://arxiv.org/pdf/2406.02929v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"generalized-zero-shot-learning","task_name":"Generalized Zero-Shot Learning"},{"task_slug":"zero-shot-learning","task_name":"Zero-Shot Learning"}],"methods":[{"method_slug":"diffusion","method_name":"Diffusion"},{"method_slug":"set","method_name":"SET"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/generalized-zero-shot-learning-on-awa2","task":"Generalized Zero-Shot Learning","dataset":"AwA2","model":"ZeroDiff","rank_in_archive_order":1,"of":4,"metrics":{"Harmonic mean":"79.5"},"uses_additional_data":false},{"leaderboard":"/sota/generalized-zero-shot-learning-on-cub-200","task":"Generalized Zero-Shot Learning","dataset":"CUB-200-2011","model":"ZeroDiff","rank_in_archive_order":1,"of":3,"metrics":{"Harmonic mean":"81.6"},"uses_additional_data":false},{"leaderboard":"/sota/generalized-zero-shot-learning-on-sun","task":"Generalized Zero-Shot Learning","dataset":"SUN Attribute","model":"ZeroDiff","rank_in_archive_order":1,"of":9,"metrics":{"Harmonic mean":"59.8"},"uses_additional_data":false},{"leaderboard":"/sota/zero-shot-learning-on-awa2","task":"Zero-Shot Learning","dataset":"AwA2","model":"ZeroDiff","rank_in_archive_order":1,"of":4,"metrics":{"average top-1 classification accuracy":"86.4"},"uses_additional_data":false},{"leaderboard":"/sota/zero-shot-learning-on-cub-200-2011","task":"Zero-Shot Learning","dataset":"CUB-200-2011","model":"ZeroDiff","rank_in_archive_order":1,"of":14,"metrics":{"average top-1 classification accuracy":"87.5"},"uses_additional_data":false},{"leaderboard":"/sota/zero-shot-learning-on-sun-attribute","task":"Zero-Shot Learning","dataset":"SUN Attribute","model":"ZeroDiff","rank_in_archive_order":1,"of":9,"metrics":{"average top-1 classification accuracy":"77.3"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2406.02929","atlas_url":"https://app.syntology.ai/?focus=2406.02929","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"2406.02929"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"2406.02929\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"2406.02929"},"call":"get_concepts_for_paper(arxiv_id=\"2406.02929\")"}],"by_repo":[],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":"the archive holds no code link for this paper","arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"51942ad964b313272ed1ce40660835b1b842d18b13d2c7596b5e031a67bf715b","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}