{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/vl-ltr-learning-class-wise-visual-linguistic","title":"VL-LTR: Learning Class-wise Visual-Linguistic Representation for Long-Tailed Visual Recognition","arxiv_id":"2111.13579","date":"2021-11-26","proceeding":null,"authors":["Changyao Tian","Wenhai Wang","Xizhou Zhu","Jifeng Dai","Yu Qiao"],"abstract":"Deep learning-based models encounter challenges when processing long-tailed data in the real world. Existing solutions usually employ some balancing strategies or transfer learning to deal with the class imbalance problem, based on the image modality. In this work, we present a visual-linguistic long-tailed recognition framework, termed VL-LTR, and conduct empirical studies on the benefits of introducing text modality for long-tailed recognition (LTR). Compared to existing approaches, the proposed VL-LTR has the following merits. (1) Our method can not only learn visual representation from images but also learn corresponding linguistic representation from noisy class-level text descriptions collected from the Internet; (2) Our method can effectively use the learned visual-linguistic representation to improve the visual recognition performance, especially for classes with fewer image samples. We also conduct extensive experiments and set the new state-of-the-art performance on widely-used LTR benchmarks. Notably, our method achieves 77.2% overall accuracy on ImageNet-LT, which significantly outperforms the previous best method by over 17 points, and is close to the prevailing performance training on the full ImageNet. Code is available at https://github.com/ChangyaoTian/VL-LTR.","url_abs":"https://arxiv.org/abs/2111.13579v4","url_pdf":"https://arxiv.org/pdf/2111.13579v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"vl-ltr-learning-class-wise-visual-linguistic","repo_url":"https://github.com/ChangyaoTian/VL-LTR","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"image-classification","task_name":"Image Classification"},{"task_slug":"long-tail-learning","task_name":"Long-tail Learning"},{"task_slug":"transfer-learning","task_name":"Transfer Learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/image-classification-on-inaturalist-2018","task":"Image Classification","dataset":"iNaturalist 2018","model":"VL-LTR (ViT-B-16)","rank_in_archive_order":14,"of":60,"metrics":{"Top-1 Accuracy":"81.0%"},"uses_additional_data":true},{"leaderboard":"/sota/image-classification-on-inaturalist-2018","task":"Image Classification","dataset":"iNaturalist 2018","model":"VL-LTR (ResNet-50)","rank_in_archive_order":29,"of":60,"metrics":{"Top-1 Accuracy":"74.6%"},"uses_additional_data":true},{"leaderboard":"/sota/long-tail-learning-on-imagenet-lt","task":"Long-tail Learning","dataset":"ImageNet-LT","model":"VL-LTR (ViT-B-16)","rank_in_archive_order":5,"of":69,"metrics":{"Top-1 Accuracy":"77.2"},"uses_additional_data":true},{"leaderboard":"/sota/long-tail-learning-on-imagenet-lt","task":"Long-tail Learning","dataset":"ImageNet-LT","model":"VL-LTR (ResNet-50)","rank_in_archive_order":9,"of":69,"metrics":{"Top-1 Accuracy":"70.1"},"uses_additional_data":true},{"leaderboard":"/sota/long-tail-learning-on-places-lt","task":"Long-tail Learning","dataset":"Places-LT","model":"VL-LTR (ViT-B-16)","rank_in_archive_order":4,"of":29,"metrics":{"Top-1 Accuracy":"50.1"},"uses_additional_data":true},{"leaderboard":"/sota/long-tail-learning-on-places-lt","task":"Long-tail Learning","dataset":"Places-LT","model":"VL-LTR (ResNet-50)","rank_in_archive_order":7,"of":29,"metrics":{"Top-1 Accuracy":"48.0"},"uses_additional_data":true},{"leaderboard":"/sota/long-tail-learning-on-inaturalist-2018","task":"Long-tail Learning","dataset":"iNaturalist 2018","model":"VL-LTR (ViT-B-16)","rank_in_archive_order":4,"of":43,"metrics":{"Top-1 Accuracy":"81.0%"},"uses_additional_data":true},{"leaderboard":"/sota/long-tail-learning-on-inaturalist-2018","task":"Long-tail Learning","dataset":"iNaturalist 2018","model":"VL-LTR (ResNet-50)","rank_in_archive_order":17,"of":43,"metrics":{"Top-1 Accuracy":"74.6%"},"uses_additional_data":true}],"syntology":{"syntology_url":"https://syntology.ai/paper/2111.13579","atlas_url":"https://app.syntology.ai/?focus=2111.13579","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"2111.13579"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"2111.13579\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"2111.13579"},"call":"get_concepts_for_paper(arxiv_id=\"2111.13579\")"}],"by_repo":[{"repo":"ChangyaoTian/VL-LTR","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"eeb6147bb26c552471fed9c2e020c1e873bbcc2bce813f1f769612d00dce42a0","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}