{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/masakhanews-news-topic-classification-for","title":"MasakhaNEWS: News Topic Classification for African languages","arxiv_id":"2304.09972","date":"2023-04-19","proceeding":null,"authors":["David Ifeoluwa Adelani","Marek Masiak","Israel Abebe Azime","Jesujoba Alabi","Atnafu Lambebo Tonja","Christine Mwase","Odunayo Ogundepo","Bonaventure F. P. Dossou","Akintunde Oladipo","Doreen Nixdorf","Chris Chinenye Emezue","sana al-azzawi","Blessing Sibanda","Davis David","Lolwethu Ndolela","Jonathan Mukiibi","Tunde Ajayi","Tatiana Moteu","Brian Odhiambo","Abraham Owodunni","Nnaemeka Obiefuna","Muhidin Mohamed","Shamsuddeen Hassan Muhammad","Teshome Mulugeta Ababu","Saheed Abdullahi Salahudeen","Mesay Gemeda Yigezu","Tajuddeen Gwadabe","Idris Abdulmumin","Mahlet Taye","Oluwabusayo Awoyomi","Iyanuoluwa Shode","Tolulope Adelani","Habiba Abdulganiyu","Abdul-Hakeem Omotayo","Adetola Adeeko","Abeeb Afolabi","Anuoluwapo Aremu","Olanrewaju Samuel","Clemencia Siro","Wangari Kimotho","Onyekachi Ogbu","Chinedu Mbonu","Chiamaka Chukwuneke","Samuel Fanijo","Jessica Ojo","Oyinkansola Awosan","Tadesse Kebede","Toadoum Sari Sakayo","Pamela Nyatsine","Freedmore Sidume","Oreen Yousuf","Mardiyyah Oduwole","Tshinu Tshinu","Ussen Kimanuka","Thina Diko","Siyanda Nxakama","Sinodos Nigusse","Abdulmejid Johar","Shafie Mohamed","Fuad Mire Hassan","Moges Ahmed Mehamed","Evrard Ngabire","Jules Jules","Ivan Ssenkungu","Pontus Stenetorp"],"abstract":"African languages are severely under-represented in NLP research due to lack of datasets covering several NLP tasks. While there are individual language specific datasets that are being expanded to different tasks, only a handful of NLP tasks (e.g. named entity recognition and machine translation) have standardized benchmark datasets covering several geographical and typologically-diverse African languages. In this paper, we develop MasakhaNEWS -- a new benchmark dataset for news topic classification covering 16 languages widely spoken in Africa. We provide an evaluation of baseline models by training classical machine learning models and fine-tuning several language models. Furthermore, we explore several alternatives to full fine-tuning of language models that are better suited for zero-shot and few-shot learning such as cross-lingual parameter-efficient fine-tuning (like MAD-X), pattern exploiting training (PET), prompting language models (like ChatGPT), and prompt-free sentence transformer fine-tuning (SetFit and Cohere Embedding API). Our evaluation in zero-shot setting shows the potential of prompting ChatGPT for news topic classification in low-resource African languages, achieving an average performance of 70 F1 points without leveraging additional supervision like MAD-X. In few-shot setting, we show that with as little as 10 examples per label, we achieved more than 90\\% (i.e. 86.0 F1 points) of the performance of full supervised training (92.6 F1 points) leveraging the PET approach.","url_abs":"https://arxiv.org/abs/2304.09972v2","url_pdf":"https://arxiv.org/pdf/2304.09972v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"masakhanews-news-topic-classification-for","repo_url":"https://github.com/masakhane-io/masakhane-news","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"classification-1","task_name":"Classification"},{"task_slug":"few-shot-learning","task_name":"Few-Shot Learning"},{"task_slug":"machine-translation","task_name":"Machine Translation"},{"task_slug":"named-entity-recognition-1","task_name":"Named Entity Recognition"},{"task_slug":"news-classification","task_name":"News Classification"},{"task_slug":"sentence","task_name":"Sentence"},{"task_slug":"topic-classification","task_name":"Topic Classification"},{"task_slug":"named-entity-recognition","task_name":"named-entity-recognition"},{"task_slug":"parameter-efficient-fine-tuning","task_name":"parameter-efficient fine-tuning"}],"methods":[],"datasets_introduced":[{"slug":"masakhanews","name":"MasakhaNEWS","full_name":""}],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2304.09972","atlas_url":"https://app.syntology.ai/?focus=2304.09972","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"2304.09972"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"2304.09972\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"2304.09972"},"call":"get_concepts_for_paper(arxiv_id=\"2304.09972\")"}],"by_repo":[{"repo":"masakhane-io/masakhane-news","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"167f1cdbae614509402f4cdb42d9c0097a16a840d6d987ac75fb0d1c8af63619","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}