{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/nuner-entity-recognition-encoder-pre-training","title":"NuNER: Entity Recognition Encoder Pre-training via LLM-Annotated Data","arxiv_id":"2402.15343","date":"2024-02-23","proceeding":null,"authors":["Sergei Bogdanov","Alexandre Constantin","Timothée Bernard","Benoit Crabbé","Etienne Bernard"],"abstract":"Large Language Models (LLMs) have shown impressive abilities in data annotation, opening the way for new approaches to solve classic NLP problems. In this paper, we show how to use LLMs to create NuNER, a compact language representation model specialized in the Named Entity Recognition (NER) task. NuNER can be fine-tuned to solve downstream NER problems in a data-efficient way, outperforming similar-sized foundation models in the few-shot regime and competing with much larger LLMs. We find that the size and entity-type diversity of the pre-training dataset are key to achieving good performance. We view NuNER as a member of the broader family of task-specific foundation models, recently unlocked by LLMs.","url_abs":"https://arxiv.org/abs/2402.15343v1","url_pdf":"https://arxiv.org/pdf/2402.15343v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"nuner-entity-recognition-encoder-pre-training","repo_url":"https://github.com/Serega6678/NuNER","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[{"task_slug":"diversity","task_name":"Diversity"},{"task_slug":"few-shot-ner","task_name":"Few-shot NER"},{"task_slug":"cg","task_name":"NER"},{"task_slug":"named-entity-recognition-1","task_name":"Named Entity Recognition"},{"task_slug":"named-entity-recognition-ner","task_name":"Named Entity Recognition (NER)"},{"task_slug":"zero-shot-named-entity-recognition-ner","task_name":"Zero-shot Named Entity Recognition (NER)"},{"task_slug":"named-entity-recognition","task_name":"named-entity-recognition"}],"methods":[],"datasets_introduced":[{"slug":"nuner","name":"NuNER","full_name":""}],"methods_introduced":[],"results":[{"leaderboard":"/sota/few-shot-ner-on-few-nerd-inter","task":"Few-shot NER","dataset":"Few-NERD (INTER)","model":"NuNER","rank_in_archive_order":3,"of":13,"metrics":{"10 way 1~2 shot":"66.54±0.40","10 way 5~10 shot":"71.04±0.14","5 way 1~2 shot":"67.37±0.31","5 way 5~10 shot":"73.50±0.09"},"uses_additional_data":false},{"leaderboard":"/sota/few-shot-ner-on-few-nerd-intra","task":"Few-shot NER","dataset":"Few-NERD (INTRA)","model":"NuNER","rank_in_archive_order":2,"of":13,"metrics":{"10 way 1~2 shot":"57.63±0.38","10 way 5~10 shot":"62.99±0.27","5 way 1~2 shot":"62.48±0.28","5 way 5~10 shot":"69.16±0.28"},"uses_additional_data":false},{"leaderboard":"/sota/named-entity-recognition-on-few-nerd-sup","task":"Named Entity Recognition (NER)","dataset":"Few-NERD (SUP)","model":"NuNER","rank_in_archive_order":3,"of":6,"metrics":{"F1-Measure":"69.4","Precision":"67.8","Recall":"71.1"},"uses_additional_data":false},{"leaderboard":"/sota/named-entity-recognition-ner-on-ncbi-disease","task":"Named Entity Recognition (NER)","dataset":"NCBI-disease","model":"NuNER Zero Span","rank_in_archive_order":26,"of":26,"metrics":{"F1":"61.1"},"uses_additional_data":true},{"leaderboard":"/sota/named-entity-recognition-ner-on-ontonotes-v5","task":"Named Entity Recognition (NER)","dataset":"Ontonotes v5 (English)","model":"NuNER","rank_in_archive_order":16,"of":28,"metrics":{"F1":"89.1","Precision":"87.8","Recall":"90.5"},"uses_additional_data":false},{"leaderboard":"/sota/zero-shot-named-entity-recognition-ner-on","task":"Zero-shot Named Entity Recognition (NER)","dataset":"Broad Twitter Corpus","model":"NuNerZero Span","rank_in_archive_order":1,"of":2,"metrics":{"Entity F1":"60.2"},"uses_additional_data":true},{"leaderboard":"/sota/zero-shot-named-entity-recognition-ner-on-1","task":"Zero-shot Named Entity Recognition (NER)","dataset":"CrossNER","model":"NuNERZero span","rank_in_archive_order":1,"of":4,"metrics":{"AI":"61.7","Literature":"64.9","Music":"69.9","Politics":"71.7","Science":"65.4"},"uses_additional_data":true},{"leaderboard":"/sota/zero-shot-named-entity-recognition-ner-on-2","task":"Zero-shot Named Entity Recognition (NER)","dataset":"HarveyNER","model":"NuNER Zero Span","rank_in_archive_order":2,"of":2,"metrics":{"Entity F1":"24.9"},"uses_additional_data":true}],"syntology":{"syntology_url":"https://syntology.ai/paper/2402.15343","atlas_url":"https://app.syntology.ai/?focus=2402.15343","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"2402.15343"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"2402.15343\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"2402.15343"},"call":"get_concepts_for_paper(arxiv_id=\"2402.15343\")"}],"by_repo":[{"repo":"Serega6678/NuNER","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"e293668371f3e99b339c00f1b84f55ac6da7f640bafbe0b79dc28d1d3538cd12","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}