{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/task/lemmatization","name":"Lemmatization","slug":"lemmatization","description_markdown":"**Lemmatization** is a process of determining a base or dictionary form (lemma) for a given surface form. Especially for languages with rich morphology it is important to be able to normalize words into their base forms to better support for example search engines and linguistic studies. Main difficulties in Lemmatization arise from encountering previously unseen words during inference time as well as disambiguating ambiguous surface forms which can be inflected variants of several different base forms depending on the context.\n\n\n<span class=\"description-source\">Source: [Universal Lemmatizer: A Sequence to Sequence Model for Lemmatizing Universal Dependencies Treebanks ](https://arxiv.org/abs/1902.00972)</span>","categories":[{"name":"Natural Language Processing","url":"/area/natural-language-processing"}],"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","slug_source":"archive_url"},"counts":{"papers_tagged":351,"papers_with_code":68,"benchmarks":0,"benchmark_tables_in_archive":0,"benchmark_tables_shown":0,"benchmark_tables_withheld_as_spam":0,"benchmark_definition":"a leaderboard table with at least one row; benchmark_tables_shown also counts the zero-row tables; benchmark_tables_in_archive adds the tables withheld as spam","datasets":3,"subtasks":0,"parent_tasks":0},"benchmarks":[],"datasets":[{"url":"/dataset/gum","name":"GUM","full_name":"Georgetown University Multilayer corpus","num_papers_in_archive":13},{"url":"/dataset/amalgum","name":"AMALGUM","full_name":"A Machine Annotated Lookalike of GUM","num_papers_in_archive":5},{"url":"/dataset/szeged-corpus","name":"Szeged Corpus","full_name":"","num_papers_in_archive":4}],"subtasks":[],"parent_tasks":[],"papers":{"order":"repositories listed in the archive (most first), then date (newest first), then slug; the archive holds no stars","population":"every paper the archive tags with this task (distinct papers; spam titles not listed). 'of' counts the papers listed; until 2026-09-25 it counted only the papers with a code link, and that number is of_with_code","page":1,"pages_in_order":4,"rows_per_page":100,"shown":100,"of":351,"of_with_code":68,"tagged_in_all":351,"counts":{"archive_papers_tagged":351,"with_a_code_link":68,"where_syntology_ran_a_sample":3,"not_listed_spam_title":0,"listed":351,"listed_where_code_ran":3,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":2,"every_run_a_failure_of_syntologys_instrument":1,"listed_with_a_run_with_no_instrument_failure":2,"listed_every_run_a_failure_of_syntologys_instrument":1,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"items":[{"url":"/paper/stanza-a-python-natural-language-processing","slug":"stanza-a-python-natural-language-processing","title":"Stanza: A Python Natural Language Processing Toolkit for Many Human Languages","date":"2020-03-16","arxiv_id":"2003.07082","repositories_listed":5,"syntology":{"n":30,"n_ran":16,"n_constructed":8,"n_ran_checked":10,"n_instrument":6,"n_unverified":14,"n_honours":2,"n_violates":0,"n_no_contract":8,"n_pointer_only":28,"phrase":"16 ran (of which 8 constructed an object rather than computing a result; 10 with no instrument failure: 2 honoured, 0 violated, 8 with no contract checked; 6 where Syntology's instrument failed) · 14 unverified","sample_list":"/paper/stanza-a-python-natural-language-processing#ran","syntology_url":"https://syntology.ai/paper/2003.07082","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2003.07082"}},"official":{"repos":["stanfordnlp/stanza"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/advancing-hungarian-text-processing-with","slug":"advancing-hungarian-text-processing-with","title":"Advancing Hungarian Text Processing with HuSpaCy: Efficient and Accurate NLP Pipelines","date":"2023-08-24","arxiv_id":"2308.12635","repositories_listed":2,"syntology":null},{"url":"/paper/sentence-embedding-models-for-ancient-greek","slug":"sentence-embedding-models-for-ancient-greek","title":"Sentence Embedding Models for Ancient Greek Using Multilingual Knowledge Distillation","date":"2023-08-24","arxiv_id":"2308.13116","repositories_listed":2,"syntology":null},{"url":"/paper/top2vec-distributed-representations-of-topics","slug":"top2vec-distributed-representations-of-topics","title":"Top2Vec: Distributed Representations of Topics","date":"2020-08-19","arxiv_id":"2008.09470","repositories_listed":2,"syntology":{"n":2,"n_ran":2,"n_constructed":0,"n_ran_checked":0,"n_instrument":2,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/top2vec-distributed-representations-of-topics#ran","syntology_url":"https://syntology.ai/paper/2008.09470","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2008.09470"}},"official":{"repos":["ddangelov/Top2Vec"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]}}},{"url":"/paper/improving-lemmatization-of-non-standard","slug":"improving-lemmatization-of-non-standard","title":"Improving Lemmatization of Non-Standard Languages with Joint Learning","date":"2019-03-16","arxiv_id":"1903.06939","repositories_listed":2,"syntology":null},{"url":"/paper/lemmatag-jointly-tagging-and-lemmatizing-for","slug":"lemmatag-jointly-tagging-and-lemmatizing-for","title":"LemmaTag: Jointly Tagging and Lemmatizing for Morphologically-Rich Languages with BRNNs","date":"2018-08-10","arxiv_id":"1808.03703","repositories_listed":2,"syntology":null},{"url":"/paper/parsipy-nlp-toolkit-for-historical-persian","slug":"parsipy-nlp-toolkit-for-historical-persian","title":"ParsiPy: NLP Toolkit for Historical Persian Texts in Python","date":"2025-03-22","arxiv_id":"2503.17810","repositories_listed":1,"syntology":null},{"url":"/paper/a-state-of-the-art-morphosyntactic-parser-and","slug":"a-state-of-the-art-morphosyntactic-parser-and","title":"A State-of-the-Art Morphosyntactic Parser and Lemmatizer for Ancient Greek","date":"2024-10-15","arxiv_id":"2410.12055","repositories_listed":1,"syntology":null},{"url":"/paper/2409-13920","slug":"2409-13920","title":"One Model is All You Need: ByT5-Sanskrit, a Unified Model for Sanskrit NLP Tasks","date":"2024-09-20","arxiv_id":"2409.13920","repositories_listed":1,"syntology":null},{"url":"/paper/open-source-web-service-with-morphological","slug":"open-source-web-service-with-morphological","title":"Open-Source Web Service with Morphological Dictionary-Supplemented Deep Learning for Morphosyntactic Analysis of Czech","date":"2024-06-18","arxiv_id":"2406.12422","repositories_listed":1,"syntology":null},{"url":"/paper/heidelberg-boston-sigtyp-2024-shared-task","slug":"heidelberg-boston-sigtyp-2024-shared-task","title":"Heidelberg-Boston @ SIGTYP 2024 Shared Task: Enhancing Low-Resource Language Analysis With Character-Aware Hierarchical Transformers","date":"2024-05-30","arxiv_id":"2405.20145","repositories_listed":1,"syntology":null},{"url":"/paper/opera-graeca-adnotata-building-a-34m-token","slug":"opera-graeca-adnotata-building-a-34m-token","title":"Opera Graeca Adnotata: Building a 34M+ Token Multilayer Corpus for Ancient Greek","date":"2024-03-31","arxiv_id":"2404.00739","repositories_listed":1,"syntology":null},{"url":"/paper/cross-lingual-named-entity-corpus-for-slavic","slug":"cross-lingual-named-entity-corpus-for-slavic","title":"Cross-lingual Named Entity Corpus for Slavic Languages","date":"2024-03-30","arxiv_id":"2404.00482","repositories_listed":1,"syntology":null},{"url":"/paper/evaluating-shortest-edit-script-methods-for","slug":"evaluating-shortest-edit-script-methods-for","title":"Evaluating Shortest Edit Script Methods for Contextual Lemmatization","date":"2024-03-25","arxiv_id":"2403.16968","repositories_listed":1,"syntology":null},{"url":"/paper/banlemma-a-word-formation-dependent-rule-and","slug":"banlemma-a-word-formation-dependent-rule-and","title":"BanLemma: A Word Formation Dependent Rule and Dictionary Based Bangla Lemmatizer","date":"2023-11-06","arxiv_id":"2311.03078","repositories_listed":1,"syntology":null},{"url":"/paper/lexicon-and-rule-based-word-lemmatization","slug":"lexicon-and-rule-based-word-lemmatization","title":"Lexicon and Rule-based Word Lemmatization Approach for the Somali Language","date":"2023-08-03","arxiv_id":"2308.01785","repositories_listed":1,"syntology":null},{"url":"/paper/hybrid-lemmatization-in-huspacy","slug":"hybrid-lemmatization-in-huspacy","title":"Hybrid lemmatization in HuSpaCy","date":"2023-06-13","arxiv_id":"2306.07636","repositories_listed":1,"syntology":null},{"url":"/paper/exploring-large-language-models-for-classical","slug":"exploring-large-language-models-for-classical","title":"Exploring Large Language Models for Classical Philology","date":"2023-05-23","arxiv_id":"2305.13698","repositories_listed":1,"syntology":null},{"url":"/paper/brent-bidirectional-retrieval-enhanced","slug":"brent-bidirectional-retrieval-enhanced","title":"BRENT: Bidirectional Retrieval Enhanced Norwegian Transformer","date":"2023-04-19","arxiv_id":"2304.09649","repositories_listed":1,"syntology":null},{"url":"/paper/exploring-the-state-of-the-art-language","slug":"exploring-the-state-of-the-art-language","title":"Transformers on Multilingual Clause-Level Morphology","date":"2022-11-03","arxiv_id":"2211.01736","repositories_listed":1,"syntology":null},{"url":"/paper/knowledge-authoring-with-factual-english","slug":"knowledge-authoring-with-factual-english","title":"Knowledge Authoring with Factual English","date":"2022-08-05","arxiv_id":"2208.03094","repositories_listed":1,"syntology":null},{"url":"/paper/dadmatools-natural-language-processing","slug":"dadmatools-natural-language-processing","title":"DadmaTools: Natural Language Processing Toolkit for Persian Language","date":"2022-07-01","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/stylistic-fingerprints-pos-tags-and-inflected","slug":"stylistic-fingerprints-pos-tags-and-inflected","title":"Stylistic Fingerprints, POS-tags and Inflected Languages: A Case Study in Polish","date":"2022-06-05","arxiv_id":"2206.02208","repositories_listed":1,"syntology":null},{"url":"/paper/huspacy-an-industrial-strength-hungarian","slug":"huspacy-an-industrial-strength-hungarian","title":"HuSpaCy: an industrial-strength Hungarian natural language processing toolkit","date":"2022-01-06","arxiv_id":"2201.01956","repositories_listed":1,"syntology":{"n":2,"n_ran":2,"n_constructed":0,"n_ran_checked":2,"n_instrument":0,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":2,"n_pointer_only":0,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/huspacy-an-industrial-strength-hungarian#ran","syntology_url":"https://syntology.ai/paper/2201.01956","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2201.01956"}},"official":null}},{"url":"/paper/elit-emory-language-and-information-toolkit","slug":"elit-emory-language-and-information-toolkit","title":"ELIT: Emory Language and Information Toolkit","date":"2021-09-08","arxiv_id":"2109.03903","repositories_listed":1,"syntology":null},{"url":"/paper/lemmatization-of-historical-old-literary","slug":"lemmatization-of-historical-old-literary","title":"Lemmatization of Historical Old Literary Finnish Texts in Modern Orthography","date":"2021-07-07","arxiv_id":"2107.03266","repositories_listed":1,"syntology":null},{"url":"/paper/neural-morphology-dataset-and-models-for","slug":"neural-morphology-dataset-and-models-for","title":"Neural Morphology Dataset and Models for Multiple Languages, from the Large to the Endangered","date":"2021-05-26","arxiv_id":"2105.12428","repositories_listed":1,"syntology":null},{"url":"/paper/enhancing-sequence-to-sequence-neural","slug":"enhancing-sequence-to-sequence-neural","title":"Enhancing Sequence-to-Sequence Neural Lemmatization with External Resources","date":"2021-01-28","arxiv_id":"2101.12056","repositories_listed":1,"syntology":null},{"url":"/paper/dbtagger-multi-task-learning-for-keyword","slug":"dbtagger-multi-task-learning-for-keyword","title":"DBTagger: Multi-Task Learning for Keyword Mapping in NLIDBs Using Bi-Directional Recurrent Neural Networks","date":"2021-01-11","arxiv_id":"2101.04226","repositories_listed":1,"syntology":null},{"url":"/paper/trankit-a-light-weight-transformer-based","slug":"trankit-a-light-weight-transformer-based","title":"Trankit: A Light-Weight Transformer-based Toolkit for Multilingual Natural Language Processing","date":"2021-01-09","arxiv_id":"2101.03289","repositories_listed":1,"syntology":null},{"url":"/paper/the-role-of-interpretable-patterns-in-deep","slug":"the-role-of-interpretable-patterns-in-deep","title":"The Role of Interpretable Patterns in Deep Learning for Morphology","date":"2020-12-08","arxiv_id":"2012.04575","repositories_listed":1,"syntology":null},{"url":"/paper/klpt-kurdish-language-processing-toolkit","slug":"klpt-kurdish-language-processing-toolkit","title":"KLPT – Kurdish Language Processing Toolkit","date":"2020-11-01","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/topicmodel4j-a-java-package-for-topic-models","slug":"topicmodel4j-a-java-package-for-topic-models","title":"TopicModel4J: A Java Package for Topic Models","date":"2020-10-28","arxiv_id":"2010.14707","repositories_listed":1,"syntology":null},{"url":"/paper/a-study-of-fasttext-word-embedding-effects-in","slug":"a-study-of-fasttext-word-embedding-effects-in","title":"A Study of fastText Word Embedding Effects in Document Classification in Bangla Language","date":"2020-07-30","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/tagging-and-parsing-of-multidomain","slug":"tagging-and-parsing-of-multidomain","title":"Tagging and parsing of multidomain collections","date":"2020-06-17","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/the-frankfurt-latin-lexicon-from","slug":"the-frankfurt-latin-lexicon-from","title":"The Frankfurt Latin Lexicon: From Morphological Expansion and Word Embeddings to SemioGraphs","date":"2020-05-21","arxiv_id":"2005.10790","repositories_listed":1,"syntology":null},{"url":"/paper/grammatical-gender-associations-outweigh","slug":"grammatical-gender-associations-outweigh","title":"Grammatical gender associations outweigh topical gender bias in crosslinguistic word embeddings","date":"2020-05-18","arxiv_id":"2005.08864","repositories_listed":1,"syntology":null},{"url":"/paper/morphological-tagging-and-lemmatization-of","slug":"morphological-tagging-and-lemmatization-of","title":"Morphological Tagging and Lemmatization of Albanian: A Manually Annotated Corpus and Neural Models","date":"2019-12-02","arxiv_id":"1912.00991","repositories_listed":1,"syntology":null},{"url":"/paper/ufal-mrpipe-at-mrp-2019-udpipe-goes-semantic-1","slug":"ufal-mrpipe-at-mrp-2019-udpipe-goes-semantic-1","title":"\\'UFAL MRPipe at MRP 2019: UDPipe Goes Semantic in the Meaning Representation Parsing Shared Task","date":"2019-11-01","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/ufal-mrpipe-at-mrp-2019-udpipe-goes-semantic","slug":"ufal-mrpipe-at-mrp-2019-udpipe-goes-semantic","title":"ÚFAL MRPipe at MRP 2019: UDPipe Goes Semantic in the Meaning Representation Parsing Shared Task","date":"2019-10-24","arxiv_id":"1910.11295","repositories_listed":1,"syntology":null},{"url":"/paper/unsupervised-lemmatization-as-embeddings","slug":"unsupervised-lemmatization-as-embeddings","title":"Unsupervised Lemmatization as Embeddings-Based Word Clustering","date":"2019-08-22","arxiv_id":"1908.08528","repositories_listed":1,"syntology":null},{"url":"/paper/cross-lingual-lemmatization-and-morphology","slug":"cross-lingual-lemmatization-and-morphology","title":"Cross-Lingual Lemmatization and Morphology Tagging with Two-Stage Multilingual BERT Fine-Tuning","date":"2019-08-01","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/morpheus-a-neural-network-for-jointly","slug":"morpheus-a-neural-network-for-jointly","title":"Morpheus: A Neural Network for Jointly Learning Contextual Lemmatization and Morphological Tagging","date":"2019-08-01","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/cmu-01-at-the-sigmorphon-2019-shared-task-on","slug":"cmu-01-at-the-sigmorphon-2019-shared-task-on","title":"CMU-01 at the SIGMORPHON 2019 Shared Task on Crosslinguality and Context in Morphology","date":"2019-07-23","arxiv_id":"1907.10129","repositories_listed":1,"syntology":null},{"url":"/paper/revisiting-nmt-for-normalization-of-early","slug":"revisiting-nmt-for-normalization-of-early","title":"Revisiting NMT for Normalization of Early English Letters","date":"2019-06-01","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/training-data-augmentation-for-context","slug":"training-data-augmentation-for-context","title":"Training Data Augmentation for Context-Sensitive Neural Lemmatizer Using Inflection Tables and Raw Text","date":"2019-06-01","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/morphological-parsing-of-low-resource","slug":"morphological-parsing-of-low-resource","title":"Morphological parsing of low‑resource languages","date":"2019-05-29","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/data-augmentation-for-context-sensitive","slug":"data-augmentation-for-context-sensitive","title":"Training Data Augmentation for Context-Sensitive Neural Lemmatization Using Inflection Tables and Raw Text","date":"2019-04-02","arxiv_id":"1904.01464","repositories_listed":1,"syntology":null},{"url":"/paper/joint-learning-of-pos-and-dependencies-for","slug":"joint-learning-of-pos-and-dependencies-for","title":"Joint Learning of POS and Dependencies for Multilingual Universal Dependency Parsing","date":"2018-10-01","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/lemmatag-jointly-tagging-and-lemmatizing-for-1","slug":"lemmatag-jointly-tagging-and-lemmatizing-for-1","title":"LemmaTag: Jointly Tagging and Lemmatizing for Morphologically Rich Languages with BRNNs","date":"2018-10-01","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/nlp-cube-end-to-end-raw-text-processing-with","slug":"nlp-cube-end-to-end-raw-text-processing-with","title":"NLP-Cube: End-to-End Raw Text Processing With Neural Networks","date":"2018-10-01","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/tree-stack-lstm-in-transition-based","slug":"tree-stack-lstm-in-transition-based","title":"Tree-Stack LSTM in Transition Based Dependency Parsing","date":"2018-10-01","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/towards-jointud-part-of-speech-tagging-and","slug":"towards-jointud-part-of-speech-tagging-and","title":"Towards JointUD: Part-of-speech Tagging and Lemmatization using Recurrent Neural Networks","date":"2018-09-10","arxiv_id":"1809.03211","repositories_listed":1,"syntology":null},{"url":"/paper/imitation-learning-for-neural-morphological","slug":"imitation-learning-for-neural-morphological","title":"Imitation Learning for Neural Morphological String Transduction","date":"2018-08-31","arxiv_id":"1808.10701","repositories_listed":1,"syntology":null},{"url":"/paper/from-text-to-lexicon-bridging-the-gap-between","slug":"from-text-to-lexicon-bridging-the-gap-between","title":"From Text to Lexicon: Bridging the Gap between Word Embeddings and Lexical Resources","date":"2018-08-01","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/neural-transition-based-string-transduction","slug":"neural-transition-based-string-transduction","title":"Neural Transition-based String Transduction for Limited-Resource Setting in Morphology","date":"2018-08-01","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/resource-size-matters-improving-neural-named","slug":"resource-size-matters-improving-neural-named","title":"Resource-Size matters: Improving Neural Named Entity Recognition with Optimized Large Corpora","date":"2018-07-26","arxiv_id":"1807.10675","repositories_listed":1,"syntology":null},{"url":"/paper/iucm-at-semeval-2018-task-11-similar-topic","slug":"iucm-at-semeval-2018-task-11-similar-topic","title":"IUCM at SemEval-2018 Task 11: Similar-Topic Texts as a Comprehension Knowledge Source","date":"2018-06-01","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/someweta-a-part-of-speech-tagger-for-german","slug":"someweta-a-part-of-speech-tagger-for-german","title":"SoMeWeTa: A Part-of-Speech Tagger for German Social Media and Web Texts","date":"2018-05-01","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/sudachi-a-japanese-tokenizer-for-business","slug":"sudachi-a-japanese-tokenizer-for-business","title":"Sudachi: a Japanese Tokenizer for Business","date":"2018-05-01","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/an-automated-text-categorization-framework","slug":"an-automated-text-categorization-framework","title":"An Automated Text Categorization Framework based on Hyperparameter Optimization","date":"2017-04-06","arxiv_id":"1704.01975","repositories_listed":1,"syntology":null},{"url":"/paper/somajo-state-of-the-art-tokenization-for","slug":"somajo-state-of-the-art-tokenization-for","title":"SoMaJo: State-of-the-art tokenization for German web and social media texts","date":"2016-08-01","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/unsupervised-compound-splitting-with","slug":"unsupervised-compound-splitting-with","title":"Unsupervised Compound Splitting With Distributional Semantics Rivals Supervised Methods","date":"2016-06-01","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/analyzing-pre-processing-settings-for-urdu","slug":"analyzing-pre-processing-settings-for-urdu","title":"Analyzing Pre-processing Settings for Urdu Single-document Extractive Summarization","date":"2016-05-01","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/urdu-summary-corpus","slug":"urdu-summary-corpus","title":"Urdu Summary Corpus","date":"2016-05-01","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/integrated-sequence-tagging-for-medieval","slug":"integrated-sequence-tagging-for-medieval","title":"Integrated Sequence Tagging for Medieval Latin Using Deep Representation Learning","date":"2016-03-04","arxiv_id":"1603.01597","repositories_listed":1,"syntology":null},{"url":"/paper/development-of-a-hindi-lemmatizer","slug":"development-of-a-hindi-lemmatizer","title":"Development of a Hindi Lemmatizer","date":"2013-05-24","arxiv_id":"1305.6211","repositories_listed":1,"syntology":null},{"url":"/paper/beyond-stemming-and-lemmatization-ultra","slug":"beyond-stemming-and-lemmatization-ultra","title":"Beyond Stemming and Lemmatization: Ultra-stemming to Improve Automatic Text Summarization","date":"2012-09-14","arxiv_id":"1209.3126","repositories_listed":1,"syntology":null},{"url":null,"slug":"neon-a-tool-for-automated-detection","title":"NeoN: A Tool for Automated Detection, Linguistic and LLM-Driven Analysis of Neologisms in Polish","date":"2025-05-21","arxiv_id":"2505.15426","repositories_listed":0,"syntology":null},{"url":null,"slug":"breaking-the-fake-news-barrier-deep-learning","title":"Breaking the Fake News Barrier: Deep Learning Approaches in Bangla Language","date":"2025-01-30","arxiv_id":"2501.18766","repositories_listed":0,"syntology":null},{"url":null,"slug":"context-aware-lemmatization-and-morphological","title":"Context Aware Lemmatization and Morphological Tagging Method in Turkish","date":"2025-01-04","arxiv_id":"2501.02361","repositories_listed":0,"syntology":null},{"url":null,"slug":"glilem-leveraging-gliner-for-contextualized","title":"GliLem: Leveraging GliNER for Contextualized Lemmatization in Estonian","date":"2024-12-29","arxiv_id":"2412.20597","repositories_listed":0,"syntology":null},{"url":null,"slug":"sinatools-open-source-toolkit-for-arabic","title":"SinaTools: Open Source Toolkit for Arabic Natural Language Processing","date":"2024-11-03","arxiv_id":"2411.01523","repositories_listed":0,"syntology":null},{"url":null,"slug":"a-comparative-study-of-hybrid-models-in","title":"A Comparative Study of Hybrid Models in Health Misinformation Text Classification","date":"2024-10-08","arxiv_id":"2410.06311","repositories_listed":0,"syntology":null},{"url":null,"slug":"ace-2005-pt-corpus-for-event-extraction-in","title":"ACE-2005-PT: Corpus for Event Extraction in Portuguese","date":"2024-08-29","arxiv_id":"2408.16928","repositories_listed":0,"syntology":null},{"url":null,"slug":"efontes-part-of-speech-tagging-and","title":"eFontes. Part of Speech Tagging and Lemmatization of Medieval Latin Texts.A Cross-Genre Survey","date":"2024-06-29","arxiv_id":"2407.00418","repositories_listed":0,"syntology":null},{"url":null,"slug":"recent-advancements-in-computational","title":"Recent advancements in computational morphology : A comprehensive survey","date":"2024-06-08","arxiv_id":"2406.05424","repositories_listed":0,"syntology":null},{"url":null,"slug":"joint-lemmatization-and-morphological-tagging-1","title":"Joint Lemmatization and Morphological Tagging with LEMMING","date":"2024-05-28","arxiv_id":"2405.18308","repositories_listed":0,"syntology":null},{"url":null,"slug":"comparison-of-current-approaches-to","title":"Comparison of Current Approaches to Lemmatization: A Case Study in Estonian","date":"2024-04-23","arxiv_id":"2404.15003","repositories_listed":0,"syntology":null},{"url":null,"slug":"tartunlp-sigtyp-2024-shared-task-adapting-xlm","title":"TartuNLP @ SIGTYP 2024 Shared Task: Adapting XLM-RoBERTa for Ancient and Historical Languages","date":"2024-04-19","arxiv_id":"2404.12845","repositories_listed":0,"syntology":null},{"url":null,"slug":"zaebuc-spoken-a-multilingual-multidialectal","title":"ZAEBUC-Spoken: A Multilingual Multidialectal Arabic-English Speech Corpus","date":"2024-03-27","arxiv_id":"2403.18182","repositories_listed":0,"syntology":null},{"url":null,"slug":"the-effect-of-stemming-and-lemmatization-on","title":"The effect of stemming and lemmatization on Portuguese fake news text classification","date":"2023-10-17","arxiv_id":"2310.11344","repositories_listed":0,"syntology":null},{"url":null,"slug":"vacaspati-a-diverse-corpus-of-bangla","title":"Vacaspati: A Diverse Corpus of Bangla Literature","date":"2023-07-11","arxiv_id":"2307.05083","repositories_listed":0,"syntology":null},{"url":null,"slug":"advancing-full-text-search-lemmatization","title":"Advancing Full-Text Search Lemmatization Techniques with Paradigm Retrieval from OpenCorpora","date":"2023-05-18","arxiv_id":"2305.10848","repositories_listed":0,"syntology":null},{"url":null,"slug":"latincy-synthetic-trained-pipelines-for-latin","title":"LatinCy: Synthetic Trained Pipelines for Latin NLP","date":"2023-05-07","arxiv_id":"2305.04365","repositories_listed":0,"syntology":null},{"url":null,"slug":"exploring-the-use-of-foundation-models-for","title":"Exploring the Use of Foundation Models for Named Entity Recognition and Lemmatization Tasks in Slavic Languages","date":"2023-04-11","arxiv_id":"2304.05336","repositories_listed":0,"syntology":null},{"url":null,"slug":"on-the-role-of-morphological-information-for","title":"On the Role of Morphological Information for Contextual Lemmatization","date":"2023-02-01","arxiv_id":"2302.00407","repositories_listed":0,"syntology":null},{"url":null,"slug":"automated-identification-of-disaster-news-for","title":"Automated Identification of Disaster News For Crisis Management Using Machine Learning","date":"2023-01-24","arxiv_id":"2301.09896","repositories_listed":0,"syntology":null},{"url":null,"slug":"h2-golden-retriever-methodology-and-tool-for","title":"H2-Golden-Retriever: Methodology and Tool for an Evidence-Based Hydrogen Research Grantsmanship","date":"2022-11-16","arxiv_id":"2211.08614","repositories_listed":0,"syntology":null},{"url":null,"slug":"development-of-a-rule-based-lemmatization","title":"Development of a rule-based lemmatization algorithm through Finite State Machine for Uzbek language","date":"2022-10-28","arxiv_id":"2210.16006","repositories_listed":0,"syntology":null},{"url":null,"slug":"arabic-word-level-readability-visualization","title":"Arabic Word-level Readability Visualization for Assisted Text Simplification","date":"2022-10-19","arxiv_id":"2210.10672","repositories_listed":0,"syntology":null},{"url":null,"slug":"social-media-personal-event-notifier-using","title":"Social Media Personal Event Notifier Using NLP and Machine Learning","date":"2022-10-10","arxiv_id":"2210.05001","repositories_listed":0,"syntology":null},{"url":null,"slug":"evaluating-diversity-of-multiword-expressions","title":"Evaluating Diversity of Multiword Expressions in Annotated Text","date":"2022-10-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"context-based-lemmatizer-for-polish-language","title":"Context based lemmatizer for Polish language","date":"2022-07-23","arxiv_id":"2207.11565","repositories_listed":0,"syntology":null},{"url":null,"slug":"tarc-tunisian-arabish-corpus-first-complete","title":"TArC: Tunisian Arabish Corpus First complete release","date":"2022-07-11","arxiv_id":"2207.04796","repositories_listed":0,"syntology":null},{"url":null,"slug":"agile-the-first-lemmatizer-for-ancient-greek","title":"AGILe: The First Lemmatizer for Ancient Greek Inscriptions","date":"2022-06-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"an-electra-model-for-latin-token-tagging","title":"An ELECTRA Model for Latin Token Tagging Tasks","date":"2022-06-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"analyse-automatique-de-lancien-armenien","title":"Analyse Automatique de l’Ancien Arménien. Évaluation d’une méthode hybride « dictionnaire » et « réseau de neurones » sur un Extrait de l’Adversus Haereses d’Irénée de Lyon","date":"2022-06-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"describing-language-variation-in-the","title":"Describing Language Variation in the Colophons of Armenian Manuscripts","date":"2022-06-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"diachronic-parsing-of-pre-standard-irish","title":"Diachronic Parsing of Pre-Standard Irish","date":"2022-06-01","arxiv_id":null,"repositories_listed":0,"syntology":null}],"syntology_records":3,"syntology_note":"a paper without a record is not a recorded non-run: it may lack an arXiv id or simply be absent from the graph layer"},"key_notes":{"n_ran_checked":"legacy name, kept unchanged so existing readers do not break: it counts the samples that ran with no instrument failure (honoured, violated, and ran with no contract checked); it does not mean a contract was checked, and the pages print it as 'K with no instrument failure', not 'K checked'","n_constructed":"a sub-count of the samples that ran, never subtracted from them and never a failure: an executed sample whose run returned an instance of its own class (fixture_out_type equals the entry name): the run built an object and did not compute a result (Syntology's RAN record, counts.constructed)"},"since_archive_judged":{"papers":0,"papers_placed":0,"judged_by":{"model":"a model","models_as_recorded":[],"from":"lb_rows_run_verified.jsonl: each record's `model` field (the extractor's call that wrote decisions[])"},"note":"a model's judgement from the paper's own tables that they report on this leaderboard, not a result: no value from a paper that was not placed is printed or carried here; papers counts each paper once over these leaderboards","backfill":"8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read)","backfill_complete":false,"leaderboards":[]},"papers_where_code_ran":3,"papers_where_code_ran_first_page":"/task/lemmatization/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not run it on this task or check it against the task's benchmarks.","pages":[{"order":"archive","page":2,"of":4,"url":"/task/lemmatization/papers/2","json":"/task/lemmatization/papers/2.json","rows":100},{"order":"archive","page":3,"of":4,"url":"/task/lemmatization/papers/3","json":"/task/lemmatization/papers/3.json","rows":100},{"order":"archive","page":4,"of":4,"url":"/task/lemmatization/papers/4","json":"/task/lemmatization/papers/4.json","rows":51},{"order":"ran","page":1,"of":1,"url":"/task/lemmatization/papers/ran/1","json":"/task/lemmatization/papers/ran/1.json","rows":3}],"description_links":{"kept":0,"unwrapped_to_text":0,"bare_urls_linked":0,"relative_images_dropped":0,"rule":"internal links are kept only when the target slug exists in the catalog"},"syntology":{"read_at":"2026-10-05T00:36:11+00:00","claim":"Per-sample execution status on synthesized fixtures ('ran N of M samples'); not a correctness claim and not a ranking signal.","status_vocabulary":{"ran_honours":"ran, honoured the contract we drafted","ran_violates":"ran, violated the contract we drafted","ran_draft_wrong":"ran; our contract draft was wrong, not the code","ran_fixture":"ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT)","ran":"ran on a synthesized input","unverified":"unverified (harvested, no recorded run)"},"row_route":"each syntology object on a benchmark's first row and on a paper carries sample_list (this site's paper page, #ran), syntology_url (syntology.ai's page for the paper, only when that route probed live) and mcp (the agent call that lists the paper's harvested samples; not a verdict on the paper)","developers":"https://syntology.ai/developers"},"not_shown":{"libraries":"the archive has no per-task library table","trend_sparklines":"the Trend column of the benchmarks table was a rendered image; it is not in the archive","social_and_latest_sorts":"stars and social signals are not in the archive"},"record_sha256":"f89f02ccaf4e3016f2888a86bb388a351b50c637daeb316abdeb77a676fa9cea","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}