{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/task/text-classification","name":"Text Classification","slug":"text-classification","description_markdown":"**Text Classification** is the task of assigning a sentence or document an appropriate category. The categories depend on the chosen dataset and can range from topics. \r\n\r\nText Classification problems include emotion classification, news classification, citation intent classification, among others. Benchmark datasets for evaluating text classification capabilities include GLUE, AGNews,  among others. \r\n\r\nIn recent years, deep learning techniques like XLNet and RoBERTa have attained some of the biggest performance jumps for text classification problems. \r\n\r\n<span style=\"color:grey; opacity: 0.6\">( Image credit: [Text Classification Algorithms: A Survey](https://arxiv.org/pdf/1904.08067v4.pdf) )</span>","categories":[{"name":"Natural Language Processing","url":"/area/natural-language-processing"}],"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","slug_source":"archive_url"},"counts":{"papers_tagged":3635,"papers_with_code":1308,"benchmarks":68,"benchmark_tables_in_archive":100,"benchmark_tables_shown":100,"benchmark_tables_withheld_as_spam":0,"benchmark_definition":"a leaderboard table with at least one row; benchmark_tables_shown also counts the zero-row tables; benchmark_tables_in_archive adds the tables withheld as spam","datasets":167,"subtasks":16,"parent_tasks":1},"benchmarks":[{"leaderboard":"/sota/text-classification-on-mteb","slug":"text-classification-on-mteb","dataset":"MTEB","dataset_url":"/dataset/mteb","rows_in_archive":31,"metrics":["Accuracy"],"first_row_in_archive_order":{"model":"ST5-XXL","paper_title":"MTEB: Massive Text Embedding Benchmark","paper_url":"/paper/mteb-massive-text-embedding-benchmark","paper_date":"2022-10-13","arxiv_id":"2210.07316","code_links":[{"title":"embeddings-benchmark/mteb","url":"https://github.com/embeddings-benchmark/mteb"},{"title":"lyon-nlp/mteb-french","url":"https://github.com/lyon-nlp/mteb-french"},{"title":"climsocana/tecb-de","url":"https://github.com/climsocana/tecb-de"},{"title":"wadoodabdul/clinical_ner_benchmark","url":"https://github.com/wadoodabdul/clinical_ner_benchmark"},{"title":"basf/chemteb","url":"https://github.com/basf/chemteb"}],"syntology":{"n":13,"n_ran":10,"n_constructed":0,"n_ran_checked":7,"n_instrument":3,"n_unverified":3,"n_honours":0,"n_violates":0,"n_no_contract":7,"n_pointer_only":0,"phrase":"10 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified","sample_list":"/paper/mteb-massive-text-embedding-benchmark#ran","syntology_url":"https://syntology.ai/paper/2210.07316","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2210.07316"}},"official":{"repos":["embeddings-benchmark/mteb"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}}},{"leaderboard":"/sota/text-classification-on-ag-news","slug":"text-classification-on-ag-news","dataset":"AG News","dataset_url":"/dataset/ag-news","rows_in_archive":24,"metrics":["Error"],"first_row_in_archive_order":{"model":"XLNet","paper_title":"XLNet: Generalized Autoregressive Pretraining for Language Understanding","paper_url":"/paper/xlnet-generalized-autoregressive-pretraining","paper_date":"2019-06-19","arxiv_id":"1906.08237","code_links":[{"title":"huggingface/transformers","url":"https://github.com/huggingface/transformers"},{"title":"PaddlePaddle/PaddleNLP","url":"https://github.com/PaddlePaddle/PaddleNLP/tree/develop/examples/language_model/xlnet"},{"title":"zihangdai/xlnet","url":"https://github.com/zihangdai/xlnet"},{"title":"kaushaltrivedi/fast-bert","url":"https://github.com/kaushaltrivedi/fast-bert"},{"title":"utterworks/fast-bert","url":"https://github.com/utterworks/fast-bert"},{"title":"graykode/xlnet-Pytorch","url":"https://github.com/graykode/xlnet-Pytorch"},{"title":"facebookresearch/anli","url":"https://github.com/facebookresearch/anli"},{"title":"lvyufeng/bert4ms","url":"https://github.com/lvyufeng/bert4ms/blob/master/bert4ms/models/xlnet.py"},{"title":"huggingface/xlnet","url":"https://github.com/huggingface/xlnet"},{"title":"cuhksz-nlp/SAPar","url":"https://github.com/cuhksz-nlp/SAPar"},{"title":"joshuaWang-bit/Textclassification-pytorch","url":"https://github.com/joshuaWang-bit/Textclassification-pytorch"},{"title":"fanchenyou/transformer-study","url":"https://github.com/fanchenyou/transformer-study"},{"title":"https-seyhan/BugAI","url":"https://github.com/https-seyhan/BugAI"},{"title":"NathanDuran/Sentence-Encoding-for-DA-Classification","url":"https://github.com/NathanDuran/Sentence-Encoding-for-DA-Classification"},{"title":"2miatran/Natural-Language-Processing","url":"https://github.com/2miatran/Natural-Language-Processing"},{"title":"chesterdu/contrastive_summary","url":"https://github.com/chesterdu/contrastive_summary"},{"title":"pauldevos/python-notes","url":"https://github.com/pauldevos/python-notes"},{"title":"pwc-1/Paper-9","url":"https://github.com/pwc-1/Paper-9/tree/main/5/xlnet"},{"title":"MindCode-4/code-5","url":"https://github.com/MindCode-4/code-5/tree/main/xlnet"},{"title":"pwc-1/Paper-9","url":"https://github.com/pwc-1/Paper-9/tree/main/1/xlnet"},{"title":"samwisegamjeee/pytorch-transformers","url":"https://github.com/samwisegamjeee/pytorch-transformers"},{"title":"SambhawDrag/XLNet.jl","url":"https://github.com/SambhawDrag/XLNet.jl"},{"title":"tomgoter/nlp_finalproject","url":"https://github.com/tomgoter/nlp_finalproject"},{"title":"MS-P3/code7","url":"https://github.com/MS-P3/code7/tree/main/xlnet"},{"title":"zaradana/Fast_BERT","url":"https://github.com/zaradana/Fast_BERT"},{"title":"jonahwinninghoff/Text-Summarization","url":"https://github.com/jonahwinninghoff/Text-Summarization"},{"title":"listenviolet/XLNet","url":"https://github.com/listenviolet/XLNet"}],"syntology":{"n":24,"n_ran":15,"n_constructed":2,"n_ran_checked":10,"n_instrument":5,"n_unverified":9,"n_honours":2,"n_violates":0,"n_no_contract":8,"n_pointer_only":4,"phrase":"15 ran (of which 2 constructed an object rather than computing a result; 10 with no instrument failure: 2 honoured, 0 violated, 8 with no contract checked; 5 where Syntology's instrument failed) · 9 unverified","sample_list":"/paper/xlnet-generalized-autoregressive-pretraining#ran","syntology_url":"https://syntology.ai/paper/1906.08237","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1906.08237"}},"official":{"repos":["zihangdai/xlnet"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":1,"ran_from_kinds":["listed","official"]}}}},{"leaderboard":"/sota/text-classification-on-dbpedia","slug":"text-classification-on-dbpedia","dataset":"DBpedia","dataset_url":"/dataset/dbpedia","rows_in_archive":21,"metrics":["Error"],"first_row_in_archive_order":{"model":"XLNet","paper_title":"XLNet: Generalized Autoregressive Pretraining for Language Understanding","paper_url":"/paper/xlnet-generalized-autoregressive-pretraining","paper_date":"2019-06-19","arxiv_id":"1906.08237","code_links":[{"title":"huggingface/transformers","url":"https://github.com/huggingface/transformers"},{"title":"PaddlePaddle/PaddleNLP","url":"https://github.com/PaddlePaddle/PaddleNLP/tree/develop/examples/language_model/xlnet"},{"title":"zihangdai/xlnet","url":"https://github.com/zihangdai/xlnet"},{"title":"kaushaltrivedi/fast-bert","url":"https://github.com/kaushaltrivedi/fast-bert"},{"title":"utterworks/fast-bert","url":"https://github.com/utterworks/fast-bert"},{"title":"graykode/xlnet-Pytorch","url":"https://github.com/graykode/xlnet-Pytorch"},{"title":"facebookresearch/anli","url":"https://github.com/facebookresearch/anli"},{"title":"lvyufeng/bert4ms","url":"https://github.com/lvyufeng/bert4ms/blob/master/bert4ms/models/xlnet.py"},{"title":"huggingface/xlnet","url":"https://github.com/huggingface/xlnet"},{"title":"cuhksz-nlp/SAPar","url":"https://github.com/cuhksz-nlp/SAPar"},{"title":"joshuaWang-bit/Textclassification-pytorch","url":"https://github.com/joshuaWang-bit/Textclassification-pytorch"},{"title":"fanchenyou/transformer-study","url":"https://github.com/fanchenyou/transformer-study"},{"title":"https-seyhan/BugAI","url":"https://github.com/https-seyhan/BugAI"},{"title":"NathanDuran/Sentence-Encoding-for-DA-Classification","url":"https://github.com/NathanDuran/Sentence-Encoding-for-DA-Classification"},{"title":"2miatran/Natural-Language-Processing","url":"https://github.com/2miatran/Natural-Language-Processing"},{"title":"chesterdu/contrastive_summary","url":"https://github.com/chesterdu/contrastive_summary"},{"title":"pauldevos/python-notes","url":"https://github.com/pauldevos/python-notes"},{"title":"pwc-1/Paper-9","url":"https://github.com/pwc-1/Paper-9/tree/main/5/xlnet"},{"title":"MindCode-4/code-5","url":"https://github.com/MindCode-4/code-5/tree/main/xlnet"},{"title":"pwc-1/Paper-9","url":"https://github.com/pwc-1/Paper-9/tree/main/1/xlnet"},{"title":"samwisegamjeee/pytorch-transformers","url":"https://github.com/samwisegamjeee/pytorch-transformers"},{"title":"SambhawDrag/XLNet.jl","url":"https://github.com/SambhawDrag/XLNet.jl"},{"title":"tomgoter/nlp_finalproject","url":"https://github.com/tomgoter/nlp_finalproject"},{"title":"MS-P3/code7","url":"https://github.com/MS-P3/code7/tree/main/xlnet"},{"title":"zaradana/Fast_BERT","url":"https://github.com/zaradana/Fast_BERT"},{"title":"jonahwinninghoff/Text-Summarization","url":"https://github.com/jonahwinninghoff/Text-Summarization"},{"title":"listenviolet/XLNet","url":"https://github.com/listenviolet/XLNet"}],"syntology":{"n":24,"n_ran":15,"n_constructed":2,"n_ran_checked":10,"n_instrument":5,"n_unverified":9,"n_honours":2,"n_violates":0,"n_no_contract":8,"n_pointer_only":4,"phrase":"15 ran (of which 2 constructed an object rather than computing a result; 10 with no instrument failure: 2 honoured, 0 violated, 8 with no contract checked; 5 where Syntology's instrument failed) · 9 unverified","sample_list":"/paper/xlnet-generalized-autoregressive-pretraining#ran","syntology_url":"https://syntology.ai/paper/1906.08237","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1906.08237"}},"official":{"repos":["zihangdai/xlnet"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":1,"ran_from_kinds":["listed","official"]}}}},{"leaderboard":"/sota/text-classification-on-r8","slug":"text-classification-on-r8","dataset":"R8","dataset_url":null,"rows_in_archive":21,"metrics":["Accuracy","F-measure"],"first_row_in_archive_order":{"model":"DeBERTa","paper_title":"Transformers are Short Text Classifiers: A Study of Inductive Short Text Classifiers on Benchmarks and Real-world Datasets","paper_url":"/paper/transformers-are-short-text-classifiers-a","paper_date":"2022-11-30","arxiv_id":"2211.16878","code_links":[{"title":"FKarl/short-text-classification","url":"https://github.com/FKarl/short-text-classification"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-trec-6","slug":"text-classification-on-trec-6","dataset":"TREC-6","dataset_url":null,"rows_in_archive":19,"metrics":["Error"],"first_row_in_archive_order":{"model":"Automatic Label Error Correction","paper_title":"The Re-Label Method For Data-Centric Machine Learning","paper_url":"/paper/the-re-label-method-for-data-centric-machine","paper_date":"2023-02-09","arxiv_id":"2302.04391","code_links":[{"title":"guotong1988/Automatic-Label-Error-Correction","url":"https://github.com/guotong1988/Automatic-Label-Error-Correction"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-20news","slug":"text-classification-on-20news","dataset":"20NEWS","dataset_url":null,"rows_in_archive":16,"metrics":["Accuracy","F-measure","Precision","Recall"],"first_row_in_archive_order":{"model":"LinearSVM+TFIDF","paper_title":"A Comparison of SVM against Pre-trained Language Models (PLMs) for Text Classification Tasks","paper_url":"/paper/a-comparison-of-svm-against-pre-trained","paper_date":"2022-11-04","arxiv_id":"2211.02563","code_links":[],"syntology":null}},{"leaderboard":"/sota/text-classification-on-uk-key-stage","slug":"text-classification-on-uk-key-stage","dataset":"UK Key Stage Readability","dataset_url":"/dataset/uk-key-stage-readability","rows_in_archive":15,"metrics":["F1"],"first_row_in_archive_order":{"model":"ELECTRA + ANN","paper_title":"What Differentiates Educational Literature? A Multimodal Fusion Approach of Transformers and Computational Linguistics","paper_url":"/paper/what-differentiates-educational-literature-a","paper_date":"2024-11-26","arxiv_id":"2411.17593","code_links":[],"syntology":null}},{"leaderboard":"/sota/text-classification-on-imdb","slug":"text-classification-on-imdb","dataset":"IMDb","dataset_url":"/dataset/imdb-movie-reviews","rows_in_archive":13,"metrics":["Accuracy","F1","Precision","Recall"],"first_row_in_archive_order":{"model":"BERT-ITPT-FiT","paper_title":"How to Fine-Tune BERT for Text Classification?","paper_url":"/paper/how-to-fine-tune-bert-for-text-classification","paper_date":"2019-05-14","arxiv_id":"1905.05583","code_links":[{"title":"xuyige/BERT4doc-Classification","url":"https://github.com/xuyige/BERT4doc-Classification"},{"title":"ongunuzaymacar/comparatively-finetuning-bert","url":"https://github.com/ongunuzaymacar/comparatively-finetuning-bert"},{"title":"uzaymacar/comparatively-finetuning-bert","url":"https://github.com/uzaymacar/comparatively-finetuning-bert"},{"title":"helmy-elrais/RoBERT_Recurrence_over_BERT","url":"https://github.com/helmy-elrais/RoBERT_Recurrence_over_BERT"},{"title":"GeorgeLuImmortal/Hierarchical-BERT-Model-with-Limited-Labelled-Data","url":"https://github.com/GeorgeLuImmortal/Hierarchical-BERT-Model-with-Limited-Labelled-Data"},{"title":"heraclex12/VLSP2020-Fake-News-Detection","url":"https://github.com/heraclex12/VLSP2020-Fake-News-Detection"},{"title":"bcaitech1/p4-dkt-no_caffeine_no_gain","url":"https://github.com/bcaitech1/p4-dkt-no_caffeine_no_gain"},{"title":"soarsmu/BiasFinder","url":"https://github.com/soarsmu/BiasFinder"},{"title":"qinhanmin2014/fine-tune-bert-for-text-classification","url":"https://github.com/qinhanmin2014/fine-tune-bert-for-text-classification"},{"title":"Domminique/Deploy-BERT-for-Sentiment-Analysis-with-FastAPI-","url":"https://github.com/Domminique/Deploy-BERT-for-Sentiment-Analysis-with-FastAPI-"},{"title":"Derposoft/ai-educator","url":"https://github.com/Derposoft/ai-educator"},{"title":"arctic-yen/Google_QUEST_Q-A_Labeling","url":"https://github.com/arctic-yen/Google_QUEST_Q-A_Labeling"},{"title":"sahil00199/KYC","url":"https://github.com/sahil00199/KYC"},{"title":"jyp1111/sentiment_analysis","url":"https://github.com/jyp1111/sentiment_analysis"},{"title":"saproovarun/Google-Quest-Q-A","url":"https://github.com/saproovarun/Google-Quest-Q-A"}],"syntology":{"n":18,"n_ran":12,"n_constructed":0,"n_ran_checked":7,"n_instrument":5,"n_unverified":6,"n_honours":1,"n_violates":0,"n_no_contract":6,"n_pointer_only":5,"phrase":"12 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 0 violated, 6 with no contract checked; 5 where Syntology's instrument failed) · 6 unverified","sample_list":"/paper/how-to-fine-tune-bert-for-text-classification#ran","syntology_url":"https://syntology.ai/paper/1905.05583","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1905.05583"}},"official":{"repos":["xuyige/BERT4doc-Classification"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["listed","official"]}}}},{"leaderboard":"/sota/text-classification-on-mr","slug":"text-classification-on-mr","dataset":"MR","dataset_url":"/dataset/mr","rows_in_archive":10,"metrics":["Accuracy"],"first_row_in_archive_order":{"model":"VLAWE","paper_title":"Vector of Locally-Aggregated Word Embeddings (VLAWE): A Novel Document-level Representation","paper_url":"/paper/vector-of-locally-aggregated-word-embeddings","paper_date":"2019-02-23","arxiv_id":"1902.08850","code_links":[{"title":"raduionescu/vlawe-boswe","url":"https://github.com/raduionescu/vlawe-boswe"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-ohsumed","slug":"text-classification-on-ohsumed","dataset":"Ohsumed","dataset_url":"/dataset/ohsumed","rows_in_archive":10,"metrics":["Accuracy"],"first_row_in_archive_order":{"model":"RoBERTaGCN","paper_title":"BertGCN: Transductive Text Classification by Combining GCN and BERT","paper_url":"/paper/bertgcn-transductive-text-classification-by","paper_date":"2021-05-12","arxiv_id":"2105.05727","code_links":[{"title":"ZeroRin/BertGCN","url":"https://github.com/ZeroRin/BertGCN"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-yahoo-answers","slug":"text-classification-on-yahoo-answers","dataset":"Yahoo! Answers","dataset_url":"/dataset/yahoo-answers","rows_in_archive":10,"metrics":["Accuracy"],"first_row_in_archive_order":{"model":"BERT-ITPT-FiT","paper_title":"How to Fine-Tune BERT for Text Classification?","paper_url":"/paper/how-to-fine-tune-bert-for-text-classification","paper_date":"2019-05-14","arxiv_id":"1905.05583","code_links":[{"title":"xuyige/BERT4doc-Classification","url":"https://github.com/xuyige/BERT4doc-Classification"},{"title":"ongunuzaymacar/comparatively-finetuning-bert","url":"https://github.com/ongunuzaymacar/comparatively-finetuning-bert"},{"title":"uzaymacar/comparatively-finetuning-bert","url":"https://github.com/uzaymacar/comparatively-finetuning-bert"},{"title":"helmy-elrais/RoBERT_Recurrence_over_BERT","url":"https://github.com/helmy-elrais/RoBERT_Recurrence_over_BERT"},{"title":"GeorgeLuImmortal/Hierarchical-BERT-Model-with-Limited-Labelled-Data","url":"https://github.com/GeorgeLuImmortal/Hierarchical-BERT-Model-with-Limited-Labelled-Data"},{"title":"heraclex12/VLSP2020-Fake-News-Detection","url":"https://github.com/heraclex12/VLSP2020-Fake-News-Detection"},{"title":"bcaitech1/p4-dkt-no_caffeine_no_gain","url":"https://github.com/bcaitech1/p4-dkt-no_caffeine_no_gain"},{"title":"soarsmu/BiasFinder","url":"https://github.com/soarsmu/BiasFinder"},{"title":"qinhanmin2014/fine-tune-bert-for-text-classification","url":"https://github.com/qinhanmin2014/fine-tune-bert-for-text-classification"},{"title":"Domminique/Deploy-BERT-for-Sentiment-Analysis-with-FastAPI-","url":"https://github.com/Domminique/Deploy-BERT-for-Sentiment-Analysis-with-FastAPI-"},{"title":"Derposoft/ai-educator","url":"https://github.com/Derposoft/ai-educator"},{"title":"arctic-yen/Google_QUEST_Q-A_Labeling","url":"https://github.com/arctic-yen/Google_QUEST_Q-A_Labeling"},{"title":"sahil00199/KYC","url":"https://github.com/sahil00199/KYC"},{"title":"jyp1111/sentiment_analysis","url":"https://github.com/jyp1111/sentiment_analysis"},{"title":"saproovarun/Google-Quest-Q-A","url":"https://github.com/saproovarun/Google-Quest-Q-A"}],"syntology":{"n":18,"n_ran":12,"n_constructed":0,"n_ran_checked":7,"n_instrument":5,"n_unverified":6,"n_honours":1,"n_violates":0,"n_no_contract":6,"n_pointer_only":5,"phrase":"12 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 0 violated, 6 with no contract checked; 5 where Syntology's instrument failed) · 6 unverified","sample_list":"/paper/how-to-fine-tune-bert-for-text-classification#ran","syntology_url":"https://syntology.ai/paper/1905.05583","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1905.05583"}},"official":{"repos":["xuyige/BERT4doc-Classification"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["listed","official"]}}}},{"leaderboard":"/sota/text-classification-on-climabench","slug":"text-classification-on-climabench","dataset":"Climabench","dataset_url":"/dataset/climabench","rows_in_archive":8,"metrics":["Evaluation Macro F1"],"first_row_in_archive_order":{"model":"CliReBERT (P0L3/clirebert_clirevocab_uncased)","paper_title":"Climate Research Domain BERTs: Pretraining, Adaptation, and Evaluation","paper_url":"/paper/climate-research-domain-berts-pretraining","paper_date":"2025-05-19","arxiv_id":null,"code_links":[],"syntology":null}},{"leaderboard":"/sota/text-classification-on-newsdiscourse","slug":"text-classification-on-newsdiscourse","dataset":"NewsDiscourse","dataset_url":null,"rows_in_archive":8,"metrics":["macro F1"],"first_row_in_archive_order":{"model":"Human (Post-Rec.) (Spangher et al., 2021)","paper_title":"Multitask Semi-Supervised Learning for Class-Imbalanced Discourse Classification","paper_url":"/paper/multitask-semi-supervised-learning-for-class","paper_date":"","arxiv_id":null,"code_links":[],"syntology":null}},{"leaderboard":"/sota/text-classification-on-r52","slug":"text-classification-on-r52","dataset":"R52","dataset_url":null,"rows_in_archive":8,"metrics":["Accuracy"],"first_row_in_archive_order":{"model":"1-6 BertGCN","paper_title":"BertGCN: Transductive Text Classification by Combining GCN and BERT","paper_url":"/paper/bertgcn-transductive-text-classification-by","paper_date":"2021-05-12","arxiv_id":"2105.05727","code_links":[{"title":"ZeroRin/BertGCN","url":"https://github.com/ZeroRin/BertGCN"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-yelp-5","slug":"text-classification-on-yelp-5","dataset":"Yelp-5","dataset_url":"/dataset/yelp","rows_in_archive":7,"metrics":["Accuracy"],"first_row_in_archive_order":{"model":"HAHNN (CNN)","paper_title":"Hierarchical Attentional Hybrid Neural Networks for Document Classification","paper_url":"/paper/hierarchical-attentional-hybrid-neural","paper_date":"2019-01-20","arxiv_id":"1901.06610","code_links":[{"title":"luisfredgs/cnn-hierarchical-network-for-document-classification","url":"https://github.com/luisfredgs/cnn-hierarchical-network-for-document-classification"},{"title":"abhilash1910/MiniAttention","url":"https://github.com/abhilash1910/MiniAttention"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-dodf-data","slug":"text-classification-on-dodf-data","dataset":"DODF Data","dataset_url":null,"rows_in_archive":5,"metrics":["Average F1","Weighted F1"],"first_row_in_archive_order":{"model":"ULMFiT (pre-trained vocab, no gradual unfreezing)","paper_title":"Inferring the source of official texts: can SVM beat ULMFiT?","paper_url":"/paper/inferring-the-source-of-official-texts-can","paper_date":"2020-03-02","arxiv_id":null,"code_links":[{"title":"peluz/kneedle-exploration","url":"https://github.com/peluz/kneedle-exploration"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-lot-insts","slug":"text-classification-on-lot-insts","dataset":"Lot-insts","dataset_url":"/dataset/lot-insts","rows_in_archive":5,"metrics":["Accuracy","Macro-F1"],"first_row_in_archive_order":{"model":"Character-BERT+RS","paper_title":"Text Classification in the Wild: a Large-scale Long-tailed Name Normalization Dataset","paper_url":"/paper/text-classification-in-the-wild-a-large-scale","paper_date":"2023-02-19","arxiv_id":"2302.09509","code_links":[{"title":"lumia-group/lot-insts","url":"https://github.com/lumia-group/lot-insts"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-mvictor-type","slug":"text-classification-on-mvictor-type","dataset":"MVICTOR (type)","dataset_url":null,"rows_in_archive":5,"metrics":["Average F1","Weighted F1"],"first_row_in_archive_order":{"model":"CNN + CRF","paper_title":"VICTOR: a Dataset for Brazilian Legal Documents Classification","paper_url":"/paper/victor-a-dataset-for-brazilian-legal","paper_date":"2020-05-01","arxiv_id":null,"code_links":[{"title":"peluz/VICTOR-dataset","url":"https://github.com/peluz/VICTOR-dataset"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-onestopenglish","slug":"text-classification-on-onestopenglish","dataset":"OneStopEnglish (Readability Assessment)","dataset_url":null,"rows_in_archive":5,"metrics":["Accuracy (5-fold)"],"first_row_in_archive_order":{"model":"RoBERTa-RF-T1 hybrid","paper_title":"Pushing on Text Readability Assessment: A Transformer Meets Handcrafted Linguistic Features","paper_url":"/paper/pushing-on-text-readability-assessment-a","paper_date":"2021-09-25","arxiv_id":"2109.12258","code_links":[{"title":"brucewlee/lingfeat","url":"https://github.com/brucewlee/lingfeat"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-svictor-type","slug":"text-classification-on-svictor-type","dataset":"SVICTOR (type)","dataset_url":null,"rows_in_archive":5,"metrics":["Average F1","Weighted F1"],"first_row_in_archive_order":{"model":"CNN + CRF","paper_title":"VICTOR: a Dataset for Brazilian Legal Documents Classification","paper_url":"/paper/victor-a-dataset-for-brazilian-legal","paper_date":"2020-05-01","arxiv_id":null,"code_links":[{"title":"peluz/VICTOR-dataset","url":"https://github.com/peluz/VICTOR-dataset"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-weebit-readability","slug":"text-classification-on-weebit-readability","dataset":"WeeBit (Readability Assessment)","dataset_url":null,"rows_in_archive":5,"metrics":["Accuracy (5-fold)"],"first_row_in_archive_order":{"model":"BERT-FP-LBL","paper_title":"A Unified Neural Network Model for Readability Assessment with Feature Projection and Length-Balanced Loss","paper_url":"/paper/a-unified-neural-network-model-for-1","paper_date":"2022-10-19","arxiv_id":"2210.10305","code_links":[{"title":"liwb1219/zhfeat","url":"https://github.com/liwb1219/zhfeat"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-yelp-2","slug":"text-classification-on-yelp-2","dataset":"Yelp-2","dataset_url":"/dataset/yelp","rows_in_archive":5,"metrics":["Accuracy"],"first_row_in_archive_order":{"model":"XLNet","paper_title":"XLNet: Generalized Autoregressive Pretraining for Language Understanding","paper_url":"/paper/xlnet-generalized-autoregressive-pretraining","paper_date":"2019-06-19","arxiv_id":"1906.08237","code_links":[{"title":"huggingface/transformers","url":"https://github.com/huggingface/transformers"},{"title":"PaddlePaddle/PaddleNLP","url":"https://github.com/PaddlePaddle/PaddleNLP/tree/develop/examples/language_model/xlnet"},{"title":"zihangdai/xlnet","url":"https://github.com/zihangdai/xlnet"},{"title":"kaushaltrivedi/fast-bert","url":"https://github.com/kaushaltrivedi/fast-bert"},{"title":"utterworks/fast-bert","url":"https://github.com/utterworks/fast-bert"},{"title":"graykode/xlnet-Pytorch","url":"https://github.com/graykode/xlnet-Pytorch"},{"title":"facebookresearch/anli","url":"https://github.com/facebookresearch/anli"},{"title":"lvyufeng/bert4ms","url":"https://github.com/lvyufeng/bert4ms/blob/master/bert4ms/models/xlnet.py"},{"title":"huggingface/xlnet","url":"https://github.com/huggingface/xlnet"},{"title":"cuhksz-nlp/SAPar","url":"https://github.com/cuhksz-nlp/SAPar"},{"title":"joshuaWang-bit/Textclassification-pytorch","url":"https://github.com/joshuaWang-bit/Textclassification-pytorch"},{"title":"fanchenyou/transformer-study","url":"https://github.com/fanchenyou/transformer-study"},{"title":"https-seyhan/BugAI","url":"https://github.com/https-seyhan/BugAI"},{"title":"NathanDuran/Sentence-Encoding-for-DA-Classification","url":"https://github.com/NathanDuran/Sentence-Encoding-for-DA-Classification"},{"title":"2miatran/Natural-Language-Processing","url":"https://github.com/2miatran/Natural-Language-Processing"},{"title":"chesterdu/contrastive_summary","url":"https://github.com/chesterdu/contrastive_summary"},{"title":"pauldevos/python-notes","url":"https://github.com/pauldevos/python-notes"},{"title":"pwc-1/Paper-9","url":"https://github.com/pwc-1/Paper-9/tree/main/5/xlnet"},{"title":"MindCode-4/code-5","url":"https://github.com/MindCode-4/code-5/tree/main/xlnet"},{"title":"pwc-1/Paper-9","url":"https://github.com/pwc-1/Paper-9/tree/main/1/xlnet"},{"title":"samwisegamjeee/pytorch-transformers","url":"https://github.com/samwisegamjeee/pytorch-transformers"},{"title":"SambhawDrag/XLNet.jl","url":"https://github.com/SambhawDrag/XLNet.jl"},{"title":"tomgoter/nlp_finalproject","url":"https://github.com/tomgoter/nlp_finalproject"},{"title":"MS-P3/code7","url":"https://github.com/MS-P3/code7/tree/main/xlnet"},{"title":"zaradana/Fast_BERT","url":"https://github.com/zaradana/Fast_BERT"},{"title":"jonahwinninghoff/Text-Summarization","url":"https://github.com/jonahwinninghoff/Text-Summarization"},{"title":"listenviolet/XLNet","url":"https://github.com/listenviolet/XLNet"}],"syntology":{"n":24,"n_ran":15,"n_constructed":2,"n_ran_checked":10,"n_instrument":5,"n_unverified":9,"n_honours":2,"n_violates":0,"n_no_contract":8,"n_pointer_only":4,"phrase":"15 ran (of which 2 constructed an object rather than computing a result; 10 with no instrument failure: 2 honoured, 0 violated, 8 with no contract checked; 5 where Syntology's instrument failed) · 9 unverified","sample_list":"/paper/xlnet-generalized-autoregressive-pretraining#ran","syntology_url":"https://syntology.ai/paper/1906.08237","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1906.08237"}},"official":{"repos":["zihangdai/xlnet"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":1,"ran_from_kinds":["listed","official"]}}}},{"leaderboard":"/sota/text-classification-on-amazon-2","slug":"text-classification-on-amazon-2","dataset":"Amazon-2","dataset_url":null,"rows_in_archive":4,"metrics":["Error"],"first_row_in_archive_order":{"model":"XLNet","paper_title":"XLNet: Generalized Autoregressive Pretraining for Language Understanding","paper_url":"/paper/xlnet-generalized-autoregressive-pretraining","paper_date":"2019-06-19","arxiv_id":"1906.08237","code_links":[{"title":"huggingface/transformers","url":"https://github.com/huggingface/transformers"},{"title":"PaddlePaddle/PaddleNLP","url":"https://github.com/PaddlePaddle/PaddleNLP/tree/develop/examples/language_model/xlnet"},{"title":"zihangdai/xlnet","url":"https://github.com/zihangdai/xlnet"},{"title":"kaushaltrivedi/fast-bert","url":"https://github.com/kaushaltrivedi/fast-bert"},{"title":"utterworks/fast-bert","url":"https://github.com/utterworks/fast-bert"},{"title":"graykode/xlnet-Pytorch","url":"https://github.com/graykode/xlnet-Pytorch"},{"title":"facebookresearch/anli","url":"https://github.com/facebookresearch/anli"},{"title":"lvyufeng/bert4ms","url":"https://github.com/lvyufeng/bert4ms/blob/master/bert4ms/models/xlnet.py"},{"title":"huggingface/xlnet","url":"https://github.com/huggingface/xlnet"},{"title":"cuhksz-nlp/SAPar","url":"https://github.com/cuhksz-nlp/SAPar"},{"title":"joshuaWang-bit/Textclassification-pytorch","url":"https://github.com/joshuaWang-bit/Textclassification-pytorch"},{"title":"fanchenyou/transformer-study","url":"https://github.com/fanchenyou/transformer-study"},{"title":"https-seyhan/BugAI","url":"https://github.com/https-seyhan/BugAI"},{"title":"NathanDuran/Sentence-Encoding-for-DA-Classification","url":"https://github.com/NathanDuran/Sentence-Encoding-for-DA-Classification"},{"title":"2miatran/Natural-Language-Processing","url":"https://github.com/2miatran/Natural-Language-Processing"},{"title":"chesterdu/contrastive_summary","url":"https://github.com/chesterdu/contrastive_summary"},{"title":"pauldevos/python-notes","url":"https://github.com/pauldevos/python-notes"},{"title":"pwc-1/Paper-9","url":"https://github.com/pwc-1/Paper-9/tree/main/5/xlnet"},{"title":"MindCode-4/code-5","url":"https://github.com/MindCode-4/code-5/tree/main/xlnet"},{"title":"pwc-1/Paper-9","url":"https://github.com/pwc-1/Paper-9/tree/main/1/xlnet"},{"title":"samwisegamjeee/pytorch-transformers","url":"https://github.com/samwisegamjeee/pytorch-transformers"},{"title":"SambhawDrag/XLNet.jl","url":"https://github.com/SambhawDrag/XLNet.jl"},{"title":"tomgoter/nlp_finalproject","url":"https://github.com/tomgoter/nlp_finalproject"},{"title":"MS-P3/code7","url":"https://github.com/MS-P3/code7/tree/main/xlnet"},{"title":"zaradana/Fast_BERT","url":"https://github.com/zaradana/Fast_BERT"},{"title":"jonahwinninghoff/Text-Summarization","url":"https://github.com/jonahwinninghoff/Text-Summarization"},{"title":"listenviolet/XLNet","url":"https://github.com/listenviolet/XLNet"}],"syntology":{"n":24,"n_ran":15,"n_constructed":2,"n_ran_checked":10,"n_instrument":5,"n_unverified":9,"n_honours":2,"n_violates":0,"n_no_contract":8,"n_pointer_only":4,"phrase":"15 ran (of which 2 constructed an object rather than computing a result; 10 with no instrument failure: 2 honoured, 0 violated, 8 with no contract checked; 5 where Syntology's instrument failed) · 9 unverified","sample_list":"/paper/xlnet-generalized-autoregressive-pretraining#ran","syntology_url":"https://syntology.ai/paper/1906.08237","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1906.08237"}},"official":{"repos":["zihangdai/xlnet"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":1,"ran_from_kinds":["listed","official"]}}}},{"leaderboard":"/sota/text-classification-on-arxiv-10","slug":"text-classification-on-arxiv-10","dataset":"arXiv-10","dataset_url":"/dataset/arxiv-10","rows_in_archive":4,"metrics":["Accuracy"],"first_row_in_archive_order":{"model":"Protoformer","paper_title":"Protoformer: Embedding Prototypes for Transformers","paper_url":"/paper/protoformer-embedding-prototypes-for-1","paper_date":"2022-06-25","arxiv_id":"2206.12710","code_links":[{"title":"codelion/adaptive-classifier","url":"https://github.com/codelion/adaptive-classifier/blob/main/src/adaptive_classifier/memory.py"},{"title":"ashfarhangi/Protoformer","url":"https://github.com/ashfarhangi/Protoformer"},{"title":"EthanCoder24/Protofomer-NLP","url":"https://github.com/EthanCoder24/Protofomer-NLP"},{"title":"GitF82/NLP-Embeddings-Protoformer-Paper","url":"https://github.com/GitF82/NLP-Embeddings-Protoformer-Paper"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-hatexplain-1","slug":"text-classification-on-hatexplain-1","dataset":"HateXplain","dataset_url":"/dataset/hatexplain","rows_in_archive":4,"metrics":["Accuracy (2 classes)","F1 Macro"],"first_row_in_archive_order":{"model":"Space-XLNet","paper_title":"Breaking Free Transformer Models: Task-specific Context Attribution Promises Improved Generalizability Without Fine-tuning Pre-trained LLMs","paper_url":"/paper/breaking-free-transformer-models-task","paper_date":"2024-01-30","arxiv_id":"2401.16638","code_links":[{"title":"stepantita/space-model","url":"https://github.com/stepantita/space-model"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-rcv1","slug":"text-classification-on-rcv1","dataset":"RCV1","dataset_url":"/dataset/rcv1","rows_in_archive":4,"metrics":["Accuracy","Macro F1","Micro F1","P@1","P@3","P@5","nDCG@1","nDCG@3","nDCG@5"],"first_row_in_archive_order":{"model":"oh-CNN + two LSTM tv-embed.","paper_title":"Supervised and Semi-Supervised Text Categorization using LSTM for Region Embeddings","paper_url":"/paper/supervised-and-semi-supervised-text","paper_date":"2016-02-07","arxiv_id":"1602.02373","code_links":[],"syntology":null}},{"leaderboard":"/sota/text-classification-on-threatgram-101-extreme","slug":"text-classification-on-threatgram-101-extreme","dataset":"ThreatGram 101 - Extreme Telegram Data","dataset_url":"/dataset/threatgram-101-extreme-telegram-data","rows_in_archive":4,"metrics":["weighted-F1 score"],"first_row_in_archive_order":{"model":"GPT-2","paper_title":"Exploring Multi-Level Threats in Telegram Data with AI-Human Annotation: A Preliminary Study","paper_url":"/paper/exploring-multi-level-threats-in-telegram","paper_date":"2023-12-15","arxiv_id":null,"code_links":[],"syntology":null}},{"leaderboard":"/sota/text-classification-on-amazon-5","slug":"text-classification-on-amazon-5","dataset":"Amazon-5","dataset_url":null,"rows_in_archive":3,"metrics":["Error"],"first_row_in_archive_order":{"model":"XLNet","paper_title":"XLNet: Generalized Autoregressive Pretraining for Language Understanding","paper_url":"/paper/xlnet-generalized-autoregressive-pretraining","paper_date":"2019-06-19","arxiv_id":"1906.08237","code_links":[{"title":"huggingface/transformers","url":"https://github.com/huggingface/transformers"},{"title":"PaddlePaddle/PaddleNLP","url":"https://github.com/PaddlePaddle/PaddleNLP/tree/develop/examples/language_model/xlnet"},{"title":"zihangdai/xlnet","url":"https://github.com/zihangdai/xlnet"},{"title":"kaushaltrivedi/fast-bert","url":"https://github.com/kaushaltrivedi/fast-bert"},{"title":"utterworks/fast-bert","url":"https://github.com/utterworks/fast-bert"},{"title":"graykode/xlnet-Pytorch","url":"https://github.com/graykode/xlnet-Pytorch"},{"title":"facebookresearch/anli","url":"https://github.com/facebookresearch/anli"},{"title":"lvyufeng/bert4ms","url":"https://github.com/lvyufeng/bert4ms/blob/master/bert4ms/models/xlnet.py"},{"title":"huggingface/xlnet","url":"https://github.com/huggingface/xlnet"},{"title":"cuhksz-nlp/SAPar","url":"https://github.com/cuhksz-nlp/SAPar"},{"title":"joshuaWang-bit/Textclassification-pytorch","url":"https://github.com/joshuaWang-bit/Textclassification-pytorch"},{"title":"fanchenyou/transformer-study","url":"https://github.com/fanchenyou/transformer-study"},{"title":"https-seyhan/BugAI","url":"https://github.com/https-seyhan/BugAI"},{"title":"NathanDuran/Sentence-Encoding-for-DA-Classification","url":"https://github.com/NathanDuran/Sentence-Encoding-for-DA-Classification"},{"title":"2miatran/Natural-Language-Processing","url":"https://github.com/2miatran/Natural-Language-Processing"},{"title":"chesterdu/contrastive_summary","url":"https://github.com/chesterdu/contrastive_summary"},{"title":"pauldevos/python-notes","url":"https://github.com/pauldevos/python-notes"},{"title":"pwc-1/Paper-9","url":"https://github.com/pwc-1/Paper-9/tree/main/5/xlnet"},{"title":"MindCode-4/code-5","url":"https://github.com/MindCode-4/code-5/tree/main/xlnet"},{"title":"pwc-1/Paper-9","url":"https://github.com/pwc-1/Paper-9/tree/main/1/xlnet"},{"title":"samwisegamjeee/pytorch-transformers","url":"https://github.com/samwisegamjeee/pytorch-transformers"},{"title":"SambhawDrag/XLNet.jl","url":"https://github.com/SambhawDrag/XLNet.jl"},{"title":"tomgoter/nlp_finalproject","url":"https://github.com/tomgoter/nlp_finalproject"},{"title":"MS-P3/code7","url":"https://github.com/MS-P3/code7/tree/main/xlnet"},{"title":"zaradana/Fast_BERT","url":"https://github.com/zaradana/Fast_BERT"},{"title":"jonahwinninghoff/Text-Summarization","url":"https://github.com/jonahwinninghoff/Text-Summarization"},{"title":"listenviolet/XLNet","url":"https://github.com/listenviolet/XLNet"}],"syntology":{"n":24,"n_ran":15,"n_constructed":2,"n_ran_checked":10,"n_instrument":5,"n_unverified":9,"n_honours":2,"n_violates":0,"n_no_contract":8,"n_pointer_only":4,"phrase":"15 ran (of which 2 constructed an object rather than computing a result; 10 with no instrument failure: 2 honoured, 0 violated, 8 with no contract checked; 5 where Syntology's instrument failed) · 9 unverified","sample_list":"/paper/xlnet-generalized-autoregressive-pretraining#ran","syntology_url":"https://syntology.ai/paper/1906.08237","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1906.08237"}},"official":{"repos":["zihangdai/xlnet"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":1,"ran_from_kinds":["listed","official"]}}}},{"leaderboard":"/sota/text-classification-on-bala-copa","slug":"text-classification-on-bala-copa","dataset":"Bala-Copa","dataset_url":"/dataset/bala-copa","rows_in_archive":3,"metrics":["Accuracy"],"first_row_in_archive_order":{"model":"Qwen2.5-32B + CAPO","paper_title":"CAPO: Cost-Aware Prompt Optimization","paper_url":"/paper/capo-cost-aware-prompt-optimization","paper_date":"2025-04-22","arxiv_id":"2504.16005","code_links":[{"title":"finitearth/promptolution","url":"https://github.com/finitearth/promptolution"},{"title":"finitearth/capo","url":"https://github.com/finitearth/capo"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-blurb","slug":"text-classification-on-blurb","dataset":"BLURB","dataset_url":"/dataset/blurb","rows_in_archive":3,"metrics":["F1"],"first_row_in_archive_order":{"model":"BioLinkBERT (large)","paper_title":"LinkBERT: Pretraining Language Models with Document Links","paper_url":"/paper/linkbert-pretraining-language-models-with","paper_date":"2022-03-29","arxiv_id":"2203.15827","code_links":[{"title":"michiyasunaga/LinkBERT","url":"https://github.com/michiyasunaga/LinkBERT"}],"syntology":{"n":14,"n_ran":3,"n_constructed":0,"n_ran_checked":3,"n_instrument":0,"n_unverified":11,"n_honours":0,"n_violates":0,"n_no_contract":3,"n_pointer_only":0,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 11 unverified","sample_list":"/paper/linkbert-pretraining-language-models-with#ran","syntology_url":"https://syntology.ai/paper/2203.15827","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2203.15827"}},"official":{"repos":["michiyasunaga/LinkBERT"],"state":"official: harvested, nothing ran","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":5,"ran_from_kinds":["found_in_text"]}}}},{"leaderboard":"/sota/text-classification-on-imdb-movie-reviews-1","slug":"text-classification-on-imdb-movie-reviews-1","dataset":"IMDb Movie Reviews","dataset_url":"/dataset/imdb-movie-reviews","rows_in_archive":3,"metrics":["AUC","Accuracy (2 classes)","F1 Macro"],"first_row_in_archive_order":{"model":"Logistic Regression","paper_title":"Anytime Active Learning","paper_url":"/paper/anytime-active-learning","paper_date":"2014-07-27","arxiv_id":null,"code_links":[{"title":"Bhavneet1492/Anytime-Active-Learning","url":"https://github.com/Bhavneet1492/Anytime-Active-Learning"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-overruling","slug":"text-classification-on-overruling","dataset":"Overruling","dataset_url":"/dataset/overruling","rows_in_archive":3,"metrics":["F1(10-fold)"],"first_row_in_archive_order":{"model":"Custom Legal-BERT","paper_title":"When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD Dataset","paper_url":"/paper/when-does-pretraining-help-assessing-self","paper_date":"2021-04-18","arxiv_id":"2104.08671","code_links":[{"title":"reglab/casehold","url":"https://github.com/reglab/casehold"},{"title":"trusthlt/privacy-legal-nlp-lm","url":"https://github.com/trusthlt/privacy-legal-nlp-lm"}],"syntology":{"n":9,"n_ran":6,"n_constructed":0,"n_ran_checked":6,"n_instrument":0,"n_unverified":3,"n_honours":0,"n_violates":0,"n_no_contract":6,"n_pointer_only":0,"phrase":"6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified","sample_list":"/paper/when-does-pretraining-help-assessing-self#ran","syntology_url":"https://syntology.ai/paper/2104.08671","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2104.08671"}},"official":{"repos":["reglab/casehold"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["listed","official"]}}}},{"leaderboard":"/sota/text-classification-on-sogou-news","slug":"text-classification-on-sogou-news","dataset":"Sogou News","dataset_url":null,"rows_in_archive":3,"metrics":["Accuracy"],"first_row_in_archive_order":{"model":"BERT-ITPT-FiT","paper_title":"How to Fine-Tune BERT for Text Classification?","paper_url":"/paper/how-to-fine-tune-bert-for-text-classification","paper_date":"2019-05-14","arxiv_id":"1905.05583","code_links":[{"title":"xuyige/BERT4doc-Classification","url":"https://github.com/xuyige/BERT4doc-Classification"},{"title":"ongunuzaymacar/comparatively-finetuning-bert","url":"https://github.com/ongunuzaymacar/comparatively-finetuning-bert"},{"title":"uzaymacar/comparatively-finetuning-bert","url":"https://github.com/uzaymacar/comparatively-finetuning-bert"},{"title":"helmy-elrais/RoBERT_Recurrence_over_BERT","url":"https://github.com/helmy-elrais/RoBERT_Recurrence_over_BERT"},{"title":"GeorgeLuImmortal/Hierarchical-BERT-Model-with-Limited-Labelled-Data","url":"https://github.com/GeorgeLuImmortal/Hierarchical-BERT-Model-with-Limited-Labelled-Data"},{"title":"heraclex12/VLSP2020-Fake-News-Detection","url":"https://github.com/heraclex12/VLSP2020-Fake-News-Detection"},{"title":"bcaitech1/p4-dkt-no_caffeine_no_gain","url":"https://github.com/bcaitech1/p4-dkt-no_caffeine_no_gain"},{"title":"soarsmu/BiasFinder","url":"https://github.com/soarsmu/BiasFinder"},{"title":"qinhanmin2014/fine-tune-bert-for-text-classification","url":"https://github.com/qinhanmin2014/fine-tune-bert-for-text-classification"},{"title":"Domminique/Deploy-BERT-for-Sentiment-Analysis-with-FastAPI-","url":"https://github.com/Domminique/Deploy-BERT-for-Sentiment-Analysis-with-FastAPI-"},{"title":"Derposoft/ai-educator","url":"https://github.com/Derposoft/ai-educator"},{"title":"arctic-yen/Google_QUEST_Q-A_Labeling","url":"https://github.com/arctic-yen/Google_QUEST_Q-A_Labeling"},{"title":"sahil00199/KYC","url":"https://github.com/sahil00199/KYC"},{"title":"jyp1111/sentiment_analysis","url":"https://github.com/jyp1111/sentiment_analysis"},{"title":"saproovarun/Google-Quest-Q-A","url":"https://github.com/saproovarun/Google-Quest-Q-A"}],"syntology":{"n":18,"n_ran":12,"n_constructed":0,"n_ran_checked":7,"n_instrument":5,"n_unverified":6,"n_honours":1,"n_violates":0,"n_no_contract":6,"n_pointer_only":5,"phrase":"12 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 0 violated, 6 with no contract checked; 5 where Syntology's instrument failed) · 6 unverified","sample_list":"/paper/how-to-fine-tune-bert-for-text-classification#ran","syntology_url":"https://syntology.ai/paper/1905.05583","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1905.05583"}},"official":{"repos":["xuyige/BERT4doc-Classification"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["listed","official"]}}}},{"leaderboard":"/sota/text-classification-on-terms-of-service","slug":"text-classification-on-terms-of-service","dataset":"Terms of Service","dataset_url":"/dataset/terms-of-service","rows_in_archive":3,"metrics":["F1(10-fold)"],"first_row_in_archive_order":{"model":"Custom Legal-BERT","paper_title":"When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD Dataset","paper_url":"/paper/when-does-pretraining-help-assessing-self","paper_date":"2021-04-18","arxiv_id":"2104.08671","code_links":[{"title":"reglab/casehold","url":"https://github.com/reglab/casehold"},{"title":"trusthlt/privacy-legal-nlp-lm","url":"https://github.com/trusthlt/privacy-legal-nlp-lm"}],"syntology":{"n":9,"n_ran":6,"n_constructed":0,"n_ran_checked":6,"n_instrument":0,"n_unverified":3,"n_honours":0,"n_violates":0,"n_no_contract":6,"n_pointer_only":0,"phrase":"6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified","sample_list":"/paper/when-does-pretraining-help-assessing-self#ran","syntology_url":"https://syntology.ai/paper/2104.08671","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2104.08671"}},"official":{"repos":["reglab/casehold"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["listed","official"]}}}},{"leaderboard":"/sota/text-classification-on-twitter","slug":"text-classification-on-twitter","dataset":"Twitter","dataset_url":null,"rows_in_archive":3,"metrics":["Accuracy"],"first_row_in_archive_order":{"model":"ERNIE 2.0","paper_title":"Transformers are Short Text Classifiers: A Study of Inductive Short Text Classifiers on Benchmarks and Real-world Datasets","paper_url":"/paper/transformers-are-short-text-classifiers-a","paper_date":"2022-11-30","arxiv_id":"2211.16878","code_links":[{"title":"FKarl/short-text-classification","url":"https://github.com/FKarl/short-text-classification"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-an-amharic-news-text","slug":"text-classification-on-an-amharic-news-text","dataset":"An Amharic News Text classification Dataset","dataset_url":"/dataset/an-amharic-news-text-classification-dataset","rows_in_archive":2,"metrics":["Accuracy"],"first_row_in_archive_order":{"model":"Naive Bayes using Tf-idf features","paper_title":"An Amharic News Text classification Dataset","paper_url":"/paper/an-amharic-news-text-classification-dataset","paper_date":"2021-03-10","arxiv_id":"2103.05639","code_links":[{"title":"IsraelAbebe/An-Amharic-News-Text-classification-Dataset","url":"https://github.com/IsraelAbebe/An-Amharic-News-Text-classification-Dataset"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-glue-sst2","slug":"text-classification-on-glue-sst2","dataset":"GLUE SST2","dataset_url":"/dataset/glue","rows_in_archive":2,"metrics":["Accuracy"],"first_row_in_archive_order":{"model":"TRANS-BLSTM","paper_title":"TRANS-BLSTM: Transformer with Bidirectional LSTM for Language Understanding","paper_url":"/paper/trans-blstm-transformer-with-bidirectional","paper_date":"2020-03-16","arxiv_id":"2003.07000","code_links":[],"syntology":null}},{"leaderboard":"/sota/text-classification-on-muld-character-type","slug":"text-classification-on-muld-character-type","dataset":"MuLD (Character Type)","dataset_url":"/dataset/muld","rows_in_archive":2,"metrics":["F1"],"first_row_in_archive_order":{"model":"Longformer","paper_title":"MuLD: The Multitask Long Document Benchmark","paper_url":"/paper/muld-the-multitask-long-document-benchmark","paper_date":"2022-02-15","arxiv_id":"2202.07362","code_links":[{"title":"ghomashudson/muld","url":"https://github.com/ghomashudson/muld"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-searchsnippets","slug":"text-classification-on-searchsnippets","dataset":"Searchsnippets","dataset_url":null,"rows_in_archive":2,"metrics":["Accuracy"],"first_row_in_archive_order":{"model":"DistilBERT","paper_title":"Transformers are Short Text Classifiers: A Study of Inductive Short Text Classifiers on Benchmarks and Real-world Datasets","paper_url":"/paper/transformers-are-short-text-classifiers-a","paper_date":"2022-11-30","arxiv_id":"2211.16878","code_links":[{"title":"FKarl/short-text-classification","url":"https://github.com/FKarl/short-text-classification"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-social-media","slug":"text-classification-on-social-media","dataset":"Social media attributions of YouTube comments","dataset_url":"/dataset/social-media-attributions-of-youtube-comments","rows_in_archive":2,"metrics":["Accuracy (2 classes)","F1 Macro"],"first_row_in_archive_order":{"model":"Space-BERT","paper_title":"Breaking Free Transformer Models: Task-specific Context Attribution Promises Improved Generalizability Without Fine-tuning Pre-trained LLMs","paper_url":"/paper/breaking-free-transformer-models-task","paper_date":"2024-01-30","arxiv_id":"2401.16638","code_links":[{"title":"stepantita/space-model","url":"https://github.com/stepantita/space-model"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-sst-2","slug":"text-classification-on-sst-2","dataset":"SST-2","dataset_url":"/dataset/sst-2","rows_in_archive":2,"metrics":["Accuracy"],"first_row_in_archive_order":{"model":"DeBERTa","paper_title":"Transformers are Short Text Classifiers: A Study of Inductive Short Text Classifiers on Benchmarks and Real-world Datasets","paper_url":"/paper/transformers-are-short-text-classifiers-a","paper_date":"2022-11-30","arxiv_id":"2211.16878","code_links":[{"title":"FKarl/short-text-classification","url":"https://github.com/FKarl/short-text-classification"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-this-is-not-a-dataset","slug":"text-classification-on-this-is-not-a-dataset","dataset":"This is not a Dataset","dataset_url":"/dataset/this-is-not-a-dataset","rows_in_archive":2,"metrics":["Accuracy","Coherence"],"first_row_in_archive_order":{"model":"Vicuna13B v1.1","paper_title":"This is not a Dataset: A Large Negation Benchmark to Challenge Large Language Models","paper_url":"/paper/this-is-not-a-dataset-a-large-negation","paper_date":"2023-10-24","arxiv_id":"2310.15941","code_links":[{"title":"hitz-zentroa/this-is-not-a-dataset","url":"https://github.com/hitz-zentroa/this-is-not-a-dataset"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-trec-50","slug":"text-classification-on-trec-50","dataset":"TREC-50","dataset_url":null,"rows_in_archive":2,"metrics":["Error"],"first_row_in_archive_order":{"model":"Rules","paper_title":"High Accuracy Rule-based Question Classification using Question Syntax and Semantics","paper_url":"/paper/high-accuracy-rule-based-question","paper_date":"2016-12-01","arxiv_id":null,"code_links":[],"syntology":null}},{"leaderboard":"/sota/text-classification-on-20-newsgroups","slug":"text-classification-on-20-newsgroups","dataset":"20 Newsgroups","dataset_url":"/dataset/20-newsgroups","rows_in_archive":1,"metrics":["Accuracy"],"first_row_in_archive_order":{"model":"RoBERTaGCN","paper_title":"BertGCN: Transductive Text Classification by Combining GCN and BERT","paper_url":"/paper/bertgcn-transductive-text-classification-by","paper_date":"2021-05-12","arxiv_id":"2105.05727","code_links":[{"title":"ZeroRin/BertGCN","url":"https://github.com/ZeroRin/BertGCN"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-adverse-drug-events","slug":"text-classification-on-adverse-drug-events","dataset":"Adverse Drug Events (ADE) Corpus","dataset_url":"/dataset/ade-corpus","rows_in_archive":1,"metrics":["F1 - macro"],"first_row_in_archive_order":{"model":"Spark NLP","paper_title":"Mining Adverse Drug Reactions from Unstructured Mediums at Scale","paper_url":"/paper/mining-adverse-drug-reactions-from","paper_date":"2022-01-05","arxiv_id":"2201.01405","code_links":[],"syntology":null}},{"leaderboard":"/sota/text-classification-on-affcon-2020-emotion","slug":"text-classification-on-affcon-2020-emotion","dataset":"AffCon 2020 Emotion Detection","dataset_url":null,"rows_in_archive":1,"metrics":["F1 score"],"first_row_in_archive_order":{"model":"BERT-based Ensembles","paper_title":"BERT-based Ensembles for Modeling Disclosure and Support in Conversational Social Media Text","paper_url":"/paper/bert-based-ensembles-for-modeling-disclosure","paper_date":"2020-06-01","arxiv_id":"2006.01222","code_links":[],"syntology":null}},{"leaderboard":"/sota/text-classification-on-arxiv","slug":"text-classification-on-arxiv","dataset":"Arxiv HEP-TH citation graph","dataset_url":"/dataset/arxiv","rows_in_archive":1,"metrics":["Accuracy"],"first_row_in_archive_order":{"model":"BigBird","paper_title":"Big Bird: Transformers for Longer Sequences","paper_url":"/paper/big-bird-transformers-for-longer-sequences","paper_date":"2020-07-28","arxiv_id":"2007.14062","code_links":[{"title":"huggingface/transformers","url":"https://github.com/huggingface/transformers"},{"title":"tensorflow/models","url":"https://github.com/tensorflow/models/tree/master/official/nlp/projects/bigbird"},{"title":"PaddlePaddle/PaddleNLP","url":"https://github.com/PaddlePaddle/PaddleNLP/tree/develop/paddlenlp/transformers/bigbird"},{"title":"facebookresearch/xformers","url":"https://github.com/facebookresearch/xformers"},{"title":"google-research/bigbird","url":"https://github.com/google-research/bigbird"},{"title":"monologg/kobigbird","url":"https://github.com/monologg/kobigbird"},{"title":"mim-solutions/bert_for_longer_texts","url":"https://github.com/mim-solutions/bert_for_longer_texts"},{"title":"mim-solutions/roberta_for_longer_texts","url":"https://github.com/mim-solutions/roberta_for_longer_texts"},{"title":"sajjjadayobi/ParsBigBird","url":"https://github.com/sajjjadayobi/ParsBigBird"},{"title":"thefonseca/factorsum","url":"https://github.com/thefonseca/factorsum"},{"title":"2024-MindSpore-1/Code2","url":"https://github.com/2024-MindSpore-1/Code2/tree/main/model-1/big_bird"},{"title":"sergeykramp/mthesis-bigbird-embeddings","url":"https://github.com/sergeykramp/mthesis-bigbird-embeddings"},{"title":"pwc-1/Paper-8","url":"https://github.com/pwc-1/Paper-8/tree/main/big_bird"},{"title":"pwc-1/Paper-8","url":"https://github.com/pwc-1/Paper-8/tree/main/bigbird_pegasus"}],"syntology":{"n":15,"n_ran":10,"n_constructed":1,"n_ran_checked":2,"n_instrument":8,"n_unverified":5,"n_honours":1,"n_violates":0,"n_no_contract":1,"n_pointer_only":11,"phrase":"10 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 8 where Syntology's instrument failed) · 5 unverified","sample_list":"/paper/big-bird-transformers-for-longer-sequences#ran","syntology_url":"https://syntology.ai/paper/2007.14062","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2007.14062"}},"official":{"repos":["google-research/bigbird"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":1,"ran_from_kinds":["listed","official"]}}}},{"leaderboard":"/sota/text-classification-on-banking77","slug":"text-classification-on-banking77","dataset":"BANKING77","dataset_url":"/dataset/banking77","rows_in_archive":1,"metrics":["Accuracy"],"first_row_in_archive_order":{"model":"RoBERTa-Large + ICDA","paper_title":"Selective In-Context Data Augmentation for Intent Detection using Pointwise V-Information","paper_url":"/paper/selective-in-context-data-augmentation-for","paper_date":"2023-02-10","arxiv_id":"2302.05096","code_links":[],"syntology":null}},{"leaderboard":"/sota/text-classification-on-facebook-media","slug":"text-classification-on-facebook-media","dataset":"Facebook Media","dataset_url":null,"rows_in_archive":1,"metrics":["F1 (Hidden Test Set)"],"first_row_in_archive_order":{"model":"Our proposed method Model Averaging(D + E + F)","paper_title":"A Unified System for Aggression Identification in English Code-Mixed and Uni-Lingual Texts","paper_url":"/paper/aggressionnet-generalised-multi-modal-deep","paper_date":"2020-01-15","arxiv_id":"2001.05493","code_links":[],"syntology":null}},{"leaderboard":"/sota/text-classification-on-fmc-mwo2kg-1","slug":"text-classification-on-fmc-mwo2kg-1","dataset":"FMC-MWO2KG","dataset_url":"/dataset/fmc-mwo2kg","rows_in_archive":1,"metrics":["Macro F1","Micro F1"],"first_row_in_archive_order":{"model":"Flair","paper_title":"MWO2KG and Echidna: Constructing and exploring knowledge graphs from maintenance data","paper_url":"/paper/mwo2kg-and-echidna-constructing-and-exploring","paper_date":"2022-11-05","arxiv_id":null,"code_links":[{"title":"nlp-tlp/mwo2kg-and-echidna","url":"https://github.com/nlp-tlp/mwo2kg-and-echidna"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-glue-cola","slug":"text-classification-on-glue-cola","dataset":"GLUE COLA","dataset_url":"/dataset/glue","rows_in_archive":1,"metrics":["Matthews Correlation"],"first_row_in_archive_order":{"model":"TRANS-BLSTM","paper_title":"TRANS-BLSTM: Transformer with Bidirectional LSTM for Language Understanding","paper_url":"/paper/trans-blstm-transformer-with-bidirectional","paper_date":"2020-03-16","arxiv_id":"2003.07000","code_links":[],"syntology":null}},{"leaderboard":"/sota/text-classification-on-glue-mrpc","slug":"text-classification-on-glue-mrpc","dataset":"GLUE MRPC","dataset_url":"/dataset/glue","rows_in_archive":1,"metrics":["Accuracy","F1"],"first_row_in_archive_order":{"model":"TRANS-BLSTM","paper_title":"TRANS-BLSTM: Transformer with Bidirectional LSTM for Language Understanding","paper_url":"/paper/trans-blstm-transformer-with-bidirectional","paper_date":"2020-03-16","arxiv_id":"2003.07000","code_links":[],"syntology":null}},{"leaderboard":"/sota/text-classification-on-glue-rte","slug":"text-classification-on-glue-rte","dataset":"GLUE RTE","dataset_url":"/dataset/glue","rows_in_archive":1,"metrics":["Accuracy"],"first_row_in_archive_order":{"model":"TRANS-BLSTM","paper_title":"TRANS-BLSTM: Transformer with Bidirectional LSTM for Language Understanding","paper_url":"/paper/trans-blstm-transformer-with-bidirectional","paper_date":"2020-03-16","arxiv_id":"2003.07000","code_links":[],"syntology":null}},{"leaderboard":"/sota/text-classification-on-glue-stsb","slug":"text-classification-on-glue-stsb","dataset":"GLUE STSB","dataset_url":"/dataset/glue","rows_in_archive":1,"metrics":["Spearmanr"],"first_row_in_archive_order":{"model":"TRANS-BLSTM","paper_title":"TRANS-BLSTM: Transformer with Bidirectional LSTM for Language Understanding","paper_url":"/paper/trans-blstm-transformer-with-bidirectional","paper_date":"2020-03-16","arxiv_id":"2003.07000","code_links":[],"syntology":null}},{"leaderboard":"/sota/text-classification-on-hyperpartisan-1","slug":"text-classification-on-hyperpartisan-1","dataset":"Hyperpartisan","dataset_url":null,"rows_in_archive":1,"metrics":["Accuracy"],"first_row_in_archive_order":{"model":"BigBird","paper_title":"Big Bird: Transformers for Longer Sequences","paper_url":"/paper/big-bird-transformers-for-longer-sequences","paper_date":"2020-07-28","arxiv_id":"2007.14062","code_links":[{"title":"huggingface/transformers","url":"https://github.com/huggingface/transformers"},{"title":"tensorflow/models","url":"https://github.com/tensorflow/models/tree/master/official/nlp/projects/bigbird"},{"title":"PaddlePaddle/PaddleNLP","url":"https://github.com/PaddlePaddle/PaddleNLP/tree/develop/paddlenlp/transformers/bigbird"},{"title":"facebookresearch/xformers","url":"https://github.com/facebookresearch/xformers"},{"title":"google-research/bigbird","url":"https://github.com/google-research/bigbird"},{"title":"monologg/kobigbird","url":"https://github.com/monologg/kobigbird"},{"title":"mim-solutions/bert_for_longer_texts","url":"https://github.com/mim-solutions/bert_for_longer_texts"},{"title":"mim-solutions/roberta_for_longer_texts","url":"https://github.com/mim-solutions/roberta_for_longer_texts"},{"title":"sajjjadayobi/ParsBigBird","url":"https://github.com/sajjjadayobi/ParsBigBird"},{"title":"thefonseca/factorsum","url":"https://github.com/thefonseca/factorsum"},{"title":"2024-MindSpore-1/Code2","url":"https://github.com/2024-MindSpore-1/Code2/tree/main/model-1/big_bird"},{"title":"sergeykramp/mthesis-bigbird-embeddings","url":"https://github.com/sergeykramp/mthesis-bigbird-embeddings"},{"title":"pwc-1/Paper-8","url":"https://github.com/pwc-1/Paper-8/tree/main/big_bird"},{"title":"pwc-1/Paper-8","url":"https://github.com/pwc-1/Paper-8/tree/main/bigbird_pegasus"}],"syntology":{"n":15,"n_ran":10,"n_constructed":1,"n_ran_checked":2,"n_instrument":8,"n_unverified":5,"n_honours":1,"n_violates":0,"n_no_contract":1,"n_pointer_only":11,"phrase":"10 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 8 where Syntology's instrument failed) · 5 unverified","sample_list":"/paper/big-bird-transformers-for-longer-sequences#ran","syntology_url":"https://syntology.ai/paper/2007.14062","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2007.14062"}},"official":{"repos":["google-research/bigbird"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":1,"ran_from_kinds":["listed","official"]}}}},{"leaderboard":"/sota/text-classification-on-nice-2","slug":"text-classification-on-nice-2","dataset":"NICE-2","dataset_url":null,"rows_in_archive":1,"metrics":["Accuracy"],"first_row_in_archive_order":{"model":"RoBERTa","paper_title":"Transformers are Short Text Classifiers: A Study of Inductive Short Text Classifiers on Benchmarks and Real-world Datasets","paper_url":"/paper/transformers-are-short-text-classifiers-a","paper_date":"2022-11-30","arxiv_id":"2211.16878","code_links":[{"title":"FKarl/short-text-classification","url":"https://github.com/FKarl/short-text-classification"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-nice-45","slug":"text-classification-on-nice-45","dataset":"NICE-45","dataset_url":null,"rows_in_archive":1,"metrics":["Accuracy"],"first_row_in_archive_order":{"model":"BERT","paper_title":"Transformers are Short Text Classifiers: A Study of Inductive Short Text Classifiers on Benchmarks and Real-world Datasets","paper_url":"/paper/transformers-are-short-text-classifiers-a","paper_date":"2022-11-30","arxiv_id":"2211.16878","code_links":[{"title":"FKarl/short-text-classification","url":"https://github.com/FKarl/short-text-classification"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-patents","slug":"text-classification-on-patents","dataset":"Patents","dataset_url":null,"rows_in_archive":1,"metrics":["Accuracy"],"first_row_in_archive_order":{"model":"BigBird","paper_title":"Big Bird: Transformers for Longer Sequences","paper_url":"/paper/big-bird-transformers-for-longer-sequences","paper_date":"2020-07-28","arxiv_id":"2007.14062","code_links":[{"title":"huggingface/transformers","url":"https://github.com/huggingface/transformers"},{"title":"tensorflow/models","url":"https://github.com/tensorflow/models/tree/master/official/nlp/projects/bigbird"},{"title":"PaddlePaddle/PaddleNLP","url":"https://github.com/PaddlePaddle/PaddleNLP/tree/develop/paddlenlp/transformers/bigbird"},{"title":"facebookresearch/xformers","url":"https://github.com/facebookresearch/xformers"},{"title":"google-research/bigbird","url":"https://github.com/google-research/bigbird"},{"title":"monologg/kobigbird","url":"https://github.com/monologg/kobigbird"},{"title":"mim-solutions/bert_for_longer_texts","url":"https://github.com/mim-solutions/bert_for_longer_texts"},{"title":"mim-solutions/roberta_for_longer_texts","url":"https://github.com/mim-solutions/roberta_for_longer_texts"},{"title":"sajjjadayobi/ParsBigBird","url":"https://github.com/sajjjadayobi/ParsBigBird"},{"title":"thefonseca/factorsum","url":"https://github.com/thefonseca/factorsum"},{"title":"2024-MindSpore-1/Code2","url":"https://github.com/2024-MindSpore-1/Code2/tree/main/model-1/big_bird"},{"title":"sergeykramp/mthesis-bigbird-embeddings","url":"https://github.com/sergeykramp/mthesis-bigbird-embeddings"},{"title":"pwc-1/Paper-8","url":"https://github.com/pwc-1/Paper-8/tree/main/big_bird"},{"title":"pwc-1/Paper-8","url":"https://github.com/pwc-1/Paper-8/tree/main/bigbird_pegasus"}],"syntology":{"n":15,"n_ran":10,"n_constructed":1,"n_ran_checked":2,"n_instrument":8,"n_unverified":5,"n_honours":1,"n_violates":0,"n_no_contract":1,"n_pointer_only":11,"phrase":"10 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 8 where Syntology's instrument failed) · 5 unverified","sample_list":"/paper/big-bird-transformers-for-longer-sequences#ran","syntology_url":"https://syntology.ai/paper/2007.14062","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2007.14062"}},"official":{"repos":["google-research/bigbird"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":1,"ran_from_kinds":["listed","official"]}}}},{"leaderboard":"/sota/text-classification-on-rusage-corpus-for-age","slug":"text-classification-on-rusage-corpus-for-age","dataset":"RusAge: Corpus for Age-Based Text Classification","dataset_url":null,"rows_in_archive":1,"metrics":["F1"],"first_row_in_archive_order":{"model":"LSVC + linguistic features + publishing attributes","paper_title":"A Comparative Study of Feature Types for Age-Based Text Classification","paper_url":"/paper/a-comparative-study-of-feature-types-for-age","paper_date":"2020-09-24","arxiv_id":"2009.11898","code_links":[{"title":"oldaandozerskaya/age_based_classification","url":"https://github.com/oldaandozerskaya/age_based_classification"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-silicone-benchmark","slug":"text-classification-on-silicone-benchmark","dataset":"SILICONE Benchmark","dataset_url":"/dataset/silicone-benchmark","rows_in_archive":1,"metrics":["1:1 Accuracy"],"first_row_in_archive_order":{"model":"Pretrained Hierarchical Transformer","paper_title":"Hierarchical Pre-training for Sequence Labelling in Spoken Dialog","paper_url":"/paper/hierarchical-pre-training-for-sequence","paper_date":"2020-09-23","arxiv_id":"2009.11152","code_links":[],"syntology":null}},{"leaderboard":"/sota/text-classification-on-stops-2","slug":"text-classification-on-stops-2","dataset":"STOPS-2","dataset_url":null,"rows_in_archive":1,"metrics":["STOPS-2"],"first_row_in_archive_order":{"model":"ERNIE 2.0","paper_title":"Transformers are Short Text Classifiers: A Study of Inductive Short Text Classifiers on Benchmarks and Real-world Datasets","paper_url":"/paper/transformers-are-short-text-classifiers-a","paper_date":"2022-11-30","arxiv_id":"2211.16878","code_links":[{"title":"FKarl/short-text-classification","url":"https://github.com/FKarl/short-text-classification"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-stops-41","slug":"text-classification-on-stops-41","dataset":"STOPS-41","dataset_url":null,"rows_in_archive":1,"metrics":["Accuracy"],"first_row_in_archive_order":{"model":"DeBERTa","paper_title":"Transformers are Short Text Classifiers: A Study of Inductive Short Text Classifiers on Benchmarks and Real-world Datasets","paper_url":"/paper/transformers-are-short-text-classifiers-a","paper_date":"2022-11-30","arxiv_id":"2211.16878","code_links":[{"title":"FKarl/short-text-classification","url":"https://github.com/FKarl/short-text-classification"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-trac2-benghali-task-2","slug":"text-classification-on-trac2-benghali-task-2","dataset":"TRAC2-Benghali. Task 2.","dataset_url":null,"rows_in_archive":1,"metrics":["F1"],"first_row_in_archive_order":{"model":"BERT","paper_title":"BERT of all trades, master of some","paper_url":"/paper/bert-of-all-trades-master-of-some","paper_date":"2020-05-01","arxiv_id":null,"code_links":[{"title":"InstituteForIndustrialEconomics/trac2","url":"https://github.com/InstituteForIndustrialEconomics/trac2"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-trac2-english-task2","slug":"text-classification-on-trac2-english-task2","dataset":"TRAC2-English. Task2.","dataset_url":null,"rows_in_archive":1,"metrics":["F1"],"first_row_in_archive_order":{"model":"BERT","paper_title":"BERT of all trades, master of some","paper_url":"/paper/bert-of-all-trades-master-of-some","paper_date":"2020-05-01","arxiv_id":null,"code_links":[{"title":"InstituteForIndustrialEconomics/trac2","url":"https://github.com/InstituteForIndustrialEconomics/trac2"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-trec-10","slug":"text-classification-on-trec-10","dataset":"TREC-10","dataset_url":"/dataset/trec-10","rows_in_archive":1,"metrics":["Accuracy"],"first_row_in_archive_order":{"model":"BERT","paper_title":"Transformers are Short Text Classifiers: A Study of Inductive Short Text Classifiers on Benchmarks and Real-world Datasets","paper_url":"/paper/transformers-are-short-text-classifiers-a","paper_date":"2022-11-30","arxiv_id":"2211.16878","code_links":[{"title":"FKarl/short-text-classification","url":"https://github.com/FKarl/short-text-classification"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-twitter-sentiment-1","slug":"text-classification-on-twitter-sentiment-1","dataset":"Twitter Sentiment Analysis","dataset_url":"/dataset/twitter-sentiment-analysis","rows_in_archive":1,"metrics":["AUC"],"first_row_in_archive_order":{"model":"Logistic Regression","paper_title":"Anytime Active Learning","paper_url":"/paper/anytime-active-learning","paper_date":"2014-07-27","arxiv_id":null,"code_links":[{"title":"Bhavneet1492/Anytime-Active-Learning","url":"https://github.com/Bhavneet1492/Anytime-Active-Learning"}],"syntology":null}},{"leaderboard":"/sota/text-classification-on-twitter-us","slug":"text-classification-on-twitter-us","dataset":"Twitter-US","dataset_url":null,"rows_in_archive":1,"metrics":["F1 (Hidden Test Set)"],"first_row_in_archive_order":{"model":"Our proposed method Model Averaging(D + E + F)","paper_title":"A Unified System for Aggression Identification in English Code-Mixed and Uni-Lingual Texts","paper_url":"/paper/aggressionnet-generalised-multi-modal-deep","paper_date":"2020-01-15","arxiv_id":"2001.05493","code_links":[],"syntology":null}},{"leaderboard":"/sota/text-classification-on-wnut-2020-task-2","slug":"text-classification-on-wnut-2020-task-2","dataset":"WNUT-2020 Task 2","dataset_url":"/dataset/wnut-2020-task-2","rows_in_archive":1,"metrics":["F1"],"first_row_in_archive_order":{"model":"NutCracker","paper_title":"NutCracker at WNUT-2020 Task 2: Robustly Identifying Informative COVID-19 Tweets using Ensembling and Adversarial Training","paper_url":"/paper/nutcracker-at-wnut-2020-task-2-robustly","paper_date":"2020-10-09","arxiv_id":"2010.04335","code_links":[{"title":"kpriyanshu256/WNUT-2020-Task-2","url":"https://github.com/kpriyanshu256/WNUT-2020-Task-2"}],"syntology":null}},{"leaderboard":null,"slug":"text-classification-on-ade-corpus-v2ade","dataset":"ade_corpus_v2Ade_corpus_v2_classification","dataset_url":null,"rows_in_archive":0,"metrics":["Validation Accuracy","Validation F1"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-classification-on-ag-news-1","dataset":"ag_news","dataset_url":"/dataset/ag-news","rows_in_archive":0,"metrics":["Accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-classification-on-amazon-polarity","dataset":"amazon_polarity","dataset_url":null,"rows_in_archive":0,"metrics":["AUC","Accuracy","F1","Precision","Recall","loss"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-classification-on-amazon-reviews-multi","dataset":"amazon_reviews_multi","dataset_url":null,"rows_in_archive":0,"metrics":["Accuracy","F1"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-classification-on-boolq","dataset":"BoolQ","dataset_url":"/dataset/boolq","rows_in_archive":0,"metrics":["Accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-classification-on-catalonia-independence","dataset":"catalonia_independence","dataset_url":"/dataset/cic","rows_in_archive":0,"metrics":["Accuracy","F1 Macro","F1 Micro","F1 Weighted","Precision Macro","Precision Micro","Precision Weighted","Recall Macro","Recall Micro","Recall Weighted","loss"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-classification-on-clinc-oos","dataset":"clinc_oos","dataset_url":"/dataset/clinc150","rows_in_archive":0,"metrics":["Accuracy","F1 Macro","F1 Micro","F1 Weighted","Precision Macro","Precision Micro","Precision Weighted","Recall Macro","Recall Micro","Recall Weighted","loss"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-classification-on-common-language","dataset":"common_language","dataset_url":null,"rows_in_archive":0,"metrics":["Accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-classification-on-dbpedia-14","dataset":"dbpedia_14","dataset_url":"/dataset/dbpedia","rows_in_archive":0,"metrics":["Accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-classification-on-emotion","dataset":"emotion","dataset_url":"/dataset/emotion","rows_in_archive":0,"metrics":["Accuracy","F1","F1 Macro","F1 Micro","F1 Weighted","Precision Macro","Precision Micro","Precision Weighted","Recall Macro","Recall Micro","Recall Weighted","loss"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-classification-on-financial-phrasebank","dataset":"financial_phrasebank","dataset_url":null,"rows_in_archive":0,"metrics":["Accuracy","Precision","Recall"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-classification-on-glue","dataset":"GLUE","dataset_url":"/dataset/glue","rows_in_archive":0,"metrics":["AUC","Accuracy","F1","Matthews Correlation","Precision","Recall","loss"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-classification-on-glue-mnli","dataset":"GLUE MNLI","dataset_url":"/dataset/glue","rows_in_archive":0,"metrics":["Accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-classification-on-glue-qnli","dataset":"GLUE QNLI","dataset_url":"/dataset/glue","rows_in_archive":0,"metrics":["Accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-classification-on-glue-qqp","dataset":"GLUE QQP","dataset_url":"/dataset/glue","rows_in_archive":0,"metrics":["Accuracy","F1"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-classification-on-glue-wnli","dataset":"GLUE WNLI","dataset_url":"/dataset/glue","rows_in_archive":0,"metrics":["Accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-classification-on-hate-speech18","dataset":"hate_speech18","dataset_url":"/dataset/hate-speech","rows_in_archive":0,"metrics":["Accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-classification-on-indonlu","dataset":"indonlu","dataset_url":"/dataset/indonlu-benchmark","rows_in_archive":0,"metrics":["Accuracy","F1","Precision","Recall"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-classification-on-klue","dataset":"KLUE","dataset_url":"/dataset/klue","rows_in_archive":0,"metrics":["Accuracy","F1","Pearsonr"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-classification-on-lenu","dataset":"lenu","dataset_url":null,"rows_in_archive":0,"metrics":["f1","f1 macro"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-classification-on-nsfw-safe-dataset","dataset":"NSFW-Safe-Dataset","dataset_url":null,"rows_in_archive":0,"metrics":["Accuracy","F1"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-classification-on-reuters21578","dataset":"reuters21578","dataset_url":"/dataset/reuters-21578","rows_in_archive":0,"metrics":["Accuracy","F1"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-classification-on-sai1908-mental-health","dataset":"sai1908/Mental_Health_Condition_Classification","dataset_url":null,"rows_in_archive":0,"metrics":["Accuracy","Validation Loss"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-classification-on-sst2","dataset":"SST2","dataset_url":"/dataset/sst","rows_in_archive":0,"metrics":["Accuracy","F1 Macro","F1 Micro","F1 Weighted","Precision Macro","Precision Micro","Precision Weighted","Recall Macro","Recall Micro","Recall Weighted","loss"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-classification-on-tecla","dataset":"tecla","dataset_url":null,"rows_in_archive":0,"metrics":["Accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-classification-on-trec-1","dataset":"trec","dataset_url":"/dataset/trecqa","rows_in_archive":0,"metrics":["Accuracy","F1 Macro","F1 Micro","F1 Weighted","Precision Macro","Precision Micro","Precision Weighted","Recall Macro","Recall Micro","Recall Weighted","loss"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-classification-on-turkish-toxic-language","dataset":"Turkish Toxic Language Dataset","dataset_url":null,"rows_in_archive":0,"metrics":["Accuracy","F1","Precision","Recall"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-classification-on-tweet-eval","dataset":"tweet_eval","dataset_url":"/dataset/emotion","rows_in_archive":0,"metrics":["F1"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-classification-on-twitter-financial-news","dataset":"twitter-financial-news-topic","dataset_url":null,"rows_in_archive":0,"metrics":["F1","accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-classification-on-wiki-labeled-articles","dataset":"Wiki Labeled Articles","dataset_url":null,"rows_in_archive":0,"metrics":["F1"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-classification-on-yahoo-answers-topics","dataset":"yahoo_answers_topics","dataset_url":null,"rows_in_archive":0,"metrics":["Accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-classification-on-yelp-polarity","dataset":"yelp_polarity","dataset_url":"/dataset/yelp","rows_in_archive":0,"metrics":["Accuracy"],"first_row_in_archive_order":null}],"datasets":[{"url":"/dataset/mnist","name":"MNIST","full_name":"","num_papers_in_archive":7651},{"url":"/dataset/glue","name":"GLUE","full_name":"General Language Understanding Evaluation benchmark","num_papers_in_archive":3197},{"url":"/dataset/sst","name":"SST","full_name":"Stanford Sentiment Treebank","num_papers_in_archive":2354},{"url":"/dataset/sst-2","name":"SST-2","full_name":"","num_papers_in_archive":1808},{"url":"/dataset/imdb-movie-reviews","name":"IMDb Movie Reviews","full_name":"","num_papers_in_archive":1787},{"url":"/dataset/ag-news","name":"AG News","full_name":"AG’s News Corpus","num_papers_in_archive":969},{"url":"/dataset/boolq","name":"BoolQ","full_name":"Boolean Questions","num_papers_in_archive":701},{"url":"/dataset/reddit","name":"Reddit","full_name":"","num_papers_in_archive":699},{"url":"/dataset/dbpedia","name":"DBpedia","full_name":"DBpedia","num_papers_in_archive":597},{"url":"/dataset/rcv1","name":"RCV1","full_name":"Reuters Corpus Volume 1","num_papers_in_archive":336},{"url":"/dataset/openwebtext","name":"OpenWebText","full_name":"","num_papers_in_archive":207},{"url":"/dataset/hate-speech","name":"Hate Speech","full_name":"","num_papers_in_archive":180},{"url":"/dataset/mteb","name":"MTEB","full_name":"Massive Text Embedding Benchmark","num_papers_in_archive":155},{"url":"/dataset/e-snli","name":"e-SNLI","full_name":"","num_papers_in_archive":139},{"url":"/dataset/yahoo-answers","name":"Yahoo! Answers","full_name":"","num_papers_in_archive":132},{"url":"/dataset/banking77","name":"BANKING77","full_name":"BANKING77","num_papers_in_archive":131},{"url":"/dataset/emotion","name":"CARER","full_name":"Contextualized Affect Representations for Emotion Recognition","num_papers_in_archive":123},{"url":"/dataset/hatexplain","name":"HateXplain","full_name":"","num_papers_in_archive":105},{"url":"/dataset/clue","name":"CLUE","full_name":"Chinese Language Understanding Evaluation Benchmark","num_papers_in_archive":99},{"url":"/dataset/clinc150","name":"CLINC150","full_name":"CLINC150","num_papers_in_archive":87},{"url":"/dataset/yelp","name":"Yelp","full_name":"","num_papers_in_archive":86},{"url":"/dataset/tweeteval","name":"TweetEval","full_name":"","num_papers_in_archive":84},{"url":"/dataset/trecqa","name":"TrecQA","full_name":"Text Retrieval Conference Question Answering","num_papers_in_archive":73},{"url":"/dataset/reuters-21578","name":"Reuters-21578","full_name":"","num_papers_in_archive":66},{"url":"/dataset/web-of-science-dataset","name":"WOS","full_name":"Web of Science Dataset","num_papers_in_archive":59},{"url":"/dataset/peerread","name":"PeerRead","full_name":"","num_papers_in_archive":42},{"url":"/dataset/amazon-product-data","name":"Amazon Product Data","full_name":"rithik","num_papers_in_archive":41},{"url":"/dataset/blurb","name":"BLURB","full_name":"Biomedical Language Understanding and Reasoning Benchmark","num_papers_in_archive":40},{"url":"/dataset/yelp-review-polarity","name":"Yelp Review Polarity","full_name":"","num_papers_in_archive":37},{"url":"/dataset/arxiv","name":"Arxiv HEP-TH citation graph","full_name":"","num_papers_in_archive":35},{"url":"/dataset/mr","name":"MR","full_name":"MR Movie Reviews","num_papers_in_archive":28},{"url":"/dataset/wnut-2020-task-2","name":"WNUT-2020 Task 2","full_name":"WNUT-2020 Task 2: Identification of Informative COVID-19 English Tweets","num_papers_in_archive":28},{"url":"/dataset/20-newsgroups","name":"20 Newsgroups","full_name":"","num_papers_in_archive":27},{"url":"/dataset/basil","name":"BASIL","full_name":"","num_papers_in_archive":27},{"url":"/dataset/evidence-inference","name":"Evidence Inference","full_name":"","num_papers_in_archive":27},{"url":"/dataset/biored","name":"BioRED","full_name":"","num_papers_in_archive":25},{"url":"/dataset/moral-stories","name":"Moral Stories","full_name":"","num_papers_in_archive":24},{"url":"/dataset/eurlex57k","name":"EURLEX57K","full_name":"","num_papers_in_archive":23},{"url":"/dataset/klue","name":"KLUE","full_name":"Korean Language Understanding Evaluation","num_papers_in_archive":21},{"url":"/dataset/terms-of-service","name":"Terms of Service","full_name":"","num_papers_in_archive":21},{"url":"/dataset/pubmed-rct","name":"PubMed RCT","full_name":"PubMed 200k RCT","num_papers_in_archive":20},{"url":"/dataset/lshtc","name":"LSHTC","full_name":"","num_papers_in_archive":18},{"url":"/dataset/turingbench","name":"TURINGBENCH","full_name":"","num_papers_in_archive":18},{"url":"/dataset/smhd","name":"SMHD","full_name":"Self-reported Mental Health Diagnoses","num_papers_in_archive":16},{"url":"/dataset/tweepfake","name":"TweepFake","full_name":"","num_papers_in_archive":16},{"url":"/dataset/beeradvocate","name":"BeerAdvocate","full_name":"","num_papers_in_archive":15},{"url":"/dataset/ade-corpus","name":"Adverse Drug Events (ADE) Corpus","full_name":"","num_papers_in_archive":14},{"url":"/dataset/indonlu-benchmark","name":"IndoNLU Benchmark","full_name":"","num_papers_in_archive":14},{"url":"/dataset/ghostbuster","name":"Ghostbuster","full_name":"","num_papers_in_archive":13},{"url":"/dataset/hopeedi","name":"HopeEDI","full_name":"HopeEDI: A Multilingual Hope Speech Detection Dataset for Equality, Diversity, and Inclusion","num_papers_in_archive":13},{"url":"/dataset/outfox","name":"OUTFOX","full_name":"","num_papers_in_archive":13},{"url":"/dataset/flue-french-language-understanding-evaluation","name":"FLUE","full_name":"French Language Understanding Evaluation","num_papers_in_archive":12},{"url":"/dataset/overruling","name":"Overruling","full_name":"","num_papers_in_archive":12},{"url":"/dataset/mage","name":"MAGE","full_name":"","num_papers_in_archive":11},{"url":"/dataset/ohsumed","name":"Ohsumed","full_name":"","num_papers_in_archive":11},{"url":"/dataset/card-660","name":"CARD-660","full_name":"","num_papers_in_archive":10},{"url":"/dataset/covid-19-twitter-chatter-dataset","name":"COVID-19 Twitter Chatter Dataset","full_name":"","num_papers_in_archive":10},{"url":"/dataset/marc-ja","name":"JGLUE","full_name":"","num_papers_in_archive":7},{"url":"/dataset/tunizi","name":"TUNIZI","full_name":"","num_papers_in_archive":7},{"url":"/dataset/arxiv-10","name":"arXiv-10","full_name":"","num_papers_in_archive":6},{"url":"/dataset/omics","name":"OMICS","full_name":"Open Mind Indoor Common Sense","num_papers_in_archive":6},{"url":"/dataset/trec-10","name":"TREC-10","full_name":"TREC-10 Question Classification","num_papers_in_archive":6},{"url":"/dataset/illness-dataset","name":"Illness-dataset","full_name":"Illness multi-domain textual dataset","num_papers_in_archive":5},{"url":"/dataset/mumin","name":"MuMiN","full_name":"","num_papers_in_archive":5},{"url":"/dataset/taiga-corpus","name":"Taiga Corpus","full_name":"An open-source corpus for machine learning.","num_papers_in_archive":5},{"url":"/dataset/climabench","name":"Climabench","full_name":"","num_papers_in_archive":4},{"url":"/dataset/liar2","name":"LIAR2","full_name":"","num_papers_in_archive":4},{"url":"/dataset/medical-abstracts","name":"Medical Abstracts","full_name":"Medical Abstracts Text Classification Dataset","num_papers_in_archive":4},{"url":"/dataset/metahate","name":"MetaHate","full_name":"","num_papers_in_archive":4},{"url":"/dataset/mixset","name":"MixSet","full_name":"Mixcase Dataset","num_papers_in_archive":4},{"url":"/dataset/mn-ds","name":"MN-DS","full_name":"Multilabeled News Dataset","num_papers_in_archive":4},{"url":"/dataset/sv-ident","name":"SV-Ident","full_name":"Survey Variable Identification","num_papers_in_archive":4},{"url":"/dataset/tarc","name":"TArC","full_name":"","num_papers_in_archive":4},{"url":"/dataset/twitter-sentiment-analysis","name":"Twitter Sentiment Analysis","full_name":"Entity-Level Twitter Sentiment Analysis Dataset","num_papers_in_archive":4},{"url":"/dataset/uit-vsmec","name":"UIT-VSMEC","full_name":"Vietnamese Social Media Emotion Corpus","num_papers_in_archive":4},{"url":"/dataset/fresada","name":"FreSaDa","full_name":"","num_papers_in_archive":3},{"url":"/dataset/lleqa","name":"LLeQA","full_name":"Long-form Legal Question Answering","num_papers_in_archive":3},{"url":"/dataset/muld","name":"MuLD","full_name":"Multitask Long Document Benchmark","num_papers_in_archive":3},{"url":"/dataset/resd","name":"RESD","full_name":"Russian Emotional Speech Dialogs with annotated text","num_papers_in_archive":3},{"url":"/dataset/sdcnl-suicide-vs-depression-classification","name":"SDCNL (Suicide vs Depression Classification)","full_name":"","num_papers_in_archive":3},{"url":"/dataset/tcab","name":"TCAB","full_name":"Text Classification Attack Benchmark","num_papers_in_archive":3},{"url":"/dataset/wikipedia-title","name":"Wikipedia Title","full_name":null,"num_papers_in_archive":3},{"url":"/dataset/ags-corpus","name":"AG’s Corpus","full_name":"AG's corpus of news articlesNews","num_papers_in_archive":2},{"url":"/dataset/biographical","name":"Biographical","full_name":"Biographical: A Semi-Supervised Relation Extraction Dataset","num_papers_in_archive":2},{"url":"/dataset/cic","name":"CIC","full_name":"Catalonia Independence Corpus","num_papers_in_archive":2},{"url":"/dataset/hlgd","name":"HLGD","full_name":"Headline Grouping Dataset","num_papers_in_archive":2},{"url":"/dataset/kanhope","name":"KanHope","full_name":"Kannada Hope speech dataset","num_papers_in_archive":2},{"url":"/dataset/latamxix","name":"LatamXIX","full_name":"19th Century Latin American Spanish Newspaper Corpus with LLM OCR Correction","num_papers_in_archive":2},{"url":"/dataset/law-stack-exchange","name":"Law Stack Exchange","full_name":"","num_papers_in_archive":2},{"url":"/dataset/nlp-taxonomy-classification-test-data","name":"NLP Taxonomy Classification Data","full_name":"","num_papers_in_archive":2},{"url":"/dataset/pmoa-cite","name":"PMOA-CITE","full_name":"PMOA-CITE","num_papers_in_archive":2},{"url":"/dataset/reddit-ideological-and-extreme-bias-dataset","name":"Reddit Ideological and Extreme Bias Dataset","full_name":"","num_papers_in_archive":2},{"url":"/dataset/rsdd-time","name":"RSDD-Time","full_name":"","num_papers_in_archive":2},{"url":"/dataset/rusentne","name":"RuSentNE","full_name":"RuSentNE-2023","num_papers_in_archive":2},{"url":"/dataset/scihtc","name":"SciHTC","full_name":"","num_papers_in_archive":2},{"url":"/dataset/social-media-attributions-of-youtube-comments","name":"Social media attributions of YouTube comments","full_name":"Social media attributions dataset of YouTube comments in the context of water crisis","num_papers_in_archive":2},{"url":"/dataset/the-call-me-sexist-but-dataset-cmsb","name":"The 'Call me sexist but' Dataset (CMSB)","full_name":"","num_papers_in_archive":2},{"url":"/dataset/threatgram-101-extreme-telegram-data","name":"ThreatGram 101 - Extreme Telegram Data","full_name":"ThreatGram 101 - Extreme Telegram Replies Data with Threat Levels","num_papers_in_archive":2},{"url":"/dataset/twitter-stance-election-2020","name":"Twitter Stance Election 2020","full_name":"","num_papers_in_archive":2},{"url":"/dataset/agb-de","name":"AGB-DE","full_name":"","num_papers_in_archive":1},{"url":"/dataset/ai-ga-ai-generated-abstracts-dataset","name":"AI-GA: AI-Generated Abstracts dataset","full_name":"AI-GA: AI-Generated Abstracts dataset","num_papers_in_archive":1},{"url":"/dataset/ai-generated-twitter-timelines","name":"AI-generated Twitter Timelines","full_name":"","num_papers_in_archive":1},{"url":"/dataset/an-amharic-news-text-classification-dataset","name":"An Amharic News Text classification Dataset","full_name":"","num_papers_in_archive":1},{"url":"/dataset/appealcase","name":"AppealCase","full_name":"","num_papers_in_archive":1},{"url":"/dataset/arxiv-categories","name":"arXiv Categories","full_name":"arXiv Categories Multi-label Text Classification Dataset","num_papers_in_archive":1},{"url":"/dataset/avicenna-deductive-commonsense-reasoning","name":"Avicenna: Deductive Commonsense Reasoning","full_name":"","num_papers_in_archive":1},{"url":"/dataset/bala-copa","name":"Bala-Copa","full_name":"Balanced-COPA","num_papers_in_archive":1},{"url":"/dataset/banglabook","name":"BanglaBook","full_name":"Large-scale Bangla Dataset for Sentiment Analysis from Book Reviews","num_papers_in_archive":1},{"url":"/dataset/banglaemotion","name":"BanglaEmotion","full_name":"BanglaEmotion: A Benchmark Dataset for Bangla Textual Emotion Analysis","num_papers_in_archive":1},{"url":"/dataset/basir","name":"BASIR","full_name":"BASIR_Budget_Assisted_Sectoral_Impact_Ranking","num_papers_in_archive":1},{"url":"/dataset/bugclassify","name":"BugClassify","full_name":"","num_papers_in_archive":1},{"url":"/dataset/cards-against-humanity","name":"Cards Against Humanity","full_name":"","num_papers_in_archive":1},{"url":"/dataset/careercoach-2022","name":"CareerCoach 2022","full_name":"","num_papers_in_archive":1},{"url":"/dataset/caselaw4","name":"Caselaw4","full_name":"","num_papers_in_archive":1},{"url":"/dataset/chinese-ai-and-law-cail-2018","name":"Chinese AI and Law (CAIL) 2018","full_name":"","num_papers_in_archive":1},{"url":"/dataset/covid-19-tweets-with-motivation-and-topics","name":"COVID-19 Tweets with Motivation and Topics","full_name":"","num_papers_in_archive":1},{"url":"/dataset/csl-2022","name":"CSL (Chinese Scientific Literature)","full_name":"","num_papers_in_archive":1},{"url":"/dataset/dejan-synthetic-taxonomy-dataset","name":"DEJAN Synthetic Taxonomy Dataset","full_name":"","num_papers_in_archive":1},{"url":"/dataset/dissonance-twitter-dataset","name":"Dissonance Twitter Dataset","full_name":"","num_papers_in_archive":1},{"url":"/dataset/fednlp","name":"FedNLP","full_name":"FOMC Docs and Speeches","num_papers_in_archive":1},{"url":"/dataset/finsen","name":"FinSen","full_name":"","num_papers_in_archive":1},{"url":"/dataset/fmc-mwo2kg","name":"FMC-MWO2KG","full_name":"The MWO2KG Failure Mode Classification Dataset","num_papers_in_archive":1},{"url":"/dataset/forex-news-annotated-dataset-for-sentiment","name":"Forex News Annotated Dataset for Sentiment Analysis","full_name":"","num_papers_in_archive":1},{"url":"/dataset/ftr-18","name":"FTR-18","full_name":"","num_papers_in_archive":1},{"url":"/dataset/gtc-topic-based-paragraph-classification","name":"Genocide Transcript Corpus (GTC): Topic-Based Paragraph Classification in Genocide-Related Court Transcripts","full_name":"","num_papers_in_archive":1},{"url":"/dataset/human-chatgpt-texts","name":"Human-ChatGPT texts","full_name":"","num_papers_in_archive":1},{"url":"/dataset/ilur-news-texts","name":"iLur News Texts","full_name":"","num_papers_in_archive":1},{"url":"/dataset/invisible-mobile-keyboard-dataset","name":"Invisible Mobile Keyboard Dataset","full_name":"","num_papers_in_archive":1},{"url":"/dataset/legal-advice-reddit","name":"Legal Advice Reddit","full_name":"","num_papers_in_archive":1},{"url":"/dataset/lot-insts","name":"Lot-insts","full_name":"Long-Tailed instituition names","num_papers_in_archive":1},{"url":"/dataset/m-phasis","name":"M-Phasis","full_name":"A Feature-Based Corpus of Hate Online","num_papers_in_archive":1},{"url":"/dataset/mathwell-human-annotation-dataset","name":"MATHWELL Human Annotation Dataset","full_name":"","num_papers_in_archive":1},{"url":"/dataset/mist","name":"MiST","full_name":"","num_papers_in_archive":1},{"url":"/dataset/modern-hebrew-sentiment-dataset","name":"Modern Hebrew Sentiment Dataset","full_name":"","num_papers_in_archive":1},{"url":"/dataset/mumin-large","name":"MuMiN-large","full_name":"","num_papers_in_archive":1},{"url":"/dataset/mumin-medium","name":"MuMiN-medium","full_name":"","num_papers_in_archive":1},{"url":"/dataset/mumin-small","name":"MuMiN-small","full_name":"","num_papers_in_archive":1},{"url":"/dataset/natcat","name":"NatCat","full_name":"","num_papers_in_archive":1},{"url":"/dataset/novic-caption-object-data","name":"NOVIC Caption-Object Data","full_name":"","num_papers_in_archive":1},{"url":"/dataset/paper-field","name":"Paper Field","full_name":"Paper Field","num_papers_in_archive":1},{"url":"/dataset/persian-nlp-hub","name":"Persian NLP Hub","full_name":"","num_papers_in_archive":1},{"url":"/dataset/scientific-statement-classification-dataset","name":"Scientific statement classification dataset from arXMLiv 08.2018","full_name":"","num_papers_in_archive":1},{"url":"/dataset/shapeit","name":"ShapeIt","full_name":"","num_papers_in_archive":1},{"url":"/dataset/shoptc-100k","name":"ShopTC-100K","full_name":"","num_papers_in_archive":1},{"url":"/dataset/shortpersianemo","name":"ShortPersianEmo","full_name":"","num_papers_in_archive":1},{"url":"/dataset/silicone-benchmark","name":"SILICONE Benchmark","full_name":"SILICONE","num_papers_in_archive":1},{"url":"/dataset/smokeng","name":"SmokEng","full_name":"","num_papers_in_archive":1},{"url":"/dataset/steducov-a-dataset-on-stance-detection-in","name":"STEDUCOV: A DATASET ON STANCE DETECTION IN TWEETS TOWARDS ONLINE EDUCATION DURING COVID-19 PANDEMIC","full_name":"","num_papers_in_archive":1},{"url":"/dataset/the-mafia-dataset","name":"The Mafia Dataset","full_name":"","num_papers_in_archive":1},{"url":"/dataset/this-is-not-a-dataset","name":"This is not a Dataset","full_name":"This is not a Dataset: A Large Negation Benchmark to Challenge Large Language Models","num_papers_in_archive":1},{"url":"/dataset/tibetan-news-classification","name":"tibetan_news_classification","full_name":"","num_papers_in_archive":1},{"url":"/dataset/towards-a-data-driven-requirements","name":"Towards a Data-Driven Requirements Engineering Approach: Automatic Analysis of User Reviews","full_name":"","num_papers_in_archive":1},{"url":"/dataset/trilemma-dataset","name":"Trilemma Dataset","full_name":"The Trilemma of Truth in Large Language Models","num_papers_in_archive":1},{"url":"/dataset/truthgen","name":"TruthGen","full_name":"","num_papers_in_archive":1},{"url":"/dataset/twitter-abusive-context","name":"Twitter Abusive Context","full_name":"","num_papers_in_archive":1},{"url":"/dataset/uk-key-stage-readability","name":"UK Key Stage Readability","full_name":"UK Key Stage Readability for English Texts","num_papers_in_archive":1},{"url":"/dataset/user-story-neodataset","name":"User Story NeoDataset","full_name":"User Story NeoDataset","num_papers_in_archive":1},{"url":"/dataset/wiki-en","name":"Wiki-en","full_name":null,"num_papers_in_archive":1},{"url":"/dataset/wiki-reliability","name":"Wiki-Reliability","full_name":"","num_papers_in_archive":1},{"url":"/dataset/wiki-zh","name":"Wiki-zh","full_name":null,"num_papers_in_archive":1},{"url":"/dataset/covid-19-disinfo","name":"COVID-19 Disinfo","full_name":"COVID-19 Disinformation Twitter Dataset","num_papers_in_archive":0},{"url":"/dataset/eduge","name":"Eduge","full_name":"Eduge news classification dataset","num_papers_in_archive":0},{"url":"/dataset/events-classification-biotech","name":"Events classification - Biotech news","full_name":"","num_papers_in_archive":0},{"url":"/dataset/indian-number-plates-dataset-vehicle-number","name":"Indian Number Plates Dataset | Vehicle Number Plates | English OCR Detection","full_name":"","num_papers_in_archive":0},{"url":"/dataset/mnad","name":"MNAD","full_name":"Moroccan News Articles Dataset","num_papers_in_archive":0},{"url":"/dataset/ruadrect","name":"RuADReCT","full_name":"The Russian Adverse Drug Reaction Corpus  of Tweets","num_papers_in_archive":0},{"url":"/dataset/comentarios-vacuna-vph","name":"Text_VPH","full_name":"","num_papers_in_archive":0}],"subtasks":[{"url":"/task/citation-intent-classification","name":"Citation Intent Classification"},{"url":"/task/coherence-evaluation","name":"Coherence Evaluation"},{"url":"/task/cross-domain-text-classification","name":"Cross-Domain Text Classification"},{"url":"/task/document-classification","name":"Document Classification"},{"url":"/task/emotion-classification","name":"Emotion Classification"},{"url":"/task/few-shot-text-classification","name":"Few-Shot Text Classification"},{"url":"/task/hierarchical-text-classification-of-blurbs","name":"Hierarchical Text Classification of Blurbs (GermEval 2019)"},{"url":"/task/multi-label-text-classification","name":"Multi-Label Text Classification"},{"url":"/task/satire-detection","name":"Satire Detection"},{"url":"/task/semi-supervised-text-classification-1","name":"Semi-Supervised Text Classification"},{"url":"/task/sentence-classification","name":"Sentence Classification"},{"url":"/task/text-categorization","name":"Text Categorization"},{"url":"/task/topic-models","name":"Topic Models"},{"url":"/task/toxic-comment-classification","name":"Toxic Comment Classification"},{"url":"/task/unsupervised-text-classification","name":"Unsupervised Text Classification"},{"url":"/task/variable-detection","name":"Variable Detection"}],"parent_tasks":[{"url":"/task/classification-1","name":"Classification"}],"papers":{"order":"repositories listed in the archive (most first), then date (newest first), then slug; the archive holds no stars","population":"every paper the archive tags with this task (distinct papers; spam titles not listed). 'of' counts the papers listed; until 2026-09-25 it counted only the papers with a code link, and that number is of_with_code","page":1,"pages_in_order":37,"rows_per_page":100,"shown":100,"of":3635,"of_with_code":1308,"tagged_in_all":3635,"counts":{"archive_papers_tagged":3635,"with_a_code_link":1308,"where_syntology_ran_a_sample":272,"not_listed_spam_title":0,"listed":3635,"listed_where_code_ran":272,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":217,"every_run_a_failure_of_syntologys_instrument":55,"listed_with_a_run_with_no_instrument_failure":217,"listed_every_run_a_failure_of_syntologys_instrument":55,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"items":[{"url":"/paper/bert-pre-training-of-deep-bidirectional","slug":"bert-pre-training-of-deep-bidirectional","title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","date":"2018-10-11","arxiv_id":"1810.04805","repositories_listed":534,"syntology":{"n":659,"n_ran":300,"n_constructed":75,"n_ran_checked":234,"n_instrument":66,"n_unverified":359,"n_honours":18,"n_violates":5,"n_no_contract":211,"n_pointer_only":164,"phrase":"300 ran (of which 75 constructed an object rather than computing a result; 234 with no instrument failure: 18 honoured, 5 violated, 211 with no contract checked; 66 where Syntology's instrument failed) · 359 unverified","sample_list":"/paper/bert-pre-training-of-deep-bidirectional#ran","syntology_url":"https://syntology.ai/paper/1810.04805","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1810.04805"}},"official":{"repos":["google-research/bert"],"state":"official: no sample here; runs from other or unrecorded repositories","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","unlocated"]}}},{"url":"/paper/semi-supervised-sequence-learning","slug":"semi-supervised-sequence-learning","title":"Semi-supervised Sequence Learning","date":"2015-11-04","arxiv_id":"1511.01432","repositories_listed":161,"syntology":null},{"url":"/paper/roberta-a-robustly-optimized-bert-pretraining","slug":"roberta-a-robustly-optimized-bert-pretraining","title":"RoBERTa: A Robustly Optimized BERT Pretraining Approach","date":"2019-07-26","arxiv_id":"1907.11692","repositories_listed":67,"syntology":{"n":48,"n_ran":37,"n_constructed":11,"n_ran_checked":36,"n_instrument":1,"n_unverified":11,"n_honours":2,"n_violates":0,"n_no_contract":34,"n_pointer_only":24,"phrase":"37 ran (of which 11 constructed an object rather than computing a result; 36 with no instrument failure: 2 honoured, 0 violated, 34 with no contract checked; 1 where Syntology's instrument failed) · 11 unverified","sample_list":"/paper/roberta-a-robustly-optimized-bert-pretraining#ran","syntology_url":"https://syntology.ai/paper/1907.11692","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1907.11692"}},"official":{"repos":["pytorch/fairseq"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/universal-language-model-fine-tuning-for-text","slug":"universal-language-model-fine-tuning-for-text","title":"Universal Language Model Fine-tuning for Text Classification","date":"2018-01-18","arxiv_id":"1801.06146","repositories_listed":66,"syntology":{"n":5,"n_ran":2,"n_constructed":0,"n_ran_checked":0,"n_instrument":2,"n_unverified":3,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":3,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified","sample_list":"/paper/universal-language-model-fine-tuning-for-text#ran","syntology_url":"https://syntology.ai/paper/1801.06146","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1801.06146"}},"official":{"repos":["fastai/fastai"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/bag-of-tricks-for-efficient-text","slug":"bag-of-tricks-for-efficient-text","title":"Bag of Tricks for Efficient Text Classification","date":"2016-07-06","arxiv_id":"1607.01759","repositories_listed":65,"syntology":{"n":9,"n_ran":3,"n_constructed":0,"n_ran_checked":1,"n_instrument":2,"n_unverified":6,"n_honours":0,"n_violates":0,"n_no_contract":1,"n_pointer_only":2,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 6 unverified","sample_list":"/paper/bag-of-tricks-for-efficient-text#ran","syntology_url":"https://syntology.ai/paper/1607.01759","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1607.01759"}},"official":{"repos":["facebookresearch/fastText"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/fasttextzip-compressing-text-classification","slug":"fasttextzip-compressing-text-classification","title":"FastText.zip: Compressing text classification models","date":"2016-12-12","arxiv_id":"1612.03651","repositories_listed":44,"syntology":{"n":18,"n_ran":11,"n_constructed":0,"n_ran_checked":8,"n_instrument":3,"n_unverified":7,"n_honours":0,"n_violates":0,"n_no_contract":8,"n_pointer_only":13,"phrase":"11 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 3 where Syntology's instrument failed) · 7 unverified","sample_list":"/paper/fasttextzip-compressing-text-classification#ran","syntology_url":"https://syntology.ai/paper/1612.03651","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1612.03651"}},"official":{"repos":["facebookresearch/fastText"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/character-level-convolutional-networks-for","slug":"character-level-convolutional-networks-for","title":"Character-level Convolutional Networks for Text Classification","date":"2015-09-04","arxiv_id":"1509.01626","repositories_listed":30,"syntology":{"n":20,"n_ran":17,"n_constructed":0,"n_ran_checked":13,"n_instrument":4,"n_unverified":3,"n_honours":0,"n_violates":0,"n_no_contract":13,"n_pointer_only":5,"phrase":"17 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 0 honoured, 0 violated, 13 with no contract checked; 4 where Syntology's instrument failed) · 3 unverified","sample_list":"/paper/character-level-convolutional-networks-for#ran","syntology_url":"https://syntology.ai/paper/1509.01626","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1509.01626"}},"official":null}},{"url":"/paper/xlnet-generalized-autoregressive-pretraining","slug":"xlnet-generalized-autoregressive-pretraining","title":"XLNet: Generalized Autoregressive Pretraining for Language Understanding","date":"2019-06-19","arxiv_id":"1906.08237","repositories_listed":27,"syntology":{"n":24,"n_ran":15,"n_constructed":2,"n_ran_checked":10,"n_instrument":5,"n_unverified":9,"n_honours":2,"n_violates":0,"n_no_contract":8,"n_pointer_only":4,"phrase":"15 ran (of which 2 constructed an object rather than computing a result; 10 with no instrument failure: 2 honoured, 0 violated, 8 with no contract checked; 5 where Syntology's instrument failed) · 9 unverified","sample_list":"/paper/xlnet-generalized-autoregressive-pretraining#ran","syntology_url":"https://syntology.ai/paper/1906.08237","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1906.08237"}},"official":{"repos":["zihangdai/xlnet"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":1,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/distributed-representations-of-sentences-and","slug":"distributed-representations-of-sentences-and","title":"Distributed Representations of Sentences and Documents","date":"2014-05-16","arxiv_id":"1405.4053","repositories_listed":27,"syntology":{"n":4,"n_ran":4,"n_constructed":0,"n_ran_checked":4,"n_instrument":0,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":4,"n_pointer_only":0,"phrase":"4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/distributed-representations-of-sentences-and#ran","syntology_url":"https://syntology.ai/paper/1405.4053","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1405.4053"}},"official":null}},{"url":"/paper/revisiting-semi-supervised-learning-with","slug":"revisiting-semi-supervised-learning-with","title":"Revisiting Semi-Supervised Learning with Graph Embeddings","date":"2016-03-29","arxiv_id":"1603.08861","repositories_listed":26,"syntology":{"n":28,"n_ran":15,"n_constructed":4,"n_ran_checked":13,"n_instrument":2,"n_unverified":13,"n_honours":3,"n_violates":2,"n_no_contract":8,"n_pointer_only":11,"phrase":"15 ran (of which 4 constructed an object rather than computing a result; 13 with no instrument failure: 3 honoured, 2 violated, 8 with no contract checked; 2 where Syntology's instrument failed) · 13 unverified","sample_list":"/paper/revisiting-semi-supervised-learning-with#ran","syntology_url":"https://syntology.ai/paper/1603.08861","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1603.08861"}},"official":null}},{"url":"/paper/universal-sentence-encoder","slug":"universal-sentence-encoder","title":"Universal Sentence Encoder","date":"2018-03-29","arxiv_id":"1803.11175","repositories_listed":24,"syntology":{"n":22,"n_ran":18,"n_constructed":0,"n_ran_checked":17,"n_instrument":1,"n_unverified":4,"n_honours":0,"n_violates":0,"n_no_contract":17,"n_pointer_only":1,"phrase":"18 ran (of which 0 constructed an object rather than computing a result; 17 with no instrument failure: 0 honoured, 0 violated, 17 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified","sample_list":"/paper/universal-sentence-encoder#ran","syntology_url":"https://syntology.ai/paper/1803.11175","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1803.11175"}},"official":null}},{"url":"/paper/very-deep-convolutional-networks-for-text","slug":"very-deep-convolutional-networks-for-text","title":"Very Deep Convolutional Networks for Text Classification","date":"2016-06-06","arxiv_id":"1606.01781","repositories_listed":24,"syntology":{"n":5,"n_ran":3,"n_constructed":0,"n_ran_checked":1,"n_instrument":2,"n_unverified":2,"n_honours":1,"n_violates":0,"n_no_contract":0,"n_pointer_only":5,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified","sample_list":"/paper/very-deep-convolutional-networks-for-text#ran","syntology_url":"https://syntology.ai/paper/1606.01781","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1606.01781"}},"official":null}},{"url":"/paper/roformer-enhanced-transformer-with-rotary","slug":"roformer-enhanced-transformer-with-rotary","title":"RoFormer: Enhanced Transformer with Rotary Position Embedding","date":"2021-04-20","arxiv_id":"2104.09864","repositories_listed":20,"syntology":{"n":16,"n_ran":14,"n_constructed":5,"n_ran_checked":8,"n_instrument":6,"n_unverified":2,"n_honours":1,"n_violates":0,"n_no_contract":7,"n_pointer_only":0,"phrase":"14 ran (of which 5 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 0 violated, 7 with no contract checked; 6 where Syntology's instrument failed) · 2 unverified","sample_list":"/paper/roformer-enhanced-transformer-with-rotary#ran","syntology_url":"https://syntology.ai/paper/2104.09864","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2104.09864"}},"official":{"repos":["ZhuiyiTechnology/roformer"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/unsupervised-data-augmentation-1","slug":"unsupervised-data-augmentation-1","title":"Unsupervised Data Augmentation for Consistency Training","date":"2019-04-29","arxiv_id":"1904.12848","repositories_listed":20,"syntology":{"n":52,"n_ran":30,"n_constructed":3,"n_ran_checked":22,"n_instrument":8,"n_unverified":22,"n_honours":2,"n_violates":0,"n_no_contract":20,"n_pointer_only":17,"phrase":"30 ran (of which 3 constructed an object rather than computing a result; 22 with no instrument failure: 2 honoured, 0 violated, 20 with no contract checked; 8 where Syntology's instrument failed) · 22 unverified","sample_list":"/paper/unsupervised-data-augmentation-1#ran","syntology_url":"https://syntology.ai/paper/1904.12848","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1904.12848"}},"official":{"repos":["google-research/uda"],"state":"official (archive's flag): 10 ran","n_ran":10,"n_constructed":0,"n_ran_no_instrument_failure":10,"n_unverified":14,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/parameter-efficient-transfer-learning-for-nlp","slug":"parameter-efficient-transfer-learning-for-nlp","title":"Parameter-Efficient Transfer Learning for NLP","date":"2019-02-02","arxiv_id":"1902.00751","repositories_listed":17,"syntology":{"n":22,"n_ran":14,"n_constructed":3,"n_ran_checked":14,"n_instrument":0,"n_unverified":8,"n_honours":0,"n_violates":0,"n_no_contract":14,"n_pointer_only":3,"phrase":"14 ran (of which 3 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 0 where Syntology's instrument failed) · 8 unverified","sample_list":"/paper/parameter-efficient-transfer-learning-for-nlp#ran","syntology_url":"https://syntology.ai/paper/1902.00751","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1902.00751"}},"official":{"repos":["google-research/adapter-bert"],"state":"official: harvested, nothing ran","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":1,"ran_from_kinds":["listed"]}}},{"url":"/paper/eda-easy-data-augmentation-techniques-for","slug":"eda-easy-data-augmentation-techniques-for","title":"EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Tasks","date":"2019-01-31","arxiv_id":"1901.11196","repositories_listed":16,"syntology":{"n":13,"n_ran":9,"n_constructed":0,"n_ran_checked":7,"n_instrument":2,"n_unverified":4,"n_honours":0,"n_violates":0,"n_no_contract":7,"n_pointer_only":1,"phrase":"9 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified","sample_list":"/paper/eda-easy-data-augmentation-techniques-for#ran","syntology_url":"https://syntology.ai/paper/1901.11196","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1901.11196"}},"official":{"repos":["jasonwei20/eda_nlp"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/how-to-fine-tune-bert-for-text-classification","slug":"how-to-fine-tune-bert-for-text-classification","title":"How to Fine-Tune BERT for Text Classification?","date":"2019-05-14","arxiv_id":"1905.05583","repositories_listed":15,"syntology":{"n":18,"n_ran":12,"n_constructed":0,"n_ran_checked":7,"n_instrument":5,"n_unverified":6,"n_honours":1,"n_violates":0,"n_no_contract":6,"n_pointer_only":5,"phrase":"12 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 0 violated, 6 with no contract checked; 5 where Syntology's instrument failed) · 6 unverified","sample_list":"/paper/how-to-fine-tune-bert-for-text-classification#ran","syntology_url":"https://syntology.ai/paper/1905.05583","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1905.05583"}},"official":{"repos":["xuyige/BERT4doc-Classification"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/big-bird-transformers-for-longer-sequences","slug":"big-bird-transformers-for-longer-sequences","title":"Big Bird: Transformers for Longer Sequences","date":"2020-07-28","arxiv_id":"2007.14062","repositories_listed":14,"syntology":{"n":15,"n_ran":10,"n_constructed":1,"n_ran_checked":2,"n_instrument":8,"n_unverified":5,"n_honours":1,"n_violates":0,"n_no_contract":1,"n_pointer_only":11,"phrase":"10 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 8 where Syntology's instrument failed) · 5 unverified","sample_list":"/paper/big-bird-transformers-for-longer-sequences#ran","syntology_url":"https://syntology.ai/paper/2007.14062","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2007.14062"}},"official":{"repos":["google-research/bigbird"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":1,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/fastformer-additive-attention-is-all-you-need","slug":"fastformer-additive-attention-is-all-you-need","title":"Fastformer: Additive Attention Can Be All You Need","date":"2021-08-20","arxiv_id":"2108.09084","repositories_listed":13,"syntology":{"n":4,"n_ran":4,"n_constructed":0,"n_ran_checked":2,"n_instrument":2,"n_unverified":0,"n_honours":0,"n_violates":2,"n_no_contract":0,"n_pointer_only":3,"phrase":"4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 2 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/fastformer-additive-attention-is-all-you-need#ran","syntology_url":"https://syntology.ai/paper/2108.09084","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2108.09084"}},"official":{"repos":["wuch15/Fastformer"],"state":"official: no sample here; runs from other or unrecorded repositories","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","unlocated"]}}},{"url":"/paper/fnet-mixing-tokens-with-fourier-transforms","slug":"fnet-mixing-tokens-with-fourier-transforms","title":"FNet: Mixing Tokens with Fourier Transforms","date":"2021-05-09","arxiv_id":"2105.03824","repositories_listed":12,"syntology":{"n":2,"n_ran":2,"n_constructed":0,"n_ran_checked":1,"n_instrument":1,"n_unverified":0,"n_honours":1,"n_violates":0,"n_no_contract":0,"n_pointer_only":1,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/fnet-mixing-tokens-with-fourier-transforms#ran","syntology_url":"https://syntology.ai/paper/2105.03824","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2105.03824"}},"official":{"repos":["google-research/google-research"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/simple-recurrent-units-for-highly","slug":"simple-recurrent-units-for-highly","title":"Simple Recurrent Units for Highly Parallelizable Recurrence","date":"2017-09-08","arxiv_id":"1709.02755","repositories_listed":11,"syntology":{"n":1,"n_ran":1,"n_constructed":0,"n_ran_checked":1,"n_instrument":0,"n_unverified":0,"n_honours":0,"n_violates":1,"n_no_contract":0,"n_pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/simple-recurrent-units-for-highly#ran","syntology_url":"https://syntology.ai/paper/1709.02755","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1709.02755"}},"official":{"repos":["asappresearch/sru"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/a-c-lstm-neural-network-for-text","slug":"a-c-lstm-neural-network-for-text","title":"A C-LSTM Neural Network for Text Classification","date":"2015-11-27","arxiv_id":"1511.08630","repositories_listed":10,"syntology":null},{"url":"/paper/ask-me-anything-dynamic-memory-networks-for","slug":"ask-me-anything-dynamic-memory-networks-for","title":"Ask Me Anything: Dynamic Memory Networks for Natural Language Processing","date":"2015-06-24","arxiv_id":"1506.07285","repositories_listed":10,"syntology":{"n":5,"n_ran":5,"n_constructed":0,"n_ran_checked":4,"n_instrument":1,"n_unverified":0,"n_honours":0,"n_violates":1,"n_no_contract":3,"n_pointer_only":0,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 1 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/ask-me-anything-dynamic-memory-networks-for#ran","syntology_url":"https://syntology.ai/paper/1506.07285","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1506.07285"}},"official":null}},{"url":"/paper/graph-convolutional-networks-for-text","slug":"graph-convolutional-networks-for-text","title":"Graph Convolutional Networks for Text Classification","date":"2018-09-15","arxiv_id":"1809.05679","repositories_listed":9,"syntology":{"n":16,"n_ran":14,"n_constructed":0,"n_ran_checked":10,"n_instrument":4,"n_unverified":2,"n_honours":2,"n_violates":0,"n_no_contract":8,"n_pointer_only":6,"phrase":"14 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 2 honoured, 0 violated, 8 with no contract checked; 4 where Syntology's instrument failed) · 2 unverified","sample_list":"/paper/graph-convolutional-networks-for-text#ran","syntology_url":"https://syntology.ai/paper/1809.05679","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1809.05679"}},"official":{"repos":["yao8839836/text_gcn"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/pubmed-200k-rct-a-dataset-for-sequential","slug":"pubmed-200k-rct-a-dataset-for-sequential","title":"PubMed 200k RCT: a Dataset for Sequential Sentence Classification in Medical Abstracts","date":"2017-10-17","arxiv_id":"1710.06071","repositories_listed":9,"syntology":{"n":1,"n_ran":1,"n_constructed":0,"n_ran_checked":0,"n_instrument":1,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":1,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/pubmed-200k-rct-a-dataset-for-sequential#ran","syntology_url":"https://syntology.ai/paper/1710.06071","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1710.06071"}},"official":{"repos":["Franck-Dernoncourt/pubmed-rct"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/flaubert-unsupervised-language-model-pre","slug":"flaubert-unsupervised-language-model-pre","title":"FlauBERT: Unsupervised Language Model Pre-training for French","date":"2019-12-11","arxiv_id":"1912.05372","repositories_listed":7,"syntology":{"n":9,"n_ran":7,"n_constructed":0,"n_ran_checked":7,"n_instrument":0,"n_unverified":2,"n_honours":0,"n_violates":1,"n_no_contract":6,"n_pointer_only":1,"phrase":"7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 1 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified","sample_list":"/paper/flaubert-unsupervised-language-model-pre#ran","syntology_url":"https://syntology.ai/paper/1912.05372","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1912.05372"}},"official":{"repos":["getalp/Flaubert"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/is-bert-really-robust-natural-language-attack","slug":"is-bert-really-robust-natural-language-attack","title":"Is BERT Really Robust? A Strong Baseline for Natural Language Attack on Text Classification and Entailment","date":"2019-07-27","arxiv_id":"1907.11932","repositories_listed":7,"syntology":{"n":2,"n_ran":2,"n_constructed":0,"n_ran_checked":0,"n_instrument":2,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":2,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/is-bert-really-robust-natural-language-attack#ran","syntology_url":"https://syntology.ai/paper/1907.11932","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1907.11932"}},"official":{"repos":["jind11/TextFooler"],"state":"official: no sample here; runs from other or unrecorded repositories","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["unlocated"]}}},{"url":"/paper/simplifying-graph-convolutional-networks","slug":"simplifying-graph-convolutional-networks","title":"Simplifying Graph Convolutional Networks","date":"2019-02-19","arxiv_id":"1902.07153","repositories_listed":7,"syntology":{"n":8,"n_ran":8,"n_constructed":0,"n_ran_checked":7,"n_instrument":1,"n_unverified":0,"n_honours":2,"n_violates":0,"n_no_contract":5,"n_pointer_only":2,"phrase":"8 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 2 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/simplifying-graph-convolutional-networks#ran","syntology_url":"https://syntology.ai/paper/1902.07153","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1902.07153"}},"official":{"repos":["Tiiiger/SGC"],"state":"official (archive's flag): 8 ran","n_ran":8,"n_constructed":0,"n_ran_no_instrument_failure":7,"n_unverified":0,"ran_from_kinds":["official"]}}},{"url":"/paper/distributed-word-representation-in-tsetlin","slug":"distributed-word-representation-in-tsetlin","title":"Enhancing Interpretable Clauses Semantically using Pretrained Word Representation","date":"2021-04-14","arxiv_id":"2104.06901","repositories_listed":6,"syntology":null},{"url":"/paper/hatexplain-a-benchmark-dataset-for","slug":"hatexplain-a-benchmark-dataset-for","title":"HateXplain: A Benchmark Dataset for Explainable Hate Speech Detection","date":"2020-12-18","arxiv_id":"2012.10289","repositories_listed":6,"syntology":null},{"url":"/paper/squeezebert-what-can-computer-vision-teach","slug":"squeezebert-what-can-computer-vision-teach","title":"SqueezeBERT: What can computer vision teach NLP about efficient neural networks?","date":"2020-06-19","arxiv_id":"2006.11316","repositories_listed":6,"syntology":{"n":1,"n_ran":1,"n_constructed":0,"n_ran_checked":1,"n_instrument":0,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":1,"n_pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/squeezebert-what-can-computer-vision-teach#ran","syntology_url":"https://syntology.ai/paper/2006.11316","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2006.11316"}},"official":{"repos":["huggingface/transformers"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/exploiting-cloze-questions-for-few-shot-text","slug":"exploiting-cloze-questions-for-few-shot-text","title":"Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inference","date":"2020-01-21","arxiv_id":"2001.07676","repositories_listed":6,"syntology":null},{"url":"/paper/the-natural-language-decathlon-multitask","slug":"the-natural-language-decathlon-multitask","title":"The Natural Language Decathlon: Multitask Learning as Question Answering","date":"2018-06-20","arxiv_id":"1806.08730","repositories_listed":6,"syntology":{"n":13,"n_ran":13,"n_constructed":0,"n_ran_checked":12,"n_instrument":1,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":12,"n_pointer_only":4,"phrase":"13 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 0 violated, 12 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/the-natural-language-decathlon-multitask#ran","syntology_url":"https://syntology.ai/paper/1806.08730","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1806.08730"}},"official":{"repos":["salesforce/decaNLP"],"state":"official (archive's flag): 9 ran","n_ran":9,"n_constructed":0,"n_ran_no_instrument_failure":9,"n_unverified":0,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/mteb-massive-text-embedding-benchmark","slug":"mteb-massive-text-embedding-benchmark","title":"MTEB: Massive Text Embedding Benchmark","date":"2022-10-13","arxiv_id":"2210.07316","repositories_listed":5,"syntology":{"n":13,"n_ran":10,"n_constructed":0,"n_ran_checked":7,"n_instrument":3,"n_unverified":3,"n_honours":0,"n_violates":0,"n_no_contract":7,"n_pointer_only":0,"phrase":"10 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified","sample_list":"/paper/mteb-massive-text-embedding-benchmark#ran","syntology_url":"https://syntology.ai/paper/2210.07316","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2210.07316"}},"official":{"repos":["embeddings-benchmark/mteb"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/pangu-a-large-scale-autoregressive-pretrained","slug":"pangu-a-large-scale-autoregressive-pretrained","title":"PanGu-$α$: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computation","date":"2021-04-26","arxiv_id":"2104.12369","repositories_listed":5,"syntology":null},{"url":"/paper/measuring-the-novelty-of-natural-language","slug":"measuring-the-novelty-of-natural-language","title":"Measuring the Novelty of Natural Language Text Using the Conjunctive Clauses of a Tsetlin Machine Text Classifier","date":"2020-11-17","arxiv_id":"2011.08755","repositories_listed":5,"syntology":null},{"url":"/paper/an-evaluation-dataset-for-intent","slug":"an-evaluation-dataset-for-intent","title":"An Evaluation Dataset for Intent Classification and Out-of-Scope Prediction","date":"2019-09-04","arxiv_id":"1909.02027","repositories_listed":5,"syntology":null},{"url":"/paper/towards-scalable-and-reliable-capsule","slug":"towards-scalable-and-reliable-capsule","title":"Towards Scalable and Reliable Capsule Networks for Challenging NLP Applications","date":"2019-06-06","arxiv_id":"1906.02829","repositories_listed":5,"syntology":null},{"url":"/paper/nuanced-metrics-for-measuring-unintended-bias","slug":"nuanced-metrics-for-measuring-unintended-bias","title":"Nuanced Metrics for Measuring Unintended Bias with Real Data for Text Classification","date":"2019-03-11","arxiv_id":"1903.04561","repositories_listed":5,"syntology":null},{"url":"/paper/few-shot-text-classification-with-induction","slug":"few-shot-text-classification-with-induction","title":"Induction Networks for Few-Shot Text Classification","date":"2019-02-27","arxiv_id":"1902.10482","repositories_listed":5,"syntology":null},{"url":"/paper/supertml-two-dimensional-word-embedding-and","slug":"supertml-two-dimensional-word-embedding-and","title":"SuperTML: Two-Dimensional Word Embedding for the Precognition on Structured Tabular Data","date":"2019-02-26","arxiv_id":"1903.06246","repositories_listed":5,"syntology":null},{"url":"/paper/conditional-bert-contextual-augmentation","slug":"conditional-bert-contextual-augmentation","title":"Conditional BERT Contextual Augmentation","date":"2018-12-17","arxiv_id":"1812.06705","repositories_listed":5,"syntology":{"n":2,"n_ran":2,"n_constructed":0,"n_ran_checked":0,"n_instrument":2,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":2,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/conditional-bert-contextual-augmentation#ran","syntology_url":"https://syntology.ai/paper/1812.06705","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1812.06705"}},"official":null}},{"url":"/paper/pixellink-detecting-scene-text-via-instance","slug":"pixellink-detecting-scene-text-via-instance","title":"PixelLink: Detecting Scene Text via Instance Segmentation","date":"2018-01-04","arxiv_id":"1801.01315","repositories_listed":5,"syntology":null},{"url":"/paper/a-neural-network-architecture-combining-gated","slug":"a-neural-network-architecture-combining-gated","title":"A Neural Network Architecture Combining Gated Recurrent Unit (GRU) and Support Vector Machine (SVM) for Intrusion Detection in Network Traffic Data","date":"2017-09-10","arxiv_id":"1709.03082","repositories_listed":5,"syntology":null},{"url":"/paper/learned-in-translation-contextualized-word","slug":"learned-in-translation-contextualized-word","title":"Learned in Translation: Contextualized Word Vectors","date":"2017-08-01","arxiv_id":"1708.00107","repositories_listed":5,"syntology":{"n":3,"n_ran":3,"n_constructed":0,"n_ran_checked":2,"n_instrument":1,"n_unverified":0,"n_honours":2,"n_violates":0,"n_no_contract":0,"n_pointer_only":2,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/learned-in-translation-contextualized-word#ran","syntology_url":"https://syntology.ai/paper/1708.00107","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1708.00107"}},"official":{"repos":["salesforce/cove"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/deeptext-a-unified-framework-for-text","slug":"deeptext-a-unified-framework-for-text","title":"DeepText: A Unified Framework for Text Proposal Generation and Text Detection in Natural Images","date":"2016-05-24","arxiv_id":"1605.07314","repositories_listed":5,"syntology":null},{"url":"/paper/lamp-when-large-language-models-meet","slug":"lamp-when-large-language-models-meet","title":"LaMP: When Large Language Models Meet Personalization","date":"2023-04-22","arxiv_id":"2304.11406","repositories_listed":4,"syntology":{"n":13,"n_ran":12,"n_constructed":0,"n_ran_checked":11,"n_instrument":1,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":11,"n_pointer_only":1,"phrase":"12 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/lamp-when-large-language-models-meet#ran","syntology_url":"https://syntology.ai/paper/2304.11406","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2304.11406"}},"official":null}},{"url":"/paper/mgtbench-benchmarking-machine-generated-text","slug":"mgtbench-benchmarking-machine-generated-text","title":"MGTBench: Benchmarking Machine-Generated Text Detection","date":"2023-03-26","arxiv_id":"2303.14822","repositories_listed":4,"syntology":{"n":26,"n_ran":19,"n_constructed":0,"n_ran_checked":12,"n_instrument":7,"n_unverified":7,"n_honours":0,"n_violates":0,"n_no_contract":12,"n_pointer_only":5,"phrase":"19 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 0 violated, 12 with no contract checked; 7 where Syntology's instrument failed) · 7 unverified","sample_list":"/paper/mgtbench-benchmarking-machine-generated-text#ran","syntology_url":"https://syntology.ai/paper/2303.14822","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2303.14822"}},"official":{"repos":["xinleihe/mgtbench"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/emb-gam-an-interpretable-and-efficient","slug":"emb-gam-an-interpretable-and-efficient","title":"Augmenting Interpretable Models with LLMs during Training","date":"2022-09-23","arxiv_id":"2209.11799","repositories_listed":4,"syntology":{"n":12,"n_ran":8,"n_constructed":0,"n_ran_checked":6,"n_instrument":2,"n_unverified":4,"n_honours":0,"n_violates":0,"n_no_contract":6,"n_pointer_only":10,"phrase":"8 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified","sample_list":"/paper/emb-gam-an-interpretable-and-efficient#ran","syntology_url":"https://syntology.ai/paper/2209.11799","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2209.11799"}},"official":{"repos":["csinva/emb-gam","csinva/imodelsX","microsoft/augmented-interpretable-models"],"state":"official (archive's flag): 8 ran","n_ran":8,"n_constructed":0,"n_ran_no_instrument_failure":6,"n_unverified":4,"ran_from_kinds":["official"]}}},{"url":"/paper/protoformer-embedding-prototypes-for-1","slug":"protoformer-embedding-prototypes-for-1","title":"Protoformer: Embedding Prototypes for Transformers","date":"2022-06-25","arxiv_id":"2206.12710","repositories_listed":4,"syntology":null},{"url":"/paper/klue-korean-language-understanding-evaluation","slug":"klue-korean-language-understanding-evaluation","title":"KLUE: Korean Language Understanding Evaluation","date":"2021-05-20","arxiv_id":"2105.09680","repositories_listed":4,"syntology":null},{"url":"/paper/ktrain-a-low-code-library-for-augmented","slug":"ktrain-a-low-code-library-for-augmented","title":"ktrain: A Low-Code Library for Augmented Machine Learning","date":"2020-04-19","arxiv_id":"2004.10703","repositories_listed":4,"syntology":{"n":16,"n_ran":4,"n_constructed":0,"n_ran_checked":4,"n_instrument":0,"n_unverified":12,"n_honours":0,"n_violates":0,"n_no_contract":4,"n_pointer_only":0,"phrase":"4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 12 unverified","sample_list":"/paper/ktrain-a-low-code-library-for-augmented#ran","syntology_url":"https://syntology.ai/paper/2004.10703","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2004.10703"}},"official":{"repos":["amaiya/ktrain"],"state":"official: harvested, nothing ran","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":10,"ran_from_kinds":["listed"]}}},{"url":"/paper/benchmarking-zero-shot-text-classification","slug":"benchmarking-zero-shot-text-classification","title":"Benchmarking Zero-shot Text Classification: Datasets, Evaluation and Entailment Approach","date":"2019-08-31","arxiv_id":"1909.00161","repositories_listed":4,"syntology":{"n":6,"n_ran":3,"n_constructed":0,"n_ran_checked":1,"n_instrument":2,"n_unverified":3,"n_honours":0,"n_violates":0,"n_no_contract":1,"n_pointer_only":3,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified","sample_list":"/paper/benchmarking-zero-shot-text-classification#ran","syntology_url":"https://syntology.ai/paper/1909.00161","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1909.00161"}},"official":{"repos":["yinwenpeng/BenchmarkingZeroShot"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","official","unlocated"]}}},{"url":"/paper/ml-net-multi-label-classification-of","slug":"ml-net-multi-label-classification-of","title":"ML-Net: multi-label classification of biomedical texts with deep neural networks","date":"2018-11-13","arxiv_id":"1811.05475","repositories_listed":4,"syntology":null},{"url":"/paper/investigating-capsule-networks-with-dynamic","slug":"investigating-capsule-networks-with-dynamic","title":"Investigating Capsule Networks with Dynamic Routing for Text Classification","date":"2018-03-29","arxiv_id":"1804.00538","repositories_listed":4,"syntology":null},{"url":"/paper/deconvolutional-paragraph-representation","slug":"deconvolutional-paragraph-representation","title":"Deconvolutional Paragraph Representation Learning","date":"2017-08-16","arxiv_id":"1708.04729","repositories_listed":4,"syntology":null},{"url":"/paper/all-but-the-top-simple-and-effective","slug":"all-but-the-top-simple-and-effective","title":"All-but-the-Top: Simple and Effective Postprocessing for Word Representations","date":"2017-02-05","arxiv_id":"1702.01417","repositories_listed":4,"syntology":{"n":26,"n_ran":21,"n_constructed":0,"n_ran_checked":21,"n_instrument":0,"n_unverified":5,"n_honours":0,"n_violates":0,"n_no_contract":21,"n_pointer_only":2,"phrase":"21 ran (of which 0 constructed an object rather than computing a result; 21 with no instrument failure: 0 honoured, 0 violated, 21 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified","sample_list":"/paper/all-but-the-top-simple-and-effective#ran","syntology_url":"https://syntology.ai/paper/1702.01417","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1702.01417"}},"official":null}},{"url":"/paper/scdv-sparse-composite-document-vectors-using","slug":"scdv-sparse-composite-document-vectors-using","title":"SCDV : Sparse Composite Document Vectors using soft clustering over distributional representations","date":"2016-12-20","arxiv_id":"1612.06778","repositories_listed":4,"syntology":null},{"url":"/paper/optimization-methods-for-large-scale-machine","slug":"optimization-methods-for-large-scale-machine","title":"Optimization Methods for Large-Scale Machine Learning","date":"2016-06-15","arxiv_id":"1606.04838","repositories_listed":4,"syntology":null},{"url":"/paper/adversarial-training-methods-for-semi","slug":"adversarial-training-methods-for-semi","title":"Adversarial Training Methods for Semi-Supervised Text Classification","date":"2016-05-25","arxiv_id":"1605.07725","repositories_listed":4,"syntology":null},{"url":"/paper/swift-a-scalable-lightweight-infrastructure","slug":"swift-a-scalable-lightweight-infrastructure","title":"SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuning","date":"2024-08-10","arxiv_id":"2408.05517","repositories_listed":3,"syntology":{"n":1,"n_ran":0,"n_constructed":0,"n_ran_checked":0,"n_instrument":0,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":1,"phrase":"0 ran · 1 unverified","sample_list":"/paper/swift-a-scalable-lightweight-infrastructure#ran","syntology_url":"https://syntology.ai/paper/2408.05517","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2408.05517"}},"official":{"repos":["modelscope/ms-swift","modelscope/swift"],"state":"official: harvested, nothing ran","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":1,"ran_from_kinds":[]}}},{"url":"/paper/modulora-finetuning-3-bit-llms-on-consumer","slug":"modulora-finetuning-3-bit-llms-on-consumer","title":"ModuLoRA: Finetuning 2-Bit LLMs on Consumer GPUs by Integrating with Modular Quantizers","date":"2023-09-28","arxiv_id":"2309.16119","repositories_listed":3,"syntology":{"n":9,"n_ran":5,"n_constructed":0,"n_ran_checked":3,"n_instrument":2,"n_unverified":4,"n_honours":0,"n_violates":0,"n_no_contract":3,"n_pointer_only":8,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified","sample_list":"/paper/modulora-finetuning-3-bit-llms-on-consumer#ran","syntology_url":"https://syntology.ai/paper/2309.16119","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2309.16119"}},"official":{"repos":["kuleshov-group/llmtools","kuleshov-group/modulora-experiment"],"state":"official (archive's flag): 5 ran","n_ran":5,"n_constructed":0,"n_ran_no_instrument_failure":3,"n_unverified":4,"ran_from_kinds":["official"]}}},{"url":"/paper/multiscale-positive-unlabeled-detection-of-ai","slug":"multiscale-positive-unlabeled-detection-of-ai","title":"Multiscale Positive-Unlabeled Detection of AI-Generated Texts","date":"2023-05-29","arxiv_id":"2305.18149","repositories_listed":3,"syntology":{"n":3,"n_ran":3,"n_constructed":0,"n_ran_checked":0,"n_instrument":3,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/multiscale-positive-unlabeled-detection-of-ai#ran","syntology_url":"https://syntology.ai/paper/2305.18149","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2305.18149"}},"official":{"repos":["yuchuantian/aigc_text_detector","huawei-noah/Efficient-Computing","mindspore-lab/mindone"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]}}},{"url":"/paper/climabench-a-benchmark-dataset-for-climate","slug":"climabench-a-benchmark-dataset-for-climate","title":"Towards Answering Climate Questionnaires from Unstructured Climate Reports","date":"2023-01-11","arxiv_id":"2301.04253","repositories_listed":3,"syntology":{"n":3,"n_ran":0,"n_constructed":0,"n_ran_checked":0,"n_instrument":0,"n_unverified":3,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":3,"phrase":"0 ran · 3 unverified","sample_list":"/paper/climabench-a-benchmark-dataset-for-climate#ran","syntology_url":"https://syntology.ai/paper/2301.04253","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2301.04253"}},"official":{"repos":["climabench/climabench"],"state":"official: harvested, nothing ran","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":3,"ran_from_kinds":[]}}},{"url":"/paper/correlation-networks-for-extreme-multi-label","slug":"correlation-networks-for-extreme-multi-label","title":"Correlation Networks for Extreme Multi-label Text Classification","date":"2022-08-23","arxiv_id":null,"repositories_listed":3,"syntology":null},{"url":"/paper/zerogen-efficient-zero-shot-learning-via","slug":"zerogen-efficient-zero-shot-learning-via","title":"ZeroGen: Efficient Zero-shot Learning via Dataset Generation","date":"2022-02-16","arxiv_id":"2202.07922","repositories_listed":3,"syntology":{"n":7,"n_ran":3,"n_constructed":0,"n_ran_checked":0,"n_instrument":3,"n_unverified":4,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":7,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 4 unverified","sample_list":"/paper/zerogen-efficient-zero-shot-learning-via#ran","syntology_url":"https://syntology.ai/paper/2202.07922","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2202.07922"}},"official":{"repos":["HKUNLP/zerogen"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":4,"ran_from_kinds":["official"]}}},{"url":"/paper/signguard-byzantine-robust-federated-learning","slug":"signguard-byzantine-robust-federated-learning","title":"Byzantine-robust Federated Learning through Collaborative Malicious Gradient Filtering","date":"2021-09-13","arxiv_id":"2109.05872","repositories_listed":3,"syntology":null},{"url":"/paper/chinesebert-chinese-pretraining-enhanced-by","slug":"chinesebert-chinese-pretraining-enhanced-by","title":"ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information","date":"2021-06-30","arxiv_id":"2106.16038","repositories_listed":3,"syntology":null},{"url":"/paper/generating-natural-language-attacks-in-a-hard","slug":"generating-natural-language-attacks-in-a-hard","title":"Generating Natural Language Attacks in a Hard Label Black Box Setting","date":"2020-12-29","arxiv_id":"2012.14956","repositories_listed":3,"syntology":{"n":6,"n_ran":6,"n_constructed":0,"n_ran_checked":1,"n_instrument":5,"n_unverified":0,"n_honours":1,"n_violates":0,"n_no_contract":0,"n_pointer_only":6,"phrase":"6 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 5 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/generating-natural-language-attacks-in-a-hard#ran","syntology_url":"https://syntology.ai/paper/2012.14956","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2012.14956"}},"official":{"repos":["RishabhMaheshwary/hard-label-attack"],"state":"official (archive's flag): 4 ran","n_ran":4,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/transformer-interpretability-beyond-attention","slug":"transformer-interpretability-beyond-attention","title":"Transformer Interpretability Beyond Attention Visualization","date":"2020-12-17","arxiv_id":"2012.09838","repositories_listed":3,"syntology":{"n":1,"n_ran":0,"n_constructed":0,"n_ran_checked":0,"n_instrument":0,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"0 ran · 1 unverified","sample_list":"/paper/transformer-interpretability-beyond-attention#ran","syntology_url":"https://syntology.ai/paper/2012.09838","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2012.09838"}},"official":{"repos":["hila-chefer/Transformer-Explainability"],"state":"official: harvested, nothing ran","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":1,"ran_from_kinds":[]}}},{"url":"/paper/hypertext-endowing-fasttext-with-hyperbolic","slug":"hypertext-endowing-fasttext-with-hyperbolic","title":"HyperText: Endowing FastText with Hyperbolic Geometry","date":"2020-10-30","arxiv_id":"2010.16143","repositories_listed":3,"syntology":{"n":2,"n_ran":1,"n_constructed":0,"n_ran_checked":1,"n_instrument":0,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":1,"n_pointer_only":1,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/hypertext-endowing-fasttext-with-hyperbolic#ran","syntology_url":"https://syntology.ai/paper/2010.16143","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2010.16143"}},"official":null}},{"url":"/paper/x-class-text-classification-with-extremely","slug":"x-class-text-classification-with-extremely","title":"X-Class: Text Classification with Extremely Weak Supervision","date":"2020-10-24","arxiv_id":"2010.12794","repositories_listed":3,"syntology":null},{"url":"/paper/learning-variational-word-masks-to-improve","slug":"learning-variational-word-masks-to-improve","title":"Learning Variational Word Masks to Improve the Interpretability of Neural Text Classifiers","date":"2020-10-01","arxiv_id":"2010.00667","repositories_listed":3,"syntology":{"n":1,"n_ran":1,"n_constructed":1,"n_ran_checked":1,"n_instrument":0,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":1,"n_pointer_only":1,"phrase":"1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result","sample_list":"/paper/learning-variational-word-masks-to-improve#ran","syntology_url":"https://syntology.ai/paper/2010.00667","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2010.00667"}},"official":{"repos":["UVa-NLP/VMASK"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":1,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}},{"url":"/paper/a-hybrid-classification-approach-using-topic","slug":"a-hybrid-classification-approach-using-topic","title":"A Hybrid Classification Approach using Topic Modeling and Graph Convolution Networks","date":"2020-09-19","arxiv_id":null,"repositories_listed":3,"syntology":null},{"url":"/paper/funnel-transformer-filtering-out-sequential","slug":"funnel-transformer-filtering-out-sequential","title":"Funnel-Transformer: Filtering out Sequential Redundancy for Efficient Language Processing","date":"2020-06-05","arxiv_id":"2006.03236","repositories_listed":3,"syntology":{"n":2,"n_ran":2,"n_constructed":0,"n_ran_checked":1,"n_instrument":1,"n_unverified":0,"n_honours":1,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/funnel-transformer-filtering-out-sequential#ran","syntology_url":"https://syntology.ai/paper/2006.03236","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2006.03236"}},"official":{"repos":["laiguokun/Funnel-Transformer"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}},{"url":"/paper/parsbert-transformer-based-model-for-persian","slug":"parsbert-transformer-based-model-for-persian","title":"ParsBERT: Transformer-based Model for Persian Language Understanding","date":"2020-05-26","arxiv_id":"2005.12515","repositories_listed":3,"syntology":null},{"url":"/paper/bertweet-a-pre-trained-language-model-for","slug":"bertweet-a-pre-trained-language-model-for","title":"BERTweet: A pre-trained language model for English Tweets","date":"2020-05-20","arxiv_id":"2005.10200","repositories_listed":3,"syntology":null},{"url":"/paper/incorporating-bert-into-neural-machine-1","slug":"incorporating-bert-into-neural-machine-1","title":"Incorporating BERT into Neural Machine Translation","date":"2020-02-17","arxiv_id":"2002.06823","repositories_listed":3,"syntology":null},{"url":"/paper/deep-learning-with-gaussian-differential","slug":"deep-learning-with-gaussian-differential","title":"Deep Learning with Gaussian Differential Privacy","date":"2019-11-26","arxiv_id":"1911.11607","repositories_listed":3,"syntology":{"n":4,"n_ran":3,"n_constructed":0,"n_ran_checked":3,"n_instrument":0,"n_unverified":1,"n_honours":0,"n_violates":3,"n_no_contract":0,"n_pointer_only":4,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 3 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/deep-learning-with-gaussian-differential#ran","syntology_url":"https://syntology.ai/paper/1911.11607","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1911.11607"}},"official":{"repos":["woodyx218/Deep-Learning-with-GDP"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/ludwig-a-type-based-declarative-deep-learning","slug":"ludwig-a-type-based-declarative-deep-learning","title":"Ludwig: a type-based declarative deep learning toolbox","date":"2019-09-17","arxiv_id":"1909.07930","repositories_listed":3,"syntology":null},{"url":"/paper/neural-attentive-bag-of-entities-model-for","slug":"neural-attentive-bag-of-entities-model-for","title":"Neural Attentive Bag-of-Entities Model for Text Classification","date":"2019-09-03","arxiv_id":"1909.01259","repositories_listed":3,"syntology":null},{"url":"/paper/language-model-embeddings-improve-sentiment","slug":"language-model-embeddings-improve-sentiment","title":"LANGUAGE MODEL EMBEDDINGS IMPROVE SENTIMENT ANALYSIS IN RUSSIAN","date":"2019-05-29","arxiv_id":null,"repositories_listed":3,"syntology":null},{"url":"/paper/docbert-bert-for-document-classification","slug":"docbert-bert-for-document-classification","title":"DocBERT: BERT for Document Classification","date":"2019-04-17","arxiv_id":"1904.08398","repositories_listed":3,"syntology":{"n":14,"n_ran":11,"n_constructed":0,"n_ran_checked":11,"n_instrument":0,"n_unverified":3,"n_honours":0,"n_violates":0,"n_no_contract":11,"n_pointer_only":0,"phrase":"11 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified","sample_list":"/paper/docbert-bert-for-document-classification#ran","syntology_url":"https://syntology.ai/paper/1904.08398","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1904.08398"}},"official":{"repos":["castorini/hedwig"],"state":"official (archive's flag): 6 ran","n_ran":6,"n_constructed":0,"n_ran_no_instrument_failure":6,"n_unverified":1,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/attentionxml-extreme-multi-label-text","slug":"attentionxml-extreme-multi-label-text","title":"AttentionXML: Label Tree-based Attention-Aware Deep Model for High-Performance Extreme Multi-Label Text Classification","date":"2018-11-01","arxiv_id":"1811.01727","repositories_listed":3,"syntology":{"n":3,"n_ran":3,"n_constructed":0,"n_ran_checked":0,"n_instrument":3,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":3,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/attentionxml-extreme-multi-label-text#ran","syntology_url":"https://syntology.ai/paper/1811.01727","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1811.01727"}},"official":{"repos":["yourh/AttentionXML"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/subword-semantic-hashing-for-intent","slug":"subword-semantic-hashing-for-intent","title":"Subword Semantic Hashing for Intent Classification on Small Datasets","date":"2018-10-16","arxiv_id":"1810.07150","repositories_listed":3,"syntology":null},{"url":"/paper/cail2018-a-large-scale-legal-dataset-for","slug":"cail2018-a-large-scale-legal-dataset-for","title":"CAIL2018: A Large-Scale Legal Dataset for Judgment Prediction","date":"2018-07-04","arxiv_id":"1807.02478","repositories_listed":3,"syntology":{"n":4,"n_ran":1,"n_constructed":0,"n_ran_checked":1,"n_instrument":0,"n_unverified":3,"n_honours":0,"n_violates":0,"n_no_contract":1,"n_pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified","sample_list":"/paper/cail2018-a-large-scale-legal-dataset-for#ran","syntology_url":"https://syntology.ai/paper/1807.02478","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1807.02478"}},"official":null}},{"url":"/paper/hdltex-hierarchical-deep-learning-for-text","slug":"hdltex-hierarchical-deep-learning-for-text","title":"HDLTex: Hierarchical Deep Learning for Text Classification","date":"2017-09-24","arxiv_id":"1709.08267","repositories_listed":3,"syntology":null},{"url":"/paper/starspace-embed-all-the-things","slug":"starspace-embed-all-the-things","title":"StarSpace: Embed All The Things!","date":"2017-09-12","arxiv_id":"1709.03856","repositories_listed":3,"syntology":null},{"url":"/paper/which-encoding-is-the-best-for-text","slug":"which-encoding-is-the-best-for-text","title":"Which Encoding is the Best for Text Classification in Chinese, English, Japanese and Korean?","date":"2017-08-08","arxiv_id":"1708.02657","repositories_listed":3,"syntology":null},{"url":"/paper/on-the-role-of-text-preprocessing-in-neural","slug":"on-the-role-of-text-preprocessing-in-neural","title":"On the Role of Text Preprocessing in Neural Network Architectures: An Evaluation Study on Text Categorization and Sentiment Analysis","date":"2017-07-06","arxiv_id":"1707.01780","repositories_listed":3,"syntology":null},{"url":"/paper/text-classification-improved-by-integrating","slug":"text-classification-improved-by-integrating","title":"Text Classification Improved by Integrating Bidirectional LSTM with Two-dimensional Max Pooling","date":"2016-11-21","arxiv_id":"1611.06639","repositories_listed":3,"syntology":null},{"url":"/paper/capo-cost-aware-prompt-optimization","slug":"capo-cost-aware-prompt-optimization","title":"CAPO: Cost-Aware Prompt Optimization","date":"2025-04-22","arxiv_id":"2504.16005","repositories_listed":2,"syntology":null},{"url":"/paper/survey-on-abstractive-text-summarization","slug":"survey-on-abstractive-text-summarization","title":"Survey on Abstractive Text Summarization: Dataset, Models, and Metrics","date":"2024-12-22","arxiv_id":"2412.17165","repositories_listed":2,"syntology":null},{"url":"/paper/unconstrained-open-vocabulary-image","slug":"unconstrained-open-vocabulary-image","title":"Unconstrained Open Vocabulary Image Classification: Zero-Shot Transfer from Text to Image via CLIP Inversion","date":"2024-07-15","arxiv_id":"2407.11211","repositories_listed":2,"syntology":null},{"url":"/paper/text-based-detection-of-on-hold-scripts-in","slug":"text-based-detection-of-on-hold-scripts-in","title":"Text-Based Detection of On-Hold Scripts in Contact Center Calls","date":"2024-07-13","arxiv_id":"2407.09849","repositories_listed":2,"syntology":null},{"url":"/paper/user-story-tutor-ust-to-support-agile","slug":"user-story-tutor-ust-to-support-agile","title":"User Story Tutor (UST) to Support Agile Software Developers","date":"2024-06-24","arxiv_id":"2406.16259","repositories_listed":2,"syntology":null},{"url":"/paper/benchmarking-large-language-models-on-cflue-a","slug":"benchmarking-large-language-models-on-cflue-a","title":"Benchmarking Large Language Models on CFLUE -- A Chinese Financial Language Understanding Evaluation Dataset","date":"2024-05-17","arxiv_id":"2405.10542","repositories_listed":2,"syntology":null},{"url":"/paper/mixlora-enhancing-large-language-models-fine","slug":"mixlora-enhancing-large-language-models-fine","title":"MixLoRA: Enhancing Large Language Models Fine-Tuning with LoRA-based Mixture of Experts","date":"2024-04-22","arxiv_id":"2404.15159","repositories_listed":2,"syntology":{"n":11,"n_ran":6,"n_constructed":0,"n_ran_checked":3,"n_instrument":3,"n_unverified":5,"n_honours":1,"n_violates":1,"n_no_contract":1,"n_pointer_only":0,"phrase":"6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 1 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 5 unverified","sample_list":"/paper/mixlora-enhancing-large-language-models-fine#ran","syntology_url":"https://syntology.ai/paper/2404.15159","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2404.15159"}},"official":{"repos":["TUDB-Labs/MixLoRA","mikecovlee/mLoRA"],"state":"official (archive's flag): 6 ran","n_ran":6,"n_constructed":0,"n_ran_no_instrument_failure":3,"n_unverified":5,"ran_from_kinds":["official"]}}},{"url":"/paper/peach-pretrained-embedding-explanation-across","slug":"peach-pretrained-embedding-explanation-across","title":"PEACH: Pretrained-embedding Explanation Across Contextual and Hierarchical Structure","date":"2024-04-21","arxiv_id":"2404.13645","repositories_listed":2,"syntology":null},{"url":"/paper/improving-image-classification-accuracy","slug":"improving-image-classification-accuracy","title":"SynerMix: Synergistic Mixup Solution for Enhanced Intra-Class Cohesion and Inter-Class Separability in Image Classification","date":"2024-03-21","arxiv_id":"2403.14137","repositories_listed":2,"syntology":null}],"syntology_records":52,"syntology_note":"a paper without a record is not a recorded non-run: it may lack an arXiv id or simply be absent from the graph layer"},"key_notes":{"n_ran_checked":"legacy name, kept unchanged so existing readers do not break: it counts the samples that ran with no instrument failure (honoured, violated, and ran with no contract checked); it does not mean a contract was checked, and the pages print it as 'K with no instrument failure', not 'K checked'","n_constructed":"a sub-count of the samples that ran, never subtracted from them and never a failure: an executed sample whose run returned an instance of its own class (fixture_out_type equals the entry name): the run built an object and did not compute a result (Syntology's RAN record, counts.constructed)"},"since_archive_judged":{"papers":35,"papers_placed":1,"judged_by":{"model":"Claude Sonnet 4.5","models_as_recorded":["global.anthropic.claude-sonnet-4-5-20250929-v1:0"],"from":"lb_rows_run_verified.jsonl: each record's `model` field (the extractor's call that wrote decisions[])"},"note":"a model's judgement from the paper's own tables that they report on this leaderboard, not a result: no value from a paper that was not placed is printed or carried here; papers counts each paper once over these leaderboards","backfill":"8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read)","backfill_complete":false,"leaderboards":[{"leaderboard":"/sota/text-classification-on-mteb","since_archive":"/sota/text-classification-on-mteb#since-judged","papers_judged":4,"placed":0},{"leaderboard":"/sota/text-classification-on-ag-news","since_archive":"/sota/text-classification-on-ag-news#since-judged","papers_judged":2,"placed":0},{"leaderboard":"/sota/text-classification-on-imdb","since_archive":"/sota/text-classification-on-imdb#since-judged","papers_judged":8,"placed":0},{"leaderboard":"/sota/text-classification-on-mr","since_archive":"/sota/text-classification-on-mr#since-judged","papers_judged":2,"placed":0},{"leaderboard":"/sota/text-classification-on-yahoo-answers","since_archive":"/sota/text-classification-on-yahoo-answers#since-judged","papers_judged":1,"placed":0},{"leaderboard":"/sota/text-classification-on-glue-sst2","since_archive":"/sota/text-classification-on-glue-sst2#since-judged","papers_judged":13,"placed":1},{"leaderboard":"/sota/text-classification-on-sst-2","since_archive":"/sota/text-classification-on-sst-2#since-judged","papers_judged":15,"placed":0},{"leaderboard":"/sota/text-classification-on-banking77","since_archive":"/sota/text-classification-on-banking77#since-judged","papers_judged":3,"placed":0},{"leaderboard":"/sota/text-classification-on-glue-cola","since_archive":"/sota/text-classification-on-glue-cola#since-judged","papers_judged":1,"placed":0},{"leaderboard":"/sota/text-classification-on-glue-mrpc","since_archive":"/sota/text-classification-on-glue-mrpc#since-judged","papers_judged":3,"placed":0},{"leaderboard":"/sota/text-classification-on-glue-rte","since_archive":"/sota/text-classification-on-glue-rte#since-judged","papers_judged":4,"placed":0},{"leaderboard":"/sota/text-classification-on-trec-10","since_archive":"/sota/text-classification-on-trec-10#since-judged","papers_judged":3,"placed":0}]},"papers_where_code_ran":272,"papers_where_code_ran_first_page":"/task/text-classification/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not run it on this task or check it against the task's benchmarks.","pages":[{"order":"archive","page":2,"of":37,"url":"/task/text-classification/papers/2","json":"/task/text-classification/papers/2.json","rows":100},{"order":"archive","page":3,"of":37,"url":"/task/text-classification/papers/3","json":"/task/text-classification/papers/3.json","rows":100},{"order":"archive","page":4,"of":37,"url":"/task/text-classification/papers/4","json":"/task/text-classification/papers/4.json","rows":100},{"order":"archive","page":5,"of":37,"url":"/task/text-classification/papers/5","json":"/task/text-classification/papers/5.json","rows":100},{"order":"archive","page":6,"of":37,"url":"/task/text-classification/papers/6","json":"/task/text-classification/papers/6.json","rows":100},{"order":"archive","page":7,"of":37,"url":"/task/text-classification/papers/7","json":"/task/text-classification/papers/7.json","rows":100},{"order":"archive","page":8,"of":37,"url":"/task/text-classification/papers/8","json":"/task/text-classification/papers/8.json","rows":100},{"order":"archive","page":9,"of":37,"url":"/task/text-classification/papers/9","json":"/task/text-classification/papers/9.json","rows":100},{"order":"archive","page":10,"of":37,"url":"/task/text-classification/papers/10","json":"/task/text-classification/papers/10.json","rows":100},{"order":"archive","page":11,"of":37,"url":"/task/text-classification/papers/11","json":"/task/text-classification/papers/11.json","rows":100},{"order":"archive","page":12,"of":37,"url":"/task/text-classification/papers/12","json":"/task/text-classification/papers/12.json","rows":100},{"order":"archive","page":13,"of":37,"url":"/task/text-classification/papers/13","json":"/task/text-classification/papers/13.json","rows":100},{"order":"archive","page":14,"of":37,"url":"/task/text-classification/papers/14","json":"/task/text-classification/papers/14.json","rows":100},{"order":"archive","page":15,"of":37,"url":"/task/text-classification/papers/15","json":"/task/text-classification/papers/15.json","rows":100},{"order":"archive","page":16,"of":37,"url":"/task/text-classification/papers/16","json":"/task/text-classification/papers/16.json","rows":100},{"order":"archive","page":17,"of":37,"url":"/task/text-classification/papers/17","json":"/task/text-classification/papers/17.json","rows":100},{"order":"archive","page":18,"of":37,"url":"/task/text-classification/papers/18","json":"/task/text-classification/papers/18.json","rows":100},{"order":"archive","page":19,"of":37,"url":"/task/text-classification/papers/19","json":"/task/text-classification/papers/19.json","rows":100},{"order":"archive","page":20,"of":37,"url":"/task/text-classification/papers/20","json":"/task/text-classification/papers/20.json","rows":100},{"order":"archive","page":21,"of":37,"url":"/task/text-classification/papers/21","json":"/task/text-classification/papers/21.json","rows":100},{"order":"archive","page":22,"of":37,"url":"/task/text-classification/papers/22","json":"/task/text-classification/papers/22.json","rows":100},{"order":"archive","page":23,"of":37,"url":"/task/text-classification/papers/23","json":"/task/text-classification/papers/23.json","rows":100},{"order":"archive","page":24,"of":37,"url":"/task/text-classification/papers/24","json":"/task/text-classification/papers/24.json","rows":100},{"order":"archive","page":25,"of":37,"url":"/task/text-classification/papers/25","json":"/task/text-classification/papers/25.json","rows":100},{"order":"archive","page":26,"of":37,"url":"/task/text-classification/papers/26","json":"/task/text-classification/papers/26.json","rows":100},{"order":"archive","page":27,"of":37,"url":"/task/text-classification/papers/27","json":"/task/text-classification/papers/27.json","rows":100},{"order":"archive","page":28,"of":37,"url":"/task/text-classification/papers/28","json":"/task/text-classification/papers/28.json","rows":100},{"order":"archive","page":29,"of":37,"url":"/task/text-classification/papers/29","json":"/task/text-classification/papers/29.json","rows":100},{"order":"archive","page":30,"of":37,"url":"/task/text-classification/papers/30","json":"/task/text-classification/papers/30.json","rows":100},{"order":"archive","page":31,"of":37,"url":"/task/text-classification/papers/31","json":"/task/text-classification/papers/31.json","rows":100},{"order":"archive","page":32,"of":37,"url":"/task/text-classification/papers/32","json":"/task/text-classification/papers/32.json","rows":100},{"order":"archive","page":33,"of":37,"url":"/task/text-classification/papers/33","json":"/task/text-classification/papers/33.json","rows":100},{"order":"archive","page":34,"of":37,"url":"/task/text-classification/papers/34","json":"/task/text-classification/papers/34.json","rows":100},{"order":"archive","page":35,"of":37,"url":"/task/text-classification/papers/35","json":"/task/text-classification/papers/35.json","rows":100},{"order":"archive","page":36,"of":37,"url":"/task/text-classification/papers/36","json":"/task/text-classification/papers/36.json","rows":100},{"order":"archive","page":37,"of":37,"url":"/task/text-classification/papers/37","json":"/task/text-classification/papers/37.json","rows":35},{"order":"ran","page":1,"of":3,"url":"/task/text-classification/papers/ran/1","json":"/task/text-classification/papers/ran/1.json","rows":100},{"order":"ran","page":2,"of":3,"url":"/task/text-classification/papers/ran/2","json":"/task/text-classification/papers/ran/2.json","rows":100},{"order":"ran","page":3,"of":3,"url":"/task/text-classification/papers/ran/3","json":"/task/text-classification/papers/ran/3.json","rows":72}],"description_links":{"kept":0,"unwrapped_to_text":0,"bare_urls_linked":0,"relative_images_dropped":0,"rule":"internal links are kept only when the target slug exists in the catalog"},"syntology":{"read_at":"2026-10-05T00:36:11+00:00","claim":"Per-sample execution status on synthesized fixtures ('ran N of M samples'); not a correctness claim and not a ranking signal.","status_vocabulary":{"ran_honours":"ran, honoured the contract we drafted","ran_violates":"ran, violated the contract we drafted","ran_draft_wrong":"ran; our contract draft was wrong, not the code","ran_fixture":"ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT)","ran":"ran on a synthesized input","unverified":"unverified (harvested, no recorded run)"},"row_route":"each syntology object on a benchmark's first row and on a paper carries sample_list (this site's paper page, #ran), syntology_url (syntology.ai's page for the paper, only when that route probed live) and mcp (the agent call that lists the paper's harvested samples; not a verdict on the paper)","developers":"https://syntology.ai/developers"},"not_shown":{"libraries":"the archive has no per-task library table","trend_sparklines":"the Trend column of the benchmarks table was a rendered image; it is not in the archive","social_and_latest_sorts":"stars and social signals are not in the archive"},"record_sha256":"801a7575aed5354798385177c0da6bb1af3a8dd25da8700a6a0b061c1cf5ba0d","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}