{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/task/text-generation","name":"Text Generation","slug":"text-generation","description_markdown":"**Text Generation** is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as \"natural language generation\" in the literature.\r\n\r\nText generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include [BART](/method/bart), [GPT](/method/gpt) and other [GAN-based approaches](/method/gan). Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU. \r\n\r\nFurther readings:\r\n\r\n- [The survey: Text generation models in deep learning](https://www.sciencedirect.com/science/article/pii/S1319157820303360)\r\n- [Modern Methods for Text Generation](https://arxiv.org/abs/2009.04968)\r\n\r\n<span style=\"color:grey; opacity: 0.6\">( Image credit: [Adversarial Ranking for Language Generation](https://arxiv.org/abs/1705.11001) )</span>","categories":[{"name":"Adversarial","url":"/area/adversarial"},{"name":"Computer Code","url":"/area/computer-code"},{"name":"Natural Language Processing","url":"/area/natural-language-processing"},{"name":"Speech","url":"/area/speech"}],"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","slug_source":"archive_url"},"counts":{"papers_tagged":5335,"papers_with_code":2047,"benchmarks":20,"benchmark_tables_in_archive":155,"benchmark_tables_shown":155,"benchmark_tables_withheld_as_spam":0,"benchmark_definition":"a leaderboard table with at least one row; benchmark_tables_shown also counts the zero-row tables; benchmark_tables_in_archive adds the tables withheld as spam","datasets":162,"subtasks":25,"parent_tasks":0},"benchmarks":[{"leaderboard":"/sota/text-generation-on-dart","slug":"text-generation-on-dart","dataset":"DART","dataset_url":"/dataset/dart","rows_in_archive":7,"metrics":["BLEU","METEOR","FactSpotter"],"first_row_in_archive_order":{"model":"T5B Baseline","paper_title":"FactSpotter: Evaluating the Factual Faithfulness of Graph-to-Text Generation","paper_url":"/paper/factspotter-evaluating-the-factual","paper_date":"2023-10-25","arxiv_id":null,"code_links":[{"title":"guihuzhang/FactSpotter","url":"https://github.com/guihuzhang/FactSpotter"}],"syntology":null}},{"leaderboard":"/sota/text-generation-on-coco-captions","slug":"text-generation-on-coco-captions","dataset":"COCO Captions","dataset_url":"/dataset/coco-captions","rows_in_archive":5,"metrics":["BLEU-2","BLEU-3","BLEU-4","BLEU-5"],"first_row_in_archive_order":{"model":"LeakGAN","paper_title":"Long Text Generation via Adversarial Training with Leaked Information","paper_url":"/paper/long-text-generation-via-adversarial-training","paper_date":"2017-09-24","arxiv_id":"1709.08624","code_links":[{"title":"CR-Gjx/LeakGAN","url":"https://github.com/CR-Gjx/LeakGAN"},{"title":"nurpeiis/LeakGAN-PyTorch","url":"https://github.com/nurpeiis/LeakGAN-PyTorch"},{"title":"valko073/LyricsGANs","url":"https://github.com/valko073/LyricsGANs"},{"title":"rupes438/CodeGen","url":"https://github.com/rupes438/CodeGen"},{"title":"liyzcj/leakgan-py3","url":"https://github.com/liyzcj/leakgan-py3"},{"title":"universebh/text_generation_fsa_gan","url":"https://github.com/universebh/text_generation_fsa_gan"}],"syntology":{"n":2,"n_ran":2,"n_constructed":0,"n_ran_checked":2,"n_instrument":0,"n_unverified":0,"n_honours":2,"n_violates":0,"n_no_contract":0,"n_pointer_only":2,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/long-text-generation-via-adversarial-training#ran","syntology_url":"https://syntology.ai/paper/1709.08624","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1709.08624"}},"official":{"repos":["CR-Gjx/LeakGAN"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}}},{"leaderboard":"/sota/text-generation-on-emnlp2017-wmt","slug":"text-generation-on-emnlp2017-wmt","dataset":"EMNLP2017 WMT","dataset_url":null,"rows_in_archive":5,"metrics":["BLEU-2","BLEU-3","BLEU-4","BLEU-5","NLLgen"],"first_row_in_archive_order":{"model":"LeakGAN","paper_title":"Long Text Generation via Adversarial Training with Leaked Information","paper_url":"/paper/long-text-generation-via-adversarial-training","paper_date":"2017-09-24","arxiv_id":"1709.08624","code_links":[{"title":"CR-Gjx/LeakGAN","url":"https://github.com/CR-Gjx/LeakGAN"},{"title":"nurpeiis/LeakGAN-PyTorch","url":"https://github.com/nurpeiis/LeakGAN-PyTorch"},{"title":"valko073/LyricsGANs","url":"https://github.com/valko073/LyricsGANs"},{"title":"rupes438/CodeGen","url":"https://github.com/rupes438/CodeGen"},{"title":"liyzcj/leakgan-py3","url":"https://github.com/liyzcj/leakgan-py3"},{"title":"universebh/text_generation_fsa_gan","url":"https://github.com/universebh/text_generation_fsa_gan"}],"syntology":{"n":2,"n_ran":2,"n_constructed":0,"n_ran_checked":2,"n_instrument":0,"n_unverified":0,"n_honours":2,"n_violates":0,"n_no_contract":0,"n_pointer_only":2,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/long-text-generation-via-adversarial-training#ran","syntology_url":"https://syntology.ai/paper/1709.08624","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1709.08624"}},"official":{"repos":["CR-Gjx/LeakGAN"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}}},{"leaderboard":"/sota/text-generation-on-redial","slug":"text-generation-on-redial","dataset":"ReDial","dataset_url":"/dataset/redial","rows_in_archive":5,"metrics":["Distinct-3","Distinct-4","Distinct-2","Perplexity"],"first_row_in_archive_order":{"model":"UniCRS","paper_title":"Towards Unified Conversational Recommender Systems via Knowledge-Enhanced Prompt Learning","paper_url":"/paper/towards-unified-conversational-recommender","paper_date":"2022-06-19","arxiv_id":"2206.09363","code_links":[{"title":"rucaibox/unicrs","url":"https://github.com/rucaibox/unicrs"}],"syntology":null}},{"leaderboard":"/sota/text-generation-on-commongen-1","slug":"text-generation-on-commongen-1","dataset":"CommonGen","dataset_url":"/dataset/commongen","rows_in_archive":4,"metrics":["CIDEr","METEOR","BLEU-4","SPICE"],"first_row_in_archive_order":{"model":"UniLM","paper_title":"CommonGen: A Constrained Text Generation Challenge for Generative Commonsense Reasoning","paper_url":"/paper/commongen-a-constrained-text-generation","paper_date":"2019-11-09","arxiv_id":"1911.03705","code_links":[{"title":"INK-USC/CommonGen","url":"https://github.com/INK-USC/CommonGen"},{"title":"allenai/CommonGen-Eval","url":"https://github.com/allenai/CommonGen-Eval"},{"title":"varshakr24/CommonsenseReasoning","url":"https://github.com/varshakr24/CommonsenseReasoning"}],"syntology":{"n":6,"n_ran":5,"n_constructed":0,"n_ran_checked":5,"n_instrument":0,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":5,"n_pointer_only":0,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/commongen-a-constrained-text-generation#ran","syntology_url":"https://syntology.ai/paper/1911.03705","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1911.03705"}},"official":null}}},{"leaderboard":"/sota/text-generation-on-rocstories","slug":"text-generation-on-rocstories","dataset":"ROCStories","dataset_url":"/dataset/rocstories","rows_in_archive":4,"metrics":["BLEU-1","Perplexity"],"first_row_in_archive_order":{"model":"Beam search + A*esque (beam)","paper_title":"NeuroLogic A*esque Decoding: Constrained Text Generation with Lookahead Heuristics","paper_url":"/paper/neurologic-a-esque-decoding-constrained-text","paper_date":"2021-12-16","arxiv_id":"2112.08726","code_links":[{"title":"GXimingLu/a_star_neurologic","url":"https://github.com/GXimingLu/a_star_neurologic"}],"syntology":null}},{"leaderboard":"/sota/text-generation-on-chinese-poems","slug":"text-generation-on-chinese-poems","dataset":"Chinese Poems","dataset_url":null,"rows_in_archive":3,"metrics":["BLEU-2"],"first_row_in_archive_order":{"model":"RankGAN","paper_title":"Adversarial Ranking for Language Generation","paper_url":"/paper/adversarial-ranking-for-language-generation","paper_date":"2017-05-31","arxiv_id":"1705.11001","code_links":[{"title":"desire2020/RankGAN","url":"https://github.com/desire2020/RankGAN"}],"syntology":null}},{"leaderboard":"/sota/text-generation-on-czech-restaurant","slug":"text-generation-on-czech-restaurant","dataset":"Czech restaurant information","dataset_url":"/dataset/czech-restaurant-information","rows_in_archive":3,"metrics":["METEOR"],"first_row_in_archive_order":{"model":"TGen++","paper_title":"The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics","paper_url":"/paper/the-gem-benchmark-natural-language-generation","paper_date":"2021-02-02","arxiv_id":"2102.01672","code_links":[],"syntology":null}},{"leaderboard":"/sota/text-generation-on-openwebtext","slug":"text-generation-on-openwebtext","dataset":"OpenWebText","dataset_url":"/dataset/openwebtext","rows_in_archive":3,"metrics":["eval_loss"],"first_row_in_archive_order":{"model":"GPT2-Hermite","paper_title":"Polynomial, trigonometric, and tropical activations","paper_url":"/paper/learnable-polynomial-trigonometric-and","paper_date":"2025-02-03","arxiv_id":"2502.01247","code_links":[{"title":"K-H-Ismail/torchortho","url":"https://github.com/K-H-Ismail/torchortho"}],"syntology":null}},{"leaderboard":"/sota/text-generation-on-sciq","slug":"text-generation-on-sciq","dataset":"SciQ","dataset_url":"/dataset/sciq","rows_in_archive":3,"metrics":["Accuracy"],"first_row_in_archive_order":{"model":"LLaMA-65B+CFG (zero-shot)","paper_title":"Stay on topic with Classifier-Free Guidance","paper_url":"/paper/stay-on-topic-with-classifier-free-guidance","paper_date":"2023-06-30","arxiv_id":"2306.17806","code_links":[],"syntology":null}},{"leaderboard":"/sota/text-generation-on-yahoo-questions","slug":"text-generation-on-yahoo-questions","dataset":"Yahoo Questions","dataset_url":null,"rows_in_archive":3,"metrics":["NLL","KL","Perplexity"],"first_row_in_archive_order":{"model":"Aggressive VAE","paper_title":"Lagging Inference Networks and Posterior Collapse in Variational Autoencoders","paper_url":"/paper/lagging-inference-networks-and-posterior","paper_date":"2019-01-16","arxiv_id":"1901.05534","code_links":[{"title":"jxhe/vae-lagging-encoder","url":"https://github.com/jxhe/vae-lagging-encoder"},{"title":"spokoyny/spokoyny.github.io","url":"https://github.com/spokoyny/spokoyny.github.io"}],"syntology":{"n":10,"n_ran":7,"n_constructed":0,"n_ran_checked":6,"n_instrument":1,"n_unverified":3,"n_honours":0,"n_violates":0,"n_no_contract":6,"n_pointer_only":1,"phrase":"7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified","sample_list":"/paper/lagging-inference-networks-and-posterior#ran","syntology_url":"https://syntology.ai/paper/1901.05534","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1901.05534"}},"official":{"repos":["jxhe/vae-lagging-encoder"],"state":"official (archive's flag): 7 ran","n_ran":7,"n_constructed":0,"n_ran_no_instrument_failure":6,"n_unverified":3,"ran_from_kinds":["official"]}}}},{"leaderboard":"/sota/text-generation-on-adgen","slug":"text-generation-on-adgen","dataset":"ADGEN","dataset_url":null,"rows_in_archive":1,"metrics":["BLEU-4"],"first_row_in_archive_order":{"model":"BART (TextBox 2.0)","paper_title":"TextBox 2.0: A Text Generation Library with Pre-trained Language Models","paper_url":"/paper/textbox-2-0-a-text-generation-library-with","paper_date":"2022-12-26","arxiv_id":"2212.13005","code_links":[{"title":"RUCAIBox/TextBox","url":"https://github.com/RUCAIBox/TextBox"}],"syntology":{"n":1,"n_ran":1,"n_constructed":1,"n_ran_checked":1,"n_instrument":0,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":1,"n_pointer_only":0,"phrase":"1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result","sample_list":"/paper/textbox-2-0-a-text-generation-library-with#ran","syntology_url":"https://syntology.ai/paper/2212.13005","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2212.13005"}},"official":{"repos":["RUCAIBox/TextBox"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":1,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}}},{"leaderboard":"/sota/text-generation-on-cmu-se","slug":"text-generation-on-cmu-se","dataset":"CMU-SE","dataset_url":null,"rows_in_archive":1,"metrics":["BLEU-3"],"first_row_in_archive_order":{"model":"STWGAN-GP","paper_title":"Generating Text through Adversarial Training using Skip-Thought Vectors","paper_url":"/paper/generating-text-through-adversarial-training","paper_date":"2018-08-27","arxiv_id":"1808.08703","code_links":[{"title":"afrozas/skip-thought-gan","url":"https://github.com/afrozas/skip-thought-gan"}],"syntology":null}},{"leaderboard":"/sota/text-generation-on-cnn-daily-mail","slug":"text-generation-on-cnn-daily-mail","dataset":"CNN/Daily Mail","dataset_url":"/dataset/cnn-daily-mail-1","rows_in_archive":1,"metrics":["ROUGE-L"],"first_row_in_archive_order":{"model":"PALM","paper_title":"PALM: Pre-training an Autoencoding&Autoregressive Language Model for Context-conditioned Generation","paper_url":"/paper/palm-pre-training-an-autoencoding","paper_date":"2020-04-14","arxiv_id":"2004.07159","code_links":[{"title":"alibaba/AliceMind","url":"https://github.com/alibaba/AliceMind/tree/main/PALM"},{"title":"overwindows/PALM","url":"https://github.com/overwindows/PALM"}],"syntology":null}},{"leaderboard":"/sota/text-generation-on-csl","slug":"text-generation-on-csl","dataset":"CSL","dataset_url":"/dataset/csl","rows_in_archive":1,"metrics":["ROUGE-L"],"first_row_in_archive_order":{"model":"BART (TextBox 2.0)","paper_title":"TextBox 2.0: A Text Generation Library with Pre-trained Language Models","paper_url":"/paper/textbox-2-0-a-text-generation-library-with","paper_date":"2022-12-26","arxiv_id":"2212.13005","code_links":[{"title":"RUCAIBox/TextBox","url":"https://github.com/RUCAIBox/TextBox"}],"syntology":{"n":1,"n_ran":1,"n_constructed":1,"n_ran_checked":1,"n_instrument":0,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":1,"n_pointer_only":0,"phrase":"1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result","sample_list":"/paper/textbox-2-0-a-text-generation-library-with#ran","syntology_url":"https://syntology.ai/paper/2212.13005","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2212.13005"}},"official":{"repos":["RUCAIBox/TextBox"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":1,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}}},{"leaderboard":"/sota/text-generation-on-dailydialog","slug":"text-generation-on-dailydialog","dataset":"DailyDialog","dataset_url":"/dataset/dailydialog","rows_in_archive":1,"metrics":["BLEU-1","BLEU-2","BLEU-3","BLEU-4"],"first_row_in_archive_order":{"model":"AEM+Attention","paper_title":"An Auto-Encoder Matching Model for Learning Utterance-Level Semantic Dependency in Dialogue Generation","paper_url":"/paper/an-auto-encoder-matching-model-for-learning","paper_date":"2018-08-27","arxiv_id":"1808.08795","code_links":[{"title":"lancopku/AMM","url":"https://github.com/lancopku/AMM"}],"syntology":null}},{"leaderboard":"/sota/text-generation-on-harmfulqa","slug":"text-generation-on-harmfulqa","dataset":"HarmfulQA","dataset_url":"/dataset/harmfulqa","rows_in_archive":1,"metrics":["ASR"],"first_row_in_archive_order":{"model":"GPT-4","paper_title":"Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment","paper_url":"/paper/red-teaming-large-language-models-using-chain","paper_date":"2023-08-18","arxiv_id":"2308.09662","code_links":[{"title":"declare-lab/red-instruct","url":"https://github.com/declare-lab/red-instruct"},{"title":"leondiao0427/seas","url":"https://github.com/leondiao0427/seas"}],"syntology":null}},{"leaderboard":"/sota/text-generation-on-lcsts","slug":"text-generation-on-lcsts","dataset":"LCSTS","dataset_url":"/dataset/lcsts","rows_in_archive":1,"metrics":["ROUGE-L"],"first_row_in_archive_order":{"model":"BART (TextBox 2.0)","paper_title":"TextBox 2.0: A Text Generation Library with Pre-trained Language Models","paper_url":"/paper/textbox-2-0-a-text-generation-library-with","paper_date":"2022-12-26","arxiv_id":"2212.13005","code_links":[{"title":"RUCAIBox/TextBox","url":"https://github.com/RUCAIBox/TextBox"}],"syntology":{"n":1,"n_ran":1,"n_constructed":1,"n_ran_checked":1,"n_instrument":0,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":1,"n_pointer_only":0,"phrase":"1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result","sample_list":"/paper/textbox-2-0-a-text-generation-library-with#ran","syntology_url":"https://syntology.ai/paper/2212.13005","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2212.13005"}},"official":{"repos":["RUCAIBox/TextBox"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":1,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}}},{"leaderboard":"/sota/text-generation-on-ldc2016e25","slug":"text-generation-on-ldc2016e25","dataset":"LDC2016E25","dataset_url":null,"rows_in_archive":1,"metrics":["BLEU"],"first_row_in_archive_order":{"model":"Graph2Seq","paper_title":"A Graph-to-Sequence Model for AMR-to-Text Generation","paper_url":"/paper/a-graph-to-sequence-model-for-amr-to-text","paper_date":"2018-05-07","arxiv_id":"1805.02473","code_links":[{"title":"freesunshine0316/neural-graph-to-seq-mp","url":"https://github.com/freesunshine0316/neural-graph-to-seq-mp"}],"syntology":null}},{"leaderboard":"/sota/text-generation-on-one-billion-word","slug":"text-generation-on-one-billion-word","dataset":"One Billion Word","dataset_url":"/dataset/billion-word-benchmark","rows_in_archive":1,"metrics":["JS-4"],"first_row_in_archive_order":{"model":"WGANGP + DGflow","paper_title":"Refining Deep Generative Models via Discriminator Gradient Flow","paper_url":"/paper/refining-deep-generative-models-via-1","paper_date":"2020-12-01","arxiv_id":"2012.00780","code_links":[{"title":"clear-nus/DGflow","url":"https://github.com/clear-nus/DGflow"}],"syntology":{"n":1,"n_ran":0,"n_constructed":0,"n_ran_checked":0,"n_instrument":0,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"0 ran · 1 unverified","sample_list":"/paper/refining-deep-generative-models-via-1#ran","syntology_url":"https://syntology.ai/paper/2012.00780","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2012.00780"}},"official":{"repos":["clear-nus/DGflow"],"state":"official: harvested, nothing ran","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":1,"ran_from_kinds":[]}}}},{"leaderboard":null,"slug":"text-generation-on-ai2-reasoning-challenge-25","dataset":"AI2 Reasoning Challenge (25-Shot)","dataset_url":null,"rows_in_archive":0,"metrics":["normalized accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-ai2-reasoning-challenge-tr","dataset":"AI2 Reasoning Challenge TR v0.2","dataset_url":null,"rows_in_archive":0,"metrics":["accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-alpacaeval","dataset":"AlpacaEval","dataset_url":"/dataset/alpacaeval","rows_in_archive":0,"metrics":["win rate"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-alpacaeval-2-0-gpt-4-1106","dataset":"AlpacaEval 2.0 (GPT-4-1106-Preview)","dataset_url":null,"rows_in_archive":0,"metrics":["lc win rate"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-arabic-poetry-dataset-6th","dataset":"Arabic Poetry Dataset (6th - 21st century)","dataset_url":null,"rows_in_archive":0,"metrics":["Validation Perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-arc-challenge","dataset":"arc_challenge","dataset_url":null,"rows_in_archive":0,"metrics":["acc"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-arc-challenge-25-shot","dataset":"ARC Challenge (25-Shot)","dataset_url":null,"rows_in_archive":0,"metrics":["normalized accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-arc-challenge-pt","dataset":"ARC-Challenge (PT)","dataset_url":null,"rows_in_archive":0,"metrics":["normalized accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-arc-easy","dataset":"arc_easy","dataset_url":null,"rows_in_archive":0,"metrics":["acc"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-assin2-rte","dataset":"Assin2 RTE","dataset_url":"/dataset/assin2","rows_in_archive":0,"metrics":["f1-macro"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-assin2-sts","dataset":"Assin2 STS","dataset_url":null,"rows_in_archive":0,"metrics":["pearson"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-axb","dataset":"axb","dataset_url":null,"rows_in_archive":0,"metrics":["acc"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-axg","dataset":"axg","dataset_url":null,"rows_in_archive":0,"metrics":["acc"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-bbh-3-shot","dataset":"BBH (3-Shot)","dataset_url":null,"rows_in_archive":0,"metrics":["normalized accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-big-bench-hard-3-shot","dataset":"Big Bench Hard (3-Shot)","dataset_url":null,"rows_in_archive":0,"metrics":["accuracy (normalized)"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-bluex-no-images","dataset":"BLUEX (No Images)","dataset_url":null,"rows_in_archive":0,"metrics":["accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-boolq","dataset":"BoolQ","dataset_url":"/dataset/boolq","rows_in_archive":0,"metrics":["acc"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-calame-pt","dataset":"CALAME-PT","dataset_url":null,"rows_in_archive":0,"metrics":["accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-cb","dataset":"cb","dataset_url":null,"rows_in_archive":0,"metrics":["acc"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-censorship-0-shot","dataset":"Censorship (0-shot)","dataset_url":null,"rows_in_archive":0,"metrics":["accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-cola","dataset":"CoLA","dataset_url":"/dataset/cola","rows_in_archive":0,"metrics":["acc"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-creativity-0-shot","dataset":"Creativity (0-shot)","dataset_url":null,"rows_in_archive":0,"metrics":["accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-crimestats","dataset":"CrimeStats","dataset_url":null,"rows_in_archive":0,"metrics":["accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-crows-pairs-english","dataset":"crows_pairs_english","dataset_url":null,"rows_in_archive":0,"metrics":["acc"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-crows-pairs-french","dataset":"crows_pairs_french","dataset_url":null,"rows_in_archive":0,"metrics":["acc"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-diabla","dataset":"DiaBLa","dataset_url":"/dataset/diabla","rows_in_archive":0,"metrics":["acc"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-drop-3-shot","dataset":"Drop (3-Shot)","dataset_url":"/dataset/drop","rows_in_archive":0,"metrics":["f1 score"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-enem-challenge-no-images","dataset":"ENEM Challenge (No Images)","dataset_url":null,"rows_in_archive":0,"metrics":["accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-faquad-nli","dataset":"FaQuAD NLI","dataset_url":null,"rows_in_archive":0,"metrics":["f1-macro"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gpqa-0-shot","dataset":"GPQA (0-shot)","dataset_url":null,"rows_in_archive":0,"metrics":["acc_norm"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-afr","dataset":"gsarti/flores_101_afr","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-asm","dataset":"gsarti/flores_101_asm","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-cat","dataset":"gsarti/flores_101_cat","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-ceb","dataset":"gsarti/flores_101_ceb","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-ces","dataset":"gsarti/flores_101_ces","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-ckb","dataset":"gsarti/flores_101_ckb","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-cym","dataset":"gsarti/flores_101_cym","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-dan","dataset":"gsarti/flores_101_dan","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-deu","dataset":"gsarti/flores_101_deu","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-ell","dataset":"gsarti/flores_101_ell","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-eng","dataset":"gsarti/flores_101_eng","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-est","dataset":"gsarti/flores_101_est","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-fas","dataset":"gsarti/flores_101_fas","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-fin","dataset":"gsarti/flores_101_fin","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-fra","dataset":"gsarti/flores_101_fra","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-ful","dataset":"gsarti/flores_101_ful","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-glg","dataset":"gsarti/flores_101_glg","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-guj","dataset":"gsarti/flores_101_guj","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-hau","dataset":"gsarti/flores_101_hau","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-heb","dataset":"gsarti/flores_101_heb","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-mlt","dataset":"gsarti/flores_101_mlt","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-mon","dataset":"gsarti/flores_101_mon","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-msa","dataset":"gsarti/flores_101_msa","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-mya","dataset":"gsarti/flores_101_mya","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-nld","dataset":"gsarti/flores_101_nld","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-nob","dataset":"gsarti/flores_101_nob","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-npi","dataset":"gsarti/flores_101_npi","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-nso","dataset":"gsarti/flores_101_nso","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-nya","dataset":"gsarti/flores_101_nya","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-oci","dataset":"gsarti/flores_101_oci","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-orm","dataset":"gsarti/flores_101_orm","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-ory","dataset":"gsarti/flores_101_ory","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-pan","dataset":"gsarti/flores_101_pan","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-pol","dataset":"gsarti/flores_101_pol","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-por","dataset":"gsarti/flores_101_por","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-ron","dataset":"gsarti/flores_101_ron","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-rus","dataset":"gsarti/flores_101_rus","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-slk","dataset":"gsarti/flores_101_slk","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-slv","dataset":"gsarti/flores_101_slv","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-som","dataset":"gsarti/flores_101_som","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-tam","dataset":"gsarti/flores_101_tam","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-tel","dataset":"gsarti/flores_101_tel","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-tgk","dataset":"gsarti/flores_101_tgk","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-tgl","dataset":"gsarti/flores_101_tgl","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-tha","dataset":"gsarti/flores_101_tha","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-tur","dataset":"gsarti/flores_101_tur","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-ukr","dataset":"gsarti/flores_101_ukr","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-umb","dataset":"gsarti/flores_101_umb","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-urd","dataset":"gsarti/flores_101_urd","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-uzb","dataset":"gsarti/flores_101_uzb","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-vie","dataset":"gsarti/flores_101_vie","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-wol","dataset":"gsarti/flores_101_wol","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-xho","dataset":"gsarti/flores_101_xho","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-yor","dataset":"gsarti/flores_101_yor","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-zho","dataset":"gsarti/flores_101_zho_simpl","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-zho-trad","dataset":"gsarti/flores_101_zho_trad","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsarti-flores-101-zul","dataset":"gsarti/flores_101_zul","dataset_url":"/dataset/flores-101","rows_in_archive":0,"metrics":["byte_perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsm8k-5-shot","dataset":"GSM8k (5-shot)","dataset_url":"/dataset/gsm8k","rows_in_archive":0,"metrics":["accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsm8k-tr","dataset":"GSM8k TR","dataset_url":"/dataset/gsm8k","rows_in_archive":0,"metrics":["accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-gsm8k-tr-v0-2","dataset":"GSM8k TR v0.2","dataset_url":"/dataset/gsm8k","rows_in_archive":0,"metrics":["accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-hatebr-binary","dataset":"HateBR Binary","dataset_url":null,"rows_in_archive":0,"metrics":["f1-macro"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-headqa","dataset":"HeadQA","dataset_url":"/dataset/headqa","rows_in_archive":0,"metrics":["acc"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-hellaswag","dataset":"HellaSwag","dataset_url":"/dataset/hellaswag","rows_in_archive":0,"metrics":["Accuracy","acc"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-hellaswag-10-shot","dataset":"HellaSwag (10-Shot)","dataset_url":"/dataset/hellaswag","rows_in_archive":0,"metrics":["normalized accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-hellaswag-pt","dataset":"HellaSwag (PT)","dataset_url":null,"rows_in_archive":0,"metrics":["normalized accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-hellaswag-tr","dataset":"HellaSwag TR","dataset_url":"/dataset/hellaswag","rows_in_archive":0,"metrics":["accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-humanness-0-shot","dataset":"Humanness (0-shot)","dataset_url":null,"rows_in_archive":0,"metrics":["accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-ifeval-0-shot","dataset":"IFEval (0-Shot)","dataset_url":null,"rows_in_archive":0,"metrics":["averaged accuracy","strict accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-indicglue","dataset":"IndicGLUE","dataset_url":"/dataset/indicglue","rows_in_archive":0,"metrics":["Average Accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-internet","dataset":"Internet","dataset_url":null,"rows_in_archive":0,"metrics":["accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-lambada-pt","dataset":"LAMBADA-PT","dataset_url":null,"rows_in_archive":0,"metrics":["accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-logiqa","dataset":"LogiQA","dataset_url":"/dataset/logiqa","rows_in_archive":0,"metrics":["acc"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-math-hard-4-shot","dataset":"Math HARD (4-Shot)","dataset_url":null,"rows_in_archive":0,"metrics":["accuracy (exact match)"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-math-lvl-5-4-shot","dataset":"MATH Lvl 5 (4-Shot)","dataset_url":null,"rows_in_archive":0,"metrics":["exact match"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-mmlu-5-shot","dataset":"MMLU (5-Shot)","dataset_url":"/dataset/mmlu","rows_in_archive":0,"metrics":["accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-mmlu-pro-5-shot","dataset":"MMLU-PRO (5-shot)","dataset_url":null,"rows_in_archive":0,"metrics":["accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-mmlu-tr","dataset":"MMLU TR","dataset_url":"/dataset/mmlu","rows_in_archive":0,"metrics":["accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-mmlu-tr-v0-2","dataset":"MMLU TR v0.2","dataset_url":"/dataset/mmlu","rows_in_archive":0,"metrics":["accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-mnli","dataset":"MNLI","dataset_url":"/dataset/multinli","rows_in_archive":0,"metrics":["acc"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-mt-bench","dataset":"MT-Bench","dataset_url":"/dataset/mt-bench","rows_in_archive":0,"metrics":["score"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-musr-0-shot","dataset":"MuSR (0-shot)","dataset_url":null,"rows_in_archive":0,"metrics":["acc_norm"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-nexa-scientific-tokens","dataset":"Nexa Scientific Tokens","dataset_url":null,"rows_in_archive":0,"metrics":["BLEU","Entropy Novelty","Internal Consistency"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-oab-exams","dataset":"OAB Exams","dataset_url":"/dataset/oab-exams","rows_in_archive":0,"metrics":["accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-open-australian-legal-qa","dataset":"Open Australian Legal QA","dataset_url":null,"rows_in_archive":0,"metrics":["Perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-open-mindedness-0-shot","dataset":"Open-Mindedness (0-shot)","dataset_url":null,"rows_in_archive":0,"metrics":["accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-openbookqa","dataset":"OpenBookQA","dataset_url":"/dataset/openbookqa","rows_in_archive":0,"metrics":["acc"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-piqa","dataset":"PIQA","dataset_url":"/dataset/piqa","rows_in_archive":0,"metrics":["acc"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-polcontro","dataset":"PolContro","dataset_url":null,"rows_in_archive":0,"metrics":["accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-pt-hate-speech-binary","dataset":"PT Hate Speech Binary","dataset_url":null,"rows_in_archive":0,"metrics":["f1-macro"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-stories-jokes","dataset":"Stories/Jokes","dataset_url":null,"rows_in_archive":0,"metrics":["accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-talking-0-shot","dataset":"Talking (0-shot)","dataset_url":null,"rows_in_archive":0,"metrics":["accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-triviaqa","dataset":"TriviaQA","dataset_url":"/dataset/triviaqa","rows_in_archive":0,"metrics":["acc"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-truthfulqa-0-shot","dataset":"TruthfulQA (0-shot)","dataset_url":"/dataset/truthfulqa","rows_in_archive":0,"metrics":["value"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-truthfulqa-pt","dataset":"TruthfulQA (PT)","dataset_url":null,"rows_in_archive":0,"metrics":["bleurt"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-truthfulqa-tr-v0-2","dataset":"TruthfulQA TR v0.2","dataset_url":"/dataset/truthfulqa","rows_in_archive":0,"metrics":["accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-tweetsentbr","dataset":"tweetSentBR","dataset_url":"/dataset/tweetsentbr","rows_in_archive":0,"metrics":["f1-macro"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-unruly","dataset":"Unruly","dataset_url":null,"rows_in_archive":0,"metrics":["accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-w-10","dataset":"W/10","dataset_url":null,"rows_in_archive":0,"metrics":["willingness to answer"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-wic","dataset":"WiC","dataset_url":"/dataset/wic","rows_in_archive":0,"metrics":["acc"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-wikitext-103","dataset":"WikiText-103","dataset_url":"/dataset/wikitext-103","rows_in_archive":0,"metrics":["Perplexity"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-winogrande","dataset":"WinoGrande","dataset_url":"/dataset/winogrande","rows_in_archive":0,"metrics":["acc"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-winogrande-5-shot","dataset":"Winogrande (5-shot)","dataset_url":"/dataset/winogrande","rows_in_archive":0,"metrics":["accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-winogrande-tr","dataset":"Winogrande TR","dataset_url":"/dataset/winogrande","rows_in_archive":0,"metrics":["accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-winogrande-tr-v0-2","dataset":"Winogrande TR v0.2","dataset_url":"/dataset/winogrande","rows_in_archive":0,"metrics":["accuracy"],"first_row_in_archive_order":null},{"leaderboard":null,"slug":"text-generation-on-world-knowledge-0-shot","dataset":"World Knowledge (0-shot)","dataset_url":null,"rows_in_archive":0,"metrics":["accuracy"],"first_row_in_archive_order":null}],"datasets":[{"url":"/dataset/glue","name":"GLUE","full_name":"General Language Understanding Evaluation benchmark","num_papers_in_archive":3197},{"url":"/dataset/mmlu","name":"MML","full_name":"Massive Multitask Language Understanding","num_papers_in_archive":1922},{"url":"/dataset/gsm8k","name":"GSM8K","full_name":"","num_papers_in_archive":1881},{"url":"/dataset/multinli","name":"MultiNLI","full_name":"Multi-Genre Natural Language Inference","num_papers_in_archive":1830},{"url":"/dataset/wikitext-2","name":"WikiText-2","full_name":"WikiText-2","num_papers_in_archive":1081},{"url":"/dataset/hellaswag","name":"HellaSwag","full_name":"","num_papers_in_archive":994},{"url":"/dataset/triviaqa","name":"TriviaQA","full_name":"","num_papers_in_archive":953},{"url":"/dataset/piqa","name":"PIQA","full_name":"Physical Interaction: Question Answering","num_papers_in_archive":772},{"url":"/dataset/cola","name":"CoLA","full_name":"Corpus of Linguistic Acceptability","num_papers_in_archive":710},{"url":"/dataset/winogrande","name":"WinoGrande","full_name":"","num_papers_in_archive":703},{"url":"/dataset/boolq","name":"BoolQ","full_name":"Boolean Questions","num_papers_in_archive":701},{"url":"/dataset/openbookqa","name":"OpenBookQA","full_name":"OBQA","num_papers_in_archive":635},{"url":"/dataset/truthfulqa","name":"TruthfulQA","full_name":"","num_papers_in_archive":607},{"url":"/dataset/wikitext-103","name":"WikiText-103","full_name":"WikiText-103","num_papers_in_archive":560},{"url":"/dataset/mt-bench","name":"MT-Bench","full_name":"","num_papers_in_archive":531},{"url":"/dataset/cnn-daily-mail-1","name":"CNN/Daily Mail","full_name":"CNN/Daily Mail","num_papers_in_archive":530},{"url":"/dataset/dailydialog","name":"DailyDialog","full_name":"","num_papers_in_archive":399},{"url":"/dataset/drop","name":"DROP","full_name":"Discrete Reasoning Over Paragraphs","num_papers_in_archive":382},{"url":"/dataset/bookcorpus","name":"BookCorpus","full_name":"","num_papers_in_archive":344},{"url":"/dataset/openwebtext","name":"OpenWebText","full_name":"","num_papers_in_archive":207},{"url":"/dataset/wic","name":"WiC","full_name":"Words in Context","num_papers_in_archive":206},{"url":"/dataset/coco-captions","name":"COCO Captions","full_name":"","num_papers_in_archive":203},{"url":"/dataset/sciq","name":"SciQ","full_name":"SciQ","num_papers_in_archive":183},{"url":"/dataset/eli5","name":"ELI5","full_name":"ELI5","num_papers_in_archive":158},{"url":"/dataset/rocstories","name":"ROCStories","full_name":"","num_papers_in_archive":152},{"url":"/dataset/billion-word-benchmark","name":"Billion Word Benchmark","full_name":"","num_papers_in_archive":141},{"url":"/dataset/alpacaeval","name":"AlpacaEval","full_name":"","num_papers_in_archive":131},{"url":"/dataset/logiqa","name":"LogiQA","full_name":"","num_papers_in_archive":127},{"url":"/dataset/writingprompts","name":"WritingPrompts","full_name":"","num_papers_in_archive":118},{"url":"/dataset/the-stack","name":"The Stack","full_name":"","num_papers_in_archive":115},{"url":"/dataset/commongen","name":"CommonGen","full_name":"","num_papers_in_archive":108},{"url":"/dataset/redial","name":"ReDial","full_name":"","num_papers_in_archive":105},{"url":"/dataset/e2e","name":"E2E","full_name":"End-to-End NLG Challenge","num_papers_in_archive":90},{"url":"/dataset/flores-101","name":"FLoRes-101","full_name":"","num_papers_in_archive":86},{"url":"/dataset/realnews","name":"RealNews","full_name":"","num_papers_in_archive":80},{"url":"/dataset/vqg","name":"VQG","full_name":"Visual Question Generation","num_papers_in_archive":80},{"url":"/dataset/sentence-compression","name":"Sentence Compression","full_name":"","num_papers_in_archive":63},{"url":"/dataset/tinystories","name":"TinyStories","full_name":"","num_papers_in_archive":62},{"url":"/dataset/lcsts","name":"LCSTS","full_name":"","num_papers_in_archive":58},{"url":"/dataset/mutual","name":"MuTual","full_name":"MuTual","num_papers_in_archive":55},{"url":"/dataset/opendialkg","name":"OpenDialKG","full_name":"","num_papers_in_archive":55},{"url":"/dataset/mtnt","name":"MTNT","full_name":"","num_papers_in_archive":52},{"url":"/dataset/dart","name":"DART","full_name":"","num_papers_in_archive":45},{"url":"/dataset/ccmatrix","name":"CCMatrix","full_name":"","num_papers_in_archive":42},{"url":"/dataset/csl","name":"CSL","full_name":"","num_papers_in_archive":34},{"url":"/dataset/image-paragraph-captioning","name":"Image Paragraph Captioning","full_name":"","num_papers_in_archive":31},{"url":"/dataset/conan","name":"CONAN","full_name":"COunter NArratives through Nichesourcing","num_papers_in_archive":27},{"url":"/dataset/kptimes","name":"KPTimes","full_name":"","num_papers_in_archive":27},{"url":"/dataset/kelm","name":"KELM","full_name":"","num_papers_in_archive":24},{"url":"/dataset/moral-stories","name":"Moral Stories","full_name":"","num_papers_in_archive":24},{"url":"/dataset/headqa","name":"HeadQA","full_name":"","num_papers_in_archive":23},{"url":"/dataset/amr-bank","name":"AMR Bank","full_name":"Abstract Meaning Representation","num_papers_in_archive":22},{"url":"/dataset/coco-cn","name":"COCO-CN","full_name":"","num_papers_in_archive":21},{"url":"/dataset/wiqa","name":"WIQA","full_name":"What-If Question Answering","num_papers_in_archive":21},{"url":"/dataset/robocup","name":"RoboCup","full_name":"RoboCup","num_papers_in_archive":20},{"url":"/dataset/indicglue","name":"IndicGLUE","full_name":"Indic General Language Understanding Evaluation Benchmark","num_papers_in_archive":16},{"url":"/dataset/celebv-text","name":"CelebV-Text","full_name":"","num_papers_in_archive":15},{"url":"/dataset/opusparcus","name":"Opusparcus","full_name":"","num_papers_in_archive":15},{"url":"/dataset/amazonqa","name":"AmazonQA","full_name":"","num_papers_in_archive":14},{"url":"/dataset/timetravel","name":"TimeTravel","full_name":"","num_papers_in_archive":14},{"url":"/dataset/personaldialog","name":"PersonalDialog","full_name":"","num_papers_in_archive":13},{"url":"/dataset/roscoe","name":"ROSCOE","full_name":"","num_papers_in_archive":13},{"url":"/dataset/opus","name":"OPUS","full_name":"open parallel corpus","num_papers_in_archive":12},{"url":"/dataset/cc-stories","name":"CC-Stories","full_name":"CC-Stories","num_papers_in_archive":10},{"url":"/dataset/chart2text","name":"Chart2Text","full_name":"Chart Summarization Dataset","num_papers_in_archive":10},{"url":"/dataset/chatharuhi-54k","name":"ChatHaruhi","full_name":"ChatHaruhi: Reviving Anime Character in Reality via Large Language Model","num_papers_in_archive":10},{"url":"/dataset/wikiatomicedits","name":"WikiAtomicEdits","full_name":"","num_papers_in_archive":10},{"url":"/dataset/harmfulqa","name":"HarmfulQA","full_name":"HarmfulQA","num_papers_in_archive":9},{"url":"/dataset/logic2text","name":"Logic2Text","full_name":null,"num_papers_in_archive":8},{"url":"/dataset/longform","name":"LongForm","full_name":"","num_papers_in_archive":8},{"url":"/dataset/wikitablet","name":"WikiTableT","full_name":"WikiTableT","num_papers_in_archive":8},{"url":"/dataset/vnhsge","name":"VNHSGE","full_name":"VietNamese High School Graduation Examination Dataset for Large Language Models","num_papers_in_archive":7},{"url":"/dataset/arxiv-10","name":"arXiv-10","full_name":"","num_papers_in_archive":6},{"url":"/dataset/cells","name":"CELLS","full_name":"","num_papers_in_archive":6},{"url":"/dataset/cluecorpus2020","name":"CLUECorpus2020","full_name":"","num_papers_in_archive":6},{"url":"/dataset/microsoft-research-social-media-conversation","name":"Microsoft Research Social Media Conversation Corpus","full_name":"","num_papers_in_archive":6},{"url":"/dataset/weblinx","name":"WebLINX","full_name":"Real-World Website Navigation with Multi-Turn","num_papers_in_archive":6},{"url":"/dataset/mlb-dataset","name":"MLB Dataset","full_name":"","num_papers_in_archive":5},{"url":"/dataset/pomo","name":"PoMo","full_name":"","num_papers_in_archive":5},{"url":"/dataset/risawoz","name":"RiSAWOZ","full_name":null,"num_papers_in_archive":5},{"url":"/dataset/rucola","name":"RuCoLA","full_name":"","num_papers_in_archive":5},{"url":"/dataset/spatialvoc2k","name":"SpatialVOC2K","full_name":"","num_papers_in_archive":5},{"url":"/dataset/stackex","name":"STACKEX","full_name":"STACKEX","num_papers_in_archive":5},{"url":"/dataset/taiga-corpus","name":"Taiga Corpus","full_name":"An open-source corpus for machine learning.","num_papers_in_archive":5},{"url":"/dataset/tweetsentbr","name":"tweetSentBR","full_name":"","num_papers_in_archive":5},{"url":"/dataset/diabla","name":"DiaBLa","full_name":"","num_papers_in_archive":4},{"url":"/dataset/goal","name":"Goal","full_name":"","num_papers_in_archive":4},{"url":"/dataset/wikipedia-generation","name":"Wikipedia Generation","full_name":"Wikipedia Generation","num_papers_in_archive":4},{"url":"/dataset/cannot","name":"CANNOT","full_name":"Compilation of ANnotated, Negation-Oriented Text-pairs","num_papers_in_archive":3},{"url":"/dataset/dr-bench","name":"DR.BENCH","full_name":"Diagnostic Reasoning Benchmark for clinical natural language processing","num_papers_in_archive":3},{"url":"/dataset/oab-exams","name":"OAB Exams","full_name":"","num_papers_in_archive":3},{"url":"/dataset/textbox-2-0","name":"TextBox 2.0","full_name":"","num_papers_in_archive":3},{"url":"/dataset/visual-writing-prompts","name":"Visual Writing Prompts","full_name":"","num_papers_in_archive":3},{"url":"/dataset/wikidocedits","name":"WikiDocEdits","full_name":"","num_papers_in_archive":3},{"url":"/dataset/ytd-18m","name":"YTD-18M","full_name":"","num_papers_in_archive":3},{"url":"/dataset/clse","name":"CLSE","full_name":"Corpus of Linguistically Significant Entities","num_papers_in_archive":2},{"url":"/dataset/codesyntax","name":"CodeSyntax","full_name":"","num_papers_in_archive":2},{"url":"/dataset/concise","name":"Concise","full_name":"","num_papers_in_archive":2},{"url":"/dataset/czech-restaurant-information","name":"Czech restaurant information","full_name":"","num_papers_in_archive":2},{"url":"/dataset/dialoconan","name":"DIALOCONAN","full_name":"","num_papers_in_archive":2},{"url":"/dataset/dtgb","name":"DTGB","full_name":"Dynamic Text-attributed Graph Benchmark","num_papers_in_archive":2},{"url":"/dataset/exhvv","name":"ExHVV","full_name":"","num_papers_in_archive":2},{"url":"/dataset/kaleidoscope","name":"Kaleidoscope","full_name":"Kaleidoscope: In-language Exams for Massively Multilingual Vision Evaluation","num_papers_in_archive":2},{"url":"/dataset/live-comment-dataset","name":"Live Comment Dataset","full_name":"","num_papers_in_archive":2},{"url":"/dataset/negotiation-dialogues-dataset","name":"Negotiation Dialogues Dataset","full_name":"","num_papers_in_archive":2},{"url":"/dataset/qtuna","name":"QTuna","full_name":null,"num_papers_in_archive":2},{"url":"/dataset/taodescribe","name":"TaoDescribe","full_name":null,"num_papers_in_archive":2},{"url":"/dataset/threatgram-101-extreme-telegram-data","name":"ThreatGram 101 - Extreme Telegram Data","full_name":"ThreatGram 101 - Extreme Telegram Replies Data with Threat Levels","num_papers_in_archive":2},{"url":"/dataset/aave-sae-paired-dataset","name":"AAVE/SAE Paired Dataset","full_name":"","num_papers_in_archive":1},{"url":"/dataset/alpaca-data-galician","name":"Alpaca Data Galician","full_name":"Alpaca Data Galician","num_papers_in_archive":1},{"url":"/dataset/appealcase","name":"AppealCase","full_name":"","num_papers_in_archive":1},{"url":"/dataset/askparents","name":"AskParents","full_name":null,"num_papers_in_archive":1},{"url":"/dataset/avicenna-deductive-commonsense-reasoning","name":"Avicenna: Deductive Commonsense Reasoning","full_name":"","num_papers_in_archive":1},{"url":"/dataset/collie-v1","name":"COLLIE-v1","full_name":"","num_papers_in_archive":1},{"url":"/dataset/colors","name":"Colors","full_name":"","num_papers_in_archive":1},{"url":"/dataset/diaforge-utc-r-0725","name":"diaforge-utc-r-0725","full_name":"DiaFORGE UTC: Unified Tool-Calling Conversations Dataset","num_papers_in_archive":1},{"url":"/dataset/docbank-tb","name":"DocBank-TB","full_name":"DocBank-Table","num_papers_in_archive":1},{"url":"/dataset/dpgmedia2019","name":"DpgMedia2019","full_name":null,"num_papers_in_archive":1},{"url":"/dataset/synthetic-grade-school-math-sgsm","name":"Educational Grade School Math (EGSM)","full_name":"","num_papers_in_archive":1},{"url":"/dataset/ent-desc","name":"ENT-DESC","full_name":"","num_papers_in_archive":1},{"url":"/dataset/expository-prose","name":"Expository Prose","full_name":"Expository-Prose-V1","num_papers_in_archive":1},{"url":"/dataset/food-com-recipes-and-interactions","name":"Food.com Recipes and Interactions","full_name":"","num_papers_in_archive":1},{"url":"/dataset/fraud-case-verdicts","name":"Fraud_Case_Verdicts","full_name":"The \"Crime Facts\" of \"Offenses of Fraudulence\" in Judicial Yuan Verdicts Dataset","num_papers_in_archive":1},{"url":"/dataset/halvest","name":"HALvest","full_name":"","num_papers_in_archive":1},{"url":"/dataset/havoc","name":"HAVOC","full_name":"Harmful Abstractions and Violations in Open Completions Benchmark","num_papers_in_archive":1},{"url":"/dataset/hixstest","name":"HiXSTest","full_name":"Hindi XSTest","num_papers_in_archive":1},{"url":"/dataset/ice-hockey-news-dataset","name":"Ice Hockey News Dataset","full_name":"","num_papers_in_archive":1},{"url":"/dataset/ilsp-greek-evaluation-suite","name":"ILSP Greek Evaluation Suite","full_name":"","num_papers_in_archive":1},{"url":"/dataset/image-caption-quality-dataset","name":"Image Caption Quality Dataset","full_name":"","num_papers_in_archive":1},{"url":"/dataset/lenta-short-sentences","name":"Lenta Short Sentences","full_name":null,"num_papers_in_archive":1},{"url":"/dataset/lipogram-e","name":"Lipogram-e","full_name":"","num_papers_in_archive":1},{"url":"/dataset/litmind-dictionary","name":"LitMind Dictionary","full_name":"","num_papers_in_archive":1},{"url":"/dataset/llmafia","name":"LLMafia","full_name":"","num_papers_in_archive":1},{"url":"/dataset/lmsys-usp","name":"LMSYS-USP","full_name":"","num_papers_in_archive":1},{"url":"/dataset/machine-mindset-mbti-dataset","name":"Machine_Mindset_MBTI_dataset","full_name":"","num_papers_in_archive":1},{"url":"/dataset/mattools","name":"MatTools","full_name":"","num_papers_in_archive":1},{"url":"/dataset/mttn","name":"MTTN","full_name":"","num_papers_in_archive":1},{"url":"/dataset/needadvice","name":"needadvice","full_name":null,"num_papers_in_archive":1},{"url":"/dataset/onlysports-dataset","name":"OnlySports Dataset","full_name":"","num_papers_in_archive":1},{"url":"/dataset/opendebateevidence","name":"OpenDebateEvidence","full_name":"","num_papers_in_archive":1},{"url":"/dataset/oqgend","name":"OQGend","full_name":"OQGend","num_papers_in_archive":1},{"url":"/dataset/oqrand","name":"OQRanD","full_name":"OQRanD","num_papers_in_archive":1},{"url":"/dataset/pentachromatic-cultural-palette-dataset","name":"Pentachromatic Cultural Palette  Dataset","full_name":"Pentachromatic Cultural Palette  Dataset","num_papers_in_archive":1},{"url":"/dataset/polynews","name":"PolyNews","full_name":"","num_papers_in_archive":1},{"url":"/dataset/ptvd","name":"PTVD","full_name":"","num_papers_in_archive":1},{"url":"/dataset/reglamento-aeronautico-colombiano-2024","name":"Reglamento_Aeronautico_Colombiano_2024","full_name":"","num_papers_in_archive":1},{"url":"/dataset/rotowire-modified","name":"Rotowire-Modified","full_name":null,"num_papers_in_archive":1},{"url":"/dataset/situational-instructions-database","name":"SAD-Instruct","full_name":"Situational Awareness Database for Instruct-Tuning","num_papers_in_archive":1},{"url":"/dataset/sg-nlg","name":"SG-NLG","full_name":"Schema-Guided Natural Language Generation","num_papers_in_archive":1},{"url":"/dataset/sgxstest","name":"SGXSTest","full_name":"Singapore XSTest","num_papers_in_archive":1},{"url":"/dataset/student-stories-reflections-and-coding","name":"Short Stories, Adjudicator Scores and Written Reflections","full_name":"","num_papers_in_archive":1},{"url":"/dataset/tamil-alpaca","name":"Tamil Alpaca","full_name":"","num_papers_in_archive":1},{"url":"/dataset/tamil-alpaca-orca","name":"Tamil Alpaca Orca","full_name":"","num_papers_in_archive":1},{"url":"/dataset/tempwikibio","name":"TempWikiBio","full_name":"","num_papers_in_archive":1},{"url":"/dataset/texygen-platform","name":"Texygen Platform","full_name":"","num_papers_in_archive":1},{"url":"/dataset/the-mafia-dataset","name":"The Mafia Dataset","full_name":"","num_papers_in_archive":1},{"url":"/dataset/xinhuahallucinations","name":"UHGEvalDataset","full_name":"","num_papers_in_archive":1},{"url":"/dataset/ukil-db-en","name":"UKIL-DB-EN","full_name":"","num_papers_in_archive":1},{"url":"/dataset/webbrain-raw","name":"WebBrain-Raw","full_name":"","num_papers_in_archive":1},{"url":"/dataset/wikiweb2m","name":"WikiWeb2M","full_name":"Wikipedia Webpage 2M","num_papers_in_archive":1},{"url":"/dataset/xwikiref","name":"XWikiRef","full_name":"","num_papers_in_archive":1},{"url":"/dataset/assin2","name":"ASSIN2","full_name":"","num_papers_in_archive":0}],"subtasks":[{"url":"/task/code-documentation-generation","name":"Code Documentation Generation"},{"url":"/task/concept-to-text-generation","name":"Concept-To-Text Generation"},{"url":"/task/conditional-text-generation","name":"Conditional Text Generation"},{"url":"/task/data-to-text-generation","name":"Data-to-Text Generation"},{"url":"/task/dialogue-generation","name":"Dialogue Generation"},{"url":"/task/distractor-generation","name":"Distractor Generation"},{"url":"/task/fact-based-text-editing","name":"Fact-based Text Editing"},{"url":"/task/headline-generation","name":"Headline Generation"},{"url":"/task/hint-generation","name":"Hint Generation"},{"url":"/task/molecular-description-generation","name":"Molecular description generation"},{"url":"/task/multi-document-summarization","name":"Multi-Document Summarization"},{"url":"/task/natural-language-landmark-navigation","name":"Natural Language Landmark Navigation Instructions Generation"},{"url":"/task/news-generation","name":"News Generation"},{"url":"/task/paper-generation","name":"Paper generation"},{"url":"/task/paraphrase-generation","name":"Paraphrase Generation"},{"url":"/task/pgtask","name":"Profile Generation"},{"url":"/task/question-answer-generation","name":"Question-Answer-Generation"},{"url":"/task/rules-of-thumb-generation","name":"Rules-of-thumb Generation"},{"url":"/task/sonnet-generation","name":"Sonnet Generation"},{"url":"/task/spelling-correction","name":"Spelling Correction"},{"url":"/task/story-completion","name":"Story Completion"},{"url":"/task/story-generation","name":"Story Generation"},{"url":"/task/table-to-text-generation","name":"Table-to-Text Generation"},{"url":"/task/text-infilling","name":"Text Infilling"},{"url":"/task/text-style-transfoer","name":"Text Style Transfer"}],"parent_tasks":[],"papers":{"order":"repositories listed in the archive (most first), then date (newest first), then slug; the archive holds no stars","population":"every paper the archive tags with this task (distinct papers; spam titles not listed). 'of' counts the papers listed; until 2026-09-25 it counted only the papers with a code link, and that number is of_with_code","page":1,"pages_in_order":54,"rows_per_page":100,"shown":100,"of":5335,"of_with_code":2047,"tagged_in_all":5335,"counts":{"archive_papers_tagged":5335,"with_a_code_link":2047,"where_syntology_ran_a_sample":610,"not_listed_spam_title":0,"listed":5335,"listed_where_code_ran":610,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":482,"every_run_a_failure_of_syntologys_instrument":128,"listed_with_a_run_with_no_instrument_failure":482,"listed_every_run_a_failure_of_syntologys_instrument":128,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"items":[{"url":"/paper/learning-transferable-visual-models-from","slug":"learning-transferable-visual-models-from","title":"Learning Transferable Visual Models From Natural Language Supervision","date":"2021-02-26","arxiv_id":"2103.00020","repositories_listed":82,"syntology":{"n":20,"n_ran":16,"n_constructed":0,"n_ran_checked":2,"n_instrument":14,"n_unverified":4,"n_honours":1,"n_violates":1,"n_no_contract":0,"n_pointer_only":16,"phrase":"16 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 14 where Syntology's instrument failed) · 4 unverified","sample_list":"/paper/learning-transferable-visual-models-from#ran","syntology_url":"https://syntology.ai/paper/2103.00020","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2103.00020"}},"official":{"repos":["openai/CLIP"],"state":"official: no sample here; runs from other or unrecorded repositories","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","unlocated"]}}},{"url":"/paper/show-and-tell-a-neural-image-caption","slug":"show-and-tell-a-neural-image-caption","title":"Show and Tell: A Neural Image Caption Generator","date":"2014-11-17","arxiv_id":"1411.4555","repositories_listed":74,"syntology":{"n":34,"n_ran":28,"n_constructed":0,"n_ran_checked":20,"n_instrument":8,"n_unverified":6,"n_honours":2,"n_violates":2,"n_no_contract":16,"n_pointer_only":7,"phrase":"28 ran (of which 0 constructed an object rather than computing a result; 20 with no instrument failure: 2 honoured, 2 violated, 16 with no contract checked; 8 where Syntology's instrument failed) · 6 unverified","sample_list":"/paper/show-and-tell-a-neural-image-caption#ran","syntology_url":"https://syntology.ai/paper/1411.4555","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1411.4555"}},"official":null}},{"url":"/paper/generating-sequences-with-recurrent-neural","slug":"generating-sequences-with-recurrent-neural","title":"Generating Sequences With Recurrent Neural Networks","date":"2013-08-04","arxiv_id":"1308.0850","repositories_listed":59,"syntology":{"n":37,"n_ran":31,"n_constructed":0,"n_ran_checked":28,"n_instrument":3,"n_unverified":6,"n_honours":4,"n_violates":0,"n_no_contract":24,"n_pointer_only":4,"phrase":"31 ran (of which 0 constructed an object rather than computing a result; 28 with no instrument failure: 4 honoured, 0 violated, 24 with no contract checked; 3 where Syntology's instrument failed) · 6 unverified","sample_list":"/paper/generating-sequences-with-recurrent-neural#ran","syntology_url":"https://syntology.ai/paper/1308.0850","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1308.0850"}},"official":null}},{"url":"/paper/bart-denoising-sequence-to-sequence-pre","slug":"bart-denoising-sequence-to-sequence-pre","title":"BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension","date":"2019-10-29","arxiv_id":"1910.13461","repositories_listed":47,"syntology":{"n":53,"n_ran":40,"n_constructed":7,"n_ran_checked":30,"n_instrument":10,"n_unverified":13,"n_honours":1,"n_violates":2,"n_no_contract":27,"n_pointer_only":13,"phrase":"40 ran (of which 7 constructed an object rather than computing a result; 30 with no instrument failure: 1 honoured, 2 violated, 27 with no contract checked; 10 where Syntology's instrument failed) · 13 unverified","sample_list":"/paper/bart-denoising-sequence-to-sequence-pre#ran","syntology_url":"https://syntology.ai/paper/1910.13461","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1910.13461"}},"official":null}},{"url":"/paper/diverse-beam-search-decoding-diverse","slug":"diverse-beam-search-decoding-diverse","title":"Diverse Beam Search: Decoding Diverse Solutions from Neural Sequence Models","date":"2016-10-07","arxiv_id":"1610.02424","repositories_listed":25,"syntology":{"n":14,"n_ran":7,"n_constructed":0,"n_ran_checked":2,"n_instrument":5,"n_unverified":7,"n_honours":0,"n_violates":1,"n_no_contract":1,"n_pointer_only":14,"phrase":"7 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 5 where Syntology's instrument failed) · 7 unverified","sample_list":"/paper/diverse-beam-search-decoding-diverse#ran","syntology_url":"https://syntology.ai/paper/1610.02424","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1610.02424"}},"official":{"repos":["ashwinkalyan/dbs"],"state":"official: no sample here; runs from other or unrecorded repositories","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","unlocated"]}}},{"url":"/paper/seqgan-sequence-generative-adversarial-nets","slug":"seqgan-sequence-generative-adversarial-nets","title":"SeqGAN: Sequence Generative Adversarial Nets with Policy Gradient","date":"2016-09-18","arxiv_id":"1609.05473","repositories_listed":23,"syntology":{"n":21,"n_ran":14,"n_constructed":0,"n_ran_checked":12,"n_instrument":2,"n_unverified":7,"n_honours":7,"n_violates":1,"n_no_contract":4,"n_pointer_only":13,"phrase":"14 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 7 honoured, 1 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 7 unverified","sample_list":"/paper/seqgan-sequence-generative-adversarial-nets#ran","syntology_url":"https://syntology.ai/paper/1609.05473","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1609.05473"}},"official":{"repos":["LantaoYu/SeqGAN"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/language-models-are-unsupervised-multitask","slug":"language-models-are-unsupervised-multitask","title":"Language Models are Unsupervised Multitask Learners","date":"2019-02-14","arxiv_id":null,"repositories_listed":21,"syntology":null},{"url":"/paper/bertscore-evaluating-text-generation-with","slug":"bertscore-evaluating-text-generation-with","title":"BERTScore: Evaluating Text Generation with BERT","date":"2019-04-21","arxiv_id":"1904.09675","repositories_listed":20,"syntology":{"n":76,"n_ran":44,"n_constructed":4,"n_ran_checked":10,"n_instrument":34,"n_unverified":32,"n_honours":3,"n_violates":2,"n_no_contract":5,"n_pointer_only":33,"phrase":"44 ran (of which 4 constructed an object rather than computing a result; 10 with no instrument failure: 3 honoured, 2 violated, 5 with no contract checked; 34 where Syntology's instrument failed) · 32 unverified","sample_list":"/paper/bertscore-evaluating-text-generation-with#ran","syntology_url":"https://syntology.ai/paper/1904.09675","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1904.09675"}},"official":{"repos":["Tiiiger/bert_score"],"state":"official (archive's flag): 6 ran","n_ran":6,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":4,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/retrieval-augmented-generation-for-knowledge","slug":"retrieval-augmented-generation-for-knowledge","title":"Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks","date":"2020-05-22","arxiv_id":"2005.11401","repositories_listed":18,"syntology":{"n":6,"n_ran":6,"n_constructed":3,"n_ran_checked":5,"n_instrument":1,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":5,"n_pointer_only":0,"phrase":"6 ran (of which 3 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/retrieval-augmented-generation-for-knowledge#ran","syntology_url":"https://syntology.ai/paper/2005.11401","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2005.11401"}},"official":null}},{"url":"/paper/blip-2-bootstrapping-language-image-pre","slug":"blip-2-bootstrapping-language-image-pre","title":"BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models","date":"2023-01-30","arxiv_id":"2301.12597","repositories_listed":17,"syntology":{"n":8,"n_ran":4,"n_constructed":4,"n_ran_checked":4,"n_instrument":0,"n_unverified":4,"n_honours":0,"n_violates":0,"n_no_contract":4,"n_pointer_only":1,"phrase":"4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified; every one of the 4 samples that ran constructed an object rather than computing a result","sample_list":"/paper/blip-2-bootstrapping-language-image-pre#ran","syntology_url":"https://syntology.ai/paper/2301.12597","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2301.12597"}},"official":{"repos":["salesforce/lavis"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/prefix-tuning-optimizing-continuous-prompts","slug":"prefix-tuning-optimizing-continuous-prompts","title":"Prefix-Tuning: Optimizing Continuous Prompts for Generation","date":"2021-01-01","arxiv_id":"2101.00190","repositories_listed":13,"syntology":{"n":6,"n_ran":4,"n_constructed":2,"n_ran_checked":2,"n_instrument":2,"n_unverified":2,"n_honours":0,"n_violates":0,"n_no_contract":2,"n_pointer_only":0,"phrase":"4 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified","sample_list":"/paper/prefix-tuning-optimizing-continuous-prompts#ran","syntology_url":"https://syntology.ai/paper/2101.00190","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2101.00190"}},"official":{"repos":["XiangLi1999/PrefixTuning"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/transformers-state-of-the-art-natural","slug":"transformers-state-of-the-art-natural","title":"HuggingFace's Transformers: State-of-the-art Natural Language Processing","date":"2019-10-09","arxiv_id":"1910.03771","repositories_listed":9,"syntology":{"n":3,"n_ran":3,"n_constructed":0,"n_ran_checked":0,"n_instrument":3,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/transformers-state-of-the-art-natural#ran","syntology_url":"https://syntology.ai/paper/1910.03771","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1910.03771"}},"official":{"repos":["huggingface/transformers"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]}}},{"url":"/paper/unified-language-model-pre-training-for","slug":"unified-language-model-pre-training-for","title":"Unified Language Model Pre-training for Natural Language Understanding and Generation","date":"2019-05-08","arxiv_id":"1905.03197","repositories_listed":9,"syntology":null},{"url":"/paper/llamafactory-unified-efficient-fine-tuning-of","slug":"llamafactory-unified-efficient-fine-tuning-of","title":"LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Models","date":"2024-03-20","arxiv_id":"2403.13372","repositories_listed":8,"syntology":{"n":17,"n_ran":11,"n_constructed":0,"n_ran_checked":9,"n_instrument":2,"n_unverified":6,"n_honours":0,"n_violates":0,"n_no_contract":9,"n_pointer_only":1,"phrase":"11 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 2 where Syntology's instrument failed) · 6 unverified","sample_list":"/paper/llamafactory-unified-efficient-fine-tuning-of#ran","syntology_url":"https://syntology.ai/paper/2403.13372","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2403.13372"}},"official":{"repos":["hiyouga/llama-factory"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/trocr-transformer-based-optical-character","slug":"trocr-transformer-based-optical-character","title":"TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models","date":"2021-09-21","arxiv_id":"2109.10282","repositories_listed":8,"syntology":{"n":6,"n_ran":5,"n_constructed":0,"n_ran_checked":5,"n_instrument":0,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":5,"n_pointer_only":0,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/trocr-transformer-based-optical-character#ran","syntology_url":"https://syntology.ai/paper/2109.10282","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2109.10282"}},"official":{"repos":["microsoft/unilm"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/ctrl-a-conditional-transformer-language-model-1","slug":"ctrl-a-conditional-transformer-language-model-1","title":"CTRL: A Conditional Transformer Language Model for Controllable Generation","date":"2019-09-11","arxiv_id":"1909.05858","repositories_listed":8,"syntology":{"n":14,"n_ran":14,"n_constructed":3,"n_ran_checked":11,"n_instrument":3,"n_unverified":0,"n_honours":3,"n_violates":1,"n_no_contract":7,"n_pointer_only":0,"phrase":"14 ran (of which 3 constructed an object rather than computing a result; 11 with no instrument failure: 3 honoured, 1 violated, 7 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/ctrl-a-conditional-transformer-language-model-1#ran","syntology_url":"https://syntology.ai/paper/1909.05858","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1909.05858"}},"official":null}},{"url":"/paper/nlg-evaluation-metrics-beyond-correlation","slug":"nlg-evaluation-metrics-beyond-correlation","title":"NLG Evaluation Metrics Beyond Correlation Analysis: An Empirical Metric Preference Checklist","date":"2023-05-15","arxiv_id":"2305.08566","repositories_listed":7,"syntology":null},{"url":"/paper/plug-and-play-language-models-a-simple","slug":"plug-and-play-language-models-a-simple","title":"Plug and Play Language Models: A Simple Approach to Controlled Text Generation","date":"2019-12-04","arxiv_id":"1912.02164","repositories_listed":7,"syntology":{"n":22,"n_ran":17,"n_constructed":0,"n_ran_checked":13,"n_instrument":4,"n_unverified":5,"n_honours":0,"n_violates":0,"n_no_contract":13,"n_pointer_only":2,"phrase":"17 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 0 honoured, 0 violated, 13 with no contract checked; 4 where Syntology's instrument failed) · 5 unverified","sample_list":"/paper/plug-and-play-language-models-a-simple#ran","syntology_url":"https://syntology.ai/paper/1912.02164","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1912.02164"}},"official":{"repos":["uber-research/PPLM"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":1,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/mass-masked-sequence-to-sequence-pre-training","slug":"mass-masked-sequence-to-sequence-pre-training","title":"MASS: Masked Sequence to Sequence Pre-training for Language Generation","date":"2019-05-07","arxiv_id":"1905.02450","repositories_listed":7,"syntology":null},{"url":"/paper/qwen2-5-technical-report","slug":"qwen2-5-technical-report","title":"Qwen2.5 Technical Report","date":"2024-12-19","arxiv_id":"2412.15115","repositories_listed":6,"syntology":{"n":3,"n_ran":1,"n_constructed":0,"n_ran_checked":0,"n_instrument":1,"n_unverified":2,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified","sample_list":"/paper/qwen2-5-technical-report#ran","syntology_url":"https://syntology.ai/paper/2412.15115","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2412.15115"}},"official":{"repos":["qwenlm/qwen2.5"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/structured-denoising-diffusion-models-in","slug":"structured-denoising-diffusion-models-in","title":"Structured Denoising Diffusion Models in Discrete State-Spaces","date":"2021-07-07","arxiv_id":"2107.03006","repositories_listed":6,"syntology":{"n":5,"n_ran":5,"n_constructed":4,"n_ran_checked":4,"n_instrument":1,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":4,"n_pointer_only":0,"phrase":"5 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/structured-denoising-diffusion-models-in#ran","syntology_url":"https://syntology.ai/paper/2107.03006","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2107.03006"}},"official":null}},{"url":"/paper/neural-text-generation-with-unlikelihood","slug":"neural-text-generation-with-unlikelihood","title":"Neural Text Generation with Unlikelihood Training","date":"2019-08-12","arxiv_id":"1908.04319","repositories_listed":6,"syntology":{"n":6,"n_ran":6,"n_constructed":1,"n_ran_checked":2,"n_instrument":4,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":2,"n_pointer_only":4,"phrase":"6 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/neural-text-generation-with-unlikelihood#ran","syntology_url":"https://syntology.ai/paper/1908.04319","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1908.04319"}},"official":{"repos":["facebookresearch/unlikelihood_training"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/gltr-statistical-detection-and-visualization","slug":"gltr-statistical-detection-and-visualization","title":"GLTR: Statistical Detection and Visualization of Generated Text","date":"2019-06-10","arxiv_id":"1906.04043","repositories_listed":6,"syntology":{"n":3,"n_ran":2,"n_constructed":0,"n_ran_checked":0,"n_instrument":2,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":2,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/gltr-statistical-detection-and-visualization#ran","syntology_url":"https://syntology.ai/paper/1906.04043","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1906.04043"}},"official":{"repos":["HendrikStrobelt/detecting-fake-text"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/training-language-gans-from-scratch","slug":"training-language-gans-from-scratch","title":"Training language GANs from Scratch","date":"2019-05-23","arxiv_id":"1905.09922","repositories_listed":6,"syntology":null},{"url":"/paper/fairseq-a-fast-extensible-toolkit-for","slug":"fairseq-a-fast-extensible-toolkit-for","title":"fairseq: A Fast, Extensible Toolkit for Sequence Modeling","date":"2019-04-01","arxiv_id":"1904.01038","repositories_listed":6,"syntology":{"n":11,"n_ran":3,"n_constructed":0,"n_ran_checked":2,"n_instrument":1,"n_unverified":8,"n_honours":0,"n_violates":0,"n_no_contract":2,"n_pointer_only":5,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 8 unverified","sample_list":"/paper/fairseq-a-fast-extensible-toolkit-for#ran","syntology_url":"https://syntology.ai/paper/1904.01038","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1904.01038"}},"official":{"repos":["pytorch/fairseq"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/long-text-generation-via-adversarial-training","slug":"long-text-generation-via-adversarial-training","title":"Long Text Generation via Adversarial Training with Leaked Information","date":"2017-09-24","arxiv_id":"1709.08624","repositories_listed":6,"syntology":{"n":2,"n_ran":2,"n_constructed":0,"n_ran_checked":2,"n_instrument":0,"n_unverified":0,"n_honours":2,"n_violates":0,"n_no_contract":0,"n_pointer_only":2,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/long-text-generation-via-adversarial-training#ran","syntology_url":"https://syntology.ai/paper/1709.08624","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1709.08624"}},"official":{"repos":["CR-Gjx/LeakGAN"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/geometric-gan","slug":"geometric-gan","title":"Geometric GAN","date":"2017-05-08","arxiv_id":"1705.02894","repositories_listed":6,"syntology":null},{"url":"/paper/a-syntactic-neural-model-for-general-purpose","slug":"a-syntactic-neural-model-for-general-purpose","title":"A Syntactic Neural Model for General-Purpose Code Generation","date":"2017-04-06","arxiv_id":"1704.01696","repositories_listed":6,"syntology":{"n":3,"n_ran":3,"n_constructed":0,"n_ran_checked":2,"n_instrument":1,"n_unverified":0,"n_honours":0,"n_violates":2,"n_no_contract":0,"n_pointer_only":3,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 2 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/a-syntactic-neural-model-for-general-purpose#ran","syntology_url":"https://syntology.ai/paper/1704.01696","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1704.01696"}},"official":null}},{"url":"/paper/boundary-seeking-generative-adversarial","slug":"boundary-seeking-generative-adversarial","title":"Boundary-Seeking Generative Adversarial Networks","date":"2017-02-27","arxiv_id":"1702.08431","repositories_listed":6,"syntology":{"n":1,"n_ran":1,"n_constructed":0,"n_ran_checked":1,"n_instrument":0,"n_unverified":0,"n_honours":1,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/boundary-seeking-generative-adversarial#ran","syntology_url":"https://syntology.ai/paper/1702.08431","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1702.08431"}},"official":null}},{"url":"/paper/sequence-to-sequence-learning-as-beam-search","slug":"sequence-to-sequence-learning-as-beam-search","title":"Sequence-to-Sequence Learning as Beam-Search Optimization","date":"2016-06-09","arxiv_id":"1606.02960","repositories_listed":6,"syntology":{"n":8,"n_ran":8,"n_constructed":0,"n_ran_checked":7,"n_instrument":1,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":7,"n_pointer_only":0,"phrase":"8 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/sequence-to-sequence-learning-as-beam-search#ran","syntology_url":"https://syntology.ai/paper/1606.02960","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1606.02960"}},"official":{"repos":["harvardnlp/BSO"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/factuality-enhanced-language-models-for-open","slug":"factuality-enhanced-language-models-for-open","title":"Factuality Enhanced Language Models for Open-Ended Text Generation","date":"2022-06-09","arxiv_id":"2206.04624","repositories_listed":5,"syntology":{"n":11,"n_ran":9,"n_constructed":0,"n_ran_checked":8,"n_instrument":1,"n_unverified":2,"n_honours":0,"n_violates":0,"n_no_contract":8,"n_pointer_only":6,"phrase":"9 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified","sample_list":"/paper/factuality-enhanced-language-models-for-open#ran","syntology_url":"https://syntology.ai/paper/2206.04624","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2206.04624"}},"official":{"repos":["nayeon7lee/factualityprompt"],"state":"official (archive's flag): 6 ran","n_ran":6,"n_constructed":0,"n_ran_no_instrument_failure":5,"n_unverified":0,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/measuring-mathematical-problem-solving-with","slug":"measuring-mathematical-problem-solving-with","title":"Measuring Mathematical Problem Solving With the MATH Dataset","date":"2021-03-05","arxiv_id":"2103.03874","repositories_listed":5,"syntology":{"n":3,"n_ran":3,"n_constructed":0,"n_ran_checked":0,"n_instrument":3,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":1,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/measuring-mathematical-problem-solving-with#ran","syntology_url":"https://syntology.ai/paper/2103.03874","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2103.03874"}},"official":{"repos":["hendrycks/math"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official","unlocated"]}}},{"url":"/paper/mauve-human-machine-divergence-curves-for","slug":"mauve-human-machine-divergence-curves-for","title":"MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontiers","date":"2021-02-02","arxiv_id":"2102.01454","repositories_listed":5,"syntology":{"n":7,"n_ran":5,"n_constructed":0,"n_ran_checked":2,"n_instrument":3,"n_unverified":2,"n_honours":2,"n_violates":0,"n_no_contract":0,"n_pointer_only":7,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified","sample_list":"/paper/mauve-human-machine-divergence-curves-for#ran","syntology_url":"https://syntology.ai/paper/2102.01454","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2102.01454"}},"official":{"repos":["krishnap25/mauve","krishnap25/mauve-experiments"],"state":"official (archive's flag): 5 ran","n_ran":5,"n_constructed":0,"n_ran_no_instrument_failure":2,"n_unverified":2,"ran_from_kinds":["official"]}}},{"url":"/paper/ernie-gen-an-enhanced-multi-flow-pre-training","slug":"ernie-gen-an-enhanced-multi-flow-pre-training","title":"ERNIE-GEN: An Enhanced Multi-Flow Pre-training and Fine-tuning Framework for Natural Language Generation","date":"2020-01-26","arxiv_id":"2001.11314","repositories_listed":5,"syntology":null},{"url":"/paper/encode-tag-realize-high-precision-text","slug":"encode-tag-realize-high-precision-text","title":"Encode, Tag, Realize: High-Precision Text Editing","date":"2019-09-03","arxiv_id":"1909.01187","repositories_listed":5,"syntology":{"n":11,"n_ran":8,"n_constructed":0,"n_ran_checked":7,"n_instrument":1,"n_unverified":3,"n_honours":1,"n_violates":0,"n_no_contract":6,"n_pointer_only":1,"phrase":"8 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified","sample_list":"/paper/encode-tag-realize-high-precision-text#ran","syntology_url":"https://syntology.ai/paper/1909.01187","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1909.01187"}},"official":{"repos":["google-research/lasertagger"],"state":"official (archive's flag): 5 ran","n_ran":5,"n_constructed":0,"n_ran_no_instrument_failure":5,"n_unverified":1,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/a-hierarchical-neural-autoencoder-for","slug":"a-hierarchical-neural-autoencoder-for","title":"A Hierarchical Neural Autoencoder for Paragraphs and Documents","date":"2015-06-02","arxiv_id":"1506.01057","repositories_listed":5,"syntology":null},{"url":"/paper/video-llama-an-instruction-tuned-audio-visual","slug":"video-llama-an-instruction-tuned-audio-visual","title":"Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding","date":"2023-06-05","arxiv_id":"2306.02858","repositories_listed":4,"syntology":{"n":25,"n_ran":18,"n_constructed":7,"n_ran_checked":8,"n_instrument":10,"n_unverified":7,"n_honours":0,"n_violates":1,"n_no_contract":7,"n_pointer_only":9,"phrase":"18 ran (of which 7 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 1 violated, 7 with no contract checked; 10 where Syntology's instrument failed) · 7 unverified","sample_list":"/paper/video-llama-an-instruction-tuned-audio-visual#ran","syntology_url":"https://syntology.ai/paper/2306.02858","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2306.02858"}},"official":{"repos":["damo-nlp-sg/video-llama"],"state":"official (archive's flag): 7 ran","n_ran":7,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":2,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/factscore-fine-grained-atomic-evaluation-of","slug":"factscore-fine-grained-atomic-evaluation-of","title":"FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation","date":"2023-05-23","arxiv_id":"2305.14251","repositories_listed":4,"syntology":{"n":15,"n_ran":11,"n_constructed":1,"n_ran_checked":8,"n_instrument":3,"n_unverified":4,"n_honours":1,"n_violates":3,"n_no_contract":4,"n_pointer_only":6,"phrase":"11 ran (of which 1 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 3 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 4 unverified","sample_list":"/paper/factscore-fine-grained-atomic-evaluation-of#ran","syntology_url":"https://syntology.ai/paper/2305.14251","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2305.14251"}},"official":{"repos":["shmsw25/factscore"],"state":"official (archive's flag): 10 ran","n_ran":10,"n_constructed":0,"n_ran_no_instrument_failure":7,"n_unverified":2,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/deeptextmark-deep-learning-based-text","slug":"deeptextmark-deep-learning-based-text","title":"DeepTextMark: A Deep Learning-Driven Text Watermarking Approach for Identifying Large Language Model Generated Text","date":"2023-05-09","arxiv_id":"2305.05773","repositories_listed":4,"syntology":{"n":1,"n_ran":1,"n_constructed":0,"n_ran_checked":1,"n_instrument":0,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":1,"n_pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/deeptextmark-deep-learning-based-text#ran","syntology_url":"https://syntology.ai/paper/2305.05773","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2305.05773"}},"official":null}},{"url":"/paper/lamp-when-large-language-models-meet","slug":"lamp-when-large-language-models-meet","title":"LaMP: When Large Language Models Meet Personalization","date":"2023-04-22","arxiv_id":"2304.11406","repositories_listed":4,"syntology":{"n":13,"n_ran":12,"n_constructed":0,"n_ran_checked":11,"n_instrument":1,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":11,"n_pointer_only":1,"phrase":"12 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/lamp-when-large-language-models-meet#ran","syntology_url":"https://syntology.ai/paper/2304.11406","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2304.11406"}},"official":null}},{"url":"/paper/one-embedder-any-task-instruction-finetuned","slug":"one-embedder-any-task-instruction-finetuned","title":"One Embedder, Any Task: Instruction-Finetuned Text Embeddings","date":"2022-12-19","arxiv_id":"2212.09741","repositories_listed":4,"syntology":{"n":20,"n_ran":17,"n_constructed":0,"n_ran_checked":14,"n_instrument":3,"n_unverified":3,"n_honours":0,"n_violates":3,"n_no_contract":11,"n_pointer_only":2,"phrase":"17 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 3 violated, 11 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified","sample_list":"/paper/one-embedder-any-task-instruction-finetuned#ran","syntology_url":"https://syntology.ai/paper/2212.09741","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2212.09741"}},"official":{"repos":["HKUNLP/instructor-embedding"],"state":"official (archive's flag): 15 ran","n_ran":15,"n_constructed":0,"n_ran_no_instrument_failure":14,"n_unverified":3,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/biogpt-generative-pre-trained-transformer-for","slug":"biogpt-generative-pre-trained-transformer-for","title":"BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Mining","date":"2022-10-19","arxiv_id":"2210.10341","repositories_listed":4,"syntology":null},{"url":"/paper/mvp-multi-task-supervised-pre-training-for","slug":"mvp-multi-task-supervised-pre-training-for","title":"MVP: Multi-task Supervised Pre-training for Natural Language Generation","date":"2022-06-24","arxiv_id":"2206.12131","repositories_listed":4,"syntology":null},{"url":"/paper/unifying-architectures-tasks-and-modalities","slug":"unifying-architectures-tasks-and-modalities","title":"OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework","date":"2022-02-07","arxiv_id":"2202.03052","repositories_listed":4,"syntology":{"n":1,"n_ran":1,"n_constructed":0,"n_ran_checked":1,"n_instrument":0,"n_unverified":0,"n_honours":1,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/unifying-architectures-tasks-and-modalities#ran","syntology_url":"https://syntology.ai/paper/2202.03052","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2202.03052"}},"official":{"repos":["ofa-sys/ofa"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}},{"url":"/paper/transformer-based-end-to-end-question","slug":"transformer-based-end-to-end-question","title":"Simplifying Paragraph-level Question Generation via Transformer Language Models","date":"2020-05-03","arxiv_id":"2005.01107","repositories_listed":4,"syntology":{"n":8,"n_ran":6,"n_constructed":0,"n_ran_checked":5,"n_instrument":1,"n_unverified":2,"n_honours":0,"n_violates":0,"n_no_contract":5,"n_pointer_only":1,"phrase":"6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified","sample_list":"/paper/transformer-based-end-to-end-question#ran","syntology_url":"https://syntology.ai/paper/2005.01107","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2005.01107"}},"official":null}},{"url":"/paper/bleurt-learning-robust-metrics-for-text","slug":"bleurt-learning-robust-metrics-for-text","title":"BLEURT: Learning Robust Metrics for Text Generation","date":"2020-04-09","arxiv_id":"2004.04696","repositories_listed":4,"syntology":{"n":2,"n_ran":1,"n_constructed":0,"n_ran_checked":0,"n_instrument":1,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":1,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/bleurt-learning-robust-metrics-for-text#ran","syntology_url":"https://syntology.ai/paper/2004.04696","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2004.04696"}},"official":{"repos":["google-research/bleurt"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/moverscore-text-generation-evaluating-with","slug":"moverscore-text-generation-evaluating-with","title":"MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distance","date":"2019-09-05","arxiv_id":"1909.02622","repositories_listed":4,"syntology":{"n":2,"n_ran":2,"n_constructed":0,"n_ran_checked":0,"n_instrument":2,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":2,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/moverscore-text-generation-evaluating-with#ran","syntology_url":"https://syntology.ai/paper/1909.02622","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1909.02622"}},"official":null}},{"url":"/paper/defending-against-neural-fake-news","slug":"defending-against-neural-fake-news","title":"Defending Against Neural Fake News","date":"2019-05-29","arxiv_id":"1905.12616","repositories_listed":4,"syntology":{"n":10,"n_ran":6,"n_constructed":0,"n_ran_checked":5,"n_instrument":1,"n_unverified":4,"n_honours":0,"n_violates":0,"n_no_contract":5,"n_pointer_only":10,"phrase":"6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified","sample_list":"/paper/defending-against-neural-fake-news#ran","syntology_url":"https://syntology.ai/paper/1905.12616","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1905.12616"}},"official":{"repos":["rowanz/grover"],"state":"official (archive's flag): 4 ran","n_ran":4,"n_constructed":0,"n_ran_no_instrument_failure":4,"n_unverified":3,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/towards-knowledge-based-personalized-product","slug":"towards-knowledge-based-personalized-product","title":"Towards Knowledge-Based Personalized Product Description Generation in E-commerce","date":"2019-03-29","arxiv_id":"1903.12457","repositories_listed":4,"syntology":null},{"url":"/paper/pretraining-based-natural-language-generation","slug":"pretraining-based-natural-language-generation","title":"Pretraining-Based Natural Language Generation for Text Summarization","date":"2019-02-25","arxiv_id":"1902.09243","repositories_listed":4,"syntology":{"n":1,"n_ran":1,"n_constructed":0,"n_ran_checked":0,"n_instrument":1,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":1,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/pretraining-based-natural-language-generation#ran","syntology_url":"https://syntology.ai/paper/1902.09243","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1902.09243"}},"official":null}},{"url":"/paper/texar-a-modularized-versatile-and-extensible-1","slug":"texar-a-modularized-versatile-and-extensible-1","title":"Texar: A Modularized, Versatile, and Extensible Toolkit for Text Generation","date":"2018-09-04","arxiv_id":"1809.00794","repositories_listed":4,"syntology":{"n":12,"n_ran":11,"n_constructed":0,"n_ran_checked":11,"n_instrument":0,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":11,"n_pointer_only":0,"phrase":"11 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/texar-a-modularized-versatile-and-extensible-1#ran","syntology_url":"https://syntology.ai/paper/1809.00794","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1809.00794"}},"official":{"repos":["asyml/texar"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/graph2seq-graph-to-sequence-learning-with","slug":"graph2seq-graph-to-sequence-learning-with","title":"Graph2Seq: Graph to Sequence Learning with Attention-based Neural Networks","date":"2018-04-03","arxiv_id":"1804.00823","repositories_listed":4,"syntology":{"n":10,"n_ran":7,"n_constructed":0,"n_ran_checked":7,"n_instrument":0,"n_unverified":3,"n_honours":1,"n_violates":0,"n_no_contract":6,"n_pointer_only":4,"phrase":"7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified","sample_list":"/paper/graph2seq-graph-to-sequence-learning-with#ran","syntology_url":"https://syntology.ai/paper/1804.00823","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1804.00823"}},"official":{"repos":["IBM/Graph2Seq"],"state":"official (archive's flag): 7 ran","n_ran":7,"n_constructed":0,"n_ran_no_instrument_failure":7,"n_unverified":3,"ran_from_kinds":["official"]}}},{"url":"/paper/convolutional-image-captioning","slug":"convolutional-image-captioning","title":"Convolutional Image Captioning","date":"2017-11-24","arxiv_id":"1711.09151","repositories_listed":4,"syntology":null},{"url":"/paper/challenges-in-data-to-document-generation","slug":"challenges-in-data-to-document-generation","title":"Challenges in Data-to-Document Generation","date":"2017-07-25","arxiv_id":"1707.08052","repositories_listed":4,"syntology":null},{"url":"/paper/modeling-context-in-referring-expressions","slug":"modeling-context-in-referring-expressions","title":"Modeling Context in Referring Expressions","date":"2016-07-31","arxiv_id":"1608.00272","repositories_listed":4,"syntology":{"n":4,"n_ran":1,"n_constructed":0,"n_ran_checked":1,"n_instrument":0,"n_unverified":3,"n_honours":1,"n_violates":0,"n_no_contract":0,"n_pointer_only":4,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified","sample_list":"/paper/modeling-context-in-referring-expressions#ran","syntology_url":"https://syntology.ai/paper/1608.00272","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1608.00272"}},"official":{"repos":["lichengunc/refer"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":3,"ran_from_kinds":["official"]}}},{"url":"/paper/multiresolution-recurrent-neural-networks-an","slug":"multiresolution-recurrent-neural-networks-an","title":"Multiresolution Recurrent Neural Networks: An Application to Dialogue Response Generation","date":"2016-06-02","arxiv_id":"1606.00776","repositories_listed":4,"syntology":null},{"url":"/paper/llmsr-xllm25-less-is-more-enhancing","slug":"llmsr-xllm25-less-is-more-enhancing","title":"LLMSR@XLLM25: Less is More: Enhancing Structured Multi-Agent Reasoning via Quality-Guided Distillation","date":"2025-04-23","arxiv_id":"2504.16408","repositories_listed":3,"syntology":null},{"url":"/paper/search-r1-training-llms-to-reason-and","slug":"search-r1-training-llms-to-reason-and","title":"Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learning","date":"2025-03-12","arxiv_id":"2503.09516","repositories_listed":3,"syntology":{"n":2,"n_ran":2,"n_constructed":0,"n_ran_checked":0,"n_instrument":2,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":1,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/search-r1-training-llms-to-reason-and#ran","syntology_url":"https://syntology.ai/paper/2503.09516","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2503.09516"}},"official":{"repos":["petergriffinjin/search-r1"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official","unlocated"]}}},{"url":"/paper/flow-matching-guide-and-code","slug":"flow-matching-guide-and-code","title":"Flow Matching Guide and Code","date":"2024-12-09","arxiv_id":"2412.06264","repositories_listed":3,"syntology":{"n":2,"n_ran":2,"n_constructed":0,"n_ran_checked":1,"n_instrument":1,"n_unverified":0,"n_honours":1,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/flow-matching-guide-and-code#ran","syntology_url":"https://syntology.ai/paper/2412.06264","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2412.06264"}},"official":null}},{"url":"/paper/bone-block-affine-transformation-as-parameter","slug":"bone-block-affine-transformation-as-parameter","title":"Balancing LoRA Performance and Efficiency with Simple Shard Sharing","date":"2024-09-19","arxiv_id":"2409.15371","repositories_listed":3,"syntology":null},{"url":"/paper/benchmarking-uncertainty-quantification","slug":"benchmarking-uncertainty-quantification","title":"Benchmarking Uncertainty Quantification Methods for Large Language Models with LM-Polygraph","date":"2024-06-21","arxiv_id":"2406.15627","repositories_listed":3,"syntology":{"n":4,"n_ran":2,"n_constructed":0,"n_ran_checked":2,"n_instrument":0,"n_unverified":2,"n_honours":2,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified","sample_list":"/paper/benchmarking-uncertainty-quantification#ran","syntology_url":"https://syntology.ai/paper/2406.15627","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2406.15627"}},"official":{"repos":["iinemo/lm-polygraph"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/chameleon-mixed-modal-early-fusion-foundation","slug":"chameleon-mixed-modal-early-fusion-foundation","title":"Chameleon: Mixed-Modal Early-Fusion Foundation Models","date":"2024-05-16","arxiv_id":"2405.09818","repositories_listed":3,"syntology":null},{"url":"/paper/evaluating-text-to-visual-generation-with","slug":"evaluating-text-to-visual-generation-with","title":"Evaluating Text-to-Visual Generation with Image-to-Text Generation","date":"2024-04-01","arxiv_id":"2404.01291","repositories_listed":3,"syntology":null},{"url":"/paper/simple-linear-attention-language-models","slug":"simple-linear-attention-language-models","title":"Simple linear attention language models balance the recall-throughput tradeoff","date":"2024-02-28","arxiv_id":"2402.18668","repositories_listed":3,"syntology":{"n":10,"n_ran":10,"n_constructed":0,"n_ran_checked":2,"n_instrument":8,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":2,"n_pointer_only":1,"phrase":"10 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 8 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/simple-linear-attention-language-models#ran","syntology_url":"https://syntology.ai/paper/2402.18668","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2402.18668"}},"official":{"repos":["hazyresearch/based","hazyresearch/zoology"],"state":"official (archive's flag): 10 ran","n_ran":10,"n_constructed":0,"n_ran_no_instrument_failure":2,"n_unverified":0,"ran_from_kinds":["official"]}}},{"url":"/paper/the-power-of-noise-redefining-retrieval-for","slug":"the-power-of-noise-redefining-retrieval-for","title":"The Power of Noise: Redefining Retrieval for RAG Systems","date":"2024-01-26","arxiv_id":"2401.14887","repositories_listed":3,"syntology":{"n":5,"n_ran":5,"n_constructed":0,"n_ran_checked":0,"n_instrument":5,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":5,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 5 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/the-power-of-noise-redefining-retrieval-for#ran","syntology_url":"https://syntology.ai/paper/2401.14887","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2401.14887"}},"official":{"repos":["florin-git/The-Power-of-Noise"],"state":"official (archive's flag): 5 ran","n_ran":5,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]}}},{"url":"/paper/knowledge-fusion-of-large-language-models","slug":"knowledge-fusion-of-large-language-models","title":"Knowledge Fusion of Large Language Models","date":"2024-01-19","arxiv_id":"2401.10491","repositories_listed":3,"syntology":{"n":4,"n_ran":1,"n_constructed":0,"n_ran_checked":0,"n_instrument":1,"n_unverified":3,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":4,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified","sample_list":"/paper/knowledge-fusion-of-large-language-models#ran","syntology_url":"https://syntology.ai/paper/2401.10491","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2401.10491"}},"official":{"repos":["fanqiwan/fusellm"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":2,"ran_from_kinds":["official"]}}},{"url":"/paper/efficient-large-language-models-a-survey","slug":"efficient-large-language-models-a-survey","title":"Efficient Large Language Models: A Survey","date":"2023-12-06","arxiv_id":"2312.03863","repositories_listed":3,"syntology":null},{"url":"/paper/medgen-a-python-natural-language-processing","slug":"medgen-a-python-natural-language-processing","title":"Ascle: A Python Natural Language Processing Toolkit for Medical Text Generation","date":"2023-11-28","arxiv_id":"2311.16588","repositories_listed":3,"syntology":null},{"url":"/paper/chateval-towards-better-llm-based-evaluators","slug":"chateval-towards-better-llm-based-evaluators","title":"ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate","date":"2023-08-14","arxiv_id":"2308.07201","repositories_listed":3,"syntology":{"n":3,"n_ran":2,"n_constructed":0,"n_ran_checked":2,"n_instrument":0,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":2,"n_pointer_only":0,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/chateval-towards-better-llm-based-evaluators#ran","syntology_url":"https://syntology.ai/paper/2308.07201","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2308.07201"}},"official":{"repos":["chanchimin/chateval"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":2,"n_unverified":1,"ran_from_kinds":["official"]}}},{"url":"/paper/shifting-attention-to-relevance-towards-the","slug":"shifting-attention-to-relevance-towards-the","title":"Shifting Attention to Relevance: Towards the Predictive Uncertainty Quantification of Free-Form Large Language Models","date":"2023-07-03","arxiv_id":"2307.01379","repositories_listed":3,"syntology":{"n":2,"n_ran":2,"n_constructed":0,"n_ran_checked":2,"n_instrument":0,"n_unverified":0,"n_honours":2,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/shifting-attention-to-relevance-towards-the#ran","syntology_url":"https://syntology.ai/paper/2307.01379","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2307.01379"}},"official":{"repos":["jinhaoduan/sar","jinhaoduan/shifting-attention-to-relevance"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":2,"n_unverified":0,"ran_from_kinds":["official"]}}},{"url":"/paper/assessing-language-model-deployment-with-risk","slug":"assessing-language-model-deployment-with-risk","title":"Assessing Language Model Deployment with Risk Cards","date":"2023-03-31","arxiv_id":"2303.18190","repositories_listed":3,"syntology":{"n":5,"n_ran":3,"n_constructed":0,"n_ran_checked":3,"n_instrument":0,"n_unverified":2,"n_honours":0,"n_violates":0,"n_no_contract":3,"n_pointer_only":5,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified","sample_list":"/paper/assessing-language-model-deployment-with-risk#ran","syntology_url":"https://syntology.ai/paper/2303.18190","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2303.18190"}},"official":{"repos":["leondz/lm_risk_cards"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/gpteval-nlg-evaluation-using-gpt-4-with","slug":"gpteval-nlg-evaluation-using-gpt-4-with","title":"G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment","date":"2023-03-29","arxiv_id":"2303.16634","repositories_listed":3,"syntology":{"n":4,"n_ran":3,"n_constructed":0,"n_ran_checked":3,"n_instrument":0,"n_unverified":1,"n_honours":1,"n_violates":0,"n_no_contract":2,"n_pointer_only":1,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/gpteval-nlg-evaluation-using-gpt-4-with#ran","syntology_url":"https://syntology.ai/paper/2303.16634","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2303.16634"}},"official":{"repos":["nlpyang/geval"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":2,"n_unverified":0,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/cost-effective-hyperparameter-optimization","slug":"cost-effective-hyperparameter-optimization","title":"Cost-Effective Hyperparameter Optimization for Large Language Model Generation Inference","date":"2023-03-08","arxiv_id":"2303.04673","repositories_listed":3,"syntology":{"n":9,"n_ran":6,"n_constructed":0,"n_ran_checked":5,"n_instrument":1,"n_unverified":3,"n_honours":1,"n_violates":0,"n_no_contract":4,"n_pointer_only":9,"phrase":"6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified","sample_list":"/paper/cost-effective-hyperparameter-optimization#ran","syntology_url":"https://syntology.ai/paper/2303.04673","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2303.04673"}},"official":{"repos":["microsoft/FLAML"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/semantic-uncertainty-linguistic-invariances","slug":"semantic-uncertainty-linguistic-invariances","title":"Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generation","date":"2023-02-19","arxiv_id":"2302.09664","repositories_listed":3,"syntology":{"n":1,"n_ran":1,"n_constructed":0,"n_ran_checked":0,"n_instrument":1,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":1,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/semantic-uncertainty-linguistic-invariances#ran","syntology_url":"https://syntology.ai/paper/2302.09664","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2302.09664"}},"official":{"repos":["lorenzkuhn/semantic_uncertainty"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]}}},{"url":"/paper/gptscore-evaluate-as-you-desire","slug":"gptscore-evaluate-as-you-desire","title":"GPTScore: Evaluate as You Desire","date":"2023-02-08","arxiv_id":"2302.04166","repositories_listed":3,"syntology":null},{"url":"/paper/an-empirical-study-on-contrastive-search-and","slug":"an-empirical-study-on-contrastive-search-and","title":"An Empirical Study On Contrastive Search And Contrastive Decoding For Open-ended Text Generation","date":"2022-11-19","arxiv_id":"2211.10797","repositories_listed":3,"syntology":{"n":9,"n_ran":9,"n_constructed":0,"n_ran_checked":0,"n_instrument":9,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":4,"phrase":"9 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 9 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/an-empirical-study-on-contrastive-search-and#ran","syntology_url":"https://syntology.ai/paper/2211.10797","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2211.10797"}},"official":{"repos":["yxuansu/contrastive_search_versus_contrastive_decoding"],"state":"official (archive's flag): 5 ran","n_ran":5,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/contrastive-search-is-what-you-need-for","slug":"contrastive-search-is-what-you-need-for","title":"Contrastive Search Is What You Need For Neural Text Generation","date":"2022-10-25","arxiv_id":"2210.14140","repositories_listed":3,"syntology":{"n":9,"n_ran":9,"n_constructed":0,"n_ran_checked":3,"n_instrument":6,"n_unverified":0,"n_honours":3,"n_violates":0,"n_no_contract":0,"n_pointer_only":4,"phrase":"9 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 3 honoured, 0 violated, 0 with no contract checked; 6 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/contrastive-search-is-what-you-need-for#ran","syntology_url":"https://syntology.ai/paper/2210.14140","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2210.14140"}},"official":{"repos":["yxuansu/contrastive_search_is_what_you_need"],"state":"official (archive's flag): 4 ran","n_ran":4,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/leather-a-framework-for-learning-to-generate","slug":"leather-a-framework-for-learning-to-generate","title":"LEATHER: A Framework for Learning to Generate Human-like Text in Dialogue","date":"2022-10-14","arxiv_id":"2210.07777","repositories_listed":3,"syntology":null},{"url":"/paper/how-large-language-models-are-transforming","slug":"how-large-language-models-are-transforming","title":"How Large Language Models are Transforming Machine-Paraphrased Plagiarism","date":"2022-10-07","arxiv_id":"2210.03568","repositories_listed":3,"syntology":null},{"url":"/paper/is-reinforcement-learning-not-for-natural","slug":"is-reinforcement-learning-not-for-natural","title":"Is Reinforcement Learning (Not) for Natural Language Processing: Benchmarks, Baselines, and Building Blocks for Natural Language Policy Optimization","date":"2022-10-03","arxiv_id":"2210.01241","repositories_listed":3,"syntology":null},{"url":"/paper/zerogen-efficient-zero-shot-learning-via","slug":"zerogen-efficient-zero-shot-learning-via","title":"ZeroGen: Efficient Zero-shot Learning via Dataset Generation","date":"2022-02-16","arxiv_id":"2202.07922","repositories_listed":3,"syntology":{"n":7,"n_ran":3,"n_constructed":0,"n_ran_checked":0,"n_instrument":3,"n_unverified":4,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":7,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 4 unverified","sample_list":"/paper/zerogen-efficient-zero-shot-learning-via#ran","syntology_url":"https://syntology.ai/paper/2202.07922","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2202.07922"}},"official":{"repos":["HKUNLP/zerogen"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":4,"ran_from_kinds":["official"]}}},{"url":"/paper/typical-decoding-for-natural-language","slug":"typical-decoding-for-natural-language","title":"Locally Typical Sampling","date":"2022-02-01","arxiv_id":"2202.00666","repositories_listed":3,"syntology":{"n":25,"n_ran":19,"n_constructed":0,"n_ran_checked":14,"n_instrument":5,"n_unverified":6,"n_honours":3,"n_violates":1,"n_no_contract":10,"n_pointer_only":15,"phrase":"19 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 3 honoured, 1 violated, 10 with no contract checked; 5 where Syntology's instrument failed) · 6 unverified","sample_list":"/paper/typical-decoding-for-natural-language#ran","syntology_url":"https://syntology.ai/paper/2202.00666","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2202.00666"}},"official":{"repos":["cimeister/typical-sampling"],"state":"official (archive's flag): 10 ran","n_ran":10,"n_constructed":0,"n_ran_no_instrument_failure":5,"n_unverified":5,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/turingbench-a-benchmark-environment-for","slug":"turingbench-a-benchmark-environment-for","title":"TURINGBENCH: A Benchmark Environment for Turing Test in the Age of Neural Text Generation","date":"2021-09-27","arxiv_id":"2109.13296","repositories_listed":3,"syntology":{"n":7,"n_ran":6,"n_constructed":0,"n_ran_checked":6,"n_instrument":0,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":6,"n_pointer_only":0,"phrase":"6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/turingbench-a-benchmark-environment-for#ran","syntology_url":"https://syntology.ai/paper/2109.13296","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2109.13296"}},"official":null}},{"url":"/paper/a-temporal-variational-model-for-story","slug":"a-temporal-variational-model-for-story","title":"A Temporal Variational Model for Story Generation","date":"2021-09-14","arxiv_id":"2109.06807","repositories_listed":3,"syntology":null},{"url":"/paper/indicbart-a-pre-trained-model-for-natural","slug":"indicbart-a-pre-trained-model-for-natural","title":"IndicBART: A Pre-trained Model for Indic Natural Language Generation","date":"2021-09-07","arxiv_id":"2109.02903","repositories_listed":3,"syntology":null},{"url":"/paper/webqa-multihop-and-multimodal-qa","slug":"webqa-multihop-and-multimodal-qa","title":"WebQA: Multihop and Multimodal QA","date":"2021-09-01","arxiv_id":"2109.00590","repositories_listed":3,"syntology":{"n":13,"n_ran":10,"n_constructed":0,"n_ran_checked":7,"n_instrument":3,"n_unverified":3,"n_honours":2,"n_violates":0,"n_no_contract":5,"n_pointer_only":12,"phrase":"10 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 2 honoured, 0 violated, 5 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified","sample_list":"/paper/webqa-multihop-and-multimodal-qa#ran","syntology_url":"https://syntology.ai/paper/2109.00590","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2109.00590"}},"official":null}},{"url":"/paper/bartscore-evaluating-generated-text-as-text","slug":"bartscore-evaluating-generated-text-as-text","title":"BARTScore: Evaluating Generated Text as Text Generation","date":"2021-06-22","arxiv_id":"2106.11520","repositories_listed":3,"syntology":null},{"url":"/paper/prophetnet-x-large-scale-pre-training-models","slug":"prophetnet-x-large-scale-pre-training-models","title":"ProphetNet-X: Large-Scale Pre-training Models for English, Chinese, Multi-lingual, Dialog, and Code Generation","date":"2021-04-16","arxiv_id":"2104.08006","repositories_listed":3,"syntology":null},{"url":"/paper/fudge-controlled-text-generation-with-future","slug":"fudge-controlled-text-generation-with-future","title":"FUDGE: Controlled Text Generation With Future Discriminators","date":"2021-04-12","arxiv_id":"2104.05218","repositories_listed":3,"syntology":{"n":4,"n_ran":1,"n_constructed":0,"n_ran_checked":0,"n_instrument":1,"n_unverified":3,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":2,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified","sample_list":"/paper/fudge-controlled-text-generation-with-future#ran","syntology_url":"https://syntology.ai/paper/2104.05218","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2104.05218"}},"official":{"repos":["yangkevin2/naacl-2021-fudge-controlled-generation"],"state":"official: harvested, nothing ran","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":1,"ran_from_kinds":["listed"]}}},{"url":"/paper/what-makes-good-in-context-examples-for-gpt-3","slug":"what-makes-good-in-context-examples-for-gpt-3","title":"What Makes Good In-Context Examples for GPT-$3$?","date":"2021-01-17","arxiv_id":"2101.06804","repositories_listed":3,"syntology":{"n":1,"n_ran":1,"n_constructed":0,"n_ran_checked":0,"n_instrument":1,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":1,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/what-makes-good-in-context-examples-for-gpt-3#ran","syntology_url":"https://syntology.ai/paper/2101.06804","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2101.06804"}},"official":null}},{"url":"/paper/improving-factual-completeness-and","slug":"improving-factual-completeness-and","title":"Improving Factual Completeness and Consistency of Image-to-Text Radiology Report Generation","date":"2020-10-20","arxiv_id":"2010.10042","repositories_listed":3,"syntology":{"n":3,"n_ran":3,"n_constructed":0,"n_ran_checked":0,"n_instrument":3,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/improving-factual-completeness-and#ran","syntology_url":"https://syntology.ai/paper/2010.10042","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2010.10042"}},"official":{"repos":["ysmiura/ifcc"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/a-survey-of-knowledge-enhanced-text","slug":"a-survey-of-knowledge-enhanced-text","title":"A Survey of Knowledge-Enhanced Text Generation","date":"2020-10-09","arxiv_id":"2010.04389","repositories_listed":3,"syntology":null},{"url":"/paper/realtoxicityprompts-evaluating-neural-toxic","slug":"realtoxicityprompts-evaluating-neural-toxic","title":"RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Models","date":"2020-09-24","arxiv_id":"2009.11462","repositories_listed":3,"syntology":{"n":5,"n_ran":4,"n_constructed":0,"n_ran_checked":2,"n_instrument":2,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":2,"n_pointer_only":0,"phrase":"4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/realtoxicityprompts-evaluating-neural-toxic#ran","syntology_url":"https://syntology.ai/paper/2009.11462","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2009.11462"}},"official":{"repos":["allenai/real-toxicity-prompts"],"state":"official (archive's flag): 4 ran","n_ran":4,"n_constructed":0,"n_ran_no_instrument_failure":2,"n_unverified":1,"ran_from_kinds":["official"]}}},{"url":"/paper/investigating-pretrained-language-models-for","slug":"investigating-pretrained-language-models-for","title":"Investigating Pretrained Language Models for Graph-to-Text Generation","date":"2020-07-16","arxiv_id":"2007.08426","repositories_listed":3,"syntology":{"n":12,"n_ran":9,"n_constructed":0,"n_ran_checked":9,"n_instrument":0,"n_unverified":3,"n_honours":0,"n_violates":0,"n_no_contract":9,"n_pointer_only":2,"phrase":"9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified","sample_list":"/paper/investigating-pretrained-language-models-for#ran","syntology_url":"https://syntology.ai/paper/2007.08426","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2007.08426"}},"official":{"repos":["UKPLab/plms-graph2text"],"state":"official (archive's flag): 9 ran","n_ran":9,"n_constructed":0,"n_ran_no_instrument_failure":9,"n_unverified":3,"ran_from_kinds":["official"]}}},{"url":"/paper/probabilistically-masked-language-model","slug":"probabilistically-masked-language-model","title":"Probabilistically Masked Language Model Capable of Autoregressive Generation in Arbitrary Word Order","date":"2020-04-24","arxiv_id":"2004.11579","repositories_listed":3,"syntology":{"n":35,"n_ran":21,"n_constructed":1,"n_ran_checked":12,"n_instrument":9,"n_unverified":14,"n_honours":4,"n_violates":3,"n_no_contract":5,"n_pointer_only":29,"phrase":"21 ran (of which 1 constructed an object rather than computing a result; 12 with no instrument failure: 4 honoured, 3 violated, 5 with no contract checked; 9 where Syntology's instrument failed) · 14 unverified","sample_list":"/paper/probabilistically-masked-language-model#ran","syntology_url":"https://syntology.ai/paper/2004.11579","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2004.11579"}},"official":{"repos":["huawei-noah/Pretrained-Language-Model"],"state":"official (archive's flag): 15 ran","n_ran":15,"n_constructed":1,"n_ran_no_instrument_failure":8,"n_unverified":13,"ran_from_kinds":["listed","official","unlocated"]}}},{"url":"/paper/scrabblegan-semi-supervised-varying-length","slug":"scrabblegan-semi-supervised-varying-length","title":"ScrabbleGAN: Semi-Supervised Varying Length Handwritten Text Generation","date":"2020-03-23","arxiv_id":"2003.10557","repositories_listed":3,"syntology":{"n":15,"n_ran":14,"n_constructed":0,"n_ran_checked":11,"n_instrument":3,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":11,"n_pointer_only":3,"phrase":"14 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/scrabblegan-semi-supervised-varying-length#ran","syntology_url":"https://syntology.ai/paper/2003.10557","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2003.10557"}},"official":null}},{"url":"/paper/advcodec-towards-a-unified-framework-for-1","slug":"advcodec-towards-a-unified-framework-for-1","title":"T3: Tree-Autoencoder Constrained Adversarial Text Generation for Targeted Attack","date":"2019-12-22","arxiv_id":"1912.10375","repositories_listed":3,"syntology":null},{"url":"/paper/commongen-a-constrained-text-generation","slug":"commongen-a-constrained-text-generation","title":"CommonGen: A Constrained Text Generation Challenge for Generative Commonsense Reasoning","date":"2019-11-09","arxiv_id":"1911.03705","repositories_listed":3,"syntology":{"n":6,"n_ran":5,"n_constructed":0,"n_ran_checked":5,"n_instrument":0,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":5,"n_pointer_only":0,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/commongen-a-constrained-text-generation#ran","syntology_url":"https://syntology.ai/paper/1911.03705","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1911.03705"}},"official":null}},{"url":"/paper/plato-pre-trained-dialogue-generation-model","slug":"plato-pre-trained-dialogue-generation-model","title":"PLATO: Pre-trained Dialogue Generation Model with Discrete Latent Variable","date":"2019-10-17","arxiv_id":"1910.07931","repositories_listed":3,"syntology":null},{"url":"/paper/unified-vision-language-pre-training-for","slug":"unified-vision-language-pre-training-for","title":"Unified Vision-Language Pre-Training for Image Captioning and VQA","date":"2019-09-24","arxiv_id":"1909.11059","repositories_listed":3,"syntology":{"n":14,"n_ran":11,"n_constructed":0,"n_ran_checked":6,"n_instrument":5,"n_unverified":3,"n_honours":1,"n_violates":0,"n_no_contract":5,"n_pointer_only":14,"phrase":"11 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 0 violated, 5 with no contract checked; 5 where Syntology's instrument failed) · 3 unverified","sample_list":"/paper/unified-vision-language-pre-training-for#ran","syntology_url":"https://syntology.ai/paper/1909.11059","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1909.11059"}},"official":{"repos":["LuoweiZhou/VLP"],"state":"official (archive's flag): 11 ran","n_ran":11,"n_constructed":0,"n_ran_no_instrument_failure":6,"n_unverified":3,"ran_from_kinds":["official"]}}}],"syntology_records":69,"syntology_note":"a paper without a record is not a recorded non-run: it may lack an arXiv id or simply be absent from the graph layer"},"key_notes":{"n_ran_checked":"legacy name, kept unchanged so existing readers do not break: it counts the samples that ran with no instrument failure (honoured, violated, and ran with no contract checked); it does not mean a contract was checked, and the pages print it as 'K with no instrument failure', not 'K checked'","n_constructed":"a sub-count of the samples that ran, never subtracted from them and never a failure: an executed sample whose run returned an instance of its own class (fixture_out_type equals the entry name): the run built an object and did not compute a result (Syntology's RAN record, counts.constructed)"},"since_archive_judged":{"papers":14,"papers_placed":0,"judged_by":{"model":"Claude Sonnet 4.5","models_as_recorded":["global.anthropic.claude-sonnet-4-5-20250929-v1:0"],"from":"lb_rows_run_verified.jsonl: each record's `model` field (the extractor's call that wrote decisions[])"},"note":"a model's judgement from the paper's own tables that they report on this leaderboard, not a result: no value from a paper that was not placed is printed or carried here; papers counts each paper once over these leaderboards","backfill":"8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read)","backfill_complete":false,"leaderboards":[{"leaderboard":"/sota/text-generation-on-commongen-1","since_archive":"/sota/text-generation-on-commongen-1#since-judged","papers_judged":1,"placed":0},{"leaderboard":"/sota/text-generation-on-openwebtext","since_archive":"/sota/text-generation-on-openwebtext#since-judged","papers_judged":1,"placed":0},{"leaderboard":"/sota/text-generation-on-sciq","since_archive":"/sota/text-generation-on-sciq#since-judged","papers_judged":7,"placed":0},{"leaderboard":"/sota/text-generation-on-cnn-daily-mail","since_archive":"/sota/text-generation-on-cnn-daily-mail#since-judged","papers_judged":3,"placed":0},{"leaderboard":"/sota/text-generation-on-harmfulqa","since_archive":"/sota/text-generation-on-harmfulqa#since-judged","papers_judged":2,"placed":0}]},"papers_where_code_ran":610,"papers_where_code_ran_first_page":"/task/text-generation/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not run it on this task or check it against the task's benchmarks.","pages":[{"order":"archive","page":2,"of":54,"url":"/task/text-generation/papers/2","json":"/task/text-generation/papers/2.json","rows":100},{"order":"archive","page":3,"of":54,"url":"/task/text-generation/papers/3","json":"/task/text-generation/papers/3.json","rows":100},{"order":"archive","page":4,"of":54,"url":"/task/text-generation/papers/4","json":"/task/text-generation/papers/4.json","rows":100},{"order":"archive","page":5,"of":54,"url":"/task/text-generation/papers/5","json":"/task/text-generation/papers/5.json","rows":100},{"order":"archive","page":6,"of":54,"url":"/task/text-generation/papers/6","json":"/task/text-generation/papers/6.json","rows":100},{"order":"archive","page":7,"of":54,"url":"/task/text-generation/papers/7","json":"/task/text-generation/papers/7.json","rows":100},{"order":"archive","page":8,"of":54,"url":"/task/text-generation/papers/8","json":"/task/text-generation/papers/8.json","rows":100},{"order":"archive","page":9,"of":54,"url":"/task/text-generation/papers/9","json":"/task/text-generation/papers/9.json","rows":100},{"order":"archive","page":10,"of":54,"url":"/task/text-generation/papers/10","json":"/task/text-generation/papers/10.json","rows":100},{"order":"archive","page":11,"of":54,"url":"/task/text-generation/papers/11","json":"/task/text-generation/papers/11.json","rows":100},{"order":"archive","page":12,"of":54,"url":"/task/text-generation/papers/12","json":"/task/text-generation/papers/12.json","rows":100},{"order":"archive","page":13,"of":54,"url":"/task/text-generation/papers/13","json":"/task/text-generation/papers/13.json","rows":100},{"order":"archive","page":14,"of":54,"url":"/task/text-generation/papers/14","json":"/task/text-generation/papers/14.json","rows":100},{"order":"archive","page":15,"of":54,"url":"/task/text-generation/papers/15","json":"/task/text-generation/papers/15.json","rows":100},{"order":"archive","page":16,"of":54,"url":"/task/text-generation/papers/16","json":"/task/text-generation/papers/16.json","rows":100},{"order":"archive","page":17,"of":54,"url":"/task/text-generation/papers/17","json":"/task/text-generation/papers/17.json","rows":100},{"order":"archive","page":18,"of":54,"url":"/task/text-generation/papers/18","json":"/task/text-generation/papers/18.json","rows":100},{"order":"archive","page":19,"of":54,"url":"/task/text-generation/papers/19","json":"/task/text-generation/papers/19.json","rows":100},{"order":"archive","page":20,"of":54,"url":"/task/text-generation/papers/20","json":"/task/text-generation/papers/20.json","rows":100},{"order":"archive","page":21,"of":54,"url":"/task/text-generation/papers/21","json":"/task/text-generation/papers/21.json","rows":100},{"order":"archive","page":22,"of":54,"url":"/task/text-generation/papers/22","json":"/task/text-generation/papers/22.json","rows":100},{"order":"archive","page":23,"of":54,"url":"/task/text-generation/papers/23","json":"/task/text-generation/papers/23.json","rows":100},{"order":"archive","page":24,"of":54,"url":"/task/text-generation/papers/24","json":"/task/text-generation/papers/24.json","rows":100},{"order":"archive","page":25,"of":54,"url":"/task/text-generation/papers/25","json":"/task/text-generation/papers/25.json","rows":100},{"order":"archive","page":26,"of":54,"url":"/task/text-generation/papers/26","json":"/task/text-generation/papers/26.json","rows":100},{"order":"archive","page":27,"of":54,"url":"/task/text-generation/papers/27","json":"/task/text-generation/papers/27.json","rows":100},{"order":"archive","page":28,"of":54,"url":"/task/text-generation/papers/28","json":"/task/text-generation/papers/28.json","rows":100},{"order":"archive","page":29,"of":54,"url":"/task/text-generation/papers/29","json":"/task/text-generation/papers/29.json","rows":100},{"order":"archive","page":30,"of":54,"url":"/task/text-generation/papers/30","json":"/task/text-generation/papers/30.json","rows":100},{"order":"archive","page":31,"of":54,"url":"/task/text-generation/papers/31","json":"/task/text-generation/papers/31.json","rows":100},{"order":"archive","page":32,"of":54,"url":"/task/text-generation/papers/32","json":"/task/text-generation/papers/32.json","rows":100},{"order":"archive","page":33,"of":54,"url":"/task/text-generation/papers/33","json":"/task/text-generation/papers/33.json","rows":100},{"order":"archive","page":34,"of":54,"url":"/task/text-generation/papers/34","json":"/task/text-generation/papers/34.json","rows":100},{"order":"archive","page":35,"of":54,"url":"/task/text-generation/papers/35","json":"/task/text-generation/papers/35.json","rows":100},{"order":"archive","page":36,"of":54,"url":"/task/text-generation/papers/36","json":"/task/text-generation/papers/36.json","rows":100},{"order":"archive","page":37,"of":54,"url":"/task/text-generation/papers/37","json":"/task/text-generation/papers/37.json","rows":100},{"order":"archive","page":38,"of":54,"url":"/task/text-generation/papers/38","json":"/task/text-generation/papers/38.json","rows":100},{"order":"archive","page":39,"of":54,"url":"/task/text-generation/papers/39","json":"/task/text-generation/papers/39.json","rows":100},{"order":"archive","page":40,"of":54,"url":"/task/text-generation/papers/40","json":"/task/text-generation/papers/40.json","rows":100},{"order":"archive","page":41,"of":54,"url":"/task/text-generation/papers/41","json":"/task/text-generation/papers/41.json","rows":100},{"order":"archive","page":42,"of":54,"url":"/task/text-generation/papers/42","json":"/task/text-generation/papers/42.json","rows":100},{"order":"archive","page":43,"of":54,"url":"/task/text-generation/papers/43","json":"/task/text-generation/papers/43.json","rows":100},{"order":"archive","page":44,"of":54,"url":"/task/text-generation/papers/44","json":"/task/text-generation/papers/44.json","rows":100},{"order":"archive","page":45,"of":54,"url":"/task/text-generation/papers/45","json":"/task/text-generation/papers/45.json","rows":100},{"order":"archive","page":46,"of":54,"url":"/task/text-generation/papers/46","json":"/task/text-generation/papers/46.json","rows":100},{"order":"archive","page":47,"of":54,"url":"/task/text-generation/papers/47","json":"/task/text-generation/papers/47.json","rows":100},{"order":"archive","page":48,"of":54,"url":"/task/text-generation/papers/48","json":"/task/text-generation/papers/48.json","rows":100},{"order":"archive","page":49,"of":54,"url":"/task/text-generation/papers/49","json":"/task/text-generation/papers/49.json","rows":100},{"order":"archive","page":50,"of":54,"url":"/task/text-generation/papers/50","json":"/task/text-generation/papers/50.json","rows":100},{"order":"archive","page":51,"of":54,"url":"/task/text-generation/papers/51","json":"/task/text-generation/papers/51.json","rows":100},{"order":"archive","page":52,"of":54,"url":"/task/text-generation/papers/52","json":"/task/text-generation/papers/52.json","rows":100},{"order":"archive","page":53,"of":54,"url":"/task/text-generation/papers/53","json":"/task/text-generation/papers/53.json","rows":100},{"order":"archive","page":54,"of":54,"url":"/task/text-generation/papers/54","json":"/task/text-generation/papers/54.json","rows":35},{"order":"ran","page":1,"of":7,"url":"/task/text-generation/papers/ran/1","json":"/task/text-generation/papers/ran/1.json","rows":100},{"order":"ran","page":2,"of":7,"url":"/task/text-generation/papers/ran/2","json":"/task/text-generation/papers/ran/2.json","rows":100},{"order":"ran","page":3,"of":7,"url":"/task/text-generation/papers/ran/3","json":"/task/text-generation/papers/ran/3.json","rows":100},{"order":"ran","page":4,"of":7,"url":"/task/text-generation/papers/ran/4","json":"/task/text-generation/papers/ran/4.json","rows":100},{"order":"ran","page":5,"of":7,"url":"/task/text-generation/papers/ran/5","json":"/task/text-generation/papers/ran/5.json","rows":100},{"order":"ran","page":6,"of":7,"url":"/task/text-generation/papers/ran/6","json":"/task/text-generation/papers/ran/6.json","rows":100},{"order":"ran","page":7,"of":7,"url":"/task/text-generation/papers/ran/7","json":"/task/text-generation/papers/ran/7.json","rows":10}],"description_links":{"kept":2,"unwrapped_to_text":0,"bare_urls_linked":0,"relative_images_dropped":0,"rule":"internal links are kept only when the target slug exists in the catalog"},"syntology":{"read_at":"2026-10-05T00:36:11+00:00","claim":"Per-sample execution status on synthesized fixtures ('ran N of M samples'); not a correctness claim and not a ranking signal.","status_vocabulary":{"ran_honours":"ran, honoured the contract we drafted","ran_violates":"ran, violated the contract we drafted","ran_draft_wrong":"ran; our contract draft was wrong, not the code","ran_fixture":"ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT)","ran":"ran on a synthesized input","unverified":"unverified (harvested, no recorded run)"},"row_route":"each syntology object on a benchmark's first row and on a paper carries sample_list (this site's paper page, #ran), syntology_url (syntology.ai's page for the paper, only when that route probed live) and mcp (the agent call that lists the paper's harvested samples; not a verdict on the paper)","developers":"https://syntology.ai/developers"},"not_shown":{"libraries":"the archive has no per-task library table","trend_sparklines":"the Trend column of the benchmarks table was a rendered image; it is not in the archive","social_and_latest_sorts":"stars and social signals are not in the archive"},"record_sha256":"05afd3a6424cc8e3e7846431a782c0564aa31455b4f4a184c34d37dbec8e0e40","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}