Browse State-of-the-Art › Text Generation
Text Generation
2,047 papers with code · 20 benchmarks · 162 datasets archive 2025-07-28
Text Generation is the task of generating text with the goal of appearing indistinguishable to human-written text. This task is more formally known as "natural language generation" in the literature.
Text generation can be addressed with Markov processes or deep generative models like LSTMs. Recently, some of the most advanced methods for text generation include BART, GPT and other GAN-based approaches. Text generation systems are evaluated either through human ratings or automatic evaluation metrics like METEOR, ROUGE, and BLEU.
Further readings:
( Image credit: Adversarial Ranking for Language Generation )
Description from the archive archive 2025-07-28; Papers-with-Code links inside it are rewritten to this site.
Benchmarks archive 2025-07-28
155 leaderboard tables shown for this task, 20 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted. 10 shown of 155 until expanded.
Syntology 14 newer papers were judged to report on this task's benchmarks so far (Claude Sonnet 4.5, reading their tables: a model's judgement, not a result; 0 placed): CommonGen (1 judged, 0 placed), OpenWebText (1 judged, 0 placed), SciQ (7 judged, 0 placed), CNN/Daily Mail (3 judged, 0 placed), HarmfulQA (2 judged, 0 placed). Drawn from 8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read).
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| DART (7 rows) | T5B Baseline | FactSpotter: Evaluating the Factual Faithfulness of Graph-to-Text... | code | — | Compare |
| COCO Captions (5 rows) | LeakGAN | Long Text Generation via Adversarial Training with Leaked Information | code | Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified | Compare |
| EMNLP2017 WMT (5 rows) | LeakGAN | Long Text Generation via Adversarial Training with Leaked Information | code | Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified | Compare |
| ReDial (5 rows) | UniCRS | Towards Unified Conversational Recommender Systems via... | code | — | Compare |
| CommonGen (4 rows) | UniLM | CommonGen: A Constrained Text Generation Challenge for Generative... | code | Syntology 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified | Compare |
| ROCStories (4 rows) | Beam search + A*esque (beam) | NeuroLogic A*esque Decoding: Constrained Text Generation with... | code | — | Compare |
| Chinese Poems (3 rows) | RankGAN | Adversarial Ranking for Language Generation | code | — | Compare |
| Czech restaurant information (3 rows) | TGen++ | The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics | — | — | Compare |
| OpenWebText (3 rows) | GPT2-Hermite | Polynomial, trigonometric, and tropical activations | code | — | Compare |
| SciQ (3 rows) | LLaMA-65B+CFG (zero-shot) | Stay on topic with Classifier-Free Guidance | — | — | Compare |
| Yahoo Questions (3 rows) | Aggressive VAE | Lagging Inference Networks and Posterior Collapse in Variational... | code | Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified | Compare |
| ADGEN (1 row) | BART (TextBox 2.0) | TextBox 2.0: A Text Generation Library with Pre-trained Language Models | code | Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result | Compare |
| CMU-SE (1 row) | STWGAN-GP | Generating Text through Adversarial Training using Skip-Thought Vectors | code | — | Compare |
| CNN/Daily Mail (1 row) | PALM | PALM: Pre-training an Autoencoding&Autoregressive Language Model... | code | — | Compare |
| CSL (1 row) | BART (TextBox 2.0) | TextBox 2.0: A Text Generation Library with Pre-trained Language Models | code | Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result | Compare |
| DailyDialog (1 row) | AEM+Attention | An Auto-Encoder Matching Model for Learning Utterance-Level... | code | — | Compare |
| HarmfulQA (1 row) | GPT-4 | Red-Teaming Large Language Models using Chain of Utterances for... | code | — | Compare |
| LCSTS (1 row) | BART (TextBox 2.0) | TextBox 2.0: A Text Generation Library with Pre-trained Language Models | code | Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result | Compare |
| LDC2016E25 (1 row) | Graph2Seq | A Graph-to-Sequence Model for AMR-to-Text Generation | code | — | Compare |
| One Billion Word (1 row) | WGANGP + DGflow | Refining Deep Generative Models via Discriminator Gradient Flow | code | Syntology official: harvested, nothing ran · 0 ran · 1 unverified | Compare |
| AI2 Reasoning Challenge (25-Shot) (0 rows) | no rows in the archive | — | — | ||
| AI2 Reasoning Challenge TR v0.2 (0 rows) | no rows in the archive | — | — | ||
| AlpacaEval (0 rows) | no rows in the archive | — | — | ||
| AlpacaEval 2.0 (GPT-4-1106-Preview) (0 rows) | no rows in the archive | — | — | ||
| Arabic Poetry Dataset (6th - 21st century) (0 rows) | no rows in the archive | — | — | ||
| arc_challenge (0 rows) | no rows in the archive | — | — | ||
| ARC Challenge (25-Shot) (0 rows) | no rows in the archive | — | — | ||
| ARC-Challenge (PT) (0 rows) | no rows in the archive | — | — | ||
| arc_easy (0 rows) | no rows in the archive | — | — | ||
| Assin2 RTE (0 rows) | no rows in the archive | — | — | ||
| Assin2 STS (0 rows) | no rows in the archive | — | — | ||
| axb (0 rows) | no rows in the archive | — | — | ||
| axg (0 rows) | no rows in the archive | — | — | ||
| BBH (3-Shot) (0 rows) | no rows in the archive | — | — | ||
| Big Bench Hard (3-Shot) (0 rows) | no rows in the archive | — | — | ||
| BLUEX (No Images) (0 rows) | no rows in the archive | — | — | ||
| BoolQ (0 rows) | no rows in the archive | — | — | ||
| CALAME-PT (0 rows) | no rows in the archive | — | — | ||
| cb (0 rows) | no rows in the archive | — | — | ||
| Censorship (0-shot) (0 rows) | no rows in the archive | — | — | ||
| CoLA (0 rows) | no rows in the archive | — | — | ||
| Creativity (0-shot) (0 rows) | no rows in the archive | — | — | ||
| CrimeStats (0 rows) | no rows in the archive | — | — | ||
| crows_pairs_english (0 rows) | no rows in the archive | — | — | ||
| crows_pairs_french (0 rows) | no rows in the archive | — | — | ||
| DiaBLa (0 rows) | no rows in the archive | — | — | ||
| Drop (3-Shot) (0 rows) | no rows in the archive | — | — | ||
| ENEM Challenge (No Images) (0 rows) | no rows in the archive | — | — | ||
| FaQuAD NLI (0 rows) | no rows in the archive | — | — | ||
| GPQA (0-shot) (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_afr (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_asm (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_cat (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_ceb (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_ces (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_ckb (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_cym (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_dan (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_deu (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_ell (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_eng (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_est (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_fas (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_fin (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_fra (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_ful (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_glg (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_guj (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_hau (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_heb (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_mlt (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_mon (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_msa (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_mya (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_nld (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_nob (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_npi (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_nso (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_nya (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_oci (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_orm (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_ory (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_pan (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_pol (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_por (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_ron (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_rus (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_slk (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_slv (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_som (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_tam (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_tel (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_tgk (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_tgl (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_tha (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_tur (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_ukr (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_umb (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_urd (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_uzb (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_vie (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_wol (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_xho (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_yor (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_zho_simpl (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_zho_trad (0 rows) | no rows in the archive | — | — | ||
| gsarti/flores_101_zul (0 rows) | no rows in the archive | — | — | ||
| GSM8k (5-shot) (0 rows) | no rows in the archive | — | — | ||
| GSM8k TR (0 rows) | no rows in the archive | — | — | ||
| GSM8k TR v0.2 (0 rows) | no rows in the archive | — | — | ||
| HateBR Binary (0 rows) | no rows in the archive | — | — | ||
| HeadQA (0 rows) | no rows in the archive | — | — | ||
| HellaSwag (0 rows) | no rows in the archive | — | — | ||
| HellaSwag (10-Shot) (0 rows) | no rows in the archive | — | — | ||
| HellaSwag (PT) (0 rows) | no rows in the archive | — | — | ||
| HellaSwag TR (0 rows) | no rows in the archive | — | — | ||
| Humanness (0-shot) (0 rows) | no rows in the archive | — | — | ||
| IFEval (0-Shot) (0 rows) | no rows in the archive | — | — | ||
| IndicGLUE (0 rows) | no rows in the archive | — | — | ||
| Internet (0 rows) | no rows in the archive | — | — | ||
| LAMBADA-PT (0 rows) | no rows in the archive | — | — | ||
| LogiQA (0 rows) | no rows in the archive | — | — | ||
| Math HARD (4-Shot) (0 rows) | no rows in the archive | — | — | ||
| MATH Lvl 5 (4-Shot) (0 rows) | no rows in the archive | — | — | ||
| MMLU (5-Shot) (0 rows) | no rows in the archive | — | — | ||
| MMLU-PRO (5-shot) (0 rows) | no rows in the archive | — | — | ||
| MMLU TR (0 rows) | no rows in the archive | — | — | ||
| MMLU TR v0.2 (0 rows) | no rows in the archive | — | — | ||
| MNLI (0 rows) | no rows in the archive | — | — | ||
| MT-Bench (0 rows) | no rows in the archive | — | — | ||
| MuSR (0-shot) (0 rows) | no rows in the archive | — | — | ||
| Nexa Scientific Tokens (0 rows) | no rows in the archive | — | — | ||
| OAB Exams (0 rows) | no rows in the archive | — | — | ||
| Open Australian Legal QA (0 rows) | no rows in the archive | — | — | ||
| Open-Mindedness (0-shot) (0 rows) | no rows in the archive | — | — | ||
| OpenBookQA (0 rows) | no rows in the archive | — | — | ||
| PIQA (0 rows) | no rows in the archive | — | — | ||
| PolContro (0 rows) | no rows in the archive | — | — | ||
| PT Hate Speech Binary (0 rows) | no rows in the archive | — | — | ||
| Stories/Jokes (0 rows) | no rows in the archive | — | — | ||
| Talking (0-shot) (0 rows) | no rows in the archive | — | — | ||
| TriviaQA (0 rows) | no rows in the archive | — | — | ||
| TruthfulQA (0-shot) (0 rows) | no rows in the archive | — | — | ||
| TruthfulQA (PT) (0 rows) | no rows in the archive | — | — | ||
| TruthfulQA TR v0.2 (0 rows) | no rows in the archive | — | — | ||
| tweetSentBR (0 rows) | no rows in the archive | — | — | ||
| Unruly (0 rows) | no rows in the archive | — | — | ||
| W/10 (0 rows) | no rows in the archive | — | — | ||
| WiC (0 rows) | no rows in the archive | — | — | ||
| WikiText-103 (0 rows) | no rows in the archive | — | — | ||
| WinoGrande (0 rows) | no rows in the archive | — | — | ||
| Winogrande (5-shot) (0 rows) | no rows in the archive | — | — | ||
| Winogrande TR (0 rows) | no rows in the archive | — | — | ||
| Winogrande TR v0.2 (0 rows) | no rows in the archive | — | — | ||
| World Knowledge (0-shot) (0 rows) | no rows in the archive | — | — | ||
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
162 datasets whose archive record lists this task, ordered by the archive's paper count. 30 shown of 162 until expanded.
Subtasks archive 2025-07-28
25 subtasks in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 5,335 · with a code link: 2,047 · where Syntology ran a sample: 610 (482 with a run with no instrument failure, 128 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (610 of 5,335 tagged: 482 with a run with no instrument failure, 128 where every run was a failure of Syntology's instrument)
Page 1 of 54: papers 1 to 100 of 5,335, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
26 Feb 2021 82 repositories listed Syntology official: no sample here; runs from other or unrecorded repositories · 16 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 14 where Syntology's instrument failed) · 4 unverified (of 20 harvested samples) · 16 pointer-only (licence)State-of-the-art computer vision systems are trained to predict a fixed set of predetermined object categories.
-
17 Nov 2014 74 repositories listed Syntology 28 ran (of which 0 constructed an object rather than computing a result; 20 with no instrument failure: 2 honoured, 2 violated, 16 with no contract checked; 8 where Syntology's instrument failed) · 6 unverified (of 34 harvested samples) · 7 pointer-only (licence)Experiments on several datasets show the accuracy of the model and the fluency of the language it learns solely from image descriptions.
-
4 Aug 2013 59 repositories listed Syntology 31 ran (of which 0 constructed an object rather than computing a result; 28 with no instrument failure: 4 honoured, 0 violated, 24 with no contract checked; 3 where Syntology's instrument failed) · 6 unverified (of 37 harvested samples) · 4 pointer-only (licence)This paper shows how Long Short-term Memory recurrent neural networks can be used to generate complex sequences with long-range structure, simply by predicting one data point at a time.
-
29 Oct 2019 47 repositories listed Syntology 40 ran (of which 7 constructed an object rather than computing a result; 30 with no instrument failure: 1 honoured, 2 violated, 27 with no contract checked; 10 where Syntology's instrument failed) · 13 unverified (of 53 harvested samples) · 13 pointer-only (licence)We evaluate a number of noising approaches, finding the best performance by both randomly shuffling the order of the original sentences and using a novel in-filling scheme, where spans of text are replaced with a single…
-
7 Oct 2016 25 repositories listed Syntology official: no sample here; runs from other or unrecorded repositories · 7 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 5 where Syntology's instrument failed) · 7 unverified (of 14 harvested samples) · 14 pointer-only (licence)We observe that our method consistently outperforms BS and previously proposed techniques for diverse decoding from neural sequence models.
-
18 Sep 2016 23 repositories listed Syntology community repositories only · 14 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 7 honoured, 1 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 7 unverified (of 21 harvested samples) · 13 pointer-only (licence)As a new way of training generative models, Generative Adversarial Nets (GAN) that uses a discriminative model to guide the training of the generative model has enjoyed considerable success in generating real-valued…
-
14 Feb 2019 21 repositories listedNatural language processing tasks, such as question answering, machine translation, reading comprehension, and summarization, are typically approached with supervised learning on taskspecific datasets.
-
21 Apr 2019 20 repositories listed Syntology official (archive's flag): 6 ran · 44 ran (of which 4 constructed an object rather than computing a result; 10 with no instrument failure: 3 honoured, 2 violated, 5 with no contract checked; 34 where Syntology's instrument failed) · 32 unverified (of 76 harvested samples) · 33 pointer-only (licence)We propose BERTScore, an automatic evaluation metric for text generation.
-
22 May 2020 18 repositories listed Syntology 6 ran (of which 3 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples)Large pre-trained language models have been shown to store factual knowledge in their parameters, and achieve state-of-the-art results when fine-tuned on downstream NLP tasks.
-
30 Jan 2023 17 repositories listed Syntology community repositories only · 4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified; every one of the 4 samples that ran constructed an object rather than computing a result (of 8 harvested samples) · 1 pointer-only (licence)The cost of vision-and-language pre-training has become increasingly prohibitive due to end-to-end training of large-scale models.
-
1 Jan 2021 13 repositories listed Syntology community repositories only · 4 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples)Fine-tuning is the de facto way to leverage large pretrained language models to perform downstream tasks.
-
9 Oct 2019 9 repositories listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)Transformer architectures have facilitated building higher-capacity models and pretraining has made it possible to effectively utilize this capacity for a wide variety of tasks.
-
8 May 2019 9 repositories listedThis paper presents a new Unified pre-trained Language Model (UniLM) that can be fine-tuned for both natural language understanding and generation tasks.
-
20 Mar 2024 8 repositories listed Syntology community repositories only · 11 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 2 where Syntology's instrument failed) · 6 unverified (of 17 harvested samples) · 1 pointer-only (licence)Efficient fine-tuning is vital for adapting large language models (LLMs) to downstream tasks.
-
21 Sep 2021 8 repositories listed Syntology community repositories only · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)Text recognition is a long-standing research problem for document digitalization.
-
11 Sep 2019 8 repositories listed Syntology 14 ran (of which 3 constructed an object rather than computing a result; 11 with no instrument failure: 3 honoured, 1 violated, 7 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 14 harvested samples)Large-scale language models show promising text generation capabilities, but users cannot easily control particular aspects of the generated text.
-
15 May 2023 7 repositories listedOur proposed framework provides access: (i) for verifying whether automatic metrics are faithful to human preference, regardless of their correlation level to human; and (ii) for inspecting the strengths and limitations…
-
4 Dec 2019 7 repositories listed Syntology official (archive's flag): 2 ran · 17 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 0 honoured, 0 violated, 13 with no contract checked; 4 where Syntology's instrument failed) · 5 unverified (of 22 harvested samples) · 2 pointer-only (licence)Large transformer-based language models (LMs) trained on huge text corpora have shown unparalleled generation capabilities.
-
7 May 2019 7 repositories listedPre-training and fine-tuning, e. g., BERT, have achieved great success in language understanding by transferring knowledge from rich-resource pre-training task to the low/zero-resource downstream tasks.
-
19 Dec 2024 6 repositories listed Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples)In addition, for hosted solutions, the proprietary models currently include two mixture-of-experts (MoE) variants: Qwen2.
-
7 Jul 2021 6 repositories listed Syntology 5 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)Here, we introduce Discrete Denoising Diffusion Probabilistic Models (D3PMs), diffusion-like generative models for discrete data that generalize the multinomial diffusion model of Hoogeboom et al. 2021, by going beyond…
-
12 Aug 2019 6 repositories listed Syntology official (archive's flag): 1 ran · 6 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 4 pointer-only (licence)Neural text generation is a key tool in natural language applications, but it is well known there are major problems at its core.
-
10 Jun 2019 6 repositories listed Syntology official (archive's flag): 1 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 2 pointer-only (licence)The rapid improvement of language models has raised the specter of abuse of text generation systems.
-
23 May 2019 6 repositories listedGenerative Adversarial Networks (GANs) enjoy great success at image generation, but have proven difficult to train in the domain of natural language.
-
1 Apr 2019 6 repositories listed Syntology community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 8 unverified (of 11 harvested samples) · 5 pointer-only (licence)fairseq is an open-source sequence modeling toolkit that allows researchers and developers to train custom models for translation, summarization, language modeling, and other text generation tasks.
-
24 Sep 2017 6 repositories listed Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)Automatically generating coherent and semantically meaningful text has many applications in machine translation, dialogue systems, image captioning, etc.
-
8 May 2017 6 repositories listedGenerative Adversarial Nets (GANs) represent an important milestone for effective generative models, which has inspired numerous variants seemingly different from each other.
-
6 Apr 2017 6 repositories listed Syntology 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 2 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)We consider the problem of parsing natural language descriptions into source code written in a general-purpose programming language like Python.
-
27 Feb 2017 6 repositories listed Syntology 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)We introduce a method for training GANs with discrete data that uses the estimated difference measure from the discriminator to compute importance weights for generated samples, thus providing a policy gradient for…
-
9 Jun 2016 6 repositories listed Syntology community repositories only · 8 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples)In this work, we introduce a model and beam-search training scheme, based on the work of Daume III and Marcu (2005), that extends seq2seq to learn global sequence scores.
-
9 Jun 2022 5 repositories listed Syntology official (archive's flag): 6 ran · 9 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 11 harvested samples) · 6 pointer-only (licence)
-
5 Mar 2021 5 repositories listed Syntology official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 1 pointer-only (licence)
-
2 Feb 2021 5 repositories listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
26 Jan 2020 5 repositories listed
-
3 Sep 2019 5 repositories listed Syntology official (archive's flag): 5 ran · 8 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples) · 1 pointer-only (licence)
-
2 Jun 2015 5 repositories listed
-
5 Jun 2023 4 repositories listed Syntology official (archive's flag): 7 ran · 18 ran (of which 7 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 1 violated, 7 with no contract checked; 10 where Syntology's instrument failed) · 7 unverified (of 25 harvested samples) · 9 pointer-only (licence)
-
23 May 2023 4 repositories listed Syntology official (archive's flag): 10 ran · 11 ran (of which 1 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 3 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 4 unverified (of 15 harvested samples) · 6 pointer-only (licence)
-
22 Apr 2023 4 repositories listed Syntology 12 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 13 harvested samples) · 1 pointer-only (licence)
-
19 Dec 2022 4 repositories listed Syntology official (archive's flag): 15 ran · 17 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 3 violated, 11 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (of 20 harvested samples) · 2 pointer-only (licence)
-
19 Oct 2022 4 repositories listed
-
24 Jun 2022 4 repositories listed
-
7 Feb 2022 4 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
3 May 2020 4 repositories listed Syntology 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples) · 1 pointer-only (licence)
-
9 Apr 2020 4 repositories listed Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples) · 1 pointer-only (licence)
-
5 Sep 2019 4 repositories listed Syntology 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
29 May 2019 4 repositories listed Syntology official (archive's flag): 4 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (of 10 harvested samples) · 10 pointer-only (licence)
-
29 Mar 2019 4 repositories listed
-
25 Feb 2019 4 repositories listed Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
4 Sep 2018 4 repositories listed Syntology community repositories only · 11 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 12 harvested samples)
-
3 Apr 2018 4 repositories listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 10 harvested samples) · 4 pointer-only (licence)
-
24 Nov 2017 4 repositories listed
-
25 Jul 2017 4 repositories listed
-
31 Jul 2016 4 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
2 Jun 2016 4 repositories listed
-
23 Apr 2025 3 repositories listed
-
12 Mar 2025 3 repositories listed Syntology official (archive's flag): 1 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 1 pointer-only (licence)
-
19 Sep 2024 3 repositories listed
-
21 Jun 2024 3 repositories listed Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples)
-
16 May 2024 3 repositories listed
-
1 Apr 2024 3 repositories listed
-
28 Feb 2024 3 repositories listed Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 8 where Syntology's instrument failed) · 0 unverified (of 10 harvested samples) · 1 pointer-only (licence)
-
26 Jan 2024 3 repositories listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 5 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
19 Jan 2024 3 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
6 Dec 2023 3 repositories listed
-
28 Nov 2023 3 repositories listed
-
14 Aug 2023 3 repositories listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
-
3 Jul 2023 3 repositories listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
31 Mar 2023 3 repositories listed Syntology community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
29 Mar 2023 3 repositories listed Syntology official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 1 pointer-only (licence)
-
8 Mar 2023 3 repositories listed Syntology community repositories only · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples) · 9 pointer-only (licence)
-
19 Feb 2023 3 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
8 Feb 2023 3 repositories listed
-
19 Nov 2022 3 repositories listed Syntology official (archive's flag): 5 ran · 9 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 9 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples) · 4 pointer-only (licence)
-
25 Oct 2022 3 repositories listed Syntology official (archive's flag): 4 ran · 9 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 3 honoured, 0 violated, 0 with no contract checked; 6 where Syntology's instrument failed) · 0 unverified (of 9 harvested samples) · 4 pointer-only (licence)
-
14 Oct 2022 3 repositories listed
-
7 Oct 2022 3 repositories listed
-
3 Oct 2022 3 repositories listed
-
16 Feb 2022 3 repositories listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 4 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
1 Feb 2022 3 repositories listed Syntology official (archive's flag): 10 ran · 19 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 3 honoured, 1 violated, 10 with no contract checked; 5 where Syntology's instrument failed) · 6 unverified (of 25 harvested samples) · 15 pointer-only (licence)
-
14 Sep 2021 3 repositories listed
-
7 Sep 2021 3 repositories listed
-
1 Sep 2021 3 repositories listed Syntology 10 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 2 honoured, 0 violated, 5 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (of 13 harvested samples) · 12 pointer-only (licence)
-
22 Jun 2021 3 repositories listed
-
16 Apr 2021 3 repositories listed
-
12 Apr 2021 3 repositories listed Syntology official: harvested, nothing ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 4 harvested samples) · 2 pointer-only (licence)
-
17 Jan 2021 3 repositories listed Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
20 Oct 2020 3 repositories listed Syntology official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
9 Oct 2020 3 repositories listed
-
24 Sep 2020 3 repositories listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples)
-
16 Jul 2020 3 repositories listed Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 12 harvested samples) · 2 pointer-only (licence)
-
Probabilistically Masked Language Model Capable of Autoregressive Generation in Arbitrary Word Order24 Apr 2020 3 repositories listed Syntology official (archive's flag): 15 ran · 21 ran (of which 1 constructed an object rather than computing a result; 12 with no instrument failure: 4 honoured, 3 violated, 5 with no contract checked; 9 where Syntology's instrument failed) · 14 unverified (of 35 harvested samples) · 29 pointer-only (licence)
-
23 Mar 2020 3 repositories listed Syntology 14 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 15 harvested samples) · 3 pointer-only (licence)
-
22 Dec 2019 3 repositories listed
-
17 Oct 2019 3 repositories listed
-
24 Sep 2019 3 repositories listed Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 0 violated, 5 with no contract checked; 5 where Syntology's instrument failed) · 3 unverified (of 14 harvested samples) · 14 pointer-only (licence)
Syntology lines on 69 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections