{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/task/machine-translation","name":"Machine Translation","slug":"machine-translation","description_markdown":"**Machine translation** is the task of translating a sentence in a source language to a different target language.\r\n\r\nApproaches for machine translation can range from rule-based to statistical to neural-based. More recently, encoder-decoder attention-based architectures like BERT have attained major improvements in machine translation. \r\n\r\nOne of the most popular datasets used to benchmark machine translation systems is the WMT family of datasets. Some of the most commonly used evaluation metrics for machine translation systems include BLEU, METEOR, NIST, and others. \r\n\r\n<span style=\"color:grey; opacity: 0.6\">( Image credit: [Google seq2seq](https://github.com/google/seq2seq) )</span>","categories":[{"name":"Natural Language Processing","url":"/area/natural-language-processing"}],"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","slug_source":"archive_url"},"counts":{"papers_tagged":10752,"papers_with_code":2444,"benchmarks":84,"benchmark_tables_in_archive":84,"benchmark_tables_shown":84,"benchmark_tables_withheld_as_spam":0,"benchmark_definition":"a leaderboard table with at least one row; benchmark_tables_shown also counts the zero-row tables; benchmark_tables_in_archive adds the tables withheld as spam","datasets":82,"subtasks":10,"parent_tasks":0},"benchmarks":[{"leaderboard":"/sota/machine-translation-on-wmt2014-english-german","slug":"machine-translation-on-wmt2014-english-german","dataset":"WMT2014 English-German","dataset_url":"/dataset/wmt-2014","rows_in_archive":91,"metrics":["BLEU score","SacreBLEU","Number of Params","Hardware Burden","Operations per network pass"],"first_row_in_archive_order":{"model":"Transformer Cycle (Rev)","paper_title":"Lessons on Parameter Sharing across Layers in Transformers","paper_url":"/paper/lessons-on-parameter-sharing-across-layers-in","paper_date":"2021-04-13","arxiv_id":"2104.06022","code_links":[{"title":"takase/share_layer_params","url":"https://github.com/takase/share_layer_params"},{"title":"jaketae/param-share-transformer","url":"https://github.com/jaketae/param-share-transformer"}],"syntology":{"n":2,"n_ran":2,"n_constructed":2,"n_ran_checked":1,"n_instrument":1,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":1,"n_pointer_only":2,"phrase":"2 ran (of which 2 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result","sample_list":"/paper/lessons-on-parameter-sharing-across-layers-in#ran","syntology_url":"https://syntology.ai/paper/2104.06022","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2104.06022"}},"official":{"repos":["takase/share_layer_params"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":2,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}}},{"leaderboard":"/sota/machine-translation-on-wmt2014-english-french","slug":"machine-translation-on-wmt2014-english-french","dataset":"WMT2014 English-French","dataset_url":"/dataset/wmt-2014","rows_in_archive":57,"metrics":["BLEU score","SacreBLEU","Hardware Burden","Operations per network pass"],"first_row_in_archive_order":{"model":"Transformer+BT (ADMIN init)","paper_title":"Very Deep Transformers for Neural Machine Translation","paper_url":"/paper/very-deep-transformers-for-neural-machine","paper_date":"2020-08-18","arxiv_id":"2008.07772","code_links":[{"title":"LiyuanLucasLiu/Transforemr-Clinic","url":"https://github.com/LiyuanLucasLiu/Transforemr-Clinic"},{"title":"LiyuanLucasLiu/Transformer-Clinic","url":"https://github.com/LiyuanLucasLiu/Transformer-Clinic"},{"title":"microsoft/deepnmt","url":"https://github.com/microsoft/deepnmt"},{"title":"namisan/exdeep-nmt","url":"https://github.com/namisan/exdeep-nmt"}],"syntology":{"n":9,"n_ran":8,"n_constructed":2,"n_ran_checked":3,"n_instrument":5,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":3,"n_pointer_only":3,"phrase":"8 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 5 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/very-deep-transformers-for-neural-machine#ran","syntology_url":"https://syntology.ai/paper/2008.07772","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2008.07772"}},"official":{"repos":["namisan/exdeep-nmt"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}}},{"leaderboard":"/sota/machine-translation-on-iwslt2014-german","slug":"machine-translation-on-iwslt2014-german","dataset":"IWSLT2014 German-English","dataset_url":null,"rows_in_archive":34,"metrics":["BLEU score","Number of Params"],"first_row_in_archive_order":{"model":"PiNMT","paper_title":"Integrating Pre-trained Language Model into Neural Machine Translation","paper_url":"/paper/integrating-pre-trained-language-model-into","paper_date":"2023-10-30","arxiv_id":"2310.19680","code_links":[],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-aces","slug":"machine-translation-on-aces","dataset":"ACES","dataset_url":"/dataset/aces","rows_in_archive":21,"metrics":["Score"],"first_row_in_archive_order":{"model":"HWTSC-Teacher-Sim","paper_title":"ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics","paper_url":"/paper/aces-translation-accuracy-challenge-sets-for","paper_date":"2022-10-27","arxiv_id":"2210.15615","code_links":[{"title":"edinburghnlp/aces","url":"https://github.com/edinburghnlp/aces"}],"syntology":{"n":2,"n_ran":2,"n_constructed":0,"n_ran_checked":1,"n_instrument":1,"n_unverified":0,"n_honours":1,"n_violates":0,"n_no_contract":0,"n_pointer_only":2,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/aces-translation-accuracy-challenge-sets-for#ran","syntology_url":"https://syntology.ai/paper/2210.15615","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2210.15615"}},"official":{"repos":["edinburghnlp/aces"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}}},{"leaderboard":"/sota/machine-translation-on-wmt2016-english-1","slug":"machine-translation-on-wmt2016-english-1","dataset":"WMT2016 English-Romanian","dataset_url":"/dataset/wmt-2016","rows_in_archive":21,"metrics":["BLEU score","BLEU-4"],"first_row_in_archive_order":{"model":"DeLighT","paper_title":"DeLighT: Deep and Light-weight Transformer","paper_url":"/paper/delight-very-deep-and-light-weight","paper_date":"2020-08-03","arxiv_id":"2008.00623","code_links":[{"title":"sacmehta/delight","url":"https://github.com/sacmehta/delight"},{"title":"pranay185417/delight","url":"https://github.com/pranay185417/delight"}],"syntology":{"n":3,"n_ran":3,"n_constructed":0,"n_ran_checked":3,"n_instrument":0,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":3,"n_pointer_only":0,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/delight-very-deep-and-light-weight#ran","syntology_url":"https://syntology.ai/paper/2008.00623","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2008.00623"}},"official":{"repos":["sacmehta/delight"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":3,"n_unverified":0,"ran_from_kinds":["official"]}}}},{"leaderboard":"/sota/machine-translation-on-wmt2016-romanian","slug":"machine-translation-on-wmt2016-romanian","dataset":"WMT2016 Romanian-English","dataset_url":"/dataset/wmt-2016","rows_in_archive":21,"metrics":["BLEU score","BLEU-4"],"first_row_in_archive_order":{"model":"fast-noisy-channel-modeling","paper_title":"Language Models not just for Pre-training: Fast Online Neural Noisy Channel Modeling","paper_url":"/paper/language-models-not-just-for-pre-training","paper_date":"2020-11-13","arxiv_id":"2011.07164","code_links":[{"title":"pytorch/fairseq","url":"https://github.com/pytorch/fairseq/tree/master/examples/fast_noisy_channel"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-wmt2014-german-english","slug":"machine-translation-on-wmt2014-german-english","dataset":"WMT2014 German-English","dataset_url":"/dataset/wmt-2014","rows_in_archive":16,"metrics":["BLEU score"],"first_row_in_archive_order":{"model":"Bi-SimCut","paper_title":"Bi-SimCut: A Simple Strategy for Boosting Neural Machine Translation","paper_url":"/paper/bi-simcut-a-simple-strategy-for-boosting-1","paper_date":"2022-06-06","arxiv_id":"2206.02368","code_links":[{"title":"gpengzhi/Bi-SimCut","url":"https://github.com/gpengzhi/Bi-SimCut"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-iwslt2015-german","slug":"machine-translation-on-iwslt2015-german","dataset":"IWSLT2015 German-English","dataset_url":null,"rows_in_archive":15,"metrics":["BLEU score"],"first_row_in_archive_order":{"model":"PS-KD","paper_title":"Self-Knowledge Distillation with Progressive Refinement of Targets","paper_url":"/paper/self-knowledge-distillation-a-simple-way-for","paper_date":"2020-06-22","arxiv_id":"2006.12000","code_links":[{"title":"lgcnsai/ps-kd-pytorch","url":"https://github.com/lgcnsai/ps-kd-pytorch"}],"syntology":{"n":5,"n_ran":5,"n_constructed":0,"n_ran_checked":1,"n_instrument":4,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":1,"n_pointer_only":3,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/self-knowledge-distillation-a-simple-way-for#ran","syntology_url":"https://syntology.ai/paper/2006.12000","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2006.12000"}},"official":{"repos":["lgcnsai/ps-kd-pytorch"],"state":"official (archive's flag): 5 ran","n_ran":5,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}}},{"leaderboard":"/sota/machine-translation-on-wmt2016-english-german","slug":"machine-translation-on-wmt2016-english-german","dataset":"WMT2016 English-German","dataset_url":"/dataset/wmt-2016","rows_in_archive":12,"metrics":["BLEU score","SacreBLEU"],"first_row_in_archive_order":{"model":"MADL","paper_title":"Multi-Agent Dual Learning","paper_url":"/paper/multi-agent-dual-learning","paper_date":"2019-05-01","arxiv_id":null,"code_links":[],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-iwslt2015-english-1","slug":"machine-translation-on-iwslt2015-english-1","dataset":"IWSLT2015 English-Vietnamese","dataset_url":null,"rows_in_archive":11,"metrics":["BLEU"],"first_row_in_archive_order":{"model":"EnViT5 + MTet","paper_title":"MTet: Multi-domain Translation for English and Vietnamese","paper_url":"/paper/mtet-multi-domain-translation-for-english-and","paper_date":"2022-10-11","arxiv_id":"2210.05610","code_links":[{"title":"vietai/mTet","url":"https://github.com/vietai/mTet"},{"title":"vietai/SAT","url":"https://github.com/vietai/SAT"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-iwslt2015-english","slug":"machine-translation-on-iwslt2015-english","dataset":"IWSLT2015 English-German","dataset_url":null,"rows_in_archive":8,"metrics":["BLEU score"],"first_row_in_archive_order":{"model":"PS-KD","paper_title":"Self-Knowledge Distillation with Progressive Refinement of Targets","paper_url":"/paper/self-knowledge-distillation-a-simple-way-for","paper_date":"2020-06-22","arxiv_id":"2006.12000","code_links":[{"title":"lgcnsai/ps-kd-pytorch","url":"https://github.com/lgcnsai/ps-kd-pytorch"}],"syntology":{"n":5,"n_ran":5,"n_constructed":0,"n_ran_checked":1,"n_instrument":4,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":1,"n_pointer_only":3,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/self-knowledge-distillation-a-simple-way-for#ran","syntology_url":"https://syntology.ai/paper/2006.12000","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2006.12000"}},"official":{"repos":["lgcnsai/ps-kd-pytorch"],"state":"official (archive's flag): 5 ran","n_ran":5,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}}},{"leaderboard":"/sota/machine-translation-on-wmt2016-german-english","slug":"machine-translation-on-wmt2016-german-english","dataset":"WMT2016 German-English","dataset_url":"/dataset/wmt-2016","rows_in_archive":8,"metrics":["BLEU score","SacreBLEU"],"first_row_in_archive_order":{"model":"FLAN 137B (few-shot, k=11)","paper_title":"Finetuned Language Models Are Zero-Shot Learners","paper_url":"/paper/finetuned-language-models-are-zero-shot","paper_date":"2021-09-03","arxiv_id":"2109.01652","code_links":[{"title":"hiyouga/llama-efficient-tuning","url":"https://github.com/hiyouga/llama-efficient-tuning"},{"title":"bigcode-project/starcoder","url":"https://github.com/bigcode-project/starcoder"},{"title":"bigscience-workshop/promptsource","url":"https://github.com/bigscience-workshop/promptsource"},{"title":"google-research/flan","url":"https://github.com/google-research/flan"},{"title":"ukplab/arxiv2025-inherent-limits-plms","url":"https://github.com/ukplab/arxiv2025-inherent-limits-plms"},{"title":"openbiolink/promptsource","url":"https://github.com/openbiolink/promptsource"},{"title":"MS-P3/code6","url":"https://github.com/MS-P3/code6/tree/main/finetune"},{"title":"hojjat-mokhtarabadi/promptsource","url":"https://github.com/hojjat-mokhtarabadi/promptsource"}],"syntology":{"n":1,"n_ran":0,"n_constructed":0,"n_ran_checked":0,"n_instrument":0,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"0 ran · 1 unverified","sample_list":"/paper/finetuned-language-models-are-zero-shot#ran","syntology_url":"https://syntology.ai/paper/2109.01652","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2109.01652"}},"official":{"repos":["google-research/flan"],"state":"official: harvested for another paper","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":[]}}}},{"leaderboard":"/sota/machine-translation-on-iwslt2014-english","slug":"machine-translation-on-iwslt2014-english","dataset":"IWSLT2014 English-German","dataset_url":null,"rows_in_archive":6,"metrics":["BLEU score"],"first_row_in_archive_order":{"model":"PiNMT","paper_title":"Integrating Pre-trained Language Model into Neural Machine Translation","paper_url":"/paper/integrating-pre-trained-language-model-into","paper_date":"2023-10-30","arxiv_id":"2310.19680","code_links":[],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-wmt2015-english-german","slug":"machine-translation-on-wmt2015-english-german","dataset":"WMT2015 English-German","dataset_url":"/dataset/wmt-2015","rows_in_archive":6,"metrics":["BLEU score"],"first_row_in_archive_order":{"model":"ByteNet","paper_title":"Neural Machine Translation in Linear Time","paper_url":"/paper/neural-machine-translation-in-linear-time","paper_date":"2016-10-31","arxiv_id":"1610.10099","code_links":[{"title":"paarthneekhara/byteNet-tensorflow","url":"https://github.com/paarthneekhara/byteNet-tensorflow"},{"title":"microsoft/protein-sequence-models","url":"https://github.com/microsoft/protein-sequence-models"},{"title":"randomrandom/deep-atrous-cnn-sentiment","url":"https://github.com/randomrandom/deep-atrous-cnn-sentiment"},{"title":"kingstarcraft/speech-to-text-wavenet2","url":"https://github.com/kingstarcraft/speech-to-text-wavenet2"},{"title":"sriharireddypusapati/speech-to-text-wavenet2","url":"https://github.com/sriharireddypusapati/speech-to-text-wavenet2"},{"title":"kinimod23/ATS_Project","url":"https://github.com/kinimod23/ATS_Project"},{"title":"Vikas-Sony/speech-to-text","url":"https://github.com/Vikas-Sony/speech-to-text"},{"title":"freedombenLiu/speech-to-text-wavenet","url":"https://github.com/freedombenLiu/speech-to-text-wavenet"},{"title":"adityaagrawal7/speech-to-text-wavenet","url":"https://github.com/adityaagrawal7/speech-to-text-wavenet"},{"title":"liguigui/speech-to-text-wavenet","url":"https://github.com/liguigui/speech-to-text-wavenet"},{"title":"Shivendra-psc/speechbot","url":"https://github.com/Shivendra-psc/speechbot"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-flores-200","slug":"machine-translation-on-flores-200","dataset":"FLoRes-200","dataset_url":"/dataset/flores-200","rows_in_archive":5,"metrics":["BLEU"],"first_row_in_archive_order":{"model":"GenTranslate-7B","paper_title":"GenTranslate: Large Language Models are Generative Multilingual Speech and Machine Translators","paper_url":"/paper/gentranslate-large-language-models-are","paper_date":"2024-02-10","arxiv_id":"2402.06894","code_links":[{"title":"yuchen005/gentranslate","url":"https://github.com/yuchen005/gentranslate"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-wmt-2017-latvian","slug":"machine-translation-on-wmt-2017-latvian","dataset":"WMT 2017 Latvian-English","dataset_url":null,"rows_in_archive":4,"metrics":["BLEU"],"first_row_in_archive_order":{"model":"Transformer trained on highly filtered data","paper_title":"Impact of Corpora Quality on Neural Machine Translation","paper_url":"/paper/impact-of-corpora-quality-on-neural-machine","paper_date":"2018-10-19","arxiv_id":"1810.08392","code_links":[{"title":"M4t1ss/parallel-corpora-tools","url":"https://github.com/M4t1ss/parallel-corpora-tools"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-wmt2016-english","slug":"machine-translation-on-wmt2016-english","dataset":"WMT2016 English-Russian","dataset_url":"/dataset/wmt-2016","rows_in_archive":4,"metrics":["BLEU score"],"first_row_in_archive_order":{"model":"Attentional encoder-decoder + BPE","paper_title":"Edinburgh Neural Machine Translation Systems for WMT 16","paper_url":"/paper/edinburgh-neural-machine-translation-systems","paper_date":"2016-06-09","arxiv_id":"1606.02891","code_links":[{"title":"rsennrich/wmt16-scripts","url":"https://github.com/rsennrich/wmt16-scripts"}],"syntology":{"n":2,"n_ran":2,"n_constructed":0,"n_ran_checked":0,"n_instrument":2,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/edinburgh-neural-machine-translation-systems#ran","syntology_url":"https://syntology.ai/paper/1606.02891","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1606.02891"}},"official":{"repos":["rsennrich/wmt16-scripts"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]}}}},{"leaderboard":"/sota/machine-translation-on-flores95-devtest-eng-x","slug":"machine-translation-on-flores95-devtest-eng-x","dataset":"flores95-devtest eng-X","dataset_url":null,"rows_in_archive":3,"metrics":["ChrF++"],"first_row_in_archive_order":{"model":"SeamlessM4T Large","paper_title":"SeamlessM4T: Massively Multilingual & Multimodal Machine Translation","paper_url":"/paper/seamlessm4t-massively-multilingual-multimodal","paper_date":"2023-08-22","arxiv_id":"2308.11596","code_links":[{"title":"facebookresearch/seamless_communication","url":"https://github.com/facebookresearch/seamless_communication"},{"title":"facebookresearch/sonar","url":"https://github.com/facebookresearch/sonar"},{"title":"yangyucheng000/University","url":"https://github.com/yangyucheng000/University/tree/main/model-3/seamless_m4t"},{"title":"pwc-1/Paper-10","url":"https://github.com/pwc-1/Paper-10/tree/main/seamless_m4t"}],"syntology":{"n":2,"n_ran":2,"n_constructed":0,"n_ran_checked":0,"n_instrument":2,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":2,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/seamlessm4t-massively-multilingual-multimodal#ran","syntology_url":"https://syntology.ai/paper/2308.11596","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2308.11596"}},"official":{"repos":["facebookresearch/seamless_communication"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]}}}},{"leaderboard":"/sota/machine-translation-on-flores95-devtest-x-eng","slug":"machine-translation-on-flores95-devtest-x-eng","dataset":"flores95-devtest X-eng","dataset_url":null,"rows_in_archive":3,"metrics":["ChrF++"],"first_row_in_archive_order":{"model":"SeamlessM4T Large","paper_title":"SeamlessM4T: Massively Multilingual & Multimodal Machine Translation","paper_url":"/paper/seamlessm4t-massively-multilingual-multimodal","paper_date":"2023-08-22","arxiv_id":"2308.11596","code_links":[{"title":"facebookresearch/seamless_communication","url":"https://github.com/facebookresearch/seamless_communication"},{"title":"facebookresearch/sonar","url":"https://github.com/facebookresearch/sonar"},{"title":"yangyucheng000/University","url":"https://github.com/yangyucheng000/University/tree/main/model-3/seamless_m4t"},{"title":"pwc-1/Paper-10","url":"https://github.com/pwc-1/Paper-10/tree/main/seamless_m4t"}],"syntology":{"n":2,"n_ran":2,"n_constructed":0,"n_ran_checked":0,"n_instrument":2,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":2,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/seamlessm4t-massively-multilingual-multimodal#ran","syntology_url":"https://syntology.ai/paper/2308.11596","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2308.11596"}},"official":{"repos":["facebookresearch/seamless_communication"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]}}}},{"leaderboard":"/sota/machine-translation-on-frmt-chinese-mainland","slug":"machine-translation-on-frmt-chinese-mainland","dataset":"FRMT (Chinese - Mainland)","dataset_url":"/dataset/frmt","rows_in_archive":3,"metrics":["BLEURT"],"first_row_in_archive_order":{"model":"PaLM 2","paper_title":"PaLM 2 Technical Report","paper_url":"/paper/palm-2-technical-report-1","paper_date":"2023-05-17","arxiv_id":"2305.10403","code_links":[{"title":"eternityyw/tram-benchmark","url":"https://github.com/eternityyw/tram-benchmark"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-frmt-chinese-taiwan","slug":"machine-translation-on-frmt-chinese-taiwan","dataset":"FRMT (Chinese - Taiwan)","dataset_url":"/dataset/frmt","rows_in_archive":3,"metrics":["BLEURT"],"first_row_in_archive_order":{"model":"PaLM 2","paper_title":"PaLM 2 Technical Report","paper_url":"/paper/palm-2-technical-report-1","paper_date":"2023-05-17","arxiv_id":"2305.10403","code_links":[{"title":"eternityyw/tram-benchmark","url":"https://github.com/eternityyw/tram-benchmark"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-frmt-portuguese","slug":"machine-translation-on-frmt-portuguese","dataset":"FRMT (Portuguese - Portugal)","dataset_url":"/dataset/frmt","rows_in_archive":3,"metrics":["BLEURT"],"first_row_in_archive_order":{"model":"PaLM 2","paper_title":"PaLM 2 Technical Report","paper_url":"/paper/palm-2-technical-report-1","paper_date":"2023-05-17","arxiv_id":"2305.10403","code_links":[{"title":"eternityyw/tram-benchmark","url":"https://github.com/eternityyw/tram-benchmark"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-frmt-portuguese-brazil","slug":"machine-translation-on-frmt-portuguese-brazil","dataset":"FRMT (Portuguese - Brazil)","dataset_url":"/dataset/frmt","rows_in_archive":3,"metrics":["BLEURT"],"first_row_in_archive_order":{"model":"PaLM 2","paper_title":"PaLM 2 Technical Report","paper_url":"/paper/palm-2-technical-report-1","paper_date":"2023-05-17","arxiv_id":"2305.10403","code_links":[{"title":"eternityyw/tram-benchmark","url":"https://github.com/eternityyw/tram-benchmark"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-wmt-2017-english-1","slug":"machine-translation-on-wmt-2017-english-1","dataset":"WMT 2017 English-Chinese","dataset_url":null,"rows_in_archive":3,"metrics":["BLEU score"],"first_row_in_archive_order":{"model":"DynamicConv","paper_title":"Pay Less Attention with Lightweight and Dynamic Convolutions","paper_url":"/paper/pay-less-attention-with-lightweight-and","paper_date":"2019-01-29","arxiv_id":"1901.10430","code_links":[{"title":"pytorch/fairseq","url":"https://github.com/pytorch/fairseq"},{"title":"bytedance/neurst","url":"https://github.com/bytedance/neurst"},{"title":"dqqcasia/st","url":"https://github.com/dqqcasia/st"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-wmt2014-french-english","slug":"machine-translation-on-wmt2014-french-english","dataset":"WMT2014 French-English","dataset_url":"/dataset/wmt-2014","rows_in_archive":3,"metrics":["BLEU score"],"first_row_in_archive_order":{"model":"FLAN 137B (few-shot, k=9)","paper_title":"Finetuned Language Models Are Zero-Shot Learners","paper_url":"/paper/finetuned-language-models-are-zero-shot","paper_date":"2021-09-03","arxiv_id":"2109.01652","code_links":[{"title":"hiyouga/llama-efficient-tuning","url":"https://github.com/hiyouga/llama-efficient-tuning"},{"title":"bigcode-project/starcoder","url":"https://github.com/bigcode-project/starcoder"},{"title":"bigscience-workshop/promptsource","url":"https://github.com/bigscience-workshop/promptsource"},{"title":"google-research/flan","url":"https://github.com/google-research/flan"},{"title":"ukplab/arxiv2025-inherent-limits-plms","url":"https://github.com/ukplab/arxiv2025-inherent-limits-plms"},{"title":"openbiolink/promptsource","url":"https://github.com/openbiolink/promptsource"},{"title":"MS-P3/code6","url":"https://github.com/MS-P3/code6/tree/main/finetune"},{"title":"hojjat-mokhtarabadi/promptsource","url":"https://github.com/hojjat-mokhtarabadi/promptsource"}],"syntology":{"n":1,"n_ran":0,"n_constructed":0,"n_ran_checked":0,"n_instrument":0,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"0 ran · 1 unverified","sample_list":"/paper/finetuned-language-models-are-zero-shot#ran","syntology_url":"https://syntology.ai/paper/2109.01652","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2109.01652"}},"official":{"repos":["google-research/flan"],"state":"official: harvested for another paper","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":[]}}}},{"leaderboard":"/sota/machine-translation-on-wmt2017-chinese","slug":"machine-translation-on-wmt2017-chinese","dataset":"WMT2017 Chinese-English","dataset_url":null,"rows_in_archive":3,"metrics":["BLEU"],"first_row_in_archive_order":{"model":"StrokeNet","paper_title":"Breaking the Representation Bottleneck of Chinese Characters: Neural Machine Translation with Stroke Sequence Modeling","paper_url":"/paper/breaking-the-representation-bottleneck-of","paper_date":"2022-11-23","arxiv_id":"2211.12781","code_links":[{"title":"zjwang21/strokenet","url":"https://github.com/zjwang21/strokenet"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-20news","slug":"machine-translation-on-20news","dataset":"20NEWS","dataset_url":null,"rows_in_archive":2,"metrics":["1-of-100 Accuracy","Accuracy"],"first_row_in_archive_order":{"model":"tensorflow/tensor2tensor","paper_title":"Neural Machine Translation","paper_url":"/paper/neural-machine-translation","paper_date":"2017-09-22","arxiv_id":"1709.07809","code_links":[{"title":"tensorflow/tensor2tensor","url":"https://github.com/tensorflow/tensor2tensor"},{"title":"awslabs/sockeye","url":"https://github.com/awslabs/sockeye"},{"title":"EdinburghNLP/nematus","url":"https://github.com/EdinburghNLP/nematus"},{"title":"neulab/xnmt","url":"https://github.com/neulab/xnmt"},{"title":"rsennrich/wmt16-scripts","url":"https://github.com/rsennrich/wmt16-scripts"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-arba-sicula","slug":"machine-translation-on-arba-sicula","dataset":"Arba Sicula","dataset_url":null,"rows_in_archive":2,"metrics":["BLEU (En-Scn)","BLEU (It-Scn)","BLEU (Scn-En)","BLEU (Scn-It)"],"first_row_in_archive_order":{"model":"Larger","paper_title":"Sicilian Translator: A Recipe for Low-Resource NMT","paper_url":"/paper/sicilian-translator-a-recipe-for-low-resource","paper_date":"2021-10-05","arxiv_id":"2110.01938","code_links":[{"title":"ewdowiak/Sicilian_Translator","url":"https://github.com/ewdowiak/Sicilian_Translator"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-itihasa","slug":"machine-translation-on-itihasa","dataset":"Itihasa","dataset_url":"/dataset/itihasa","rows_in_archive":2,"metrics":["SacreBLEU"],"first_row_in_archive_order":{"model":"Baseline (en->sn)","paper_title":"Itihasa: A large-scale corpus for Sanskrit to English translation","paper_url":"/paper/itihasa-a-large-scale-corpus-for-sanskrit-to","paper_date":"2021-06-06","arxiv_id":"2106.03269","code_links":[],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-iwslt2015-vietnamese","slug":"machine-translation-on-iwslt2015-vietnamese","dataset":"IWSLT2015 Vietnamese-English","dataset_url":null,"rows_in_archive":2,"metrics":["BLEU"],"first_row_in_archive_order":{"model":"HeadMask (Random-18)","paper_title":"Alleviating the Inequality of Attention Heads for Neural Machine Translation","paper_url":"/paper/alleviating-the-inequality-of-attention-heads","paper_date":"2020-09-21","arxiv_id":"2009.09672","code_links":[],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-iwslt2017-arabic","slug":"machine-translation-on-iwslt2017-arabic","dataset":"IWSLT2017 Arabic-English","dataset_url":null,"rows_in_archive":2,"metrics":["Cased sacreBLEU","SacreBLEU"],"first_row_in_archive_order":{"model":"Transformer base + BPE-Dropout","paper_title":"BPE-Dropout: Simple and Effective Subword Regularization","paper_url":"/paper/191013267","paper_date":"2019-10-29","arxiv_id":"1910.13267","code_links":[{"title":"google/sentencepiece","url":"https://github.com/google/sentencepiece"},{"title":"rsennrich/subword-nmt","url":"https://github.com/rsennrich/subword-nmt"},{"title":"VKCOM/YouTokenToMe","url":"https://github.com/VKCOM/YouTokenToMe"},{"title":"VProv/BPE-Dropout","url":"https://github.com/VProv/BPE-Dropout"},{"title":"kh-mo/QA_wikisql","url":"https://github.com/kh-mo/QA_wikisql"},{"title":"mozilla/subword-nmt","url":"https://github.com/mozilla/subword-nmt"},{"title":"PatxiofromAlphensign/subword-nmt-mods","url":"https://github.com/PatxiofromAlphensign/subword-nmt-mods"}],"syntology":{"n":24,"n_ran":24,"n_constructed":0,"n_ran_checked":15,"n_instrument":9,"n_unverified":0,"n_honours":0,"n_violates":1,"n_no_contract":14,"n_pointer_only":1,"phrase":"24 ran (of which 0 constructed an object rather than computing a result; 15 with no instrument failure: 0 honoured, 1 violated, 14 with no contract checked; 9 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/191013267#ran","syntology_url":"https://syntology.ai/paper/1910.13267","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1910.13267"}},"official":{"repos":["VProv/BPE-Dropout"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","official"]}}}},{"leaderboard":"/sota/machine-translation-on-iwslt2017-english","slug":"machine-translation-on-iwslt2017-english","dataset":"IWSLT2017 English-French","dataset_url":null,"rows_in_archive":2,"metrics":["Cased sacreBLEU","SacreBLEU"],"first_row_in_archive_order":{"model":"Transformer base + BPE-Dropout","paper_title":"BPE-Dropout: Simple and Effective Subword Regularization","paper_url":"/paper/191013267","paper_date":"2019-10-29","arxiv_id":"1910.13267","code_links":[{"title":"google/sentencepiece","url":"https://github.com/google/sentencepiece"},{"title":"rsennrich/subword-nmt","url":"https://github.com/rsennrich/subword-nmt"},{"title":"VKCOM/YouTokenToMe","url":"https://github.com/VKCOM/YouTokenToMe"},{"title":"VProv/BPE-Dropout","url":"https://github.com/VProv/BPE-Dropout"},{"title":"kh-mo/QA_wikisql","url":"https://github.com/kh-mo/QA_wikisql"},{"title":"mozilla/subword-nmt","url":"https://github.com/mozilla/subword-nmt"},{"title":"PatxiofromAlphensign/subword-nmt-mods","url":"https://github.com/PatxiofromAlphensign/subword-nmt-mods"}],"syntology":{"n":24,"n_ran":24,"n_constructed":0,"n_ran_checked":15,"n_instrument":9,"n_unverified":0,"n_honours":0,"n_violates":1,"n_no_contract":14,"n_pointer_only":1,"phrase":"24 ran (of which 0 constructed an object rather than computing a result; 15 with no instrument failure: 0 honoured, 1 violated, 14 with no contract checked; 9 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/191013267#ran","syntology_url":"https://syntology.ai/paper/1910.13267","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1910.13267"}},"official":{"repos":["VProv/BPE-Dropout"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","official"]}}}},{"leaderboard":"/sota/machine-translation-on-iwslt2017-english-1","slug":"machine-translation-on-iwslt2017-english-1","dataset":"IWSLT2017 English-Arabic","dataset_url":null,"rows_in_archive":2,"metrics":["Cased sacreBLEU","SacreBLEU"],"first_row_in_archive_order":{"model":"Transformer base + BPE-Dropout","paper_title":"BPE-Dropout: Simple and Effective Subword Regularization","paper_url":"/paper/191013267","paper_date":"2019-10-29","arxiv_id":"1910.13267","code_links":[{"title":"google/sentencepiece","url":"https://github.com/google/sentencepiece"},{"title":"rsennrich/subword-nmt","url":"https://github.com/rsennrich/subword-nmt"},{"title":"VKCOM/YouTokenToMe","url":"https://github.com/VKCOM/YouTokenToMe"},{"title":"VProv/BPE-Dropout","url":"https://github.com/VProv/BPE-Dropout"},{"title":"kh-mo/QA_wikisql","url":"https://github.com/kh-mo/QA_wikisql"},{"title":"mozilla/subword-nmt","url":"https://github.com/mozilla/subword-nmt"},{"title":"PatxiofromAlphensign/subword-nmt-mods","url":"https://github.com/PatxiofromAlphensign/subword-nmt-mods"}],"syntology":{"n":24,"n_ran":24,"n_constructed":0,"n_ran_checked":15,"n_instrument":9,"n_unverified":0,"n_honours":0,"n_violates":1,"n_no_contract":14,"n_pointer_only":1,"phrase":"24 ran (of which 0 constructed an object rather than computing a result; 15 with no instrument failure: 0 honoured, 1 violated, 14 with no contract checked; 9 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/191013267#ran","syntology_url":"https://syntology.ai/paper/1910.13267","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1910.13267"}},"official":{"repos":["VProv/BPE-Dropout"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","official"]}}}},{"leaderboard":"/sota/machine-translation-on-iwslt2017-french","slug":"machine-translation-on-iwslt2017-french","dataset":"IWSLT2017 French-English","dataset_url":null,"rows_in_archive":2,"metrics":["Cased sacreBLEU","SacreBLEU"],"first_row_in_archive_order":{"model":"Transformer base + BPE-Dropout","paper_title":"BPE-Dropout: Simple and Effective Subword Regularization","paper_url":"/paper/191013267","paper_date":"2019-10-29","arxiv_id":"1910.13267","code_links":[{"title":"google/sentencepiece","url":"https://github.com/google/sentencepiece"},{"title":"rsennrich/subword-nmt","url":"https://github.com/rsennrich/subword-nmt"},{"title":"VKCOM/YouTokenToMe","url":"https://github.com/VKCOM/YouTokenToMe"},{"title":"VProv/BPE-Dropout","url":"https://github.com/VProv/BPE-Dropout"},{"title":"kh-mo/QA_wikisql","url":"https://github.com/kh-mo/QA_wikisql"},{"title":"mozilla/subword-nmt","url":"https://github.com/mozilla/subword-nmt"},{"title":"PatxiofromAlphensign/subword-nmt-mods","url":"https://github.com/PatxiofromAlphensign/subword-nmt-mods"}],"syntology":{"n":24,"n_ran":24,"n_constructed":0,"n_ran_checked":15,"n_instrument":9,"n_unverified":0,"n_honours":0,"n_violates":1,"n_no_contract":14,"n_pointer_only":1,"phrase":"24 ran (of which 0 constructed an object rather than computing a result; 15 with no instrument failure: 0 honoured, 1 violated, 14 with no contract checked; 9 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/191013267#ran","syntology_url":"https://syntology.ai/paper/1910.13267","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1910.13267"}},"official":{"repos":["VProv/BPE-Dropout"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","official"]}}}},{"leaderboard":"/sota/machine-translation-on-iwslt2017-german","slug":"machine-translation-on-iwslt2017-german","dataset":"IWSLT2017 German-English","dataset_url":null,"rows_in_archive":2,"metrics":["BLEU score"],"first_row_in_archive_order":{"model":"Adaptively Sparse Transformer (alpha-entmax)","paper_title":"Adaptively Sparse Transformers","paper_url":"/paper/adaptively-sparse-transformers","paper_date":"2019-08-30","arxiv_id":"1909.00015","code_links":[{"title":"deep-spin/entmax","url":"https://github.com/deep-spin/entmax"},{"title":"prajjwal1/fluence","url":"https://github.com/prajjwal1/fluence"},{"title":"prajjwal1/adaptive_transformer","url":"https://github.com/prajjwal1/adaptive_transformer"}],"syntology":{"n":3,"n_ran":3,"n_constructed":0,"n_ran_checked":0,"n_instrument":3,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/adaptively-sparse-transformers#ran","syntology_url":"https://syntology.ai/paper/1909.00015","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1909.00015"}},"official":{"repos":["deep-spin/entmax"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","official"]}}}},{"leaderboard":"/sota/machine-translation-on-wmt-2018-finnish","slug":"machine-translation-on-wmt-2018-finnish","dataset":"WMT 2018 Finnish-English","dataset_url":"/dataset/wmt-2018","rows_in_archive":2,"metrics":["BLEU"],"first_row_in_archive_order":{"model":"CT+B/S construction","paper_title":"The University of Sydney's Machine Translation System for WMT19","paper_url":"/paper/the-university-of-sydneys-machine-translation","paper_date":"2019-06-30","arxiv_id":"1907.00494","code_links":[],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-wmt2014-english-czech","slug":"machine-translation-on-wmt2014-english-czech","dataset":"WMT2014 English-Czech","dataset_url":"/dataset/wmt-2014","rows_in_archive":2,"metrics":["BLEU score"],"first_row_in_archive_order":{"model":"Evolved Transformer Big","paper_title":"The Evolved Transformer","paper_url":"/paper/the-evolved-transformer","paper_date":"2019-01-30","arxiv_id":"1901.11117","code_links":[{"title":"tensorflow/tensor2tensor","url":"https://github.com/tensorflow/tensor2tensor"},{"title":"nazarov-yuriy/zh-ru-shared-task","url":"https://github.com/nazarov-yuriy/zh-ru-shared-task"},{"title":"moon23k/Transformer_Archs","url":"https://github.com/moon23k/Transformer_Archs"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-wmt2017-turkish","slug":"machine-translation-on-wmt2017-turkish","dataset":"WMT2017 Turkish-English","dataset_url":null,"rows_in_archive":2,"metrics":["BLEU score"],"first_row_in_archive_order":{"model":"HeadMask (Random-18)","paper_title":"Alleviating the Inequality of Attention Heads for Neural Machine Translation","paper_url":"/paper/alleviating-the-inequality-of-attention-heads","paper_date":"2020-09-21","arxiv_id":"2009.09672","code_links":[],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-wmt2019-english-german","slug":"machine-translation-on-wmt2019-english-german","dataset":"WMT2019 English-German","dataset_url":null,"rows_in_archive":2,"metrics":["BLEU score","SacreBLEU"],"first_row_in_archive_order":{"model":"Facebook FAIR (ensemble)","paper_title":"Facebook FAIR's WMT19 News Translation Task Submission","paper_url":"/paper/facebook-fairs-wmt19-news-translation-task","paper_date":"2019-07-15","arxiv_id":"1907.06616","code_links":[{"title":"huggingface/transformers","url":"https://github.com/huggingface/transformers"},{"title":"pytorch/fairseq","url":"https://github.com/pytorch/fairseq/tree/master/examples/wmt19"},{"title":"makcedward/nlpaug","url":"https://github.com/makcedward/nlpaug"},{"title":"cyberagentailab/mbr-anomaly","url":"https://github.com/cyberagentailab/mbr-anomaly"},{"title":"atreyasha/semantic-isometry-nmt","url":"https://github.com/atreyasha/semantic-isometry-nmt"}],"syntology":{"n":9,"n_ran":7,"n_constructed":0,"n_ran_checked":6,"n_instrument":1,"n_unverified":2,"n_honours":0,"n_violates":0,"n_no_contract":6,"n_pointer_only":0,"phrase":"7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified","sample_list":"/paper/facebook-fairs-wmt19-news-translation-task#ran","syntology_url":"https://syntology.ai/paper/1907.06616","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1907.06616"}},"official":null}}},{"leaderboard":"/sota/machine-translation-on-accurat-balanced-test-1","slug":"machine-translation-on-accurat-balanced-test-1","dataset":"ACCURAT balanced test corpus for under resourced languages Russian-Estonian","dataset_url":null,"rows_in_archive":1,"metrics":["BLEU"],"first_row_in_archive_order":{"model":"Multilingual Transformer","paper_title":"Training and Adapting Multilingual NMT for Less-resourced and Morphologically Rich Languages","paper_url":"/paper/training-and-adapting-multilingual-nmt-for","paper_date":"2018-05-01","arxiv_id":null,"code_links":[{"title":"tilde-nlp/multilingual-nmt-data-prep","url":"https://github.com/tilde-nlp/multilingual-nmt-data-prep"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-accurat-balanced-test-2","slug":"machine-translation-on-accurat-balanced-test-2","dataset":"ACCURAT balanced test corpus for under resourced languages Estonian-Russian","dataset_url":null,"rows_in_archive":1,"metrics":["BLEU"],"first_row_in_archive_order":{"model":"Multilingual Transformer","paper_title":"Training and Adapting Multilingual NMT for Less-resourced and Morphologically Rich Languages","paper_url":"/paper/training-and-adapting-multilingual-nmt-for","paper_date":"2018-05-01","arxiv_id":null,"code_links":[{"title":"tilde-nlp/multilingual-nmt-data-prep","url":"https://github.com/tilde-nlp/multilingual-nmt-data-prep"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-alexa-point-of-view","slug":"machine-translation-on-alexa-point-of-view","dataset":"Alexa Point of View","dataset_url":"/dataset/alexa-point-of-view","rows_in_archive":1,"metrics":["BLEU"],"first_row_in_archive_order":{"model":"T5","paper_title":"Converting the Point of View of Messages Spoken to Virtual Assistants","paper_url":"/paper/converting-the-point-of-view-of-messages","paper_date":"2020-10-06","arxiv_id":"2010.02600","code_links":[{"title":"alexa/alexa-point-of-view-dataset","url":"https://github.com/alexa/alexa-point-of-view-dataset"},{"title":"prithviraj-maurya/alexa-point-of-view-dataset","url":"https://github.com/prithviraj-maurya/alexa-point-of-view-dataset"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-business-scene","slug":"machine-translation-on-business-scene","dataset":"Business Scene Dialogue JA-EN","dataset_url":"/dataset/business-scene-dialogue","rows_in_archive":1,"metrics":["BLEU"],"first_row_in_archive_order":{"model":"Transformer-base","paper_title":"Designing the Business Conversation Corpus","paper_url":"/paper/designing-the-business-conversation-corpus-1","paper_date":"2020-08-05","arxiv_id":"2008.01940","code_links":[{"title":"tsuruoka-lab/BSD","url":"https://github.com/tsuruoka-lab/BSD"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-business-scene-1","slug":"machine-translation-on-business-scene-1","dataset":"Business Scene Dialogue EN-JA","dataset_url":"/dataset/business-scene-dialogue","rows_in_archive":1,"metrics":["BLEU"],"first_row_in_archive_order":{"model":"Transformer-base","paper_title":"Designing the Business Conversation Corpus","paper_url":"/paper/designing-the-business-conversation-corpus-1","paper_date":"2020-08-05","arxiv_id":"2008.01940","code_links":[{"title":"tsuruoka-lab/BSD","url":"https://github.com/tsuruoka-lab/BSD"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-iwslt-2017","slug":"machine-translation-on-iwslt-2017","dataset":"IWSLT 2017","dataset_url":"/dataset/iwslt-2017","rows_in_archive":1,"metrics":["BLEU score"],"first_row_in_archive_order":{"model":"GPT-4o (HPT)","paper_title":"Hierarchical Prompting Taxonomy: A Universal Evaluation Framework for Large Language Models Aligned with Human Cognitive Principles","paper_url":"/paper/hierarchical-prompting-taxonomy-a-universal","paper_date":"2024-06-18","arxiv_id":"2406.12644","code_links":[{"title":"devichand579/HPT","url":"https://github.com/devichand579/HPT"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-iwslt2015-chinese","slug":"machine-translation-on-iwslt2015-chinese","dataset":"IWSLT2015 Chinese-English","dataset_url":null,"rows_in_archive":1,"metrics":["BLEU"],"first_row_in_archive_order":{"model":"BP-Transformer","paper_title":"BP-Transformer: Modelling Long-Range Context via Binary Partitioning","paper_url":"/paper/bp-transformer-modelling-long-range-context","paper_date":"2019-11-11","arxiv_id":"1911.04070","code_links":[{"title":"dmlc/dgl","url":"https://github.com/dmlc/dgl/tree/master/examples/pytorch/transformer"},{"title":"yzh119/BPT","url":"https://github.com/yzh119/BPT"}],"syntology":{"n":7,"n_ran":2,"n_constructed":0,"n_ran_checked":2,"n_instrument":0,"n_unverified":5,"n_honours":0,"n_violates":0,"n_no_contract":2,"n_pointer_only":0,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified","sample_list":"/paper/bp-transformer-modelling-long-range-context#ran","syntology_url":"https://syntology.ai/paper/1911.04070","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1911.04070"}},"official":{"repos":["yzh119/BPT"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":2,"n_unverified":5,"ran_from_kinds":["official"]}}}},{"leaderboard":"/sota/machine-translation-on-iwslt2015-thai-english","slug":"machine-translation-on-iwslt2015-thai-english","dataset":"IWSLT2015 Thai-English","dataset_url":null,"rows_in_archive":1,"metrics":["BLEU score"],"first_row_in_archive_order":{"model":"Seq-KD + Seq-Inter + Word-KD","paper_title":"Sequence-Level Knowledge Distillation","paper_url":"/paper/sequence-level-knowledge-distillation","paper_date":"2016-06-25","arxiv_id":"1606.07947","code_links":[{"title":"harvardnlp/seq2seq-attn","url":"https://github.com/harvardnlp/seq2seq-attn"},{"title":"facebookresearch/stopes","url":"https://github.com/facebookresearch/stopes"},{"title":"harvardnlp/nmt-android","url":"https://github.com/harvardnlp/nmt-android"},{"title":"ictnlp/Seq-NAT","url":"https://github.com/ictnlp/Seq-NAT"},{"title":"xuanlinli17/autoregressive_inference","url":"https://github.com/xuanlinli17/autoregressive_inference"},{"title":"anonymouscode115/autoregressive_inference","url":"https://github.com/anonymouscode115/autoregressive_inference"}],"syntology":{"n":2,"n_ran":1,"n_constructed":0,"n_ran_checked":1,"n_instrument":0,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":1,"n_pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/sequence-level-knowledge-distillation#ran","syntology_url":"https://syntology.ai/paper/1606.07947","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1606.07947"}},"official":{"repos":["harvardnlp/nmt-android","harvardnlp/seq2seq-attn"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":1,"ran_from_kinds":["official"]}}}},{"leaderboard":"/sota/machine-translation-on-multi-lingual-bug","slug":"machine-translation-on-multi-lingual-bug","dataset":"Multi Lingual Bug Reports","dataset_url":"/dataset/multi-lingual-bug-reports","rows_in_archive":1,"metrics":["BERTScore"],"first_row_in_archive_order":{"model":"ChatGPT","paper_title":"English Please: Evaluating Machine Translation with Large Language Models for Multilingual Bug Reports","paper_url":"/paper/english-please-evaluating-machine-translation","paper_date":"2025-02-20","arxiv_id":"2502.14338","code_links":[{"title":"av9ash/English-Please","url":"https://github.com/av9ash/English-Please"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-opensubtitles","slug":"machine-translation-on-opensubtitles","dataset":"OpenSubtitles","dataset_url":"/dataset/opensubtitles","rows_in_archive":1,"metrics":["BLEU score","METEOR"],"first_row_in_archive_order":{"model":"Fine tuned MarianMT","paper_title":"Crossing Language Borders: A Pipeline for Indonesian Manhwa Translation","paper_url":"/paper/crossing-language-borders-a-pipeline-for","paper_date":"2025-01-03","arxiv_id":"2501.01629","code_links":[{"title":"Sagarika-Singh-99/indonesian_manhwa_translation","url":"https://github.com/Sagarika-Singh-99/indonesian_manhwa_translation"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-slone-myv-ru-2022-myv","slug":"machine-translation-on-slone-myv-ru-2022-myv","dataset":"slone/myv_ru_2022 myv-ru","dataset_url":null,"rows_in_archive":1,"metrics":["ChrF++"],"first_row_in_archive_order":{"model":"slone/mbart-large-51-myv-mul-v1","paper_title":"The first neural machine translation system for the Erzya language","paper_url":"/paper/the-first-neural-machine-translation-system","paper_date":"2022-09-19","arxiv_id":"2209.09368","code_links":[{"title":"slone-nlp/myv-nmt","url":"https://github.com/slone-nlp/myv-nmt"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-slone-myv-ru-2022-ru","slug":"machine-translation-on-slone-myv-ru-2022-ru","dataset":"slone/myv_ru_2022 ru-myv","dataset_url":null,"rows_in_archive":1,"metrics":["ChrF++"],"first_row_in_archive_order":{"model":"slone/mbart-large-51-mul-myv-v1","paper_title":"The first neural machine translation system for the Erzya language","paper_url":"/paper/the-first-neural-machine-translation-system","paper_date":"2022-09-19","arxiv_id":"2209.09368","code_links":[{"title":"slone-nlp/myv-nmt","url":"https://github.com/slone-nlp/myv-nmt"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-tatoeba-el-to-en","slug":"machine-translation-on-tatoeba-el-to-en","dataset":"Tatoeba (EL-to-EN)","dataset_url":"/dataset/tatoeba","rows_in_archive":1,"metrics":["BLEU"],"first_row_in_archive_order":{"model":"PENELOPIE (Transformers-based Greek-to-English NMT)","paper_title":"PENELOPIE: Enabling Open Information Extraction for the Greek Language through Machine Translation","paper_url":"/paper/penelopie-enabling-open-information","paper_date":"2021-03-28","arxiv_id":"2103.15075","code_links":[{"title":"lighteternal/PENELOPIE","url":"https://github.com/lighteternal/PENELOPIE"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-tatoeba-en-to-el","slug":"machine-translation-on-tatoeba-en-to-el","dataset":"Tatoeba (EN-to-EL)","dataset_url":"/dataset/tatoeba","rows_in_archive":1,"metrics":["BLEU"],"first_row_in_archive_order":{"model":"PENELOPIE Transformers-based NMT (EN2EL)","paper_title":"PENELOPIE: Enabling Open Information Extraction for the Greek Language through Machine Translation","paper_url":"/paper/penelopie-enabling-open-information","paper_date":"2021-03-28","arxiv_id":"2103.15075","code_links":[{"title":"lighteternal/PENELOPIE","url":"https://github.com/lighteternal/PENELOPIE"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-v-a-trained-on-t-h","slug":"machine-translation-on-v-a-trained-on-t-h","dataset":"V_A (trained on T_H)","dataset_url":null,"rows_in_archive":1,"metrics":["Median Relative Edit Distance"],"first_row_in_archive_order":{"model":"M_C","paper_title":"On Automatic Parsing of Log Records","paper_url":"/paper/on-automatic-parsing-of-log-records","paper_date":"2021-02-12","arxiv_id":"2102.06320","code_links":[{"title":"WulffHunter/log_generator","url":"https://github.com/WulffHunter/log_generator"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-v-b-trained-on-t-h","slug":"machine-translation-on-v-b-trained-on-t-h","dataset":"V_B (trained on T_H)","dataset_url":null,"rows_in_archive":1,"metrics":["Median Relative Edit Distance"],"first_row_in_archive_order":{"model":"M_C","paper_title":"On Automatic Parsing of Log Records","paper_url":"/paper/on-automatic-parsing-of-log-records","paper_date":"2021-02-12","arxiv_id":"2102.06320","code_links":[{"title":"WulffHunter/log_generator","url":"https://github.com/WulffHunter/log_generator"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-v-c-trained-on-t-h","slug":"machine-translation-on-v-c-trained-on-t-h","dataset":"V_C (trained on T_H)","dataset_url":null,"rows_in_archive":1,"metrics":["Median Relative Edit Distance"],"first_row_in_archive_order":{"model":"M_C","paper_title":"On Automatic Parsing of Log Records","paper_url":"/paper/on-automatic-parsing-of-log-records","paper_date":"2021-02-12","arxiv_id":"2102.06320","code_links":[{"title":"WulffHunter/log_generator","url":"https://github.com/WulffHunter/log_generator"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-wmt-2017-english","slug":"machine-translation-on-wmt-2017-english","dataset":"WMT 2017 English-Latvian","dataset_url":null,"rows_in_archive":1,"metrics":["BLEU"],"first_row_in_archive_order":{"model":"Transformer trained on highly filtered data","paper_title":"Impact of Corpora Quality on Neural Machine Translation","paper_url":"/paper/impact-of-corpora-quality-on-neural-machine","paper_date":"2018-10-19","arxiv_id":"1810.08392","code_links":[{"title":"M4t1ss/parallel-corpora-tools","url":"https://github.com/M4t1ss/parallel-corpora-tools"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-wmt-2018-english","slug":"machine-translation-on-wmt-2018-english","dataset":"WMT 2018 English-Estonian","dataset_url":"/dataset/wmt-2018","rows_in_archive":1,"metrics":["BLEU"],"first_row_in_archive_order":{"model":"Multi-pass backtranslated adapted transformer","paper_title":"Tilde's Machine Translation Systems for WMT 2018","paper_url":"/paper/tildes-machine-translation-systems-for-wmt","paper_date":"2018-10-01","arxiv_id":null,"code_links":[{"title":"M4t1ss/parallel-corpora-tools","url":"https://github.com/M4t1ss/parallel-corpora-tools"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-wmt-2018-english-1","slug":"machine-translation-on-wmt-2018-english-1","dataset":"WMT 2018 English-Finnish","dataset_url":"/dataset/wmt-2018","rows_in_archive":1,"metrics":["BLEU"],"first_row_in_archive_order":{"model":"Transformer trained on highly filtered data","paper_title":"Impact of Corpora Quality on Neural Machine Translation","paper_url":"/paper/impact-of-corpora-quality-on-neural-machine","paper_date":"2018-10-19","arxiv_id":"1810.08392","code_links":[{"title":"M4t1ss/parallel-corpora-tools","url":"https://github.com/M4t1ss/parallel-corpora-tools"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-wmt-2018-estonian","slug":"machine-translation-on-wmt-2018-estonian","dataset":"WMT 2018 Estonian-English","dataset_url":"/dataset/wmt-2018","rows_in_archive":1,"metrics":["BLEU"],"first_row_in_archive_order":{"model":"Multi-pass backtranslated adapted transformer","paper_title":"Tilde's Machine Translation Systems for WMT 2018","paper_url":"/paper/tildes-machine-translation-systems-for-wmt","paper_date":"2018-10-01","arxiv_id":null,"code_links":[{"title":"M4t1ss/parallel-corpora-tools","url":"https://github.com/M4t1ss/parallel-corpora-tools"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-wmt-2022-chinese","slug":"machine-translation-on-wmt-2022-chinese","dataset":"WMT 2022 Chinese-English","dataset_url":null,"rows_in_archive":1,"metrics":["SacreBLEU"],"first_row_in_archive_order":{"model":"Vega-MT","paper_title":"Vega-MT: The JD Explore Academy Translation System for WMT22","paper_url":"/paper/vega-mt-the-jd-explore-academy-translation","paper_date":"2022-09-20","arxiv_id":"2209.09444","code_links":[{"title":"jdea-nlp/vega-mt","url":"https://github.com/jdea-nlp/vega-mt"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-wmt-2022-czech-english","slug":"machine-translation-on-wmt-2022-czech-english","dataset":"WMT 2022 Czech-English","dataset_url":null,"rows_in_archive":1,"metrics":["SacreBLEU"],"first_row_in_archive_order":{"model":"Vega-MT","paper_title":"Vega-MT: The JD Explore Academy Translation System for WMT22","paper_url":"/paper/vega-mt-the-jd-explore-academy-translation","paper_date":"2022-09-20","arxiv_id":"2209.09444","code_links":[{"title":"jdea-nlp/vega-mt","url":"https://github.com/jdea-nlp/vega-mt"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-wmt-2022-english","slug":"machine-translation-on-wmt-2022-english","dataset":"WMT 2022 English-German","dataset_url":null,"rows_in_archive":1,"metrics":["SacreBLEU"],"first_row_in_archive_order":{"model":"Vega-MT","paper_title":"Vega-MT: The JD Explore Academy Translation System for WMT22","paper_url":"/paper/vega-mt-the-jd-explore-academy-translation","paper_date":"2022-09-20","arxiv_id":"2209.09444","code_links":[{"title":"jdea-nlp/vega-mt","url":"https://github.com/jdea-nlp/vega-mt"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-wmt-2022-english-1","slug":"machine-translation-on-wmt-2022-english-1","dataset":"WMT 2022 English-Japanese","dataset_url":null,"rows_in_archive":1,"metrics":["SacreBLEU"],"first_row_in_archive_order":{"model":"Vega-MT","paper_title":"Vega-MT: The JD Explore Academy Translation System for WMT22","paper_url":"/paper/vega-mt-the-jd-explore-academy-translation","paper_date":"2022-09-20","arxiv_id":"2209.09444","code_links":[{"title":"jdea-nlp/vega-mt","url":"https://github.com/jdea-nlp/vega-mt"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-wmt-2022-english-2","slug":"machine-translation-on-wmt-2022-english-2","dataset":"WMT 2022 English-Russian","dataset_url":null,"rows_in_archive":1,"metrics":["SacreBLEU"],"first_row_in_archive_order":{"model":"Vega-MT","paper_title":"Vega-MT: The JD Explore Academy Translation System for WMT22","paper_url":"/paper/vega-mt-the-jd-explore-academy-translation","paper_date":"2022-09-20","arxiv_id":"2209.09444","code_links":[{"title":"jdea-nlp/vega-mt","url":"https://github.com/jdea-nlp/vega-mt"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-wmt-2022-english-3","slug":"machine-translation-on-wmt-2022-english-3","dataset":"WMT 2022 English-Chinese","dataset_url":null,"rows_in_archive":1,"metrics":["SacreBLEU"],"first_row_in_archive_order":{"model":"Vega-MT","paper_title":"Vega-MT: The JD Explore Academy Translation System for WMT22","paper_url":"/paper/vega-mt-the-jd-explore-academy-translation","paper_date":"2022-09-20","arxiv_id":"2209.09444","code_links":[{"title":"jdea-nlp/vega-mt","url":"https://github.com/jdea-nlp/vega-mt"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-wmt-2022-english-czech","slug":"machine-translation-on-wmt-2022-english-czech","dataset":"WMT 2022 English-Czech","dataset_url":null,"rows_in_archive":1,"metrics":["SacreBLEU"],"first_row_in_archive_order":{"model":"Vega-MT","paper_title":"Vega-MT: The JD Explore Academy Translation System for WMT22","paper_url":"/paper/vega-mt-the-jd-explore-academy-translation","paper_date":"2022-09-20","arxiv_id":"2209.09444","code_links":[{"title":"jdea-nlp/vega-mt","url":"https://github.com/jdea-nlp/vega-mt"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-wmt-2022-german","slug":"machine-translation-on-wmt-2022-german","dataset":"WMT 2022 German-English","dataset_url":null,"rows_in_archive":1,"metrics":["SacreBLEU"],"first_row_in_archive_order":{"model":"Vega-MT","paper_title":"Vega-MT: The JD Explore Academy Translation System for WMT22","paper_url":"/paper/vega-mt-the-jd-explore-academy-translation","paper_date":"2022-09-20","arxiv_id":"2209.09444","code_links":[{"title":"jdea-nlp/vega-mt","url":"https://github.com/jdea-nlp/vega-mt"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-wmt-2022-japanese","slug":"machine-translation-on-wmt-2022-japanese","dataset":"WMT 2022 Japanese-English","dataset_url":null,"rows_in_archive":1,"metrics":["SacreBLEU"],"first_row_in_archive_order":{"model":"Vega-MT","paper_title":"Vega-MT: The JD Explore Academy Translation System for WMT22","paper_url":"/paper/vega-mt-the-jd-explore-academy-translation","paper_date":"2022-09-20","arxiv_id":"2209.09444","code_links":[{"title":"jdea-nlp/vega-mt","url":"https://github.com/jdea-nlp/vega-mt"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-wmt-2022-russian","slug":"machine-translation-on-wmt-2022-russian","dataset":"WMT 2022 Russian-English","dataset_url":null,"rows_in_archive":1,"metrics":["SacreBLEU"],"first_row_in_archive_order":{"model":"Vega-MT","paper_title":"Vega-MT: The JD Explore Academy Translation System for WMT22","paper_url":"/paper/vega-mt-the-jd-explore-academy-translation","paper_date":"2022-09-20","arxiv_id":"2209.09444","code_links":[{"title":"jdea-nlp/vega-mt","url":"https://github.com/jdea-nlp/vega-mt"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-wmt2015-english","slug":"machine-translation-on-wmt2015-english","dataset":"WMT2015 English-Russian","dataset_url":"/dataset/wmt-2015","rows_in_archive":1,"metrics":["BLEU score"],"first_row_in_archive_order":{"model":"C2-50k Segmentation","paper_title":"Neural Machine Translation of Rare Words with Subword Units","paper_url":"/paper/neural-machine-translation-of-rare-words-with","paper_date":"2015-08-31","arxiv_id":"1508.07909","code_links":[{"title":"facebookresearch/fairseq","url":"https://github.com/facebookresearch/fairseq"},{"title":"google/sentencepiece","url":"https://github.com/google/sentencepiece"},{"title":"karpathy/minbpe","url":"https://github.com/karpathy/minbpe"},{"title":"rsennrich/subword-nmt","url":"https://github.com/rsennrich/subword-nmt"},{"title":"VKCOM/YouTokenToMe","url":"https://github.com/VKCOM/YouTokenToMe"},{"title":"glample/fastBPE","url":"https://github.com/glample/fastBPE"},{"title":"salesforce/GeDi","url":"https://github.com/salesforce/GeDi"},{"title":"EdinburghNLP/code-docstring-corpus","url":"https://github.com/EdinburghNLP/code-docstring-corpus"},{"title":"Avmb/code-docstring-corpus","url":"https://github.com/Avmb/code-docstring-corpus"},{"title":"nyu-dl/dl4mt-cdec","url":"https://github.com/nyu-dl/dl4mt-cdec"},{"title":"nyu-dl/dl4mt-c2c","url":"https://github.com/nyu-dl/dl4mt-c2c"},{"title":"ThAIKeras/bert","url":"https://github.com/ThAIKeras/bert"},{"title":"nyu-dl/dl4mt-simul-trans","url":"https://github.com/nyu-dl/dl4mt-simul-trans"},{"title":"Automattic/wp-translate","url":"https://github.com/Automattic/wp-translate"},{"title":"SeonbeomKim/Python-Bype_Pair_Encoding","url":"https://github.com/SeonbeomKim/Python-Bype_Pair_Encoding"},{"title":"thinkwee/DPP_CNN_Summarization","url":"https://github.com/thinkwee/DPP_CNN_Summarization"},{"title":"SeonbeomKim/Python-Byte_Pair_Encoding","url":"https://github.com/SeonbeomKim/Python-Byte_Pair_Encoding"},{"title":"PaulSudarshan/Language-Classification-Using-Naive-Bayes-Algorithm","url":"https://github.com/PaulSudarshan/Language-Classification-Using-Naive-Bayes-Algorithm"},{"title":"johnr0/TaleBrush-backend","url":"https://github.com/johnr0/TaleBrush-backend"},{"title":"kh-mo/QA_wikisql","url":"https://github.com/kh-mo/QA_wikisql"},{"title":"simonjisu/NMT","url":"https://github.com/simonjisu/NMT"},{"title":"siyuofzhou/CNNSeqToSeq","url":"https://github.com/siyuofzhou/CNNSeqToSeq"},{"title":"lkfo415579/MT-Readling-List","url":"https://github.com/lkfo415579/MT-Readling-List"},{"title":"HarshKhandelwal1552/Language_classifier_with_Naive_Bayes","url":"https://github.com/HarshKhandelwal1552/Language_classifier_with_Naive_Bayes"},{"title":"Xinsen-Zhang/transformer","url":"https://github.com/Xinsen-Zhang/transformer"},{"title":"ksulima/Unsupervised-method-to-NPL-Polish-language","url":"https://github.com/ksulima/Unsupervised-method-to-NPL-Polish-language"}],"syntology":{"n":30,"n_ran":21,"n_constructed":0,"n_ran_checked":1,"n_instrument":20,"n_unverified":9,"n_honours":0,"n_violates":0,"n_no_contract":1,"n_pointer_only":21,"phrase":"21 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 20 where Syntology's instrument failed) · 9 unverified","sample_list":"/paper/neural-machine-translation-of-rare-words-with#ran","syntology_url":"https://syntology.ai/paper/1508.07909","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1508.07909"}},"official":{"repos":["rsennrich/subword-nmt"],"state":"official (archive's flag): 4 ran","n_ran":4,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":2,"ran_from_kinds":["listed","official"]}}}},{"leaderboard":"/sota/machine-translation-on-wmt2016-czech-english","slug":"machine-translation-on-wmt2016-czech-english","dataset":"WMT2016 Czech-English","dataset_url":"/dataset/wmt-2016","rows_in_archive":1,"metrics":["BLEU score"],"first_row_in_archive_order":{"model":"Attentional encoder-decoder + BPE","paper_title":"Edinburgh Neural Machine Translation Systems for WMT 16","paper_url":"/paper/edinburgh-neural-machine-translation-systems","paper_date":"2016-06-09","arxiv_id":"1606.02891","code_links":[{"title":"rsennrich/wmt16-scripts","url":"https://github.com/rsennrich/wmt16-scripts"}],"syntology":{"n":2,"n_ran":2,"n_constructed":0,"n_ran_checked":0,"n_instrument":2,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/edinburgh-neural-machine-translation-systems#ran","syntology_url":"https://syntology.ai/paper/1606.02891","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1606.02891"}},"official":{"repos":["rsennrich/wmt16-scripts"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]}}}},{"leaderboard":"/sota/machine-translation-on-wmt2016-english-czech","slug":"machine-translation-on-wmt2016-english-czech","dataset":"WMT2016 English-Czech","dataset_url":"/dataset/wmt-2016","rows_in_archive":1,"metrics":["BLEU score"],"first_row_in_archive_order":{"model":"Attentional encoder-decoder + BPE","paper_title":"Edinburgh Neural Machine Translation Systems for WMT 16","paper_url":"/paper/edinburgh-neural-machine-translation-systems","paper_date":"2016-06-09","arxiv_id":"1606.02891","code_links":[{"title":"rsennrich/wmt16-scripts","url":"https://github.com/rsennrich/wmt16-scripts"}],"syntology":{"n":2,"n_ran":2,"n_constructed":0,"n_ran_checked":0,"n_instrument":2,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/edinburgh-neural-machine-translation-systems#ran","syntology_url":"https://syntology.ai/paper/1606.02891","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1606.02891"}},"official":{"repos":["rsennrich/wmt16-scripts"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]}}}},{"leaderboard":"/sota/machine-translation-on-wmt2016-english-french","slug":"machine-translation-on-wmt2016-english-french","dataset":"WMT2016 English-French","dataset_url":"/dataset/wmt-2016","rows_in_archive":1,"metrics":["BLEU score"],"first_row_in_archive_order":{"model":"DeLighT","paper_title":"DeLighT: Deep and Light-weight Transformer","paper_url":"/paper/delight-very-deep-and-light-weight","paper_date":"2020-08-03","arxiv_id":"2008.00623","code_links":[{"title":"sacmehta/delight","url":"https://github.com/sacmehta/delight"},{"title":"pranay185417/delight","url":"https://github.com/pranay185417/delight"}],"syntology":{"n":3,"n_ran":3,"n_constructed":0,"n_ran_checked":3,"n_instrument":0,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":3,"n_pointer_only":0,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/delight-very-deep-and-light-weight#ran","syntology_url":"https://syntology.ai/paper/2008.00623","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2008.00623"}},"official":{"repos":["sacmehta/delight"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":3,"n_unverified":0,"ran_from_kinds":["official"]}}}},{"leaderboard":"/sota/machine-translation-on-wmt2016-finnish","slug":"machine-translation-on-wmt2016-finnish","dataset":"WMT2016 Finnish-English","dataset_url":"/dataset/wmt-2016","rows_in_archive":1,"metrics":["BLEU"],"first_row_in_archive_order":{"model":"CT+B/S construction","paper_title":"The University of Sydney's Machine Translation System for WMT19","paper_url":"/paper/the-university-of-sydneys-machine-translation","paper_date":"2019-06-30","arxiv_id":"1907.00494","code_links":[],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-wmt2016-russian","slug":"machine-translation-on-wmt2016-russian","dataset":"WMT2016 Russian-English","dataset_url":"/dataset/wmt-2016","rows_in_archive":1,"metrics":["BLEU score"],"first_row_in_archive_order":{"model":"Attentional encoder-decoder + BPE","paper_title":"Edinburgh Neural Machine Translation Systems for WMT 16","paper_url":"/paper/edinburgh-neural-machine-translation-systems","paper_date":"2016-06-09","arxiv_id":"1606.02891","code_links":[{"title":"rsennrich/wmt16-scripts","url":"https://github.com/rsennrich/wmt16-scripts"}],"syntology":{"n":2,"n_ran":2,"n_constructed":0,"n_ran_checked":0,"n_instrument":2,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/edinburgh-neural-machine-translation-systems#ran","syntology_url":"https://syntology.ai/paper/1606.02891","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1606.02891"}},"official":{"repos":["rsennrich/wmt16-scripts"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]}}}},{"leaderboard":"/sota/machine-translation-on-wmt2017-english","slug":"machine-translation-on-wmt2017-english","dataset":"WMT2017 English-Finnish","dataset_url":null,"rows_in_archive":1,"metrics":["BLEU"],"first_row_in_archive_order":{"model":"OmniNetP","paper_title":"OmniNet: Omnidirectional Representations from Transformers","paper_url":"/paper/omninet-omnidirectional-representations-from","paper_date":"2021-03-01","arxiv_id":"2103.01075","code_links":[{"title":"lucidrains/omninet-pytorch","url":"https://github.com/lucidrains/omninet-pytorch"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-wmt2017-english-french","slug":"machine-translation-on-wmt2017-english-french","dataset":"WMT2017 English-French","dataset_url":null,"rows_in_archive":1,"metrics":["BLEU"],"first_row_in_archive_order":{"model":"OmniNetP","paper_title":"OmniNet: Omnidirectional Representations from Transformers","paper_url":"/paper/omninet-omnidirectional-representations-from","paper_date":"2021-03-01","arxiv_id":"2103.01075","code_links":[{"title":"lucidrains/omninet-pytorch","url":"https://github.com/lucidrains/omninet-pytorch"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-wmt2017-english-german","slug":"machine-translation-on-wmt2017-english-german","dataset":"WMT2017 English-German","dataset_url":null,"rows_in_archive":1,"metrics":["BLEU"],"first_row_in_archive_order":{"model":"OmniNetP","paper_title":"OmniNet: Omnidirectional Representations from Transformers","paper_url":"/paper/omninet-omnidirectional-representations-from","paper_date":"2021-03-01","arxiv_id":"2103.01075","code_links":[{"title":"lucidrains/omninet-pytorch","url":"https://github.com/lucidrains/omninet-pytorch"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-wmt2017-finnish","slug":"machine-translation-on-wmt2017-finnish","dataset":"WMT2017 Finnish-English","dataset_url":null,"rows_in_archive":1,"metrics":["BLEU"],"first_row_in_archive_order":{"model":"CT+B/S construction","paper_title":"The University of Sydney's Machine Translation System for WMT19","paper_url":"/paper/the-university-of-sydneys-machine-translation","paper_date":"2019-06-30","arxiv_id":"1907.00494","code_links":[],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-wmt2017-russian","slug":"machine-translation-on-wmt2017-russian","dataset":"WMT2017 Russian-English","dataset_url":null,"rows_in_archive":1,"metrics":["BLEU"],"first_row_in_archive_order":{"model":"OmniNetP","paper_title":"OmniNet: Omnidirectional Representations from Transformers","paper_url":"/paper/omninet-omnidirectional-representations-from","paper_date":"2021-03-01","arxiv_id":"2103.01075","code_links":[{"title":"lucidrains/omninet-pytorch","url":"https://github.com/lucidrains/omninet-pytorch"}],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-wmt2019-english-1","slug":"machine-translation-on-wmt2019-english-1","dataset":"WMT2019 English-Japanese","dataset_url":null,"rows_in_archive":1,"metrics":["BLEU"],"first_row_in_archive_order":{"model":"fiore","paper_title":"Parallel Corpus Filtering via Pre-trained Language Models","paper_url":"/paper/parallel-corpus-filtering-via-pre-trained","paper_date":"2020-05-13","arxiv_id":"2005.06166","code_links":[],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-wmt2019-finnish","slug":"machine-translation-on-wmt2019-finnish","dataset":"WMT2019 Finnish-English","dataset_url":null,"rows_in_archive":1,"metrics":["BLEU"],"first_row_in_archive_order":{"model":"CT+B/S construction","paper_title":"The University of Sydney's Machine Translation System for WMT19","paper_url":"/paper/the-university-of-sydneys-machine-translation","paper_date":"2019-06-30","arxiv_id":"1907.00494","code_links":[],"syntology":null}},{"leaderboard":"/sota/machine-translation-on-wmt2019-german-english","slug":"machine-translation-on-wmt2019-german-english","dataset":"WMT2019 German-English","dataset_url":null,"rows_in_archive":1,"metrics":["SacreBLEU"],"first_row_in_archive_order":{"model":"Exploiting Mono at Scale (single)","paper_title":"Exploiting Monolingual Data at Scale for Neural Machine Translation","paper_url":"/paper/exploiting-monolingual-data-at-scale-for","paper_date":"2019-11-01","arxiv_id":null,"code_links":[],"syntology":null}}],"datasets":[{"url":"/dataset/wmt-2014","name":"WMT 2014","full_name":"","num_papers_in_archive":288},{"url":"/dataset/opensubtitles","name":"OpenSubtitles","full_name":"","num_papers_in_archive":214},{"url":"/dataset/wmt-2016","name":"WMT 2016","full_name":"","num_papers_in_archive":178},{"url":"/dataset/mlqa","name":"MLQA","full_name":"MultiLingual Question Answering","num_papers_in_archive":167},{"url":"/dataset/europarl","name":"Europarl","full_name":"European Parliament Proceedings Parallel Corpus","num_papers_in_archive":128},{"url":"/dataset/flores-200","name":"FLoRes-200","full_name":"","num_papers_in_archive":117},{"url":"/dataset/aspec","name":"ASPEC","full_name":"Asian Scientific Paper Excerpt Corpus","num_papers_in_archive":87},{"url":"/dataset/flores-101","name":"FLoRes-101","full_name":"","num_papers_in_archive":86},{"url":"/dataset/opus-100","name":"OPUS-100","full_name":"","num_papers_in_archive":78},{"url":"/dataset/europarl-st","name":"Europarl-ST","full_name":"","num_papers_in_archive":57},{"url":"/dataset/shifts","name":"Shifts","full_name":"","num_papers_in_archive":55},{"url":"/dataset/mtnt","name":"MTNT","full_name":"","num_papers_in_archive":52},{"url":"/dataset/mkqa","name":"MKQA","full_name":"Multilingual Knowledge Questions and Answers","num_papers_in_archive":49},{"url":"/dataset/samanantar","name":"Samanantar","full_name":"","num_papers_in_archive":40},{"url":"/dataset/tatoeba","name":"Tatoeba","full_name":"Tatoeba","num_papers_in_archive":38},{"url":"/dataset/wmt-2018","name":"WMT 2018","full_name":"","num_papers_in_archive":37},{"url":"/dataset/wmt-2015","name":"WMT 2015","full_name":"","num_papers_in_archive":33},{"url":"/dataset/wmt-2020","name":"WMT 2020","full_name":"","num_papers_in_archive":33},{"url":"/dataset/escape","name":"eSCAPE","full_name":"","num_papers_in_archive":28},{"url":"/dataset/wmt-2016-news","name":"WMT 2016 News","full_name":"WMT 2016 News Translation Task","num_papers_in_archive":24},{"url":"/dataset/coco-cn","name":"COCO-CN","full_name":"","num_papers_in_archive":21},{"url":"/dataset/mlqe-pe","name":"MLQE-PE","full_name":"Multilingual Quality Estimation and Automatic Post-editing Dataset","num_papers_in_archive":20},{"url":"/dataset/paranmt-50m","name":"PARANMT-50M","full_name":"","num_papers_in_archive":13},{"url":"/dataset/duolingo-staple-shared-task","name":"Duolingo STAPLE Shared Task","full_name":"","num_papers_in_archive":10},{"url":"/dataset/xquad-r","name":"LAReQA","full_name":"","num_papers_in_archive":10},{"url":"/dataset/business-scene-dialogue","name":"Business Scene Dialogue","full_name":"","num_papers_in_archive":9},{"url":"/dataset/gigast","name":"GigaST","full_name":"","num_papers_in_archive":8},{"url":"/dataset/nlc2cmd","name":"NLC2CMD","full_name":"","num_papers_in_archive":8},{"url":"/dataset/wmt-2018-news","name":"WMT 2018 News","full_name":"WMT 2018 News Translation Task","num_papers_in_archive":8},{"url":"/dataset/aces","name":"ACES","full_name":"A Translation Accuracy Challenge Set","num_papers_in_archive":7},{"url":"/dataset/demetr","name":"Demetr","full_name":"","num_papers_in_archive":7},{"url":"/dataset/hindi-visual-genome","name":"Hindi Visual Genome","full_name":"","num_papers_in_archive":7},{"url":"/dataset/iwslt-2017","name":"IWSLT 2017","full_name":"","num_papers_in_archive":7},{"url":"/dataset/phomt","name":"PhoMT","full_name":"","num_papers_in_archive":7},{"url":"/dataset/bmeld","name":"BMELD","full_name":"","num_papers_in_archive":6},{"url":"/dataset/iwslt2015","name":"IWSLT2015","full_name":"IWSLT2015","num_papers_in_archive":6},{"url":"/dataset/jparacrawl","name":"JParaCrawl","full_name":"","num_papers_in_archive":6},{"url":"/dataset/shellcode-ia32","name":"Shellcode_IA32","full_name":"Shellcode_IA32","num_papers_in_archive":6},{"url":"/dataset/hindencorp","name":"HindEnCorp","full_name":"","num_papers_in_archive":5},{"url":"/dataset/mlqe","name":"MLQE","full_name":"MultiLingual Quality Estimation","num_papers_in_archive":5},{"url":"/dataset/diabla","name":"DiaBLa","full_name":"","num_papers_in_archive":4},{"url":"/dataset/frmt","name":"FRMT","full_name":"Few-shot Region-aware Machine Translation","num_papers_in_archive":4},{"url":"/dataset/indonlg","name":"IndoNLG","full_name":"","num_papers_in_archive":4},{"url":"/dataset/x-srl","name":"X-SRL","full_name":"","num_papers_in_archive":4},{"url":"/dataset/divemt","name":"DivEMT","full_name":"Post-Editing Effort Across Typologically-diverse Languages","num_papers_in_archive":3},{"url":"/dataset/havg","name":"HaVG","full_name":"Hausa Visual Genome Dataset","num_papers_in_archive":3},{"url":"/dataset/itihasa","name":"Itihasa","full_name":"","num_papers_in_archive":3},{"url":"/dataset/mmid","name":"MMID","full_name":"Massively Multilingual Image Dataset","num_papers_in_archive":3},{"url":"/dataset/textbox-2-0","name":"TextBox 2.0","full_name":"","num_papers_in_archive":3},{"url":"/dataset/amharic-english-parallel-corpus-for-machine","name":"Amharic - English Parallel Corpus for Machine Translation","full_name":"","num_papers_in_archive":2},{"url":"/dataset/ape","name":"APE","full_name":"Automatic Post-Editing","num_papers_in_archive":2},{"url":"/dataset/etymdb-2-0","name":"EtymDB 2.0","full_name":"","num_papers_in_archive":2},{"url":"/dataset/flores-in","name":"Flores-IN","full_name":"Flores-IN","num_papers_in_archive":2},{"url":"/dataset/gatitos","name":"GATITOS","full_name":"Google's Additional Translations Into Tail-languages: Often Short","num_papers_in_archive":2},{"url":"/dataset/muse","name":"MUSE","full_name":"MUSE","num_papers_in_archive":2},{"url":"/dataset/perseus","name":"Perseus","full_name":"","num_papers_in_archive":2},{"url":"/dataset/petci","name":"PETCI","full_name":"PETCI: A Parallel English Translation Dataset of Chinese Idioms","num_papers_in_archive":2},{"url":"/dataset/subedits","name":"SubEdits","full_name":"","num_papers_in_archive":2},{"url":"/dataset/tilde-model-corpus","name":"Tilde MODEL Corpus","full_name":"Tilde Multilingual Open Data for European Languages","num_papers_in_archive":2},{"url":"/dataset/wikicaps","name":"WikiCaps","full_name":"","num_papers_in_archive":2},{"url":"/dataset/alexa-point-of-view","name":"Alexa Point of View","full_name":null,"num_papers_in_archive":1},{"url":"/dataset/bilingual-corpus-of-arabic-english-parallel","name":"Bilingual Corpus of Arabic-English Parallel Tweets","full_name":"","num_papers_in_archive":1},{"url":"/dataset/bpersona-chat","name":"BPersona-chat","full_name":"","num_papers_in_archive":1},{"url":"/dataset/bwb","name":"BWB","full_name":"","num_papers_in_archive":1},{"url":"/dataset/congolese-swahili-french-parallel-text","name":"Congolese Swahili – French parallel text corpora","full_name":"","num_papers_in_archive":1},{"url":"/dataset/fgrada","name":"FGraDA","full_name":"Fine-Grained Domain Adaptation Dataset","num_papers_in_archive":1},{"url":"/dataset/humanmt","name":"HumanMT","full_name":"","num_papers_in_archive":1},{"url":"/dataset/igbonlp-datasets","name":"IgboNLP Datasets","full_name":"","num_papers_in_archive":1},{"url":"/dataset/kurdishinterdialect","name":"KurdishInterdialect","full_name":"Kurdish parallel corpus in Kurmanji, Sorani and English","num_papers_in_archive":1},{"url":"/dataset/menyo-20k","name":"MENYO-20k","full_name":"","num_papers_in_archive":1},{"url":"/dataset/multi-lingual-bug-reports","name":"Multi Lingual Bug Reports","full_name":"","num_papers_in_archive":1},{"url":"/dataset/phemt","name":"PheMT","full_name":"","num_papers_in_archive":1},{"url":"/dataset/polynewsparallel","name":"PolyNewsParallel","full_name":"","num_papers_in_archive":1},{"url":"/dataset/scb-mt-en-th-2020","name":"scb-mt-en-th-2020","full_name":"","num_papers_in_archive":1},{"url":"/dataset/simpevalasset","name":"SimpEvalASSET","full_name":"","num_papers_in_archive":1},{"url":"/dataset/vashantor-a-large-scale-multilingual","name":"Vashantor: A Large-scale Multilingual Benchmark Dataset for Automated Translation of Bangla Regional Dialects to Bangla Language","full_name":"","num_papers_in_archive":1},{"url":"/dataset/wmt-2014-medical","name":"WMT 2014 Medical","full_name":"WMT 2014 Medical Translation Task","num_papers_in_archive":1},{"url":"/dataset/wmt-2015-news","name":"WMT 2015 News","full_name":"WMT 2015 News Translation Task","num_papers_in_archive":1},{"url":"/dataset/wmt-2016-biomedical","name":"WMT 2016 Biomedical","full_name":"WMT 2016 Biomedical Translation Task","num_papers_in_archive":1},{"url":"/dataset/wmt-2016-it","name":"WMT 2016 IT","full_name":"WMT 2016 IT Translation Task","num_papers_in_archive":1},{"url":"/dataset/contracat","name":"ContraCAT","full_name":"Contrastive Coreference Analytical Templates (for Machine Translation)","num_papers_in_archive":0},{"url":"/dataset/wmt-2021-ge-ez-amharic","name":"WMT 2021 Ge'ez-Amharic","full_name":"","num_papers_in_archive":0}],"subtasks":[{"url":"/task/automatic-post-editing","name":"Automatic Post-Editing"},{"url":"/task/bilingual-lexicon-induction","name":"Bilingual Lexicon Induction"},{"url":"/task/clinical-language-translation","name":"Clinical Language Translation"},{"url":"/task/legal-document-translation","name":"Legal Document Translation"},{"url":"/task/low-resource-neural-machine-translation","name":"Low-Resource Neural Machine Translation"},{"url":"/task/low-resource-neural-machine-translation-2","name":"Low Resource Neural Machine Translation"},{"url":"/task/low-resource-nmt","name":"Low Resource NMT"},{"url":"/task/multimodal-machine-translation","name":"Multimodal Machine Translation"},{"url":"/task/transliteration","name":"Transliteration"},{"url":"/task/unsupervised-machine-translation","name":"Unsupervised Machine Translation"}],"parent_tasks":[],"papers":{"order":"repositories listed in the archive (most first), then date (newest first), then slug; the archive holds no stars","population":"every paper the archive tags with this task (distinct papers; spam titles not listed). 'of' counts the papers listed; until 2026-09-25 it counted only the papers with a code link, and that number is of_with_code","page":1,"pages_in_order":108,"rows_per_page":100,"shown":100,"of":10752,"of_with_code":2444,"tagged_in_all":10752,"counts":{"archive_papers_tagged":10752,"with_a_code_link":2444,"where_syntology_ran_a_sample":477,"not_listed_spam_title":0,"listed":10752,"listed_where_code_ran":477,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":360,"every_run_a_failure_of_syntologys_instrument":117,"listed_with_a_run_with_no_instrument_failure":360,"listed_every_run_a_failure_of_syntologys_instrument":117,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"items":[{"url":"/paper/attention-is-all-you-need","slug":"attention-is-all-you-need","title":"Attention Is All You Need","date":"2017-06-12","arxiv_id":"1706.03762","repositories_listed":595,"syntology":{"n":946,"n_ran":610,"n_constructed":293,"n_ran_checked":529,"n_instrument":81,"n_unverified":336,"n_honours":45,"n_violates":15,"n_no_contract":469,"n_pointer_only":451,"phrase":"610 ran (of which 293 constructed an object rather than computing a result; 529 with no instrument failure: 45 honoured, 15 violated, 469 with no contract checked; 81 where Syntology's instrument failed) · 336 unverified","sample_list":"/paper/attention-is-all-you-need#ran","syntology_url":"https://syntology.ai/paper/1706.03762","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1706.03762"}},"official":{"repos":["tensorflow/tensor2tensor"],"state":"official: no sample here; runs from other or unrecorded repositories","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","unlocated"]}}},{"url":"/paper/neural-machine-translation-by-jointly","slug":"neural-machine-translation-by-jointly","title":"Neural Machine Translation by Jointly Learning to Align and Translate","date":"2014-09-01","arxiv_id":"1409.0473","repositories_listed":124,"syntology":{"n":44,"n_ran":41,"n_constructed":2,"n_ran_checked":24,"n_instrument":17,"n_unverified":3,"n_honours":4,"n_violates":0,"n_no_contract":20,"n_pointer_only":16,"phrase":"41 ran (of which 2 constructed an object rather than computing a result; 24 with no instrument failure: 4 honoured, 0 violated, 20 with no contract checked; 17 where Syntology's instrument failed) · 3 unverified","sample_list":"/paper/neural-machine-translation-by-jointly#ran","syntology_url":"https://syntology.ai/paper/1409.0473","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1409.0473"}},"official":null}},{"url":"/paper/sequence-to-sequence-learning-with-neural","slug":"sequence-to-sequence-learning-with-neural","title":"Sequence to Sequence Learning with Neural Networks","date":"2014-09-10","arxiv_id":"1409.3215","repositories_listed":74,"syntology":{"n":25,"n_ran":21,"n_constructed":0,"n_ran_checked":13,"n_instrument":8,"n_unverified":4,"n_honours":3,"n_violates":0,"n_no_contract":10,"n_pointer_only":9,"phrase":"21 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 3 honoured, 0 violated, 10 with no contract checked; 8 where Syntology's instrument failed) · 4 unverified","sample_list":"/paper/sequence-to-sequence-learning-with-neural#ran","syntology_url":"https://syntology.ai/paper/1409.3215","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1409.3215"}},"official":null}},{"url":"/paper/exploring-the-limits-of-transfer-learning","slug":"exploring-the-limits-of-transfer-learning","title":"Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer","date":"2019-10-23","arxiv_id":"1910.10683","repositories_listed":57,"syntology":{"n":31,"n_ran":21,"n_constructed":0,"n_ran_checked":20,"n_instrument":1,"n_unverified":10,"n_honours":1,"n_violates":0,"n_no_contract":19,"n_pointer_only":0,"phrase":"21 ran (of which 0 constructed an object rather than computing a result; 20 with no instrument failure: 1 honoured, 0 violated, 19 with no contract checked; 1 where Syntology's instrument failed) · 10 unverified","sample_list":"/paper/exploring-the-limits-of-transfer-learning#ran","syntology_url":"https://syntology.ai/paper/1910.10683","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1910.10683"}},"official":null}},{"url":"/paper/bart-denoising-sequence-to-sequence-pre","slug":"bart-denoising-sequence-to-sequence-pre","title":"BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension","date":"2019-10-29","arxiv_id":"1910.13461","repositories_listed":47,"syntology":{"n":53,"n_ran":40,"n_constructed":7,"n_ran_checked":30,"n_instrument":10,"n_unverified":13,"n_honours":1,"n_violates":2,"n_no_contract":27,"n_pointer_only":13,"phrase":"40 ran (of which 7 constructed an object rather than computing a result; 30 with no instrument failure: 1 honoured, 2 violated, 27 with no contract checked; 10 where Syntology's instrument failed) · 13 unverified","sample_list":"/paper/bart-denoising-sequence-to-sequence-pre#ran","syntology_url":"https://syntology.ai/paper/1910.13461","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1910.13461"}},"official":null}},{"url":"/paper/effective-approaches-to-attention-based","slug":"effective-approaches-to-attention-based","title":"Effective Approaches to Attention-based Neural Machine Translation","date":"2015-08-17","arxiv_id":"1508.04025","repositories_listed":44,"syntology":{"n":8,"n_ran":7,"n_constructed":0,"n_ran_checked":6,"n_instrument":1,"n_unverified":1,"n_honours":1,"n_violates":0,"n_no_contract":5,"n_pointer_only":2,"phrase":"7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/effective-approaches-to-attention-based#ran","syntology_url":"https://syntology.ai/paper/1508.04025","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1508.04025"}},"official":null}},{"url":"/paper/learning-phrase-representations-using-rnn","slug":"learning-phrase-representations-using-rnn","title":"Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation","date":"2014-06-03","arxiv_id":"1406.1078","repositories_listed":42,"syntology":{"n":22,"n_ran":13,"n_constructed":6,"n_ran_checked":10,"n_instrument":3,"n_unverified":9,"n_honours":0,"n_violates":0,"n_no_contract":10,"n_pointer_only":14,"phrase":"13 ran (of which 6 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 3 where Syntology's instrument failed) · 9 unverified","sample_list":"/paper/learning-phrase-representations-using-rnn#ran","syntology_url":"https://syntology.ai/paper/1406.1078","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1406.1078"}},"official":null}},{"url":"/paper/convolutional-sequence-to-sequence-learning","slug":"convolutional-sequence-to-sequence-learning","title":"Convolutional Sequence to Sequence Learning","date":"2017-05-08","arxiv_id":"1705.03122","repositories_listed":37,"syntology":null},{"url":"/paper/an-empirical-evaluation-of-generic","slug":"an-empirical-evaluation-of-generic","title":"An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling","date":"2018-03-04","arxiv_id":"1803.01271","repositories_listed":35,"syntology":{"n":10,"n_ran":9,"n_constructed":0,"n_ran_checked":8,"n_instrument":1,"n_unverified":1,"n_honours":0,"n_violates":1,"n_no_contract":7,"n_pointer_only":1,"phrase":"9 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 1 violated, 7 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/an-empirical-evaluation-of-generic#ran","syntology_url":"https://syntology.ai/paper/1803.01271","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1803.01271"}},"official":{"repos":["locuslab/TCN"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/googles-neural-machine-translation-system","slug":"googles-neural-machine-translation-system","title":"Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation","date":"2016-09-26","arxiv_id":"1609.08144","repositories_listed":28,"syntology":{"n":46,"n_ran":34,"n_constructed":4,"n_ran_checked":25,"n_instrument":9,"n_unverified":12,"n_honours":1,"n_violates":2,"n_no_contract":22,"n_pointer_only":13,"phrase":"34 ran (of which 4 constructed an object rather than computing a result; 25 with no instrument failure: 1 honoured, 2 violated, 22 with no contract checked; 9 where Syntology's instrument failed) · 12 unverified","sample_list":"/paper/googles-neural-machine-translation-system#ran","syntology_url":"https://syntology.ai/paper/1609.08144","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1609.08144"}},"official":null}},{"url":"/paper/3d-u-net-learning-dense-volumetric","slug":"3d-u-net-learning-dense-volumetric","title":"3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation","date":"2016-06-21","arxiv_id":"1606.06650","repositories_listed":27,"syntology":{"n":76,"n_ran":59,"n_constructed":18,"n_ran_checked":42,"n_instrument":17,"n_unverified":17,"n_honours":4,"n_violates":0,"n_no_contract":38,"n_pointer_only":20,"phrase":"59 ran (of which 18 constructed an object rather than computing a result; 42 with no instrument failure: 4 honoured, 0 violated, 38 with no contract checked; 17 where Syntology's instrument failed) · 17 unverified","sample_list":"/paper/3d-u-net-learning-dense-volumetric#ran","syntology_url":"https://syntology.ai/paper/1606.06650","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1606.06650"}},"official":null}},{"url":"/paper/neural-machine-translation-of-rare-words-with","slug":"neural-machine-translation-of-rare-words-with","title":"Neural Machine Translation of Rare Words with Subword Units","date":"2015-08-31","arxiv_id":"1508.07909","repositories_listed":26,"syntology":{"n":30,"n_ran":21,"n_constructed":0,"n_ran_checked":1,"n_instrument":20,"n_unverified":9,"n_honours":0,"n_violates":0,"n_no_contract":1,"n_pointer_only":21,"phrase":"21 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 20 where Syntology's instrument failed) · 9 unverified","sample_list":"/paper/neural-machine-translation-of-rare-words-with#ran","syntology_url":"https://syntology.ai/paper/1508.07909","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1508.07909"}},"official":{"repos":["rsennrich/subword-nmt"],"state":"official (archive's flag): 4 ran","n_ran":4,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":2,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/diverse-beam-search-decoding-diverse","slug":"diverse-beam-search-decoding-diverse","title":"Diverse Beam Search: Decoding Diverse Solutions from Neural Sequence Models","date":"2016-10-07","arxiv_id":"1610.02424","repositories_listed":25,"syntology":{"n":14,"n_ran":7,"n_constructed":0,"n_ran_checked":2,"n_instrument":5,"n_unverified":7,"n_honours":0,"n_violates":1,"n_no_contract":1,"n_pointer_only":14,"phrase":"7 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 5 where Syntology's instrument failed) · 7 unverified","sample_list":"/paper/diverse-beam-search-decoding-diverse#ran","syntology_url":"https://syntology.ai/paper/1610.02424","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1610.02424"}},"official":{"repos":["ashwinkalyan/dbs"],"state":"official: no sample here; runs from other or unrecorded repositories","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","unlocated"]}}},{"url":"/paper/on-the-variance-of-the-adaptive-learning-rate","slug":"on-the-variance-of-the-adaptive-learning-rate","title":"On the Variance of the Adaptive Learning Rate and Beyond","date":"2019-08-08","arxiv_id":"1908.03265","repositories_listed":21,"syntology":{"n":13,"n_ran":12,"n_constructed":0,"n_ran_checked":11,"n_instrument":1,"n_unverified":1,"n_honours":2,"n_violates":0,"n_no_contract":9,"n_pointer_only":1,"phrase":"12 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 2 honoured, 0 violated, 9 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/on-the-variance-of-the-adaptive-learning-rate#ran","syntology_url":"https://syntology.ai/paper/1908.03265","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1908.03265"}},"official":{"repos":["LiyuanLucasLiu/RAdam"],"state":"official (archive's flag): 5 ran","n_ran":5,"n_constructed":0,"n_ran_no_instrument_failure":4,"n_unverified":0,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/language-models-are-unsupervised-multitask","slug":"language-models-are-unsupervised-multitask","title":"Language Models are Unsupervised Multitask Learners","date":"2019-02-14","arxiv_id":null,"repositories_listed":21,"syntology":null},{"url":"/paper/recurrent-neural-network-regularization","slug":"recurrent-neural-network-regularization","title":"Recurrent Neural Network Regularization","date":"2014-09-08","arxiv_id":"1409.2329","repositories_listed":21,"syntology":{"n":6,"n_ran":2,"n_constructed":0,"n_ran_checked":0,"n_instrument":2,"n_unverified":4,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":6,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified","sample_list":"/paper/recurrent-neural-network-regularization#ran","syntology_url":"https://syntology.ai/paper/1409.2329","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1409.2329"}},"official":{"repos":["wojzaremba/lstm"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/bertscore-evaluating-text-generation-with","slug":"bertscore-evaluating-text-generation-with","title":"BERTScore: Evaluating Text Generation with BERT","date":"2019-04-21","arxiv_id":"1904.09675","repositories_listed":20,"syntology":{"n":76,"n_ran":44,"n_constructed":4,"n_ran_checked":10,"n_instrument":34,"n_unverified":32,"n_honours":3,"n_violates":2,"n_no_contract":5,"n_pointer_only":33,"phrase":"44 ran (of which 4 constructed an object rather than computing a result; 10 with no instrument failure: 3 honoured, 2 violated, 5 with no contract checked; 34 where Syntology's instrument failed) · 32 unverified","sample_list":"/paper/bertscore-evaluating-text-generation-with#ran","syntology_url":"https://syntology.ai/paper/1904.09675","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1904.09675"}},"official":{"repos":["Tiiiger/bert_score"],"state":"official (archive's flag): 6 ran","n_ran":6,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":4,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/word-translation-without-parallel-data","slug":"word-translation-without-parallel-data","title":"Word Translation Without Parallel Data","date":"2017-10-11","arxiv_id":"1710.04087","repositories_listed":20,"syntology":{"n":8,"n_ran":6,"n_constructed":0,"n_ran_checked":2,"n_instrument":4,"n_unverified":2,"n_honours":0,"n_violates":2,"n_no_contract":0,"n_pointer_only":8,"phrase":"6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 2 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 2 unverified","sample_list":"/paper/word-translation-without-parallel-data#ran","syntology_url":"https://syntology.ai/paper/1710.04087","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1710.04087"}},"official":{"repos":["facebookresearch/MUSE"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/resmlp-feedforward-networks-for-image","slug":"resmlp-feedforward-networks-for-image","title":"ResMLP: Feedforward networks for image classification with data-efficient training","date":"2021-05-07","arxiv_id":"2105.03404","repositories_listed":19,"syntology":{"n":7,"n_ran":5,"n_constructed":0,"n_ran_checked":5,"n_instrument":0,"n_unverified":2,"n_honours":1,"n_violates":1,"n_no_contract":3,"n_pointer_only":0,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 1 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified","sample_list":"/paper/resmlp-feedforward-networks-for-image#ran","syntology_url":"https://syntology.ai/paper/2105.03404","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2105.03404"}},"official":{"repos":["facebookresearch/deit"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/lookahead-optimizer-k-steps-forward-1-step","slug":"lookahead-optimizer-k-steps-forward-1-step","title":"Lookahead Optimizer: k steps forward, 1 step back","date":"2019-07-19","arxiv_id":"1907.08610","repositories_listed":19,"syntology":null},{"url":"/paper/cross-lingual-language-model-pretraining","slug":"cross-lingual-language-model-pretraining","title":"Cross-lingual Language Model Pretraining","date":"2019-01-22","arxiv_id":"1901.07291","repositories_listed":17,"syntology":{"n":7,"n_ran":5,"n_constructed":0,"n_ran_checked":5,"n_instrument":0,"n_unverified":2,"n_honours":0,"n_violates":1,"n_no_contract":4,"n_pointer_only":1,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 1 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified","sample_list":"/paper/cross-lingual-language-model-pretraining#ran","syntology_url":"https://syntology.ai/paper/1901.07291","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1901.07291"}},"official":null}},{"url":"/paper/sockeye-a-toolkit-for-neural-machine","slug":"sockeye-a-toolkit-for-neural-machine","title":"Sockeye: A Toolkit for Neural Machine Translation","date":"2017-12-15","arxiv_id":"1712.05690","repositories_listed":16,"syntology":null},{"url":"/paper/qanet-combining-local-convolution-with-global","slug":"qanet-combining-local-convolution-with-global","title":"QANet: Combining Local Convolution with Global Self-Attention for Reading Comprehension","date":"2018-04-23","arxiv_id":"1804.09541","repositories_listed":15,"syntology":{"n":19,"n_ran":14,"n_constructed":0,"n_ran_checked":10,"n_instrument":4,"n_unverified":5,"n_honours":3,"n_violates":0,"n_no_contract":7,"n_pointer_only":3,"phrase":"14 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 3 honoured, 0 violated, 7 with no contract checked; 4 where Syntology's instrument failed) · 5 unverified","sample_list":"/paper/qanet-combining-local-convolution-with-global#ran","syntology_url":"https://syntology.ai/paper/1804.09541","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1804.09541"}},"official":null}},{"url":"/paper/tensor2tensor-for-neural-machine-translation","slug":"tensor2tensor-for-neural-machine-translation","title":"Tensor2Tensor for Neural Machine Translation","date":"2018-03-16","arxiv_id":"1803.07416","repositories_listed":15,"syntology":{"n":48,"n_ran":30,"n_constructed":0,"n_ran_checked":29,"n_instrument":1,"n_unverified":18,"n_honours":0,"n_violates":0,"n_no_contract":29,"n_pointer_only":0,"phrase":"30 ran (of which 0 constructed an object rather than computing a result; 29 with no instrument failure: 0 honoured, 0 violated, 29 with no contract checked; 1 where Syntology's instrument failed) · 18 unverified","sample_list":"/paper/tensor2tensor-for-neural-machine-translation#ran","syntology_url":"https://syntology.ai/paper/1803.07416","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1803.07416"}},"official":{"repos":["tensorflow/tensor2tensor"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/phrase-based-neural-unsupervised-machine","slug":"phrase-based-neural-unsupervised-machine","title":"Phrase-Based & Neural Unsupervised Machine Translation","date":"2018-04-20","arxiv_id":"1804.07755","repositories_listed":14,"syntology":null},{"url":"/paper/unsupervised-machine-translation-using","slug":"unsupervised-machine-translation-using","title":"Unsupervised Machine Translation Using Monolingual Corpora Only","date":"2017-10-31","arxiv_id":"1711.00043","repositories_listed":14,"syntology":{"n":14,"n_ran":7,"n_constructed":0,"n_ran_checked":5,"n_instrument":2,"n_unverified":7,"n_honours":0,"n_violates":1,"n_no_contract":4,"n_pointer_only":5,"phrase":"7 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 1 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 7 unverified","sample_list":"/paper/unsupervised-machine-translation-using#ran","syntology_url":"https://syntology.ai/paper/1711.00043","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1711.00043"}},"official":null}},{"url":"/paper/attention-based-models-for-speech-recognition","slug":"attention-based-models-for-speech-recognition","title":"Attention-Based Models for Speech Recognition","date":"2015-06-24","arxiv_id":"1506.07503","repositories_listed":14,"syntology":null},{"url":"/paper/gpipe-efficient-training-of-giant-neural","slug":"gpipe-efficient-training-of-giant-neural","title":"GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism","date":"2018-11-16","arxiv_id":"1811.06965","repositories_listed":13,"syntology":{"n":25,"n_ran":20,"n_constructed":0,"n_ran_checked":19,"n_instrument":1,"n_unverified":5,"n_honours":0,"n_violates":0,"n_no_contract":19,"n_pointer_only":16,"phrase":"20 ran (of which 0 constructed an object rather than computing a result; 19 with no instrument failure: 0 honoured, 0 violated, 19 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified","sample_list":"/paper/gpipe-efficient-training-of-giant-neural#ran","syntology_url":"https://syntology.ai/paper/1811.06965","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1811.06965"}},"official":null}},{"url":"/paper/self-attention-with-relative-position","slug":"self-attention-with-relative-position","title":"Self-Attention with Relative Position Representations","date":"2018-03-06","arxiv_id":"1803.02155","repositories_listed":13,"syntology":{"n":23,"n_ran":13,"n_constructed":4,"n_ran_checked":8,"n_instrument":5,"n_unverified":10,"n_honours":2,"n_violates":0,"n_no_contract":6,"n_pointer_only":3,"phrase":"13 ran (of which 4 constructed an object rather than computing a result; 8 with no instrument failure: 2 honoured, 0 violated, 6 with no contract checked; 5 where Syntology's instrument failed) · 10 unverified","sample_list":"/paper/self-attention-with-relative-position#ran","syntology_url":"https://syntology.ai/paper/1803.02155","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1803.02155"}},"official":{"repos":["tensorflow/tensor2tensor"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/fnet-mixing-tokens-with-fourier-transforms","slug":"fnet-mixing-tokens-with-fourier-transforms","title":"FNet: Mixing Tokens with Fourier Transforms","date":"2021-05-09","arxiv_id":"2105.03824","repositories_listed":12,"syntology":{"n":2,"n_ran":2,"n_constructed":0,"n_ran_checked":1,"n_instrument":1,"n_unverified":0,"n_honours":1,"n_violates":0,"n_no_contract":0,"n_pointer_only":1,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/fnet-mixing-tokens-with-fourier-transforms#ran","syntology_url":"https://syntology.ai/paper/2105.03824","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2105.03824"}},"official":{"repos":["google-research/google-research"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/style-transfer-from-non-parallel-text-by","slug":"style-transfer-from-non-parallel-text-by","title":"Style Transfer from Non-Parallel Text by Cross-Alignment","date":"2017-05-26","arxiv_id":"1705.09655","repositories_listed":12,"syntology":{"n":7,"n_ran":6,"n_constructed":0,"n_ran_checked":1,"n_instrument":5,"n_unverified":1,"n_honours":1,"n_violates":0,"n_no_contract":0,"n_pointer_only":6,"phrase":"6 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 5 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/style-transfer-from-non-parallel-text-by#ran","syntology_url":"https://syntology.ai/paper/1705.09655","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1705.09655"}},"official":{"repos":["shentianxiao/language-style-transfer"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/massive-exploration-of-neural-machine","slug":"massive-exploration-of-neural-machine","title":"Massive Exploration of Neural Machine Translation Architectures","date":"2017-03-11","arxiv_id":"1703.03906","repositories_listed":12,"syntology":{"n":9,"n_ran":6,"n_constructed":0,"n_ran_checked":5,"n_instrument":1,"n_unverified":3,"n_honours":0,"n_violates":0,"n_no_contract":5,"n_pointer_only":1,"phrase":"6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified","sample_list":"/paper/massive-exploration-of-neural-machine#ran","syntology_url":"https://syntology.ai/paper/1703.03906","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1703.03906"}},"official":{"repos":["google/seq2seq"],"state":"official: harvested, nothing ran","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":1,"ran_from_kinds":["listed"]}}},{"url":"/paper/simple-recurrent-units-for-highly","slug":"simple-recurrent-units-for-highly","title":"Simple Recurrent Units for Highly Parallelizable Recurrence","date":"2017-09-08","arxiv_id":"1709.02755","repositories_listed":11,"syntology":{"n":1,"n_ran":1,"n_constructed":0,"n_ran_checked":1,"n_instrument":0,"n_unverified":0,"n_honours":0,"n_violates":1,"n_no_contract":0,"n_pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/simple-recurrent-units-for-highly#ran","syntology_url":"https://syntology.ai/paper/1709.02755","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1709.02755"}},"official":{"repos":["asappresearch/sru"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/neural-machine-translation-in-linear-time","slug":"neural-machine-translation-in-linear-time","title":"Neural Machine Translation in Linear Time","date":"2016-10-31","arxiv_id":"1610.10099","repositories_listed":11,"syntology":null},{"url":"/paper/fixup-initialization-residual-learning","slug":"fixup-initialization-residual-learning","title":"Fixup Initialization: Residual Learning Without Normalization","date":"2019-01-27","arxiv_id":"1901.09321","repositories_listed":10,"syntology":{"n":4,"n_ran":2,"n_constructed":0,"n_ran_checked":1,"n_instrument":1,"n_unverified":2,"n_honours":1,"n_violates":0,"n_no_contract":0,"n_pointer_only":4,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified","sample_list":"/paper/fixup-initialization-residual-learning#ran","syntology_url":"https://syntology.ai/paper/1901.09321","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1901.09321"}},"official":null}},{"url":"/paper/hypernetworks","slug":"hypernetworks","title":"HyperNetworks","date":"2016-09-27","arxiv_id":"1609.09106","repositories_listed":10,"syntology":{"n":4,"n_ran":3,"n_constructed":0,"n_ran_checked":1,"n_instrument":2,"n_unverified":1,"n_honours":1,"n_violates":0,"n_no_contract":0,"n_pointer_only":3,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/hypernetworks#ran","syntology_url":"https://syntology.ai/paper/1609.09106","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1609.09106"}},"official":null}},{"url":"/paper/no-language-left-behind-scaling-human-1","slug":"no-language-left-behind-scaling-human-1","title":"No Language Left Behind: Scaling Human-Centered Machine Translation","date":"2022-07-11","arxiv_id":"2207.04672","repositories_listed":9,"syntology":{"n":10,"n_ran":6,"n_constructed":0,"n_ran_checked":6,"n_instrument":0,"n_unverified":4,"n_honours":0,"n_violates":0,"n_no_contract":6,"n_pointer_only":0,"phrase":"6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified","sample_list":"/paper/no-language-left-behind-scaling-human-1#ran","syntology_url":"https://syntology.ai/paper/2207.04672","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2207.04672"}},"official":{"repos":["facebookresearch/fairseq","facebookresearch/stopes"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/linear-transformers-are-secretly-fast-weight","slug":"linear-transformers-are-secretly-fast-weight","title":"Linear Transformers Are Secretly Fast Weight Programmers","date":"2021-02-22","arxiv_id":"2102.11174","repositories_listed":9,"syntology":{"n":2,"n_ran":2,"n_constructed":0,"n_ran_checked":1,"n_instrument":1,"n_unverified":0,"n_honours":1,"n_violates":0,"n_no_contract":0,"n_pointer_only":1,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/linear-transformers-are-secretly-fast-weight#ran","syntology_url":"https://syntology.ai/paper/2102.11174","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2102.11174"}},"official":{"repos":["ischlag/fast-weight-transformers"],"state":"official: no sample here; runs from other or unrecorded repositories","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","unlocated"]}}},{"url":"/paper/unsupervised-translation-of-programming","slug":"unsupervised-translation-of-programming","title":"Unsupervised Translation of Programming Languages","date":"2020-06-05","arxiv_id":"2006.03511","repositories_listed":9,"syntology":{"n":8,"n_ran":7,"n_constructed":0,"n_ran_checked":7,"n_instrument":0,"n_unverified":1,"n_honours":0,"n_violates":1,"n_no_contract":6,"n_pointer_only":0,"phrase":"7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 1 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/unsupervised-translation-of-programming#ran","syntology_url":"https://syntology.ai/paper/2006.03511","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2006.03511"}},"official":{"repos":["facebookresearch/CodeGen"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/margin-based-parallel-corpus-mining-with","slug":"margin-based-parallel-corpus-mining-with","title":"Margin-based Parallel Corpus Mining with Multilingual Sentence Embeddings","date":"2018-11-03","arxiv_id":"1811.01136","repositories_listed":9,"syntology":null},{"url":"/paper/xnli-evaluating-cross-lingual-sentence","slug":"xnli-evaluating-cross-lingual-sentence","title":"XNLI: Evaluating Cross-lingual Sentence Representations","date":"2018-09-13","arxiv_id":"1809.05053","repositories_listed":9,"syntology":null},{"url":"/paper/opennmt-neural-machine-translation-toolkit","slug":"opennmt-neural-machine-translation-toolkit","title":"OpenNMT: Neural Machine Translation Toolkit","date":"2018-05-28","arxiv_id":"1805.11462","repositories_listed":9,"syntology":{"n":29,"n_ran":20,"n_constructed":0,"n_ran_checked":20,"n_instrument":0,"n_unverified":9,"n_honours":1,"n_violates":1,"n_no_contract":18,"n_pointer_only":1,"phrase":"20 ran (of which 0 constructed an object rather than computing a result; 20 with no instrument failure: 1 honoured, 1 violated, 18 with no contract checked; 0 where Syntology's instrument failed) · 9 unverified","sample_list":"/paper/opennmt-neural-machine-translation-toolkit#ran","syntology_url":"https://syntology.ai/paper/1805.11462","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1805.11462"}},"official":{"repos":["rsennrich/nematus"],"state":"official (archive's flag): 5 ran","n_ran":5,"n_constructed":0,"n_ran_no_instrument_failure":5,"n_unverified":4,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/population-based-training-of-neural-networks","slug":"population-based-training-of-neural-networks","title":"Population Based Training of Neural Networks","date":"2017-11-27","arxiv_id":"1711.09846","repositories_listed":9,"syntology":null},{"url":"/paper/finetuned-language-models-are-zero-shot","slug":"finetuned-language-models-are-zero-shot","title":"Finetuned Language Models Are Zero-Shot Learners","date":"2021-09-03","arxiv_id":"2109.01652","repositories_listed":8,"syntology":{"n":1,"n_ran":0,"n_constructed":0,"n_ran_checked":0,"n_instrument":0,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"0 ran · 1 unverified","sample_list":"/paper/finetuned-language-models-are-zero-shot#ran","syntology_url":"https://syntology.ai/paper/2109.01652","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2109.01652"}},"official":{"repos":["google-research/flan"],"state":"official: harvested for another paper","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":[]}}},{"url":"/paper/r-drop-regularized-dropout-for-neural","slug":"r-drop-regularized-dropout-for-neural","title":"R-Drop: Regularized Dropout for Neural Networks","date":"2021-06-28","arxiv_id":"2106.14448","repositories_listed":8,"syntology":{"n":6,"n_ran":4,"n_constructed":2,"n_ran_checked":4,"n_instrument":0,"n_unverified":2,"n_honours":0,"n_violates":0,"n_no_contract":4,"n_pointer_only":0,"phrase":"4 ran (of which 2 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified","sample_list":"/paper/r-drop-regularized-dropout-for-neural#ran","syntology_url":"https://syntology.ai/paper/2106.14448","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2106.14448"}},"official":{"repos":["dropreg/R-Drop"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/beyond-english-centric-multilingual-machine","slug":"beyond-english-centric-multilingual-machine","title":"Beyond English-Centric Multilingual Machine Translation","date":"2020-10-21","arxiv_id":"2010.11125","repositories_listed":8,"syntology":{"n":8,"n_ran":7,"n_constructed":2,"n_ran_checked":4,"n_instrument":3,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":4,"n_pointer_only":2,"phrase":"7 ran (of which 2 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/beyond-english-centric-multilingual-machine#ran","syntology_url":"https://syntology.ai/paper/2010.11125","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2010.11125"}},"official":{"repos":["pytorch/fairseq"],"state":"official: no sample here; runs from other or unrecorded repositories","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","unlocated"]}}},{"url":"/paper/multilingual-denoising-pre-training-for","slug":"multilingual-denoising-pre-training-for","title":"Multilingual Denoising Pre-training for Neural Machine Translation","date":"2020-01-22","arxiv_id":"2001.08210","repositories_listed":8,"syntology":null},{"url":"/paper/joey-nmt-a-minimalist-nmt-toolkit-for-novices","slug":"joey-nmt-a-minimalist-nmt-toolkit-for-novices","title":"Joey NMT: A Minimalist NMT Toolkit for Novices","date":"2019-07-29","arxiv_id":"1907.12484","repositories_listed":8,"syntology":{"n":17,"n_ran":16,"n_constructed":0,"n_ran_checked":14,"n_instrument":2,"n_unverified":1,"n_honours":0,"n_violates":1,"n_no_contract":13,"n_pointer_only":1,"phrase":"16 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 1 violated, 13 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/joey-nmt-a-minimalist-nmt-toolkit-for-novices#ran","syntology_url":"https://syntology.ai/paper/1907.12484","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1907.12484"}},"official":{"repos":["joeynmt/joeynmt"],"state":"official: no sample here; runs from other or unrecorded repositories","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","unlocated"]}}},{"url":"/paper/universal-transformers","slug":"universal-transformers","title":"Universal Transformers","date":"2018-07-10","arxiv_id":"1807.03819","repositories_listed":8,"syntology":{"n":25,"n_ran":17,"n_constructed":8,"n_ran_checked":17,"n_instrument":0,"n_unverified":8,"n_honours":1,"n_violates":0,"n_no_contract":16,"n_pointer_only":24,"phrase":"17 ran (of which 8 constructed an object rather than computing a result; 17 with no instrument failure: 1 honoured, 0 violated, 16 with no contract checked; 0 where Syntology's instrument failed) · 8 unverified","sample_list":"/paper/universal-transformers#ran","syntology_url":"https://syntology.ai/paper/1807.03819","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1807.03819"}},"official":{"repos":["tensorflow/tensor2tensor"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/exploiting-similarities-among-languages-for","slug":"exploiting-similarities-among-languages-for","title":"Exploiting Similarities among Languages for Machine Translation","date":"2013-09-17","arxiv_id":"1309.4168","repositories_listed":8,"syntology":null},{"url":"/paper/mega-moving-average-equipped-gated-attention","slug":"mega-moving-average-equipped-gated-attention","title":"Mega: Moving Average Equipped Gated Attention","date":"2022-09-21","arxiv_id":"2209.10655","repositories_listed":7,"syntology":{"n":13,"n_ran":12,"n_constructed":6,"n_ran_checked":7,"n_instrument":5,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":7,"n_pointer_only":11,"phrase":"12 ran (of which 6 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 5 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/mega-moving-average-equipped-gated-attention#ran","syntology_url":"https://syntology.ai/paper/2209.10655","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2209.10655"}},"official":{"repos":["facebookresearch/mega"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":2,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/191013267","slug":"191013267","title":"BPE-Dropout: Simple and Effective Subword Regularization","date":"2019-10-29","arxiv_id":"1910.13267","repositories_listed":7,"syntology":{"n":24,"n_ran":24,"n_constructed":0,"n_ran_checked":15,"n_instrument":9,"n_unverified":0,"n_honours":0,"n_violates":1,"n_no_contract":14,"n_pointer_only":1,"phrase":"24 ran (of which 0 constructed an object rather than computing a result; 15 with no instrument failure: 0 honoured, 1 violated, 14 with no contract checked; 9 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/191013267#ran","syntology_url":"https://syntology.ai/paper/1910.13267","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1910.13267"}},"official":{"repos":["VProv/BPE-Dropout"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/leveraging-pre-trained-checkpoints-for","slug":"leveraging-pre-trained-checkpoints-for","title":"Leveraging Pre-trained Checkpoints for Sequence Generation Tasks","date":"2019-07-29","arxiv_id":"1907.12461","repositories_listed":7,"syntology":{"n":6,"n_ran":6,"n_constructed":0,"n_ran_checked":6,"n_instrument":0,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":6,"n_pointer_only":0,"phrase":"6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/leveraging-pre-trained-checkpoints-for#ran","syntology_url":"https://syntology.ai/paper/1907.12461","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1907.12461"}},"official":null}},{"url":"/paper/self-regulated-interactive-sequence-to","slug":"self-regulated-interactive-sequence-to","title":"Self-Regulated Interactive Sequence-to-Sequence Learning","date":"2019-07-11","arxiv_id":"1907.05190","repositories_listed":7,"syntology":null},{"url":"/paper/mass-masked-sequence-to-sequence-pre-training","slug":"mass-masked-sequence-to-sequence-pre-training","title":"MASS: Masked Sequence to Sequence Pre-training for Language Generation","date":"2019-05-07","arxiv_id":"1905.02450","repositories_listed":7,"syntology":null},{"url":"/paper/generalization-without-systematicity-on-the","slug":"generalization-without-systematicity-on-the","title":"Generalization without systematicity: On the compositional skills of sequence-to-sequence recurrent networks","date":"2017-10-31","arxiv_id":"1711.00350","repositories_listed":7,"syntology":null},{"url":"/paper/quasi-recurrent-neural-networks","slug":"quasi-recurrent-neural-networks","title":"Quasi-Recurrent Neural Networks","date":"2016-11-05","arxiv_id":"1611.01576","repositories_listed":7,"syntology":{"n":1,"n_ran":1,"n_constructed":0,"n_ran_checked":1,"n_instrument":0,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":1,"n_pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/quasi-recurrent-neural-networks#ran","syntology_url":"https://syntology.ai/paper/1611.01576","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1611.01576"}},"official":null}},{"url":"/paper/sequence-transduction-with-recurrent-neural","slug":"sequence-transduction-with-recurrent-neural","title":"Sequence Transduction with Recurrent Neural Networks","date":"2012-11-14","arxiv_id":"1211.3711","repositories_listed":7,"syntology":{"n":4,"n_ran":3,"n_constructed":0,"n_ran_checked":3,"n_instrument":0,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":3,"n_pointer_only":0,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/sequence-transduction-with-recurrent-neural#ran","syntology_url":"https://syntology.ai/paper/1211.3711","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1211.3711"}},"official":null}},{"url":"/paper/multilingual-translation-with-extensible","slug":"multilingual-translation-with-extensible","title":"Multilingual Translation with Extensible Multilingual Pretraining and Finetuning","date":"2020-08-02","arxiv_id":"2008.00401","repositories_listed":6,"syntology":{"n":2,"n_ran":2,"n_constructed":0,"n_ran_checked":2,"n_instrument":0,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":2,"n_pointer_only":0,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/multilingual-translation-with-extensible#ran","syntology_url":"https://syntology.ai/paper/2008.00401","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2008.00401"}},"official":null}},{"url":"/paper/improving-grammatical-error-correction-via","slug":"improving-grammatical-error-correction-via","title":"Improving Grammatical Error Correction via Pre-Training a Copy-Augmented Architecture with Unlabeled Data","date":"2019-03-01","arxiv_id":"1903.00138","repositories_listed":6,"syntology":null},{"url":"/paper/neural-speech-synthesis-with-transformer","slug":"neural-speech-synthesis-with-transformer","title":"Neural Speech Synthesis with Transformer Network","date":"2018-09-19","arxiv_id":"1809.08895","repositories_listed":6,"syntology":null},{"url":"/paper/the-natural-language-decathlon-multitask","slug":"the-natural-language-decathlon-multitask","title":"The Natural Language Decathlon: Multitask Learning as Question Answering","date":"2018-06-20","arxiv_id":"1806.08730","repositories_listed":6,"syntology":{"n":13,"n_ran":13,"n_constructed":0,"n_ran_checked":12,"n_instrument":1,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":12,"n_pointer_only":4,"phrase":"13 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 0 violated, 12 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/the-natural-language-decathlon-multitask#ran","syntology_url":"https://syntology.ai/paper/1806.08730","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1806.08730"}},"official":{"repos":["salesforce/decaNLP"],"state":"official (archive's flag): 9 ran","n_ran":9,"n_constructed":0,"n_ran_no_instrument_failure":9,"n_unverified":0,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/a-parallel-corpus-of-python-functions-and","slug":"a-parallel-corpus-of-python-functions-and","title":"A parallel corpus of Python functions and documentation strings for automated code documentation and code generation","date":"2017-07-07","arxiv_id":"1707.02275","repositories_listed":6,"syntology":{"n":3,"n_ran":2,"n_constructed":0,"n_ran_checked":0,"n_instrument":2,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":3,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/a-parallel-corpus-of-python-functions-and#ran","syntology_url":"https://syntology.ai/paper/1707.02275","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1707.02275"}},"official":{"repos":["Avmb/code-docstring-corpus"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/thumt-an-open-source-toolkit-for-neural","slug":"thumt-an-open-source-toolkit-for-neural","title":"THUMT: An Open Source Toolkit for Neural Machine Translation","date":"2017-06-20","arxiv_id":"1706.06415","repositories_listed":6,"syntology":null},{"url":"/paper/sequence-level-knowledge-distillation","slug":"sequence-level-knowledge-distillation","title":"Sequence-Level Knowledge Distillation","date":"2016-06-25","arxiv_id":"1606.07947","repositories_listed":6,"syntology":{"n":2,"n_ran":1,"n_constructed":0,"n_ran_checked":1,"n_instrument":0,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":1,"n_pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/sequence-level-knowledge-distillation#ran","syntology_url":"https://syntology.ai/paper/1606.07947","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1606.07947"}},"official":{"repos":["harvardnlp/nmt-android","harvardnlp/seq2seq-attn"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":1,"ran_from_kinds":["official"]}}},{"url":"/paper/sequence-to-sequence-learning-as-beam-search","slug":"sequence-to-sequence-learning-as-beam-search","title":"Sequence-to-Sequence Learning as Beam-Search Optimization","date":"2016-06-09","arxiv_id":"1606.02960","repositories_listed":6,"syntology":{"n":8,"n_ran":8,"n_constructed":0,"n_ran_checked":7,"n_instrument":1,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":7,"n_pointer_only":0,"phrase":"8 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/sequence-to-sequence-learning-as-beam-search#ran","syntology_url":"https://syntology.ai/paper/1606.02960","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1606.02960"}},"official":{"repos":["harvardnlp/BSO"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/solving-the-electronic-schrodinger-equation","slug":"solving-the-electronic-schrodinger-equation","title":"Solving the electronic Schrödinger equation for multiple nuclear geometries with weight-sharing deep neural networks","date":"2021-05-18","arxiv_id":"2105.08351","repositories_listed":5,"syntology":{"n":5,"n_ran":5,"n_constructed":0,"n_ran_checked":0,"n_instrument":5,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":5,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 5 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/solving-the-electronic-schrodinger-equation#ran","syntology_url":"https://syntology.ai/paper/2105.08351","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2105.08351"}},"official":{"repos":["mipunivie/deeperwin"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/informer-transformer-likes-informed-attention","slug":"informer-transformer-likes-informed-attention","title":"RealFormer: Transformer Likes Residual Attention","date":"2020-12-21","arxiv_id":"2012.11747","repositories_listed":5,"syntology":null},{"url":"/paper/fairseq-s2t-fast-speech-to-text-modeling-with","slug":"fairseq-s2t-fast-speech-to-text-modeling-with","title":"fairseq S2T: Fast Speech-to-Text Modeling with fairseq","date":"2020-10-11","arxiv_id":"2010.05171","repositories_listed":5,"syntology":null},{"url":"/paper/nearest-neighbor-machine-translation","slug":"nearest-neighbor-machine-translation","title":"Nearest Neighbor Machine Translation","date":"2020-10-01","arxiv_id":"2010.00710","repositories_listed":5,"syntology":{"n":10,"n_ran":4,"n_constructed":1,"n_ran_checked":1,"n_instrument":3,"n_unverified":6,"n_honours":0,"n_violates":0,"n_no_contract":1,"n_pointer_only":4,"phrase":"4 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 6 unverified","sample_list":"/paper/nearest-neighbor-machine-translation#ran","syntology_url":"https://syntology.ai/paper/2010.00710","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2010.00710"}},"official":{"repos":["urvashik/knnlm"],"state":"official: harvested, nothing ran","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":1,"ran_from_kinds":["listed"]}}},{"url":"/paper/editable-neural-networks-1","slug":"editable-neural-networks-1","title":"Editable Neural Networks","date":"2020-04-01","arxiv_id":"2004.00345","repositories_listed":5,"syntology":{"n":17,"n_ran":13,"n_constructed":0,"n_ran_checked":12,"n_instrument":1,"n_unverified":4,"n_honours":0,"n_violates":0,"n_no_contract":12,"n_pointer_only":1,"phrase":"13 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 0 violated, 12 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified","sample_list":"/paper/editable-neural-networks-1#ran","syntology_url":"https://syntology.ai/paper/2004.00345","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2004.00345"}},"official":{"repos":["editable-ICLR2020/editable","xtinkt/editable"],"state":"official (archive's flag): 13 ran","n_ran":13,"n_constructed":0,"n_ran_no_instrument_failure":12,"n_unverified":4,"ran_from_kinds":["official"]}}},{"url":"/paper/wide-minima-density-hypothesis-and-the","slug":"wide-minima-density-hypothesis-and-the","title":"Wide-minima Density Hypothesis and the Explore-Exploit Learning Rate Schedule","date":"2020-03-09","arxiv_id":"2003.03977","repositories_listed":5,"syntology":null},{"url":"/paper/a-probabilistic-formulation-of-unsupervised-1","slug":"a-probabilistic-formulation-of-unsupervised-1","title":"A Probabilistic Formulation of Unsupervised Text Style Transfer","date":"2020-02-10","arxiv_id":"2002.03912","repositories_listed":5,"syntology":{"n":25,"n_ran":18,"n_constructed":13,"n_ran_checked":11,"n_instrument":7,"n_unverified":7,"n_honours":0,"n_violates":0,"n_no_contract":11,"n_pointer_only":12,"phrase":"18 ran (of which 13 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 7 where Syntology's instrument failed) · 7 unverified","sample_list":"/paper/a-probabilistic-formulation-of-unsupervised-1#ran","syntology_url":"https://syntology.ai/paper/2002.03912","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2002.03912"}},"official":{"repos":["cindyxinyiwang/deep-latent-sequence-model"],"state":"official: no sample here; runs from other or unrecorded repositories","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","unlocated"]}}},{"url":"/paper/transformers-without-tears-improving-the","slug":"transformers-without-tears-improving-the","title":"Transformers without Tears: Improving the Normalization of Self-Attention","date":"2019-10-14","arxiv_id":"1910.05895","repositories_listed":5,"syntology":{"n":3,"n_ran":3,"n_constructed":0,"n_ran_checked":3,"n_instrument":0,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":3,"n_pointer_only":0,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/transformers-without-tears-improving-the#ran","syntology_url":"https://syntology.ai/paper/1910.05895","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1910.05895"}},"official":{"repos":["tnq177/transformers_without_tears"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":3,"n_unverified":0,"ran_from_kinds":["official"]}}},{"url":"/paper/stabilizing-transformers-for-reinforcement-1","slug":"stabilizing-transformers-for-reinforcement-1","title":"Stabilizing Transformers for Reinforcement Learning","date":"2019-10-13","arxiv_id":"1910.06764","repositories_listed":5,"syntology":{"n":3,"n_ran":3,"n_constructed":0,"n_ran_checked":2,"n_instrument":1,"n_unverified":0,"n_honours":0,"n_violates":2,"n_no_contract":0,"n_pointer_only":3,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 2 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/stabilizing-transformers-for-reinforcement-1#ran","syntology_url":"https://syntology.ai/paper/1910.06764","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1910.06764"}},"official":null}},{"url":"/paper/reducing-transformer-depth-on-demand-with-1","slug":"reducing-transformer-depth-on-demand-with-1","title":"Reducing Transformer Depth on Demand with Structured Dropout","date":"2019-09-25","arxiv_id":"1909.11556","repositories_listed":5,"syntology":null},{"url":"/paper/facebook-fairs-wmt19-news-translation-task","slug":"facebook-fairs-wmt19-news-translation-task","title":"Facebook FAIR's WMT19 News Translation Task Submission","date":"2019-07-15","arxiv_id":"1907.06616","repositories_listed":5,"syntology":{"n":9,"n_ran":7,"n_constructed":0,"n_ran_checked":6,"n_instrument":1,"n_unverified":2,"n_honours":0,"n_violates":0,"n_no_contract":6,"n_pointer_only":0,"phrase":"7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified","sample_list":"/paper/facebook-fairs-wmt19-news-translation-task#ran","syntology_url":"https://syntology.ai/paper/1907.06616","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1907.06616"}},"official":null}},{"url":"/paper/neural-abstractive-text-summarization-with","slug":"neural-abstractive-text-summarization-with","title":"Neural Abstractive Text Summarization with Sequence-to-Sequence Models","date":"2018-12-05","arxiv_id":"1812.02303","repositories_listed":5,"syntology":{"n":2,"n_ran":1,"n_constructed":0,"n_ran_checked":1,"n_instrument":0,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":1,"n_pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/neural-abstractive-text-summarization-with#ran","syntology_url":"https://syntology.ai/paper/1812.02303","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1812.02303"}},"official":{"repos":["tshi04/NATS"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/multi-task-learning-for-machine-reading","slug":"multi-task-learning-for-machine-reading","title":"Multi-task Learning with Sample Re-weighting for Machine Reading Comprehension","date":"2018-09-18","arxiv_id":"1809.06963","repositories_listed":5,"syntology":null},{"url":"/paper/scaling-neural-machine-translation","slug":"scaling-neural-machine-translation","title":"Scaling Neural Machine Translation","date":"2018-06-01","arxiv_id":"1806.00187","repositories_listed":5,"syntology":null},{"url":"/paper/adafactor-adaptive-learning-rates-with","slug":"adafactor-adaptive-learning-rates-with","title":"Adafactor: Adaptive Learning Rates with Sublinear Memory Cost","date":"2018-04-11","arxiv_id":"1804.04235","repositories_listed":5,"syntology":{"n":4,"n_ran":4,"n_constructed":0,"n_ran_checked":4,"n_instrument":0,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":4,"n_pointer_only":0,"phrase":"4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/adafactor-adaptive-learning-rates-with#ran","syntology_url":"https://syntology.ai/paper/1804.04235","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1804.04235"}},"official":null}},{"url":"/paper/weighted-transformer-network-for-machine","slug":"weighted-transformer-network-for-machine","title":"Weighted Transformer Network for Machine Translation","date":"2017-11-06","arxiv_id":"1711.02132","repositories_listed":5,"syntology":{"n":2,"n_ran":2,"n_constructed":0,"n_ran_checked":2,"n_instrument":0,"n_unverified":0,"n_honours":2,"n_violates":0,"n_no_contract":0,"n_pointer_only":2,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/weighted-transformer-network-for-machine#ran","syntology_url":"https://syntology.ai/paper/1711.02132","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1711.02132"}},"official":null}},{"url":"/paper/neural-machine-translation","slug":"neural-machine-translation","title":"Neural Machine Translation","date":"2017-09-22","arxiv_id":"1709.07809","repositories_listed":5,"syntology":null},{"url":"/paper/learned-in-translation-contextualized-word","slug":"learned-in-translation-contextualized-word","title":"Learned in Translation: Contextualized Word Vectors","date":"2017-08-01","arxiv_id":"1708.00107","repositories_listed":5,"syntology":{"n":3,"n_ran":3,"n_constructed":0,"n_ran_checked":2,"n_instrument":1,"n_unverified":0,"n_honours":2,"n_violates":0,"n_no_contract":0,"n_pointer_only":2,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/learned-in-translation-contextualized-word#ran","syntology_url":"https://syntology.ai/paper/1708.00107","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1708.00107"}},"official":{"repos":["salesforce/cove"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/sequence-level-training-with-recurrent-neural","slug":"sequence-level-training-with-recurrent-neural","title":"Sequence Level Training with Recurrent Neural Networks","date":"2015-11-20","arxiv_id":"1511.06732","repositories_listed":5,"syntology":null},{"url":"/paper/addressing-the-rare-word-problem-in-neural","slug":"addressing-the-rare-word-problem-in-neural","title":"Addressing the Rare Word Problem in Neural Machine Translation","date":"2014-10-30","arxiv_id":"1410.8206","repositories_listed":5,"syntology":null},{"url":"/paper/quantifying-the-plausibility-of-context","slug":"quantifying-the-plausibility-of-context","title":"Quantifying the Plausibility of Context Reliance in Neural Machine Translation","date":"2023-10-02","arxiv_id":"2310.01188","repositories_listed":4,"syntology":{"n":13,"n_ran":10,"n_constructed":1,"n_ran_checked":9,"n_instrument":1,"n_unverified":3,"n_honours":0,"n_violates":0,"n_no_contract":9,"n_pointer_only":2,"phrase":"10 ran (of which 1 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified","sample_list":"/paper/quantifying-the-plausibility-of-context#ran","syntology_url":"https://syntology.ai/paper/2310.01188","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2310.01188"}},"official":{"repos":["inseq-team/inseq","gsarti/pecore"],"state":"official (archive's flag): 8 ran","n_ran":8,"n_constructed":0,"n_ran_no_instrument_failure":8,"n_unverified":3,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/seamlessm4t-massively-multilingual-multimodal","slug":"seamlessm4t-massively-multilingual-multimodal","title":"SeamlessM4T: Massively Multilingual & Multimodal Machine Translation","date":"2023-08-22","arxiv_id":"2308.11596","repositories_listed":4,"syntology":{"n":2,"n_ran":2,"n_constructed":0,"n_ran_checked":0,"n_instrument":2,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":2,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/seamlessm4t-massively-multilingual-multimodal#ran","syntology_url":"https://syntology.ai/paper/2308.11596","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2308.11596"}},"official":{"repos":["facebookresearch/seamless_communication"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]}}},{"url":"/paper/model-and-data-transfer-for-cross-lingual","slug":"model-and-data-transfer-for-cross-lingual","title":"Model and Data Transfer for Cross-Lingual Sequence Labelling in Zero-Resource Settings","date":"2022-10-23","arxiv_id":"2210.12623","repositories_listed":4,"syntology":null},{"url":"/paper/foundation-transformers","slug":"foundation-transformers","title":"Foundation Transformers","date":"2022-10-12","arxiv_id":"2210.06423","repositories_listed":4,"syntology":{"n":2,"n_ran":1,"n_constructed":0,"n_ran_checked":1,"n_instrument":0,"n_unverified":1,"n_honours":1,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/foundation-transformers#ran","syntology_url":"https://syntology.ai/paper/2210.06423","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2210.06423"}},"official":{"repos":["microsoft/unilm"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/okwugbe-end-to-end-speech-recognition-for-fon","slug":"okwugbe-end-to-end-speech-recognition-for-fon","title":"OkwuGbé: End-to-End Speech Recognition for Fon and Igbo","date":"2021-03-13","arxiv_id":"2103.07762","repositories_listed":4,"syntology":null},{"url":"/paper/participatory-research-for-low-resourced","slug":"participatory-research-for-low-resourced","title":"Participatory Research for Low-resourced Machine Translation: A Case Study in African Languages","date":"2020-10-05","arxiv_id":"2010.02353","repositories_listed":4,"syntology":{"n":1,"n_ran":1,"n_constructed":0,"n_ran_checked":1,"n_instrument":0,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":1,"n_pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/participatory-research-for-low-resourced#ran","syntology_url":"https://syntology.ai/paper/2010.02353","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2010.02353"}},"official":{"repos":["masakhane-io/masakhane-mt"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/very-deep-transformers-for-neural-machine","slug":"very-deep-transformers-for-neural-machine","title":"Very Deep Transformers for Neural Machine Translation","date":"2020-08-18","arxiv_id":"2008.07772","repositories_listed":4,"syntology":{"n":9,"n_ran":8,"n_constructed":2,"n_ran_checked":3,"n_instrument":5,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":3,"n_pointer_only":3,"phrase":"8 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 5 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/very-deep-transformers-for-neural-machine#ran","syntology_url":"https://syntology.ai/paper/2008.07772","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2008.07772"}},"official":{"repos":["namisan/exdeep-nmt"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/hat-hardware-aware-transformers-for-efficient","slug":"hat-hardware-aware-transformers-for-efficient","title":"HAT: Hardware-Aware Transformers for Efficient Natural Language Processing","date":"2020-05-28","arxiv_id":"2005.14187","repositories_listed":4,"syntology":null},{"url":"/paper/unsupervised-quality-estimation-for-neural","slug":"unsupervised-quality-estimation-for-neural","title":"Unsupervised Quality Estimation for Neural Machine Translation","date":"2020-05-21","arxiv_id":"2005.10608","repositories_listed":4,"syntology":null},{"url":"/paper/accessing-higher-level-representations-in","slug":"accessing-higher-level-representations-in","title":"Addressing Some Limitations of Transformers with Feedback Memory","date":"2020-02-21","arxiv_id":"2002.09402","repositories_listed":4,"syntology":{"n":3,"n_ran":3,"n_constructed":0,"n_ran_checked":2,"n_instrument":1,"n_unverified":0,"n_honours":0,"n_violates":2,"n_no_contract":0,"n_pointer_only":2,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 2 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/accessing-higher-level-representations-in#ran","syntology_url":"https://syntology.ai/paper/2002.09402","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2002.09402"}},"official":{"repos":["facebookresearch/transformer-sequential"],"state":"official: no sample here; runs from other or unrecorded repositories","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","unlocated"]}}},{"url":"/paper/mlqa-evaluating-cross-lingual-extractive","slug":"mlqa-evaluating-cross-lingual-extractive","title":"MLQA: Evaluating Cross-lingual Extractive Question Answering","date":"2019-10-16","arxiv_id":"1910.07475","repositories_listed":4,"syntology":{"n":3,"n_ran":3,"n_constructed":0,"n_ran_checked":0,"n_instrument":3,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":3,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/mlqa-evaluating-cross-lingual-extractive#ran","syntology_url":"https://syntology.ai/paper/1910.07475","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1910.07475"}},"official":{"repos":["facebookresearch/MLQA"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]}}},{"url":"/paper/moverscore-text-generation-evaluating-with","slug":"moverscore-text-generation-evaluating-with","title":"MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distance","date":"2019-09-05","arxiv_id":"1909.02622","repositories_listed":4,"syntology":{"n":2,"n_ran":2,"n_constructed":0,"n_ran_checked":0,"n_instrument":2,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":2,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/moverscore-text-generation-evaluating-with#ran","syntology_url":"https://syntology.ai/paper/1909.02622","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1909.02622"}},"official":null}},{"url":"/paper/transformers-with-convolutional-context-for","slug":"transformers-with-convolutional-context-for","title":"Transformers with convolutional context for ASR","date":"2019-04-26","arxiv_id":"1904.11660","repositories_listed":4,"syntology":{"n":8,"n_ran":8,"n_constructed":0,"n_ran_checked":7,"n_instrument":1,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":7,"n_pointer_only":1,"phrase":"8 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/transformers-with-convolutional-context-for#ran","syntology_url":"https://syntology.ai/paper/1904.11660","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1904.11660"}},"official":null}},{"url":"/paper/vatex-a-large-scale-high-quality-multilingual","slug":"vatex-a-large-scale-high-quality-multilingual","title":"VATEX: A Large-Scale, High-Quality Multilingual Dataset for Video-and-Language Research","date":"2019-04-06","arxiv_id":"1904.03493","repositories_listed":4,"syntology":null}],"syntology_records":68,"syntology_note":"a paper without a record is not a recorded non-run: it may lack an arXiv id or simply be absent from the graph layer"},"key_notes":{"n_ran_checked":"legacy name, kept unchanged so existing readers do not break: it counts the samples that ran with no instrument failure (honoured, violated, and ran with no contract checked); it does not mean a contract was checked, and the pages print it as 'K with no instrument failure', not 'K checked'","n_constructed":"a sub-count of the samples that ran, never subtracted from them and never a failure: an executed sample whose run returned an instance of its own class (fixture_out_type equals the entry name): the run built an object and did not compute a result (Syntology's RAN record, counts.constructed)"},"since_archive_judged":{"papers":3,"papers_placed":0,"judged_by":{"model":"Claude Sonnet 4.5","models_as_recorded":["global.anthropic.claude-sonnet-4-5-20250929-v1:0"],"from":"lb_rows_run_verified.jsonl: each record's `model` field (the extractor's call that wrote decisions[])"},"note":"a model's judgement from the paper's own tables that they report on this leaderboard, not a result: no value from a paper that was not placed is printed or carried here; papers counts each paper once over these leaderboards","backfill":"8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read)","backfill_complete":false,"leaderboards":[{"leaderboard":"/sota/machine-translation-on-wmt2014-german-english","since_archive":"/sota/machine-translation-on-wmt2014-german-english#since-judged","papers_judged":1,"placed":0},{"leaderboard":"/sota/machine-translation-on-flores-200","since_archive":"/sota/machine-translation-on-flores-200#since-judged","papers_judged":2,"placed":0}]},"papers_where_code_ran":477,"papers_where_code_ran_first_page":"/task/machine-translation/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not run it on this task or check it against the task's benchmarks.","pages":[{"order":"archive","page":2,"of":108,"url":"/task/machine-translation/papers/2","json":"/task/machine-translation/papers/2.json","rows":100},{"order":"archive","page":3,"of":108,"url":"/task/machine-translation/papers/3","json":"/task/machine-translation/papers/3.json","rows":100},{"order":"archive","page":4,"of":108,"url":"/task/machine-translation/papers/4","json":"/task/machine-translation/papers/4.json","rows":100},{"order":"archive","page":5,"of":108,"url":"/task/machine-translation/papers/5","json":"/task/machine-translation/papers/5.json","rows":100},{"order":"archive","page":6,"of":108,"url":"/task/machine-translation/papers/6","json":"/task/machine-translation/papers/6.json","rows":100},{"order":"archive","page":7,"of":108,"url":"/task/machine-translation/papers/7","json":"/task/machine-translation/papers/7.json","rows":100},{"order":"archive","page":8,"of":108,"url":"/task/machine-translation/papers/8","json":"/task/machine-translation/papers/8.json","rows":100},{"order":"archive","page":9,"of":108,"url":"/task/machine-translation/papers/9","json":"/task/machine-translation/papers/9.json","rows":100},{"order":"archive","page":10,"of":108,"url":"/task/machine-translation/papers/10","json":"/task/machine-translation/papers/10.json","rows":100},{"order":"archive","page":11,"of":108,"url":"/task/machine-translation/papers/11","json":"/task/machine-translation/papers/11.json","rows":100},{"order":"archive","page":12,"of":108,"url":"/task/machine-translation/papers/12","json":"/task/machine-translation/papers/12.json","rows":100},{"order":"archive","page":13,"of":108,"url":"/task/machine-translation/papers/13","json":"/task/machine-translation/papers/13.json","rows":100},{"order":"archive","page":14,"of":108,"url":"/task/machine-translation/papers/14","json":"/task/machine-translation/papers/14.json","rows":100},{"order":"archive","page":15,"of":108,"url":"/task/machine-translation/papers/15","json":"/task/machine-translation/papers/15.json","rows":100},{"order":"archive","page":16,"of":108,"url":"/task/machine-translation/papers/16","json":"/task/machine-translation/papers/16.json","rows":100},{"order":"archive","page":17,"of":108,"url":"/task/machine-translation/papers/17","json":"/task/machine-translation/papers/17.json","rows":100},{"order":"archive","page":18,"of":108,"url":"/task/machine-translation/papers/18","json":"/task/machine-translation/papers/18.json","rows":100},{"order":"archive","page":19,"of":108,"url":"/task/machine-translation/papers/19","json":"/task/machine-translation/papers/19.json","rows":100},{"order":"archive","page":20,"of":108,"url":"/task/machine-translation/papers/20","json":"/task/machine-translation/papers/20.json","rows":100},{"order":"archive","page":21,"of":108,"url":"/task/machine-translation/papers/21","json":"/task/machine-translation/papers/21.json","rows":100},{"order":"archive","page":22,"of":108,"url":"/task/machine-translation/papers/22","json":"/task/machine-translation/papers/22.json","rows":100},{"order":"archive","page":23,"of":108,"url":"/task/machine-translation/papers/23","json":"/task/machine-translation/papers/23.json","rows":100},{"order":"archive","page":24,"of":108,"url":"/task/machine-translation/papers/24","json":"/task/machine-translation/papers/24.json","rows":100},{"order":"archive","page":25,"of":108,"url":"/task/machine-translation/papers/25","json":"/task/machine-translation/papers/25.json","rows":100},{"order":"archive","page":26,"of":108,"url":"/task/machine-translation/papers/26","json":"/task/machine-translation/papers/26.json","rows":100},{"order":"archive","page":27,"of":108,"url":"/task/machine-translation/papers/27","json":"/task/machine-translation/papers/27.json","rows":100},{"order":"archive","page":28,"of":108,"url":"/task/machine-translation/papers/28","json":"/task/machine-translation/papers/28.json","rows":100},{"order":"archive","page":29,"of":108,"url":"/task/machine-translation/papers/29","json":"/task/machine-translation/papers/29.json","rows":100},{"order":"archive","page":30,"of":108,"url":"/task/machine-translation/papers/30","json":"/task/machine-translation/papers/30.json","rows":100},{"order":"archive","page":31,"of":108,"url":"/task/machine-translation/papers/31","json":"/task/machine-translation/papers/31.json","rows":100},{"order":"archive","page":32,"of":108,"url":"/task/machine-translation/papers/32","json":"/task/machine-translation/papers/32.json","rows":100},{"order":"archive","page":33,"of":108,"url":"/task/machine-translation/papers/33","json":"/task/machine-translation/papers/33.json","rows":100},{"order":"archive","page":34,"of":108,"url":"/task/machine-translation/papers/34","json":"/task/machine-translation/papers/34.json","rows":100},{"order":"archive","page":35,"of":108,"url":"/task/machine-translation/papers/35","json":"/task/machine-translation/papers/35.json","rows":100},{"order":"archive","page":36,"of":108,"url":"/task/machine-translation/papers/36","json":"/task/machine-translation/papers/36.json","rows":100},{"order":"archive","page":37,"of":108,"url":"/task/machine-translation/papers/37","json":"/task/machine-translation/papers/37.json","rows":100},{"order":"archive","page":38,"of":108,"url":"/task/machine-translation/papers/38","json":"/task/machine-translation/papers/38.json","rows":100},{"order":"archive","page":39,"of":108,"url":"/task/machine-translation/papers/39","json":"/task/machine-translation/papers/39.json","rows":100},{"order":"archive","page":40,"of":108,"url":"/task/machine-translation/papers/40","json":"/task/machine-translation/papers/40.json","rows":100},{"order":"archive","page":41,"of":108,"url":"/task/machine-translation/papers/41","json":"/task/machine-translation/papers/41.json","rows":100},{"order":"archive","page":42,"of":108,"url":"/task/machine-translation/papers/42","json":"/task/machine-translation/papers/42.json","rows":100},{"order":"archive","page":43,"of":108,"url":"/task/machine-translation/papers/43","json":"/task/machine-translation/papers/43.json","rows":100},{"order":"archive","page":44,"of":108,"url":"/task/machine-translation/papers/44","json":"/task/machine-translation/papers/44.json","rows":100},{"order":"archive","page":45,"of":108,"url":"/task/machine-translation/papers/45","json":"/task/machine-translation/papers/45.json","rows":100},{"order":"archive","page":46,"of":108,"url":"/task/machine-translation/papers/46","json":"/task/machine-translation/papers/46.json","rows":100},{"order":"archive","page":47,"of":108,"url":"/task/machine-translation/papers/47","json":"/task/machine-translation/papers/47.json","rows":100},{"order":"archive","page":48,"of":108,"url":"/task/machine-translation/papers/48","json":"/task/machine-translation/papers/48.json","rows":100},{"order":"archive","page":49,"of":108,"url":"/task/machine-translation/papers/49","json":"/task/machine-translation/papers/49.json","rows":100},{"order":"archive","page":50,"of":108,"url":"/task/machine-translation/papers/50","json":"/task/machine-translation/papers/50.json","rows":100},{"order":"archive","page":51,"of":108,"url":"/task/machine-translation/papers/51","json":"/task/machine-translation/papers/51.json","rows":100},{"order":"archive","page":52,"of":108,"url":"/task/machine-translation/papers/52","json":"/task/machine-translation/papers/52.json","rows":100},{"order":"archive","page":53,"of":108,"url":"/task/machine-translation/papers/53","json":"/task/machine-translation/papers/53.json","rows":100},{"order":"archive","page":54,"of":108,"url":"/task/machine-translation/papers/54","json":"/task/machine-translation/papers/54.json","rows":100},{"order":"archive","page":55,"of":108,"url":"/task/machine-translation/papers/55","json":"/task/machine-translation/papers/55.json","rows":100},{"order":"archive","page":56,"of":108,"url":"/task/machine-translation/papers/56","json":"/task/machine-translation/papers/56.json","rows":100},{"order":"archive","page":57,"of":108,"url":"/task/machine-translation/papers/57","json":"/task/machine-translation/papers/57.json","rows":100},{"order":"archive","page":58,"of":108,"url":"/task/machine-translation/papers/58","json":"/task/machine-translation/papers/58.json","rows":100},{"order":"archive","page":59,"of":108,"url":"/task/machine-translation/papers/59","json":"/task/machine-translation/papers/59.json","rows":100},{"order":"archive","page":60,"of":108,"url":"/task/machine-translation/papers/60","json":"/task/machine-translation/papers/60.json","rows":100},{"order":"archive","page":61,"of":108,"url":"/task/machine-translation/papers/61","json":"/task/machine-translation/papers/61.json","rows":100},{"order":"archive","page":62,"of":108,"url":"/task/machine-translation/papers/62","json":"/task/machine-translation/papers/62.json","rows":100},{"order":"archive","page":63,"of":108,"url":"/task/machine-translation/papers/63","json":"/task/machine-translation/papers/63.json","rows":100},{"order":"archive","page":64,"of":108,"url":"/task/machine-translation/papers/64","json":"/task/machine-translation/papers/64.json","rows":100},{"order":"archive","page":65,"of":108,"url":"/task/machine-translation/papers/65","json":"/task/machine-translation/papers/65.json","rows":100},{"order":"archive","page":66,"of":108,"url":"/task/machine-translation/papers/66","json":"/task/machine-translation/papers/66.json","rows":100},{"order":"archive","page":67,"of":108,"url":"/task/machine-translation/papers/67","json":"/task/machine-translation/papers/67.json","rows":100},{"order":"archive","page":68,"of":108,"url":"/task/machine-translation/papers/68","json":"/task/machine-translation/papers/68.json","rows":100},{"order":"archive","page":69,"of":108,"url":"/task/machine-translation/papers/69","json":"/task/machine-translation/papers/69.json","rows":100},{"order":"archive","page":70,"of":108,"url":"/task/machine-translation/papers/70","json":"/task/machine-translation/papers/70.json","rows":100},{"order":"archive","page":71,"of":108,"url":"/task/machine-translation/papers/71","json":"/task/machine-translation/papers/71.json","rows":100},{"order":"archive","page":72,"of":108,"url":"/task/machine-translation/papers/72","json":"/task/machine-translation/papers/72.json","rows":100},{"order":"archive","page":73,"of":108,"url":"/task/machine-translation/papers/73","json":"/task/machine-translation/papers/73.json","rows":100},{"order":"archive","page":74,"of":108,"url":"/task/machine-translation/papers/74","json":"/task/machine-translation/papers/74.json","rows":100},{"order":"archive","page":75,"of":108,"url":"/task/machine-translation/papers/75","json":"/task/machine-translation/papers/75.json","rows":100},{"order":"archive","page":76,"of":108,"url":"/task/machine-translation/papers/76","json":"/task/machine-translation/papers/76.json","rows":100},{"order":"archive","page":77,"of":108,"url":"/task/machine-translation/papers/77","json":"/task/machine-translation/papers/77.json","rows":100},{"order":"archive","page":78,"of":108,"url":"/task/machine-translation/papers/78","json":"/task/machine-translation/papers/78.json","rows":100},{"order":"archive","page":79,"of":108,"url":"/task/machine-translation/papers/79","json":"/task/machine-translation/papers/79.json","rows":100},{"order":"archive","page":80,"of":108,"url":"/task/machine-translation/papers/80","json":"/task/machine-translation/papers/80.json","rows":100},{"order":"archive","page":81,"of":108,"url":"/task/machine-translation/papers/81","json":"/task/machine-translation/papers/81.json","rows":100},{"order":"archive","page":82,"of":108,"url":"/task/machine-translation/papers/82","json":"/task/machine-translation/papers/82.json","rows":100},{"order":"archive","page":83,"of":108,"url":"/task/machine-translation/papers/83","json":"/task/machine-translation/papers/83.json","rows":100},{"order":"archive","page":84,"of":108,"url":"/task/machine-translation/papers/84","json":"/task/machine-translation/papers/84.json","rows":100},{"order":"archive","page":85,"of":108,"url":"/task/machine-translation/papers/85","json":"/task/machine-translation/papers/85.json","rows":100},{"order":"archive","page":86,"of":108,"url":"/task/machine-translation/papers/86","json":"/task/machine-translation/papers/86.json","rows":100},{"order":"archive","page":87,"of":108,"url":"/task/machine-translation/papers/87","json":"/task/machine-translation/papers/87.json","rows":100},{"order":"archive","page":88,"of":108,"url":"/task/machine-translation/papers/88","json":"/task/machine-translation/papers/88.json","rows":100},{"order":"archive","page":89,"of":108,"url":"/task/machine-translation/papers/89","json":"/task/machine-translation/papers/89.json","rows":100},{"order":"archive","page":90,"of":108,"url":"/task/machine-translation/papers/90","json":"/task/machine-translation/papers/90.json","rows":100},{"order":"archive","page":91,"of":108,"url":"/task/machine-translation/papers/91","json":"/task/machine-translation/papers/91.json","rows":100},{"order":"archive","page":92,"of":108,"url":"/task/machine-translation/papers/92","json":"/task/machine-translation/papers/92.json","rows":100},{"order":"archive","page":93,"of":108,"url":"/task/machine-translation/papers/93","json":"/task/machine-translation/papers/93.json","rows":100},{"order":"archive","page":94,"of":108,"url":"/task/machine-translation/papers/94","json":"/task/machine-translation/papers/94.json","rows":100},{"order":"archive","page":95,"of":108,"url":"/task/machine-translation/papers/95","json":"/task/machine-translation/papers/95.json","rows":100},{"order":"archive","page":96,"of":108,"url":"/task/machine-translation/papers/96","json":"/task/machine-translation/papers/96.json","rows":100},{"order":"archive","page":97,"of":108,"url":"/task/machine-translation/papers/97","json":"/task/machine-translation/papers/97.json","rows":100},{"order":"archive","page":98,"of":108,"url":"/task/machine-translation/papers/98","json":"/task/machine-translation/papers/98.json","rows":100},{"order":"archive","page":99,"of":108,"url":"/task/machine-translation/papers/99","json":"/task/machine-translation/papers/99.json","rows":100},{"order":"archive","page":100,"of":108,"url":"/task/machine-translation/papers/100","json":"/task/machine-translation/papers/100.json","rows":100},{"order":"archive","page":101,"of":108,"url":"/task/machine-translation/papers/101","json":"/task/machine-translation/papers/101.json","rows":100},{"order":"archive","page":102,"of":108,"url":"/task/machine-translation/papers/102","json":"/task/machine-translation/papers/102.json","rows":100},{"order":"archive","page":103,"of":108,"url":"/task/machine-translation/papers/103","json":"/task/machine-translation/papers/103.json","rows":100},{"order":"archive","page":104,"of":108,"url":"/task/machine-translation/papers/104","json":"/task/machine-translation/papers/104.json","rows":100},{"order":"archive","page":105,"of":108,"url":"/task/machine-translation/papers/105","json":"/task/machine-translation/papers/105.json","rows":100},{"order":"archive","page":106,"of":108,"url":"/task/machine-translation/papers/106","json":"/task/machine-translation/papers/106.json","rows":100},{"order":"archive","page":107,"of":108,"url":"/task/machine-translation/papers/107","json":"/task/machine-translation/papers/107.json","rows":100},{"order":"archive","page":108,"of":108,"url":"/task/machine-translation/papers/108","json":"/task/machine-translation/papers/108.json","rows":52},{"order":"ran","page":1,"of":5,"url":"/task/machine-translation/papers/ran/1","json":"/task/machine-translation/papers/ran/1.json","rows":100},{"order":"ran","page":2,"of":5,"url":"/task/machine-translation/papers/ran/2","json":"/task/machine-translation/papers/ran/2.json","rows":100},{"order":"ran","page":3,"of":5,"url":"/task/machine-translation/papers/ran/3","json":"/task/machine-translation/papers/ran/3.json","rows":100},{"order":"ran","page":4,"of":5,"url":"/task/machine-translation/papers/ran/4","json":"/task/machine-translation/papers/ran/4.json","rows":100},{"order":"ran","page":5,"of":5,"url":"/task/machine-translation/papers/ran/5","json":"/task/machine-translation/papers/ran/5.json","rows":77}],"description_links":{"kept":0,"unwrapped_to_text":0,"bare_urls_linked":0,"relative_images_dropped":0,"rule":"internal links are kept only when the target slug exists in the catalog"},"syntology":{"read_at":"2026-10-05T00:36:11+00:00","claim":"Per-sample execution status on synthesized fixtures ('ran N of M samples'); not a correctness claim and not a ranking signal.","status_vocabulary":{"ran_honours":"ran, honoured the contract we drafted","ran_violates":"ran, violated the contract we drafted","ran_draft_wrong":"ran; our contract draft was wrong, not the code","ran_fixture":"ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT)","ran":"ran on a synthesized input","unverified":"unverified (harvested, no recorded run)"},"row_route":"each syntology object on a benchmark's first row and on a paper carries sample_list (this site's paper page, #ran), syntology_url (syntology.ai's page for the paper, only when that route probed live) and mcp (the agent call that lists the paper's harvested samples; not a verdict on the paper)","developers":"https://syntology.ai/developers"},"not_shown":{"libraries":"the archive has no per-task library table","trend_sparklines":"the Trend column of the benchmarks table was a rendered image; it is not in the archive","social_and_latest_sorts":"stars and social signals are not in the archive"},"record_sha256":"06cbb6d47d6eaf163d2a805d09ca795e7087014d0dee1bb66c2ef6ed7535b398","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}