Browse State-of-the-Art › Cross-Lingual Natural Language Inference
Cross-Lingual Natural Language Inference
17 papers with code · 4 benchmarks · 2 datasets archive 2025-07-28
Using data and models available for one language for which ample such resources are available (e.g., English) to solve a natural language inference task in another, commonly more low-resource, language.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
4 leaderboard tables shown for this task, 4 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
Syntology 2 newer papers were judged to report on this task's benchmarks so far (Claude Sonnet 4.5, reading their tables: a model's judgement, not a result; 0 placed): XNLI (2 judged, 0 placed). Drawn from 8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read).
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| XNLI (5 rows) | ByT5 XXL | ByT5: Towards a token-free future with pre-trained byte-to-byte models | code | Syntology official (archive's flag): 4 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified | Compare |
| XNLI Zero-Shot English-to-Spanish (4 rows) | XLM-R R4F | Better Fine-Tuning by Reducing Representational Collapse | code | — | Compare |
| XNLI Zero-Shot English-to-German (4 rows) | XLM-R R4F | Better Fine-Tuning by Reducing Representational Collapse | code | — | Compare |
| XNLI Zero-Shot English-to-French (3 rows) | XLM-R R4F | Better Fine-Tuning by Reducing Representational Collapse | code | — | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
2 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 31 · with a code link: 17 · where Syntology ran a sample: 7 (7 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (7 of 31 tagged: 7 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 31 of 31, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
11 Oct 2018 534 repositories listed Syntology official: no sample here; runs from other or unrecorded repositories · 300 ran (of which 75 constructed an object rather than computing a result; 234 with no instrument failure: 18 honoured, 5 violated, 211 with no contract checked; 66 where Syntology's instrument failed) · 359 unverified (of 659 harvested samples) · 164 pointer-only (licence)We introduce a new language representation model called BERT, which stands for Bidirectional Encoder Representations from Transformers.
-
5 May 2017 23 repositories listed Syntology official (archive's flag): 3 ran · 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 7 pointer-only (licence)Many modern NLP systems rely on word embeddings, previously trained in an unsupervised manner on large corpora, as base features.
-
26 Dec 2018 13 repositories listed Syntology community repositories only · 10 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 2 honoured, 0 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 10 harvested samples) · 4 pointer-only (licence)We introduce an architecture to learn joint multilingual sentence representations for 93 languages, belonging to more than 30 different families and written in 28 different scripts.
-
13 Sep 2018 9 repositories listedState-of-the-art natural language processing systems rely on supervision in the form of annotated data to learn competent models.
-
28 May 2021 5 repositories listed Syntology official (archive's flag): 4 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)Most widely-used pre-trained language models operate on sequences of tokens corresponding to word or subword units.
-
24 Oct 2020 4 repositories listedWe re-evaluate the standard practice of sharing weights between input and output embeddings in state-of-the-art pre-trained language models.
-
6 Aug 2020 3 repositories listedAlthough widely adopted, existing approaches for fine-tuning pre-trained language models have been shown to be unstable across hyper-parameter settings, motivating recent work on trust region methods.
-
1 Aug 2024 1 repository listedSynthetically created Cross-Lingual Summarisation (CLS) datasets are prone to include document-summary pairs where the reference summary is unfaithful to the corresponding document as it contains content not supported…
-
2 Aug 2023 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples)In this work, we introduce a new approach called self-translate, which overcomes the need of an external translation system by leveraging the few-shot translation capabilities of multilingual language models.
-
22 May 2023 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)In this paper, we propose a novel Soft prompt learning framework with the Multilingual Verbalizer (SoftMV) for XNLI.
-
19 May 2022 1 repository listedWe took natural language processing (NLP) as an example to show how Nebula-I works in different training phases that include: a) pre-training a multilingual language model using two remote clusters; and b) fine-tuning a…
-
1 May 2022 1 repository listedCross-lingual natural language inference (XNLI) is a fundamental task in cross-lingual natural language understanding.
-
16 Apr 2022 1 repository listedFor multilingual sequence-to-sequence pretrained language models (multilingual Seq2Seq PLMs), e. g. mBART, the self-supervised pretraining task is trained on a wide range of monolingual languages, e. g.
-
15 Apr 2022 1 repository listedRecent studies report that autoregressive language models can successfully solve many NLP tasks via zero- and few-shot learning paradigms, which opens up new possibilities for using the pre-trained language models.
-
9 Sep 2021 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)State-of-the-art multilingual systems rely on shared vocabularies that sufficiently cover all considered languages.
-
4 Aug 2021 1 repository listedDespite the success of multilingual sequence-to-sequence pretraining, most existing approaches rely on monolingual corpora, and do not make use of the strong cross-lingual signal contained in parallel data.
-
3 Jun 2021 1 repository listedCross-lingual language tasks typically require a substantial amount of annotated data or parallel translation data.
-
Cross-Document Cross-Lingual NLI via RST-Enhanced Graph Fusion and Interpretability Prediction11 Apr 2025 0 repositories listedNatural Language Inference (NLI) is a fundamental task in natural language processing.
-
Robust Unsupervised Cross-Lingual Word Embedding using Domain Flow Interpolation7 Oct 2022 0 repositories listedThis paper investigates an unsupervised approach towards deriving a universal, cross-lingual word embedding space, where words with similar semantics from different languages are close to one another.
-
Alexa Teacher Model: Pretraining and Distilling Multi-Billion-Parameter Encoders for Natural Language Understanding Systems15 Jun 2022 0 repositories listedWe present results from a large-scale experiment on pretraining encoders with non-embedding parameter counts ranging from 700M to 9.3B, their subsequent distillation into smaller models ranging from 17M-170M parameters…
-
A Deep Transfer Learning Method for Cross-Lingual Natural Language Inference1 Jun 2022 0 repositories listedNatural Language Inference (NLI), also known as Recognizing Textual Entailment (RTE), has been one of the central tasks in Artificial Intelligence (AI) and Natural Language Processing (NLP).
-
PARADISE”:" Exploiting Parallel Data for Multilingual Sequence-to-Sequence Pretraining1 May 2022 0 repositories listedDespite the success of multilingual sequence-to-sequence pretraining, most existing approaches rely on monolingual corpora and do not make use of the strong cross-lingual signal contained in parallel data.
-
Data Augmentation with Adversarial Training for Cross-Lingual NLI1 Aug 2021 0 repositories listedDue to recent pretrained multilingual representation models, it has become feasible to exploit labeled data from one language to train a cross-lingual model that can then be applied to multiple new languages.
-
Soft Layer Selection with Meta-Learning for Zero-Shot Cross-Lingual Transfer21 Jul 2021 0 repositories listedMultilingual pre-trained contextual embedding models (Devlin et al., 2019) have achieved impressive performance on zero-shot cross-lingual transfer tasks.
-
Cross-Lingual Transfer with MAML on Trees1 Apr 2021 0 repositories listedIn meta-learning, the knowledge learned from previous tasks is transferred to new ones, but this transfer only works if tasks are related.
-
SILT: Efficient transformer training for inter-lingual inference17 Mar 2021 0 repositories listedThe ability of transformers to perform precision tasks such as question answering, Natural Language Inference (NLI) or summarising, have enabled them to be ranked as one of the best paradigm to address Natural Language…
-
Meta-Learning with MAML on Trees8 Mar 2021 0 repositories listedIn meta-learning, the knowledge learned from previous tasks is transferred to new ones, but this transfer only works if tasks are related.
-
On Learning Universal Representations Across Languages31 Jul 2020 0 repositories listedRecent studies have demonstrated the overwhelming advantage of cross-lingual pre-trained models (PTMs), such as multilingual BERT and XLM, on cross-lingual NLP tasks.
-
Meemi: A Simple Method for Post-processing and Integrating Cross-lingual Word Embeddings16 Oct 2019 0 repositories listedWhile monolingual word embeddings encode information about words in the context of a particular language, cross-lingual embeddings define a multilingual space where word embeddings from two or more languages are…
-
Unicoder: A Universal Language Encoder by Pre-training with Multiple Cross-lingual Tasks3 Sep 2019 0 repositories listedWe present Unicoder, a universal language encoder that is insensitive to different languages.
-
XLDA: Cross-Lingual Data Augmentation for Natural Language Inference and Question Answering27 May 2019 0 repositories listed
Syntology lines on 7 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections