Browse State-of-the-Art › Pretrained Multilingual Language Models
Pretrained Multilingual Language Models
12 papers with code · 0 benchmarks · 1 dataset archive 2025-07-28
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
1 dataset whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 26 · with a code link: 12 · where Syntology ran a sample: 3 (3 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3 of 26 tagged: 3 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 26 of 26, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from.
-
11 Jan 2024 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples) · 8 pointer-only (licence)While these results are promising, follow-up works found that, within the multilingual embedding spaces, there exists strong language identity information which hinders the expression of linguistic factors shared across…
-
30 Oct 2022 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)This crucial step is done via 1) creating a word similarity dataset, comprising positive word pairs (i. e., true translations) and hard negative pairs induced from the original CLWE space, and then 2) fine-tuning an…
-
12 Oct 2022 1 repository listedMultilingual information retrieval (IR) is challenging since annotated training data is costly to obtain in many languages.
-
11 Oct 2022 1 repository listedPretrained multilingual language models can help bridge the digital language divide, enabling high-quality NLP models for lower resourced languages.
-
10 Oct 2022 1 repository listedTo benchmark the performance of pretrained multilingual language models, we construct noisy datasets covering five languages and four NLP tasks and observe a clear gap in the performance between clean and noisy data in…
-
30 Aug 2022 1 repository listedRecent advances in the field of abstractive summarization leverage pre-trained language models rather than train a model from scratch.
-
15 Mar 2022 1 repository listed Syntology official (archive's flag): 2 ran · 5 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples) · 4 pointer-only (licence)At Stage C1, we propose to refine standard cross-lingual linear maps between static word embeddings (WEs) via a contrastive learning objective; we also show how to integrate it into the self-learning procedure for even…
-
16 Nov 2021 1 repository listedAs Stage C1, we propose to refine standard cross-lingual linear maps between static word embeddings (WEs) via a contrastive learning objective; we also show how to integrate it into the self-learning procedure for even…
-
1 Nov 2021 1 repository listedIn this work, we challenge this assumption and present the first attempt at training a multilingual language model on only low-resource languages.
-
16 Jun 2021 1 repository listedPretrained multilingual language models have become a common tool in transferring NLP capabilities to low-resource languages, often with adaptations.
-
19 May 2021 1 repository listedIn this paper, we revisit math word problems (MWPs) from the cross-lingual and multilingual perspective.
-
31 Dec 2020 1 repository listedIn this work, we provide a systematic and comprehensive empirical comparison of pretrained multilingual language models versus their monolingual counterparts with regard to their monolingual task performance.
-
OpenNER 1.0: Standardized Open-Access Named Entity Recognition Datasets in 50+ Languages12 Dec 2024 0 repositories listedWe present OpenNER 1.0, a standardized collection of openly available named entity recognition (NER) datasets.
-
Empirical study of pretrained multilingual language models for zero-shot cross-lingual knowledge transfer in generation15 Oct 2023 0 repositories listedZero-shot cross-lingual knowledge transfer enables the multilingual pretrained language model (mPLM), finetuned on a task in one language, make predictions for this task in other languages.
-
9 Oct 2023 0 repositories listedMultilingual language models have gained significant attention in recent years, enabling the development of applications that meet diverse linguistic contexts.
-
Improving Non-autoregressive Translation Quality with Pretrained Language Model, Embedding Distillation and Upsampling Strategy for CTC10 Jun 2023 0 repositories listedNon-autoregressive approaches aim to improve the inference speed of translation models, particularly those that generate output in a one-pass forward manner.
-
Probing Cross-Lingual Lexical Knowledge from Multilingual Sentence Encoders30 Apr 2022 0 repositories listedPretrained multilingual language models (LMs) can be successfully transformed into multilingual sentence encoders (SEs; e.g., LaBSE, xMPNet) via additional fine-tuning or model distillation with parallel data.
-
Team ÚFAL at CMCL 2022 Shared Task: Figuring out the correct recipe for predicting Eye-Tracking features using Pretrained Language Models11 Apr 2022 0 repositories listedEye-Tracking data is a very useful source of information to study cognition and especially language comprehension in humans.
-
Out of Thin Air: Is Zero-Shot Cross-Lingual Keyword Detection Better Than Unsupervised?14 Feb 2022 0 repositories listedKeyword extraction is the task of retrieving words that are essential to the content of a given document.
-
Are Pretrained Multilingual Models Equally Fair Across Languages?16 Jan 2022 0 repositories listedPretrained multilingual language models can help bridge the digital language divide, enabling high-quality NLP models for lower-resourced languages.
-
Investigating Math Word Problems using Pretrained Multilingual Language Models16 Jan 2022 0 repositories listedIn this paper, we revisit math word problems (MWPs) from the cross-lingual and multilingual perspective.We construct our MWP solvers over pretrained multilingual language models using the sequence-to-sequence model with…
-
Multi-Source Cross-Lingual Constituency Parsing1 Dec 2021 0 repositories listedPretrained multilingual language models have become a key part of cross-lingual transfer for many natural language processing tasks, even those without bilingual information.
-
Transliteration: A Simple Technique For Improving Multilingual Language Modeling29 Sep 2021 0 repositories listedWhile impressive performance in natural language processing tasks has been achieved for many languages by transfer learning from large pretrained multilingual language models, it is limited by the unavailability of…
-
Rumour Detection via Zero-shot Cross-lingual Transfer Learning27 Sep 2021 0 repositories listedMost rumour detection models for social media are designed for one specific language (mostly English).
-
The Effectiveness of Intermediate-Task Training for Code-Switched Natural Language Understanding21 Jul 2021 0 repositories listedWhile recent benchmarks have spurred a lot of new work on improving the generalization of pretrained multilingual language models on multilingual tasks, techniques to improve code-switched natural language understanding…
-
A Primer on Pretrained Multilingual Language Models1 Jul 2021 0 repositories listedMultilingual Language Models (\MLLMs) such as mBERT, XLM, XLM-R, etc. have emerged as a viable option for bringing the power of pretraining to a large number of languages.
Syntology lines on 3 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections