Browse State-of-the-Art › Semantic Similarity
Semantic Similarity
534 papers with code · 7 benchmarks · 17 datasets archive 2025-07-28
The main objective Semantic Similarity is to measure the distance between the semantic meanings of a pair of words, phrases, sentences, or documents. For example, the word “car” is more similar to “bus” than it is to “cat”. The two main approaches to measuring Semantic Similarity are knowledge-based approaches and corpus-based, distributional methods.
Source: Visual and Semantic Knowledge Transfer for Large Scale Semi-supervised Object Detection
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
27 leaderboard tables shown for this task, 7 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted. 10 shown of 27 until expanded.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| SICK (5 rows) | Dependency Tree-LSTM (Tai et al., 2015) | Improved Semantic Representations From Tree-Structured Long... | code | Syntology community repositories only · 12 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 6 where Syntology's instrument failed) · 3 unverified | Compare |
| Annotated corpus for semantic similarity of clinical trial outcomes (original corpus) (5 rows) | BioBERT (pre-trained on PubMed abstracts + PMC, fine-tuned on "Annotated corpus for semantic similarity of clinical trial outcomes, original corpus") | Measuring semantic similarity of clinical trial outcomes using... | — | — | Compare |
| Annotated corpus for semantic similarity of clinical trial outcomes (expanded corpus) (5 rows) | BioBERT (pre-trained on PubMed abstracts + PMC, fine-tuned on "Annotated corpus for semantic similarity of clinical trial outcomes, expanded corpus") | Measuring semantic similarity of clinical trial outcomes using... | — | — | Compare |
| BIOSSES (3 rows) | BioLinkBERT (large) | LinkBERT: Pretraining Language Models with Document Links | code | Syntology official: harvested, nothing ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 11 unverified | Compare |
| CHIP-STS (1 row) | MacBERT-large | CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmark | code | Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 0 violated, 7 with no contract checked; 3 where Syntology's instrument failed) · 5 unverified | Compare |
| ClinicalSTS (1 row) | CharacterBERT (base, medical, ensemble) | CharacterBERT: Reconciling ELMo and BERT for Word-Level... | code | Syntology community repositories only · 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified | Compare |
| MedSTS (1 row) | NCBI_BERT(base) (P+M) | Transfer Learning in Biomedical Natural Language Processing: An... | code | Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified | Compare |
| dev evaluation (0 rows) | no rows in the archive | — | — | ||
| JSTS (0 rows) | no rows in the archive | — | — | ||
| sts dev (0 rows) | no rows in the archive | — | — | ||
| sts dev 128 (0 rows) | no rows in the archive | — | — | ||
| sts dev 256 (0 rows) | no rows in the archive | — | — | ||
| sts dev 512 (0 rows) | no rows in the archive | — | — | ||
| sts dev 64 (0 rows) | no rows in the archive | — | — | ||
| sts dev 768 (0 rows) | no rows in the archive | — | — | ||
| sts test 128 (0 rows) | no rows in the archive | — | — | ||
| sts test 256 (0 rows) | no rows in the archive | — | — | ||
| sts test 512 (0 rows) | no rows in the archive | — | — | ||
| sts test 64 (0 rows) | no rows in the archive | — | — | ||
| sts test 768 (0 rows) | no rows in the archive | — | — | ||
| sts17 en ua (0 rows) | no rows in the archive | — | — | ||
| sts17 es en test (0 rows) | no rows in the archive | — | — | ||
| sts17 ua ua (0 rows) | no rows in the archive | — | — | ||
| stsb multi mt en (0 rows) | no rows in the archive | — | — | ||
| stsb tr (0 rows) | no rows in the archive | — | — | ||
| test t (0 rows) | no rows in the archive | — | — | ||
| Unknown (0 rows) | no rows in the archive | — | — | ||
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
17 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
2 subtasks in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 1,564 · with a code link: 534 · where Syntology ran a sample: 102 (82 with a run with no instrument failure, 20 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (102 of 1,564 tagged: 82 with a run with no instrument failure, 20 where every run was a failure of Syntology's instrument)
Page 1 of 16: papers 1 to 100 of 1,564, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
27 Aug 2019 64 repositories listed Syntology community repositories only · 33 ran (of which 9 constructed an object rather than computing a result; 30 with no instrument failure: 1 honoured, 0 violated, 29 with no contract checked; 3 where Syntology's instrument failed) · 25 unverified (of 58 harvested samples) · 11 pointer-only (licence)However, it requires that both sentences are fed into the network, which causes a massive computational overhead: Finding the most similar pair in a collection of 10, 000 sentences requires about 50 million inference…
-
19 Apr 2019 19 repositories listed Syntology community repositories only · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)We present a novel language representation model enhanced by knowledge called ERNIE (Enhanced Representation through kNowledge IntEgration).
-
28 Feb 2015 16 repositories listed Syntology community repositories only · 12 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 6 where Syntology's instrument failed) · 3 unverified (of 15 harvested samples) · 6 pointer-only (licence)Because of their superior ability to preserve sequence information over time, Long Short-Term Memory (LSTM) networks, a type of recurrent neural network with a more complex computational unit, have obtained strong…
-
11 Jun 2018 13 repositories listedWe demonstrate that large gains on these tasks can be realized by generative pre-training of a language model on a diverse corpus of unlabeled text, followed by discriminative fine-tuning on each specific task.
-
3 Jul 2020 6 repositories listedWhile BERT is an effective method for learning monolingual sentence embeddings for semantic similarity and embedding based transfer learning (Reimers and Gurevych, 2019), BERT based cross-lingual sentence embeddings…
-
28 Aug 2018 5 repositories listedA subset of MedSTS (MedSTS_ann) containing 1, 068 sentence pairs was annotated by two medical experts with semantic similarity scores of 0-5 (low to high similarity).
-
13 Jun 2019 4 repositories listed Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
15 Feb 2018 4 repositories listedTo calculate the semantic similarity between words and sentences, the proposed method follows an edge-based approach using a lexical database.
-
2 Sep 2024 3 repositories listedThrough extensive experimental analysis, we identified three key challenges in designing effective data management strategies that enable the model to achieve long-context capability without sacrificing performance in…
-
18 Mar 2021 3 repositories listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)Current video retrieval efforts all found their evaluation on an instance-based assumption, that only a single caption is relevant to a query video and vice versa.
-
29 Dec 2020 3 repositories listed Syntology official (archive's flag): 4 ran · 6 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 5 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 6 pointer-only (licence)Our proposed attack strategy leverages population-based optimization algorithm to craft plausible and semantically similar adversarial examples by observing only the top label predicted by the target model.
-
2 Nov 2020 3 repositories listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)Pre-trained contextual representations like BERT have achieved great success in natural language processing.
-
17 Sep 2019 3 repositories listedWe present a scenario where semantic similarity is not enough, and we devise a neural approach to learn semantic relatedness.
-
27 Jul 2019 3 repositories listed Syntology official: harvested for another paper · 0 ran · 1 unverified (of 1 harvested sample)An HNN consists of two component models, a masked language model and a semantic similarity model, which share a BERT-based contextual encoder but use different model-specific input and output layers.
-
4 Nov 2018 3 repositories listedTherefore, we propose a novel sample mining method, called Online Soft Mining (OSM), which assigns one continuous score to each sample to make use of all samples in the mini-batch.
-
20 Aug 2017 3 repositories listedWord embeddings have been found to provide meaningful representations for words in an efficient way; therefore, they have become common in Natural Language Processing sys- tems.
-
17 Feb 2016 3 repositories listedCurrent systems of fine-grained entity typing use distant supervision in conjunction with existing knowledge bases to assign categories (type labels) to entity mentions.
-
20 Sep 2024 2 repositories listedIn the second stage, LoFI leverages a pre-trained language model with a novel prompt-based tuning method to extract fine-grained information of interest from the collected logs.
-
19 Sep 2024 2 repositories listedOur large-scale experiments, spanning 100+ LLMs and 150k minimal pairs in three languages, reveal properties of linguistic similarity from four key aspects: consistency across LLMs, relation to theoretical…
-
2 Apr 2024 2 repositories listed Syntology official (archive's flag): 12 ran · 12 ran (of which 7 constructed an object rather than computing a result; 11 with no instrument failure: 1 honoured, 0 violated, 10 with no contract checked; 1 where Syntology's instrument failed) · 6 unverified (of 18 harvested samples) · 2 pointer-only (licence)Conditional sound separation in multi-source audio mixtures without having access to single source sound data during training is a long standing challenge.
-
13 Feb 2024 2 repositories listed Syntology 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)Exploring and quantifying semantic relatedness is central to representing language and holds significant implications across various NLP tasks.
-
16 Dec 2023 2 repositories listedDef2Vec introduces a novel paradigm for word embeddings, leveraging dictionary definitions to learn semantic representations.
-
9 Nov 2023 2 repositories listed Syntology community repositories only · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 7 harvested samples)Most recent studies employed large language models (LLMs) to learn sentence embeddings.
-
20 Oct 2023 2 repositories listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)But to achieve these results, LMs must be trained in distinctly un-human-like ways - requiring orders of magnitude more language data than children receive during development, and without perceptual or social context.
-
24 Aug 2023 2 repositories listedIn this work, we use a multilingual knowledge distillation approach to train BERT models to produce sentence embeddings for Ancient Greek text.
-
18 Jul 2023 2 repositories listed Syntology official: harvested, nothing ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 1 pointer-only (licence)In addition, to enable a flexible knowledge distillation scheme for each data point in novel classes, we develop a learnable weighting function for the regularization, which adaptively promotes knowledge transfer based…
-
30 May 2023 2 repositories listed Syntology official (archive's flag): 4 ran · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 1 pointer-only (licence)Our pipeline enhances the generation quality of image variations by aligning the image generation process to the source image's inversion chain.
-
26 May 2023 2 repositories listedAlignScore is based on a general function of information alignment between two arbitrary text pieces.
-
23 May 2023 2 repositories listedHowever, if we want to use a new tokenizer specialized for the target language, we cannot transfer the source model's embedding matrix.
-
19 May 2023 2 repositories listedLarge Language Models (LLMs), such as ChatGPT, greatly empower dialogue systems with strong language understanding and generation capabilities.
-
21 Dec 2022 2 repositories listed
-
29 Nov 2022 2 repositories listed
-
26 Sep 2022 2 repositories listed
-
29 Jun 2022 2 repositories listed
-
5 Mar 2022 2 repositories listed
-
9 Dec 2021 2 repositories listed
-
29 Nov 2021 2 repositories listed
-
25 Oct 2021 2 repositories listed Syntology community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
10 Oct 2021 2 repositories listed Syntology community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
-
23 Aug 2021 2 repositories listed
-
15 Jun 2021 2 repositories listed Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 0 violated, 7 with no contract checked; 3 where Syntology's instrument failed) · 5 unverified (of 16 harvested samples) · 2 pointer-only (licence)
-
20 Apr 2021 2 repositories listed
-
11 Apr 2021 2 repositories listed
-
22 Mar 2021 2 repositories listed
-
13 Dec 2020 2 repositories listed
-
3 Dec 2020 2 repositories listed
-
20 Oct 2020 2 repositories listed Syntology community repositories only · 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples) · 4 pointer-only (licence)
-
19 Aug 2020 2 repositories listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
4 May 2020 2 repositories listed Syntology official (archive's flag): 1 ran · 3 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
30 Apr 2020 2 repositories listed
-
27 Mar 2020 2 repositories listed
-
26 Feb 2020 2 repositories listed
-
25 Dec 2019 2 repositories listed
-
10 Nov 2019 2 repositories listed
-
9 Jul 2019 2 repositories listed
-
8 Mar 2019 2 repositories listed Syntology community repositories only · 9 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 12 harvested samples) · 1 pointer-only (licence)
-
1 Oct 2018 2 repositories listed
-
4 Sep 2018 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
14 Aug 2018 2 repositories listed
-
17 Jul 2018 2 repositories listed
-
16 Feb 2018 2 repositories listed
-
14 Jul 2017 2 repositories listed
-
1 Jun 2017 2 repositories listed
-
21 Mar 2017 2 repositories listed
-
2 Mar 2016 2 repositories listed
-
29 Nov 1995 2 repositories listed
-
6 Jul 2025 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 4 unverified (of 9 harvested samples) · 9 pointer-only (licence)
-
17 Jun 2025 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
11 Jun 2025 1 repository listed
-
9 Jun 2025 1 repository listed
-
7 Jun 2025 1 repository listed
-
1 Jun 2025 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 1 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
30 May 2025 1 repository listed
-
30 May 2025 1 repository listed
-
29 May 2025 1 repository listed
-
26 May 2025 1 repository listed
-
26 May 2025 1 repository listed
-
25 May 2025 1 repository listed
-
24 May 2025 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 2 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 6 unverified (of 12 harvested samples) · 12 pointer-only (licence)
-
22 May 2025 1 repository listed
-
22 May 2025 1 repository listed
-
22 May 2025 1 repository listed
-
21 May 2025 1 repository listed
-
21 May 2025 1 repository listed
-
20 May 2025 1 repository listed
-
20 May 2025 1 repository listed
-
19 May 2025 1 repository listed
-
19 May 2025 1 repository listed
-
17 May 2025 1 repository listed
-
16 May 2025 1 repository listed
-
12 May 2025 1 repository listed
-
12 May 2025 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
30 Apr 2025 1 repository listed
-
18 Apr 2025 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 2 unverified (of 2 harvested samples)
-
17 Apr 2025 1 repository listed
-
31 Mar 2025 1 repository listed
-
26 Mar 2025 1 repository listed
-
19 Mar 2025 1 repository listed Syntology official (archive's flag): 25 ran · 25 ran (of which 15 constructed an object rather than computing a result; 20 with no instrument failure: 0 honoured, 0 violated, 20 with no contract checked; 5 where Syntology's instrument failed) · 14 unverified (of 39 harvested samples) · 39 pointer-only (licence)
Syntology lines on 31 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections