Browse State-of-the-Art › STS
STS
129 papers with code · 0 benchmarks · 4 datasets archive 2025-07-28
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
4 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 334 · with a code link: 129 · where Syntology ran a sample: 28 (24 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (28 of 334 tagged: 24 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument)
Page 1 of 4: papers 1 to 100 of 334, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
27 Aug 2019 64 repositories listed Syntology community repositories only · 33 ran (of which 9 constructed an object rather than computing a result; 30 with no instrument failure: 1 honoured, 0 violated, 29 with no contract checked; 3 where Syntology's instrument failed) · 25 unverified (of 58 harvested samples) · 11 pointer-only (licence)However, it requires that both sentences are fed into the network, which causes a massive computational overhead: Finding the most similar pair in a collection of 10, 000 sentences requires about 50 million inference…
-
18 Apr 2021 23 repositories listed Syntology community repositories only · 17 ran (of which 9 constructed an object rather than computing a result; 12 with no instrument failure: 1 honoured, 0 violated, 11 with no contract checked; 5 where Syntology's instrument failed) · 13 unverified (of 30 harvested samples) · 19 pointer-only (licence)This paper presents SimCSE, a simple contrastive learning framework that greatly advances state-of-the-art sentence embeddings.
-
14 Apr 2021 6 repositories listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)Learning sentence embeddings often requires a large amount of labeled data.
-
13 Oct 2022 5 repositories listed Syntology community repositories only · 10 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (of 13 harvested samples)MTEB spans 8 embedding tasks covering a total of 58 datasets and 112 languages.
-
28 Aug 2018 5 repositories listedA subset of MedSTS (MedSTS_ann) containing 1, 068 sentence pairs was annotated by two medical experts with semantic similarity scores of 0-5 (low to high similarity).
-
7 Apr 2020 3 repositories listedAlthough several benchmark datasets for those tasks have been released in English and a few other languages, there are no publicly available NLI or STS datasets in the Korean language.
-
SemEval-2017 Task 1: Semantic Textual Similarity - Multilingual and Cross-lingual Focused Evaluation31 Jul 2017 3 repositories listedSemantic Textual Similarity (STS) measures the meaning similarity of sentences.
-
14 Jun 2024 2 repositories listedSemantic Textual Similarity (STS) constitutes a critical research direction in computational linguistics and serves as a key indicator of the encoding capabilities of embedding models.
-
8 Jun 2024 2 repositories listedSince the introduction of BERT and RoBERTa, research on Semantic Textual Similarity (STS) has made groundbreaking progress.
-
13 Feb 2024 2 repositories listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)To our knowledge, this is the first representation learning method devoid of traditional language models for understanding sentence and document semantics, marking a stride closer to human-like textual comprehension.
-
9 Nov 2023 2 repositories listed Syntology community repositories only · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 7 harvested samples)Most recent studies employed large language models (LLMs) to learn sentence embeddings.
-
22 Sep 2023 2 repositories listedThis novel approach effectively mitigates the adverse effects of the saturation zone in the cosine function, which can impede gradient and hinder optimization processes.
-
8 Oct 2022 2 repositories listedContrastive learning has been extensively studied in sentence embedding learning, which assumes that the embeddings of different views of the same sentence are closer.
-
ESimCSE: Enhanced Sample Building Method for Contrastive Learning of Unsupervised Sentence Embedding9 Sep 2021 2 repositories listedUnsup-SimCSE takes dropout as a minimal data augmentation method, and passes the same input sentence to a pre-trained Transformer encoder (with dropout turned on) twice to obtain the two corresponding embeddings to…
-
9 Sep 2021 2 repositories listedContrastive learning has been gradually applied to learn high-quality unsupervised sentence embedding.
-
19 Aug 2021 2 repositories listedTo support our investigation, we establish a new sentence representation transfer benchmark, SentGLUE, which extends the SentEval toolkit to nine tasks from the GLUE benchmark.
-
22 Mar 2021 2 repositories listedThis study provides an efficient approach for using text data to calculate patent-to-patent (p2p) technological similarity, and presents a hybrid framework for leveraging the resulting p2p similarity for applications…
-
27 Nov 2020 2 repositories listedIn this paper, we propose FFCI, a framework for fine-grained summarization evaluation that comprises four elements: faithfulness (degree of factual consistency with the source), focus (precision of summary content…
-
30 Apr 2019 2 repositories listedRecent literature suggests that averaged word vectors followed by simple post-processing outperform many deep learning methods on semantic textual similarity tasks.
-
19 May 2025 1 repository listedPrevious studies usually focus on prompt engineering to guide LLMs to encode the core semantic information of the sentence into the embedding of the last token.
-
4 May 2025 1 repository listedEmbedding layers in transformer-based NLP models typically account for the largest share of model parameters, scaling with vocabulary size but not yielding performance gains proportional to scale.
-
12 Mar 2025 1 repository listedSuch sentence embeddings can be further enhanced by domain adaptation that adapts a backbone model to a specific domain.
-
9 Mar 2025 1 repository listedVisual Place Recognition (VPR) is a crucial capability for long-term autonomous robots, enabling them to identify previously visited locations using visual information.
-
16 Feb 2025 1 repository listedEmbedding models play a crucial role in representing and retrieving information across various NLP applications.
-
26 Nov 2024 1 repository listedIn this reproducibility study, we implement and evaluate both versions of 2D Matryoshka Training on STS tasks and extend our analysis to retrieval tasks.
-
26 Nov 2024 1 repository listed Syntology 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result (of 2 harvested samples)Thompson sampling (TS) has optimal regret and excellent empirical performance in multi-armed bandit problems.
-
18 Oct 2024 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples) · 3 pointer-only (licence)Training-free embedding methods directly leverage pretrained large language models (LLMs) to embed text, bypassing the costly and complex procedure of contrastive learning.
-
13 Sep 2024 1 repository listedThe results on the monolingual tasks confirmed that our representations exhibited a competitive performance compared to that of the previous study for the context-aware lexical semantic tasks and outperformed it for STS…
-
28 Aug 2024 1 repository listedThis paper examines the Code-Switching (CS) phenomenon where two languages intertwine within a single utterance.
-
1 Aug 2024 1 repository listedThroughout rapid development of multimodal large language models, a crucial ingredient is a fair and accurate evaluation of their multimodal comprehension abilities.
-
1 Aug 2024 1 repository listed
-
13 Jul 2024 1 repository listed
-
6 Jun 2024 1 repository listed
-
5 Jun 2024 1 repository listed
-
25 May 2024 1 repository listed Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 0 violated, 5 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 10 harvested samples) · 10 pointer-only (licence)
-
14 May 2024 1 repository listed
-
19 Apr 2024 1 repository listed
-
11 Apr 2024 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 7 harvested samples)
-
9 Apr 2024 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 6 pointer-only (licence)
-
2 Apr 2024 1 repository listed
-
26 Mar 2024 1 repository listed
-
28 Feb 2024 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
28 Feb 2024 1 repository listed
-
23 Feb 2024 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
22 Feb 2024 1 repository listed
-
20 Feb 2024 1 repository listed
-
20 Feb 2024 1 repository listed
-
24 Jan 2024 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
23 Jan 2024 1 repository listed
-
5 Jan 2024 1 repository listed
-
9 Dec 2023 1 repository listed
-
6 Nov 2023 1 repository listed
-
2 Nov 2023 1 repository listed
-
10 Oct 2023 1 repository listed
-
9 Oct 2023 1 repository listed
-
22 Sep 2023 1 repository listed
-
19 Aug 2023 1 repository listed
-
8 Aug 2023 1 repository listed
-
3 Aug 2023 1 repository listed
-
31 Jul 2023 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
6 Jun 2023 1 repository listed
-
28 May 2023 1 repository listed
-
26 May 2023 1 repository listed
-
24 May 2023 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 4 harvested samples) · 4 pointer-only (licence)
-
22 May 2023 1 repository listed
-
18 May 2023 1 repository listed
-
17 May 2023 1 repository listed
-
12 May 2023 1 repository listed
-
3 May 2023 1 repository listed
-
16 Mar 2023 1 repository listed
-
19 Jan 2023 1 repository listed
-
19 Dec 2022 1 repository listed
-
21 Nov 2022 1 repository listed
-
14 Nov 2022 1 repository listed
-
11 Nov 2022 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 1 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 10 harvested samples) · 5 pointer-only (licence)
-
30 Oct 2022 1 repository listed Syntology official: no sample here; runs from other or unrecorded repositories · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
16 Oct 2022 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 3 unverified (of 3 harvested samples)
-
5 Oct 2022 1 repository listed
-
1 Oct 2022 1 repository listed
-
14 Sep 2022 1 repository listed
-
13 Sep 2022 1 repository listed
-
9 Aug 2022 1 repository listed
-
1 Jul 2022 1 repository listed
-
25 Jun 2022 1 repository listed
-
20 Jun 2022 1 repository listed
-
6 Jun 2022 1 repository listed
-
30 May 2022 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
10 May 2022 1 repository listed
-
9 May 2022 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (of 5 harvested samples)
-
6 May 2022 1 repository listed
-
3 May 2022 1 repository listed
-
1 May 2022 1 repository listed
-
24 Mar 2022 1 repository listed
-
15 Mar 2022 1 repository listed
-
14 Mar 2022 1 repository listed
-
11 Mar 2022 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
Exploring the Impact of Negative Samples of Contrastive Learning: A Case Study of Sentence Embedding26 Feb 2022 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
26 Feb 2022 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
28 Jan 2022 1 repository listed
-
16 Jan 2022 1 repository listed
Syntology lines on 24 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections