Browse State-of-the-Art › Passage Retrieval
Passage Retrieval
133 papers with code · 5 benchmarks · 10 datasets archive 2025-07-28
Passage retrieval is a specialized type of IR application that retrieves relevant passages (or pieces of text) rather than an entire ranked set of documents.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
19 leaderboard tables shown for this task, 5 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted. 10 shown of 19 until expanded.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| MSMARCO (BEIR) (12 rows) | BM25+CE | BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of... | code | Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified | Compare |
| Natural Questions (10 rows) | ReAtt | Retrieval as Attention: End-to-end Learning of Retrieval and... | code | — | Compare |
| PeerQA (8 rows) | SPLADEv3 | SPLADE-v3: New baselines for SPLADE | code | Syntology 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified | Compare |
| EntityQuestions (7 rows) | TOME-2 | Mention Memory: incorporating textual knowledge into Transformers... | code | — | Compare |
| MS MARCO (1 row) | TW-BERT | End-to-End Query Term Weighting | code | — | Compare |
| mMARCO-ar (0 rows) | no rows in the archive | — | — | ||
| mMARCO-de (0 rows) | no rows in the archive | — | — | ||
| mMARCO-en (0 rows) | no rows in the archive | — | — | ||
| mMARCO-es (0 rows) | no rows in the archive | — | — | ||
| mMARCO-fr (0 rows) | no rows in the archive | — | — | ||
| mMARCO-hi (0 rows) | no rows in the archive | — | — | ||
| mMARCO-id (0 rows) | no rows in the archive | — | — | ||
| mMARCO-it (0 rows) | no rows in the archive | — | — | ||
| mMARCO-ja (0 rows) | no rows in the archive | — | — | ||
| mMARCO-nl (0 rows) | no rows in the archive | — | — | ||
| mMARCO-pt (0 rows) | no rows in the archive | — | — | ||
| mMARCO-ru (0 rows) | no rows in the archive | — | — | ||
| mMARCO-vi (0 rows) | no rows in the archive | — | — | ||
| mMARCO-zh (0 rows) | no rows in the archive | — | — | ||
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
10 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 268 · with a code link: 133 · where Syntology ran a sample: 34 (28 with a run with no instrument failure, 6 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (34 of 268 tagged: 28 with a run with no instrument failure, 6 where every run was a failure of Syntology's instrument)
Page 1 of 3: papers 1 to 100 of 268, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
10 Apr 2020 19 repositories listed Syntology official: harvested, nothing ran · 11 ran (of which 6 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 14 harvested samples) · 9 pointer-only (licence)Open-domain question answering relies on efficient passage retrieval to select candidate contexts, where traditional sparse vector space models, such as TF-IDF or BM25, are the de facto method.
-
2 Jul 2020 8 repositories listedGenerative models for open domain question answering have proven to be competitive, without resorting to external knowledge.
-
16 Dec 2021 6 repositories listed Syntology community repositories only · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples) · 1 pointer-only (licence)In this work, we explore the limits of contrastive learning as a way to train unsupervised dense retrievers and show that it leads to strong performance in various retrieval settings.
-
13 Jan 2019 6 repositories listed Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 13 harvested samples) · 2 pointer-only (licence)Recently, neural models pretrained on a language modeling task, such as ELMo (Peters et al., 2017), OpenAI GPT (Radford et al., 2018), and BERT (Devlin et al., 2018), have achieved impressive results on various natural…
-
1 Jul 2020 5 repositories listed Syntology official (archive's flag): 10 ran · 11 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 0 violated, 7 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 12 harvested samples) · 3 pointer-only (licence)In this paper, we identify that the main bottleneck is in the training mechanisms, where the negative instances used in training are not representative of the irrelevant documents in testing.
-
4 Jul 2024 3 repositories listed Syntology official (archive's flag): 10 ran · 15 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 2 violated, 10 with no contract checked; 3 where Syntology's instrument failed) · 7 unverified (of 22 harvested samples)We introduce BM25S, an efficient Python-based implementation of BM25 that only depends on Numpy and Scipy.
-
20 Jan 2024 3 repositories listed Syntology official (archive's flag): 1 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)In this study, we aim to shed light on this issue by revealing that masked auto-encoder (MAE) pre-training with enhanced decoding significantly improves the term coverage of input tokens in dense representations…
-
23 May 2023 3 repositories listedThis drives us to build a benchmark for this task including multiple datasets from heterogeneous domains.
-
30 May 2022 3 repositories listedThis paper introduces our proposed system for the MIA Shared Task on Cross-lingual Open-retrieval Question Answering (COQA).
-
2 Dec 2021 3 repositories listed Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)Neural information retrieval (IR) has greatly advanced search and other knowledge-intensive language tasks.
-
17 Apr 2021 3 repositories listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)To address this, and to facilitate researchers to broadly evaluate the effectiveness of their models, we introduce Benchmarking-IR (BEIR), a robust and heterogeneous evaluation benchmark for information retrieval.
-
15 Nov 2023 2 repositories listed Syntology official (archive's flag): 14 ran · 15 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 1 honoured, 1 violated, 10 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 17 harvested samples) · 3 pointer-only (licence)While large language models (LLMs) are equipped with longer text input capabilities than before, they are struggling to seek correct information in long contexts.
-
12 Oct 2023 2 repositories listed Syntology 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 9 harvested samples)Our findings demonstrate that the effectiveness of large language models indeed surpasses that of smaller models.
-
14 Jun 2023 2 repositories listedIn this work, we propose a KD approach that distills LLMs into smaller language models.
-
4 Jun 2023 2 repositories listed Syntology community repositories only · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (of 10 harvested samples)Moreover, the proposed implicit interaction is compatible with special pre-training and knowledge distillation for passage retrieval, which brings a new state-of-the-art performance.
-
26 May 2023 2 repositories listedWe propose EAR, a query Expansion And Reranking approach for improving passage retrieval, with the application to open-domain question answering.
-
19 Dec 2022 2 repositories listedRecently, methods have been developed to improve the performance of dense passage retrieval by using context-supervised pre-training.
-
24 Aug 2022 2 repositories listedWe believe this work facilitates the industry, as it saves enormous efforts and costs of deployment and increases the utility of computing resources.
-
16 Aug 2022 2 repositories listedDense passage retrieval aims to retrieve the relevant passages of a query from a large corpus based on dense representations (i. e., vectors) of the query and the passages.
-
25 May 2022 2 repositories listed Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)Our results highlight the need for developing ODQA models that handle a broad range of question types, including single and multi-answer questions.
-
19 Mar 2022 2 repositories listedIn this paper, we present DuReader_retrieval, a large-scale Chinese dataset for passage retrieval.
-
7 Mar 2022 2 repositories listedWe find that the performance of retrieval models trained on dataset from general domain will inevitably decrease on specific domain.
-
15 Dec 2021 2 repositories listedWith multi-stage training, surprisingly, scaling up the model size brings significant improvement on a variety of retrieval tasks, especially for out-of-domain generalization.
-
13 Oct 2021 2 repositories listedDespite their recent popularity and well-known advantages, dense retrievers still lag behind sparse methods such as BM25 in their ability to reliably match salient phrases and rare entities in the query and to…
-
17 Sep 2021 2 repositories listedIn this work we present a slot filling approach to the task of biomedical IE, effectively replacing the need for entity and relation-specific training data, allowing us to deal with zero-shot settings.
-
31 Aug 2021 2 repositories listed Syntology community repositories only · 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples) · 1 pointer-only (licence)Automatically inducing high quality knowledge graphs from a given collection of documents still remains a challenging problem in AI.
-
27 Aug 2021 2 repositories listedOur experimental results on the MS MARCO passage ranking dataset show that, with our proposed typos-aware training, DR and BERT re-ranker can become robust to typos in queries, resulting in significantly improved…
-
20 Oct 2020 2 repositories listedThrough this process, it teaches the DR model how to retrieve relevant documents from the entire corpus instead of how to rerank a potentially biased sample of documents.
-
10 Oct 2020 2 repositories listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples)We introduce a new dataset for Question Rewriting in Conversational Context (QReCC), which contains 14K conversations with 80K question-answer pairs.
-
17 Mar 2020 2 repositories listedThe Deep Learning Track is a new track for TREC 2019, with the goal of studying ad hoc ranking in a large data regime.
-
23 Oct 2019 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
26 May 2025 1 repository listed
-
25 May 2025 1 repository listed
-
19 May 2025 1 repository listed
-
21 Mar 2025 1 repository listed
-
19 Feb 2025 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples)
-
30 Oct 2024 1 repository listed
-
6 Oct 2024 1 repository listed
-
23 Aug 2024 1 repository listed
-
12 Aug 2024 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 2 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
27 Jun 2024 1 repository listed
-
31 May 2024 1 repository listed
-
22 Apr 2024 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 5 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 1 pointer-only (licence)
-
26 Mar 2024 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)
-
16 Mar 2024 1 repository listed
-
11 Mar 2024 1 repository listed Syntology 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
21 Feb 2024 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 5 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples) · 6 pointer-only (licence)
-
11 Dec 2023 1 repository listed
-
7 Dec 2023 1 repository listed
-
27 Nov 2023 1 repository listed
-
15 Nov 2023 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 9 harvested samples) · 9 pointer-only (licence)
-
29 Sep 2023 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 6 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples) · 8 pointer-only (licence)
-
8 Sep 2023 1 repository listed
-
25 Aug 2023 1 repository listed
-
17 Aug 2023 1 repository listed
-
8 Aug 2023 1 repository listed
-
6 Aug 2023 1 repository listed
-
28 Jun 2023 1 repository listed
-
5 Jun 2023 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
18 May 2023 1 repository listed
-
16 May 2023 1 repository listed
-
15 May 2023 1 repository listed
-
7 Apr 2023 1 repository listed
-
20 Feb 2023 1 repository listed
-
15 Feb 2023 1 repository listed
-
13 Jan 2023 1 repository listed
-
18 Dec 2022 1 repository listed
-
15 Dec 2022 1 repository listed
-
5 Dec 2022 1 repository listed
-
17 Nov 2022 1 repository listed
-
27 Oct 2022 1 repository listed
-
23 Oct 2022 1 repository listed
-
7 Oct 2022 1 repository listed
-
26 Sep 2022 1 repository listed
-
31 Aug 2022 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
31 Jul 2022 1 repository listed
-
6 Jul 2022 1 repository listed
-
21 Jun 2022 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
7 Jun 2022 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
25 May 2022 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)
-
21 May 2022 1 repository listed
-
6 May 2022 1 repository listed
-
1 May 2022 1 repository listed
-
28 Apr 2022 1 repository listed
-
22 Apr 2022 1 repository listed
-
15 Apr 2022 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 3 where Syntology's instrument failed) · 6 unverified (of 14 harvested samples) · 10 pointer-only (licence)
-
5 Apr 2022 1 repository listed
-
1 Apr 2022 1 repository listed
-
1 Apr 2022 1 repository listed
-
19 Mar 2022 1 repository listed
-
15 Mar 2022 1 repository listed
-
14 Mar 2022 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified; the one sample that ran constructed an object rather than computing a result (of 3 harvested samples) · 3 pointer-only (licence)
-
25 Feb 2022 1 repository listed
-
17 Feb 2022 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
5 Jan 2022 1 repository listed
-
9 Dec 2021 1 repository listed
-
14 Oct 2021 1 repository listed
-
12 Oct 2021 1 repository listed
-
27 Sep 2021 1 repository listed
-
17 Sep 2021 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples)
Syntology lines on 32 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections