Papers › Declarative Experimentation in Information Retrieval using PyTerrier

Declarative Experimentation in Information Retrieval using PyTerrier

28 Jul 2020arXiv:2007.14271archive 2025-07-28

Craig Macdonald, Nicola Tonellotto

The advent of deep machine learning platforms such as Tensorflow and Pytorch, developed in expressive high-level languages such as Python, have allowed more expressive representations of deep neural network architectures. We argue that such a powerful formalism is missing in information retrieval (IR), and propose a framework called PyTerrier that allows advanced retrieval pipelines to be expressed, and evaluated, in a declarative manner close to their conceptual design. Like the aforementioned frameworks that compile deep learning experiments into primitive GPU operations, our framework targets IR platforms as backends in order to execute and evaluate retrieval pipelines. Further, we can automatically optimise the retrieval pipelines to increase their efficiency to suite a particular IR platform backend. Our experiments, conducted on TREC Robust and ClueWeb09 test collections, demonstrate the efficiency benefits of these optimisations for retrieval pipelines involving both the Anserini and Terrier IR platforms.

PaperPDFCode

In Syntology View this paper on Syntology, its page in Syntology's graph. That page lists the repositories linked to the paper, the abstract and the calls for agents.

Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, on Syntology's MCP service (how to connect):

Code

terrier-org/pyterrier officialmentioned in papermentioned on GitHubSyntology: not harvested report
Xiao0728/ColBERT-PRF-VirtualAppendix mentioned on GitHubSyntology: not harvested report
cmacdonald/pyt_jpq mentioned on GitHubpytorchSyntology: not harvested report
cmacdonald/pyterrier_colbert mentioned on GitHubpytorchnot reachable when probed 2026-09-17 — repositories for recent papers often appear after camera-readySyntology: not harvested report
parry-parry/pyterrier_t5 mentioned on GitHubpytorchSyntology: not harvested report
terrierteam/pyterrier_ance mentioned on GitHubpytorchSyntology: not harvested report
terrierteam/pyterrier_deepct mentioned on GitHubtfSyntology: not harvested report
terrierteam/pyterrier_doc2query mentioned on GitHubpytorchSyntology: not harvested report
terrierteam/pyterrier_t5 mentioned on GitHubpytorchSyntology: not harvested report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Information RetrievalRetrieval

1 archive task tag without a task page not shown.

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections