Datasets › FB15k-237

FB15k-237

1 Jul 2015 archive 2025-07-28

FB15k-237 is a link prediction dataset created from FB15k. While FB15k consists of 1,345 relations, 14,951 entities, and 592,213 triples, many triples are inverses that cause leakage from the training to testing and validation splits. FB15k-237 was created by Toutanova and Chen (2015) to ensure that the testing and evaluation datasets do not have inverse relation test leakage. In summary, FB15k-237 dataset contains 310,116 triples with 14,541 entities and 237 relation types.

Benchmarks archive 2025-07-28

All 3 leaderboards whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

Syntology 4 newer papers were judged to report on this dataset's benchmarks so far (Claude Sonnet 4.5, reading their tables: a model's judgement, not a result; 0 placed): Link Prediction · FB15k-237 (4 judged, 0 placed), Knowledge Graph Completion · FB15k-237 (2 judged, 0 placed). Drawn from 8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read).

Papers archive 2025-07-28

papers with a benchmark row: 75 · with a code link: 65 · where Syntology ran a sample: 25 (20 with a run with no instrument failure, 5 where every run was a failure of Syntology's instrument) Syntology

Show: all papers with a benchmark rowonly where code ran (25 of 75 with a benchmark row: 20 with a run with no instrument failure, 5 where every run was a failure of Syntology's instrument)

Page 1 of 1: papers 1 to 75 of 75 with a leaderboard row on this dataset's benchmarks, newest first by the archive's date (ties by slug; undated papers last).

The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset, not that list; the archive's count for this dataset is 452. The Syntology column is from Syntology's graph, stated per sample; it is not part of any archive number. A line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified” (C is a part of N, never taken away from it); the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. When the archive marks a repository official for the paper, the cell starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record.

PaperCodeResultsDateSamples run Syntology
Distance-Adaptive Quaternion Knowledge Graph Embedding with Bidirectional Rotation 1 1 5 Dec 2024 not harvested
MoCoKGC: Momentum Contrast Entity Encoding for Knowledge Graph Completion 0 1 12 Nov 2024 not harvested
KERMIT: Knowledge Graph Completion of Enhanced Relation Modeling with Inverse Transformation 1 1 26 Sep 2023 not harvested
MoCoSA: Momentum Contrast for Knowledge Graph Completion with Structure-Augmented Pre-trained Language Models 0 1 16 Aug 2023 not harvested
Self-Distillation with Meta Learning for Knowledge Graph Completion 1 1 20 May 2023 not harvested
Adapting Neural Link Predictors for Data-Efficient Complex Query Answering 0 1 29 Jan 2023 not harvested
A Retrieve-and-Read Framework for Knowledge Graph Link Prediction 1 2 19 Dec 2022 not harvested
Answering Complex Logical Queries on Knowledge Graphs via Query Computation Tree Optimization 1 1 19 Dec 2022 official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 6 unverified (7 pointer-only for licence)
KGLM: Integrating Knowledge Graph Structure in Language Models for Link Prediction 1 1 4 Nov 2022 official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified
PALT: Parameter-Lite Transfer of Language Models for Knowledge Graph Completion 1 1 25 Oct 2022 not harvested
MEIM: Multi-partition Embedding Interaction Beyond Block Term Format for Efficient and Expressive Link Prediction 4 1 30 Sep 2022 official: no sample here; runs from other or unrecorded repositories · 6 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 5 where Syntology's instrument failed) · 1 unverified (7 pointer-only for licence)
Joint Language Semantic and Structure Embedding for Knowledge Graph Completion 1 1 19 Sep 2022 not harvested
GreenKGC: A Lightweight Knowledge Graph Completion Method 1 2 19 Aug 2022 not harvested
Relphormer: Relational Graph Transformer for Knowledge Graph Representations 1 1 22 May 2022 official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified
Neural-Symbolic Models for Logical Queries on Knowledge Graphs 1 1 16 May 2022 official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (2 pointer-only for licence)
R-GCN: The R Could Stand for Random 1 1 4 Mar 2022 not harvested
SimKGC: Simple Contrastive Knowledge Graph Completion with Pre-trained Language Models 2 1 4 Mar 2022 official (archive's flag): 1 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (3 pointer-only for licence)
From Discrimination to Generation: Knowledge Graph Completion with Generative Transformer 1 1 4 Feb 2022 not harvested
Reasoning Through Memorization: Nearest Neighbor Knowledge Graph Embeddings 1 1 14 Jan 2022 not harvested
Multi-task Pre-training Language Model for Semantic Network Completion 1 1 13 Jan 2022 not harvested
Self-attention Presents Low-dimensional Knowledge Graph Embeddings for Link Prediction 1 1 20 Dec 2021 not harvested
Do Pre-trained Models Benefit Knowledge Graph Completion? A Reliable Evaluation and a Reasonable Approach 0 1 16 Nov 2021 not harvested
Modeling Heterogeneous Hierarchies with Relation-specific Hyperbolic Cones 1 1 28 Oct 2021 official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result
Rot-Pro: Modeling Transitivity by Projection in Knowledge Graph Embedding 2 1 27 Oct 2021 not harvested
Relation Prediction as an Auxiliary Training Objective for Improving Multi-Relational Graph Representations 1 3 6 Oct 2021 not harvested
How Does Knowledge Graph Embedding Extrapolate to Unseen Data: A Semantic Evidence View 1 1 24 Sep 2021 not harvested
SAFRAN: An interpretable, rule-based link prediction method outperforming embedding models 1 1 16 Sep 2021 not harvested
KGRefiner: Knowledge Graph Refinement for Improving Accuracy of Translational Link Prediction Methods 0 1 27 Jun 2021 not harvested
Unified Interpretation of Softmax Cross-Entropy and Negative Sampling: With Case Study for Knowledge Graph Embedding 1 2 14 Jun 2021 not harvested
Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link Prediction 3 1 13 Jun 2021 official (archive's flag): 2 ran · 12 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 4 where Syntology's instrument failed) · 3 unverified (2 pointer-only for licence)
Embedding Knowledge Graphs Attentive to Positional and Centrality Qualities 1 1 1 Jun 2021 not harvested
QuatDE: Dynamic Quaternion Embedding for Knowledge Graph Completion 1 1 19 May 2021 not harvested
NePTuNe: Neural Powered Tucker Network for Knowledge Graph Completion 1 1 15 Apr 2021 not harvested
Duality-Induced Regularizer for Tensor Factorization Based Knowledge Graph Completion 3 1 11 Nov 2020 official: harvested, nothing ran · 0 ran · 2 unverified (2 pointer-only for licence)
Complex Query Answering with Neural Link Predictors 5 3 6 Nov 2020 community repositories only · 5 ran (of which 2 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (4 pointer-only for licence)
Beta Embeddings for Multi-Hop Logical Reasoning in Knowledge Graphs 9 1 22 Oct 2020 9 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 2 honoured, 0 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 5 unverified (2 pointer-only for licence)
MLMLM: Link Prediction with Mean Likelihood Masked Language Model 0 1 15 Sep 2020 not harvested
HittER: Hierarchical Transformers for Knowledge Graph Embeddings 3 1 28 Aug 2020 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (1 pointer-only for licence)
DensE: An Enhanced Non-commutative Representation for Knowledge Graph Embedding with Adaptive Semantic Hierarchy 1 1 11 Aug 2020 not harvested
BoxE: A Box Embedding Model for Knowledge Base Completion 1 1 13 Jul 2020 not harvested
Multi-Partition Embedding Interaction with Block Term Format for Knowledge Graph Completion 2 1 29 Jun 2020 not harvested
Low-Dimensional Hyperbolic Knowledge Graph Embeddings 3 1 1 May 2020 official: harvested, nothing ran · 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 7 unverified (8 pointer-only for licence)
Structure-Augmented Text Representation Learning for Efficient Knowledge Graph Completion 1 1 30 Apr 2020 not harvested
LineaRE: Simple but Powerful Knowledge Graph Embedding for Link Prediction 1 1 21 Apr 2020 not harvested
Query2box: Reasoning over Knowledge Graphs in Vector Space using Box Embeddings 9 1 14 Feb 2020 official (archive's flag): 7 ran · 30 ran (of which 13 constructed an object rather than computing a result; 18 with no instrument failure: 1 honoured, 0 violated, 17 with no contract checked; 12 where Syntology's instrument failed) · 11 unverified (2 pointer-only for licence)
Learning Hierarchy-Aware Knowledge Graph Embeddings for Link Prediction 9 2 21 Nov 2019 official (archive's flag): 1 ran · 7 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (1 pointer-only for licence)
Decompressing Knowledge Graph Representations for Link Prediction 1 1 11 Nov 2019 not harvested
A Re-evaluation of Knowledge Graph Completion Methods 2 3 10 Nov 2019 official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified
Orthogonal Relation Transforms with Graph Context Modeling for Knowledge Graph Embedding 0 1 9 Nov 2019 not harvested
Composition-based Multi-Relational Graph Convolutional Networks 4 1 8 Nov 2019 official (archive's flag): 3 ran · 5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (3 pointer-only for licence)
InteractE: Improving Convolution-based Knowledge Graph Embeddings by Increasing Feature Interactions 1 1 1 Nov 2019 official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified
DRUM: End-To-End Differentiable Rule Mining On Knowledge Graphs 1 1 31 Oct 2019 not harvested
Using Pairwise Occurrence Information to Improve Knowledge Graph Completion on Large-Scale Datasets 0 1 25 Oct 2019 not harvested
KG-BERT: BERT for Knowledge Graph Completion 3 1 7 Sep 2019 official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (1 pointer-only for licence)
LogicENN: A Neural Based Knowledge Graphs Embedding Model with Logical Rules 0 1 20 Aug 2019 not harvested
Augmenting and Tuning Knowledge Graph Embeddings 1 1 1 Jul 2019 official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified
Learning Attention-based Embeddings for Relation Prediction in Knowledge Graphs 2 2 4 Jun 2019 community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (1 pointer-only for licence)
Adaptive Convolution for Multi-Relational Learning 0 1 1 Jun 2019 not harvested
MDE: Multiple Distance Embeddings for Link Prediction in Knowledge Graphs 2 1 25 May 2019 not harvested
Multi-relational Poincaré Graph Embeddings 1 1 23 May 2019 official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified
AutoSF: Searching Scoring Functions for Knowledge Graph Embedding 3 1 26 Apr 2019 not harvested
Quaternion Knowledge Graph Embeddings 1 1 23 Apr 2019 not harvested
GraphVite: A High-Performance CPU-GPU Hybrid System for Node Embedding 1 1 2 Mar 2019 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified
RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space 10 2 26 Feb 2019 community repositories only · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified
TuckER: Tensor Factorization for Knowledge Graph Completion 5 1 28 Jan 2019 not harvested
NSCaching: Simple and Efficient Negative Sampling for Knowledge Graph Embedding 6 1 16 Dec 2018 not harvested
End-to-end Structure-Aware Convolutional Networks for Knowledge Base Completion 1 1 11 Nov 2018 official: harvested, nothing ran · 0 ran · 3 unverified
Hypernetwork Knowledge Graph Embeddings 1 1 21 Aug 2018 not harvested
Embedding Logical Queries on Knowledge Graphs 12 1 5 Jun 2018 community repositories only · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (1 pointer-only for licence)
KBGAN: Adversarial Learning for Knowledge Graph Embeddings 3 1 11 Nov 2017 official (archive's flag): 5 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified
Convolutional 2D Knowledge Graph Embeddings 8 2 5 Jul 2017 not harvested
Complex Embeddings for Simple Link Prediction 9 1 20 Jun 2016 not harvested
Knowledge Graph Embedding via Dynamic Mapping Matrix 1 1 1 Jul 2015 not harvested
Embedding Entities and Relations for Learning and Inference in Knowledge Bases 10 1 20 Dec 2014 not harvested
Translating Embeddings for Modeling Multi-relational Data 8 1 1 Dec 2013 not harvested

Dataset loaders archive 2025-07-28

2 loaders as listed in the archive; links are outbound and not re-checked here.

Tasks archive 2025-07-28

License archive 2025-07-28

No licence recorded in the archive. Absence here is not a statement about the dataset's terms.

Modalities archive 2025-07-28

Languages archive 2025-07-28

Variants archive 2025-07-28

  • FB15k-237

1 variant name, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections