Datasets › SNLI

SNLI (Stanford Natural Language Inference)

Introduced by Samuel R. Bowman et al. in A large annotated corpus for learning natural language inference1 Jan 2015 archive 2025-07-28

The SNLI dataset (Stanford Natural Language Inference) consists of 570k sentence-pairs manually labeled as entailment, contradiction, and neutral. Premises are image captions from Flickr30k, while hypotheses were generated by crowd-sourced annotators who were shown a premise and asked to generate entailing, contradicting, and neutral sentences. Annotators were instructed to judge the relation between sentences given that they describe the same event. Each pair is labeled as “entailment”, “neutral”, “contradiction” or “-”, where “-” indicates that an agreement could not be reached.

Source: Breaking NLI Systemswith Sentences that Require Simple Lexical Inferences

Benchmarks archive 2025-07-28

All 1 leaderboard whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

Syntology 4 newer papers were judged to report on this dataset's benchmarks so far (Claude Sonnet 4.5, reading their tables: a model's judgement, not a result; 0 placed): Natural Language Inference · SNLI (4 judged, 0 placed). Drawn from 8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read).

First row (archive order)PaperCode
Natural Language Inference SNLI UnitedSynT5 (3B) % Test Accuracy 94.7 First Train to Generate, then Generate to Train:... — 98 Compare

Papers archive 2025-07-28

papers with a benchmark row: 57 · with a code link: 43 · where Syntology ran a sample: 16 (12 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument) Syntology

Show: all papers with a benchmark rowonly where code ran (16 of 57 with a benchmark row: 12 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument)

Page 1 of 1: papers 1 to 57 of 57 with a leaderboard row on this dataset's benchmarks, newest first by the archive's date (ties by slug; undated papers last).

The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset, not that list; the archive's count for this dataset is 1,311. The Syntology column is from Syntology's graph, stated per sample; it is not part of any archive number. A line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified” (C is a part of N, never taken away from it); the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. When the archive marks a repository official for the paper, the cell starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record.

PaperCodeResultsDateSamples run Syntology
First Train to Generate, then Generate to Train: UnitedSynT5 for Few-Shot NLI 0 2 12 Dec 2024 not harvested
SplitEE: Early Exit in Deep Neural Networks with Split Computing 1 1 17 Sep 2023 not harvested
DEIM: An effective deep encoding and interaction model for sentence matching 0 1 20 Mar 2022 not harvested
Entailment as Few-Shot Learner 3 2 29 Apr 2021 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified
Self-Explaining Structures Improve NLP Models 1 2 3 Dec 2020 not harvested
Conditionally Adaptive Multi-Task Learning: Improving Transfer Learning in NLP Using Fewer Parameters & Less Data 1 1 19 Sep 2020 not harvested
What Do Questions Exactly Ask? MFAE: Duplicate Question Identification with Multi-Fusion Asking Emphasis 1 1 7 May 2020 not harvested
SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization 6 5 8 Nov 2019 official: no sample here; runs from other or unrecorded repositories · 8 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 2 honoured, 1 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (1 pointer-only for licence)
Semantics-aware BERT for Language Understanding 1 1 5 Sep 2019 official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 2 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 5 unverified (3 pointer-only for licence)
DELTA: A DEep learning based Language Technology plAtform 2 1 2 Aug 2019 not harvested
Simple and Effective Text Matching with Richer Alignment Features 3 1 1 Aug 2019 community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (1 pointer-only for licence)
Discourse Marker Augmented Network with Reinforcement Learning for Natural Language Inference 1 2 23 Jul 2019 not harvested
Star-Transformer 2 1 25 Feb 2019 official: harvested for another paper · 0 ran · 1 unverified
Multi-Task Deep Neural Networks for Natural Language Understanding 7 2 31 Jan 2019 community repositories only · 9 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 1 violated, 2 with no contract checked; 5 where Syntology's instrument failed) · 4 unverified (4 pointer-only for licence)
Attention Boosted Sequential Inference Model 0 1 5 Dec 2018 not harvested
Parameter Re-Initialization through Cyclical Batch Size Schedules 0 1 4 Dec 2018 not harvested
Combining Similarity Features and Deep Representation Learning for Stance Detection in the Context of Checking Fake News 3 3 2 Nov 2018 not harvested
Explicit Contextual Semantics for Text Comprehension 0 2 8 Sep 2018 not harvested
Cell-aware Stacked LSTMs for Modeling Sentences 0 1 7 Sep 2018 not harvested
Sentence Embeddings in NLI with Iterative Refinement Encoders 1 1 27 Aug 2018 not harvested
Dynamic Self-Attention : Computing Attention over Words Dynamically for Sentence Embedding 1 2 22 Aug 2018 not harvested
Multiway Attention Networks for Modeling Sentence Pairs 1 2 1 Jul 2018 not harvested
Enhancing Sentence Embedding with Generalized Pooling 1 1 26 Jun 2018 not harvested
Improving Language Understanding by Generative Pre-Training 13 1 11 Jun 2018 not harvested
Semantic Sentence Matching with Densely-connected Recurrent and Co-attentive Information 0 3 29 May 2018 not harvested
Baseline Needs More Love: On Simple Word-Embedding-Based Models and Associated Pooling Mechanisms 2 1 24 May 2018 not harvested
Dynamic Meta-Embeddings for Improved Sentence Representations 3 1 21 Apr 2018 not harvested
Stochastic Answer Networks for Natural Language Inference 3 1 21 Apr 2018 not harvested
Deep contextualized word representations 46 2 15 Feb 2018 30 ran (of which 12 constructed an object rather than computing a result; 24 with no instrument failure: 2 honoured, 0 violated, 22 with no contract checked; 6 where Syntology's instrument failed) · 28 unverified (25 pointer-only for licence)
DR-BiLSTM: Dependent Reading Bidirectional LSTM for Natural Language Inference 0 2 15 Feb 2018 not harvested
Reinforced Self-Attention Network: a Hybrid of Hard and Soft Attention for Sequence Modeling 1 1 31 Jan 2018 not harvested
Compare, Compress and Propagate: Enhancing Neural Architectures with Alignment Factorization for Natural Language Inference 0 3 30 Dec 2017 not harvested
Distance-based Self-Attention Network for Natural Language Inference 0 1 6 Dec 2017 not harvested
Neural Natural Language Inference Models Enhanced with External Knowledge 2 2 12 Nov 2017 not harvested
DiSAN: Directional Self-Attention Network for RNN/CNN-Free Language Understanding 3 1 14 Sep 2017 not harvested
Natural Language Inference over Interaction Space 2 2 13 Sep 2017 community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified
Shortcut-Stacked Sentence Encoders for Multi-Domain Inference 3 2 7 Aug 2017 not harvested
Recurrent Neural Network-Based Sentence Encoder with Gated Attention for Natural Language Inference 2 1 4 Aug 2017 not harvested
Learned in Translation: Contextualized Word Vectors 5 1 1 Aug 2017 community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (2 pointer-only for licence)
Learning to Compose Task-Specific Tree Structures 1 2 10 Jul 2017 not harvested
Supervised Learning of Universal Sentence Representations from Natural Language Inference Data 23 1 5 May 2017 official (archive's flag): 3 ran · 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (7 pointer-only for licence)
Bilateral Multi-Perspective Matching for Natural Language Sentences 10 2 13 Feb 2017 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (1 pointer-only for licence)
Reading and Thinking: Re-read LSTM Unit for Textual Entailment Recognition 0 1 1 Dec 2016 not harvested
Enhanced LSTM for Natural Language Inference 12 2 20 Sep 2016 not harvested
Deep Fusion LSTMs for Text Semantic Matching 0 1 1 Aug 2016 not harvested
Neural Tree Indexers for Text Understanding 1 2 15 Jul 2016 not harvested
Neural Semantic Encoders 3 2 14 Jul 2016 not harvested
A Decomposable Attention Model for Natural Language Inference 10 4 6 Jun 2016 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified
Learning Natural Language Inference using Bidirectional LSTM model and Inner-Attention 2 3 30 May 2016 not harvested
Modelling Interaction of Sentence Pair with coupled-LSTMs 0 1 18 May 2016 not harvested
A Fast Unified Model for Parsing and Sentence Understanding 3 2 19 Mar 2016 official (archive's flag): 3 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified
Long Short-Term Memory-Networks for Machine Reading 3 2 25 Jan 2016 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (2 pointer-only for licence)
Learning Natural Language Inference with LSTM 4 1 30 Dec 2015 community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (1 pointer-only for licence)
Natural Language Inference by Tree-Based Convolution and Heuristic Matching 0 1 28 Dec 2015 not harvested
Order-Embeddings of Images and Language 2 1 19 Nov 2015 not harvested
Reasoning about Entailment with Neural Attention 7 1 22 Sep 2015 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (1 pointer-only for licence)
A large annotated corpus for learning natural language inference 3 3 21 Aug 2015 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (3 pointer-only for licence)

Dataset loaders archive 2025-07-28

9 loaders as listed in the archive; links are outbound and not re-checked here.

Tasks archive 2025-07-28

License archive 2025-07-28

CC BY-SA 4.0

Modalities archive 2025-07-28

Languages archive 2025-07-28

Variants archive 2025-07-28

  • SNLI
  • JSNLI

2 variant names, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections