Datasets › SST

SST (Stanford Sentiment Treebank)

Introduced by Richard Socher et al. in Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank1 Oct 2013 archive 2025-07-28

The Stanford Sentiment Treebank is a corpus with fully labeled parse trees that allows for a complete analysis of the compositional effects of sentiment in language. The corpus is based on the dataset introduced by Pang and Lee (2005) and consists of 11,855 single sentences extracted from movie reviews. It was parsed with the Stanford parser and includes a total of 215,154 unique phrases from those parse trees, each annotated by 3 human judges.

Each phrase is labelled as either negative, somewhat negative, neutral, somewhat positive or positive. The corpus with all 5 labels is referred to as SST-5 or SST fine-grained. Binary classification experiments on full sentences (negative or somewhat negative vs somewhat positive or positive with neutral sentences discarded) refer to the dataset as SST-2 or SST binary.

Benchmarks archive 2025-07-28

All 6 leaderboards whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

Syntology 21 newer papers were judged to report on this dataset's benchmarks so far (Claude Sonnet 4.5, reading their tables: a model's judgement, not a result; 0 placed): Sentiment Analysis · SST-2 Binary classification (17 judged, 0 placed), Sentiment Analysis · SST-5 Fine-grained classification (4 judged, 0 placed), Explanation Fidelity Evaluation · SST2 (1 judged, 0 placed), Few-Shot Learning · SST-2 Binary classification (1 judged, 0 placed), Out-of-Distribution Detection · SST (1 judged, 0 placed). Drawn from 8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read).

Papers archive 2025-07-28

papers with a benchmark row: 84 · with a code link: 74 · where Syntology ran a sample: 36 (34 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument) Syntology

Show: all papers with a benchmark rowonly where code ran (36 of 84 with a benchmark row: 34 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument)

Page 1 of 1: papers 1 to 84 of 84 with a leaderboard row on this dataset's benchmarks, newest first by the archive's date (ties by slug; undated papers last).

The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset, not that list; the archive's count for this dataset is 2,354. The Syntology column is from Syntology's graph, stated per sample; it is not part of any archive number. A line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified” (C is a part of N, never taken away from it); the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. When the archive marks a repository official for the paper, the cell starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record.

PaperCodeResultsDateSamples run Syntology
CAPO: Cost-Aware Prompt Optimization 2 3 22 Apr 2025 not harvested
SubRegWeigh: Effective and Efficient Annotation Weighing with Subword Regularization 1 1 10 Sep 2024 not harvested
SAME: Uncovering GNN Black Box with Structure-aware Shapley-based Multipiece Explanations 1 1 21 Sep 2023 not harvested
LM-CPPF: Paraphrasing-Guided Data Augmentation for Contrastive Prompt-Based Few-Shot Fine-Tuning 1 2 29 May 2023 not harvested
An Algorithm for Routing Vectors in Sequences 1 2 20 Nov 2022 not harvested
Fine-mixing: Mitigating Backdoors in Fine-tuned Language Models 1 1 18 Oct 2022 official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 10 unverified (19 pointer-only for licence)
LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale 4 1 15 Aug 2022 official: harvested, nothing ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (2 pointer-only for licence)
Adversarial Self-Attention for Language Understanding 1 2 25 Jun 2022 not harvested
Dual Contrastive Learning: Text Classification via Label-Aware Data Augmentation 2 1 21 Jan 2022 not harvested
Differentiable Prompt Makes Pre-trained Language Models Better Few-shot Learners 4 1 30 Aug 2021 official (archive's flag): 2 ran · 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 3 samples that ran constructed an object rather than computing a result
Charformer: Fast Character Transformers via Gradient-based Subword Tokenization 2 1 23 Jun 2021 community repositories only · 7 ran (of which 3 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified
Pay Attention to MLPs 20 1 17 May 2021 34 ran (of which 15 constructed an object rather than computing a result; 31 with no instrument failure: 1 honoured, 4 violated, 26 with no contract checked; 3 where Syntology's instrument failed) · 10 unverified (11 pointer-only for licence)
An Effective Baseline for Robustness to Distributional Shift 1 1 15 May 2021 not harvested
FNet: Mixing Tokens with Fourier Transforms 12 1 9 May 2021 community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (1 pointer-only for licence)
Entailment as Few-Shot Learner 3 1 29 Apr 2021 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified
How to Train BERT with an Academic Budget 4 1 15 Apr 2021 not harvested
Nyströmformer: A Nyström-Based Algorithm for Approximating Self-Attention 10 1 7 Feb 2021 official: no sample here; runs from other or unrecorded repositories · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (1 pointer-only for licence)
Muppet: Massive Multi-task Representations with Pre-Finetuning 2 2 26 Jan 2021 not harvested
CLEAR: Contrastive Learning for Sentence Representation 0 1 31 Dec 2020 not harvested
RealFormer: Transformer Likes Residual Attention 5 1 21 Dec 2020 not harvested
Self-Explaining Structures Improve NLP Models 1 1 3 Dec 2020 not harvested
A Statistical Framework for Low-bitwidth Training of Deep Neural Networks 2 1 27 Oct 2020 official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (1 pointer-only for licence)
Pay Attention when Required 2 1 9 Sep 2020 not harvested
Big Bird: Transformers for Longer Sequences 14 1 28 Jul 2020 official (archive's flag): 1 ran · 10 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 8 where Syntology's instrument failed) · 5 unverified (11 pointer-only for licence)
SqueezeBERT: What can computer vision teach NLP about efficient neural networks? 6 1 19 Jun 2020 community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified
DeBERTa: Decoding-enhanced BERT with Disentangled Attention 14 1 5 Jun 2020 official: no sample here; runs from other or unrecorded repositories · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 9 unverified (3 pointer-only for licence)
ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators 19 1 23 Mar 2020 official: no sample here; runs from other or unrecorded repositories · 31 ran (of which 7 constructed an object rather than computing a result; 18 with no instrument failure: 2 honoured, 2 violated, 14 with no contract checked; 13 where Syntology's instrument failed) · 9 unverified (10 pointer-only for licence)
Learning to Encode Position for Transformer with Continuous Dynamical Model 1 1 13 Mar 2020 3 ran (of which 2 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (6 pointer-only for licence)
BP-Transformer: Modelling Long-Range Context via Binary Partitioning 2 1 11 Nov 2019 official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified
SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization 6 6 8 Nov 2019 official: no sample here; runs from other or unrecorded repositories · 8 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 2 honoured, 1 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (1 pointer-only for licence)
An Algorithm for Routing Capsules in All Domains 1 2 2 Nov 2019 not harvested
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer 57 5 23 Oct 2019 21 ran (of which 0 constructed an object rather than computing a result; 20 with no instrument failure: 1 honoured, 0 violated, 19 with no contract checked; 1 where Syntology's instrument failed) · 10 unverified
Q8BERT: Quantized 8Bit BERT 5 1 14 Oct 2019 official (archive's flag): 5 ran · 10 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 2 honoured, 0 violated, 7 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (3 pointer-only for licence)
Fine-grained Sentiment Classification using BERT 1 3 4 Oct 2019 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter 37 1 2 Oct 2019 official (archive's flag): 1 ran · 21 ran (of which 5 constructed an object rather than computing a result; 12 with no instrument failure: 3 honoured, 1 violated, 8 with no contract checked; 9 where Syntology's instrument failed) · 6 unverified (2 pointer-only for licence)
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations 48 1 26 Sep 2019 official (archive's flag): 6 ran · 81 ran (of which 17 constructed an object rather than computing a result; 56 with no instrument failure: 4 honoured, 0 violated, 52 with no contract checked; 25 where Syntology's instrument failed) · 45 unverified (28 pointer-only for licence)
TinyBERT: Distilling BERT for Natural Language Understanding 10 2 23 Sep 2019 official: harvested, nothing ran · 0 ran · 4 unverified (4 pointer-only for licence)
Q-BERT: Hessian Based Ultra Low Precision Quantization of BERT 0 1 12 Sep 2019 not harvested
Message Passing Attention Networks for Document Understanding 2 2 17 Aug 2019 not harvested
StructBERT: Incorporating Language Structures into Pre-training for Deep Language Understanding 0 1 13 Aug 2019 not harvested
ERNIE 2.0: A Continual Pre-training Framework for Language Understanding 3 1 29 Jul 2019 official: harvested, nothing ran · 0 ran · 1 unverified (1 pointer-only for licence)
RoBERTa: A Robustly Optimized BERT Pretraining Approach 67 1 26 Jul 2019 community repositories only · 37 ran (of which 11 constructed an object rather than computing a result; 36 with no instrument failure: 2 honoured, 0 violated, 34 with no contract checked; 1 where Syntology's instrument failed) · 11 unverified (24 pointer-only for licence)
SpanBERT: Improving Pre-training by Representing and Predicting Spans 6 1 24 Jul 2019 official (archive's flag): 2 ran · 9 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 4 where Syntology's instrument failed) · 6 unverified (6 pointer-only for licence)
XLNet: Generalized Autoregressive Pretraining for Language Understanding 27 2 19 Jun 2019 official (archive's flag): 1 ran · 15 ran (of which 2 constructed an object rather than computing a result; 10 with no instrument failure: 2 honoured, 0 violated, 8 with no contract checked; 5 where Syntology's instrument failed) · 9 unverified (4 pointer-only for licence)
The Pupil Has Become the Master: Teacher-Student Model-Based Word Embedding Distillation with Ensemble Learning 1 2 31 May 2019 not harvested
ERNIE: Enhanced Language Representation with Informative Entities 2 1 17 May 2019 official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (1 pointer-only for licence)
Improving Multi-Task Deep Neural Networks via Knowledge Distillation for Natural Language Understanding 3 1 20 Apr 2019 not harvested
Distilling Task-Specific Knowledge from BERT into Simple Neural Networks 4 1 28 Mar 2019 9 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 3 honoured, 0 violated, 0 with no contract checked; 6 where Syntology's instrument failed) · 0 unverified
Cloze-driven Pretraining of Self-attention Networks 0 1 19 Mar 2019 not harvested
Star-Transformer 2 1 25 Feb 2019 official: harvested for another paper · 0 ran · 1 unverified
Multi-Task Deep Neural Networks for Natural Language Understanding 7 1 31 Jan 2019 community repositories only · 9 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 1 violated, 2 with no contract checked; 5 where Syntology's instrument failed) · 4 unverified (4 pointer-only for licence)
Leveraging Multi-grained Sentiment Lexicon Information for Neural Sequence Models 0 1 4 Dec 2018 not harvested
Practical Text Classification With Large Pre-Trained Language Models 1 1 4 Dec 2018 not harvested
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 534 1 11 Oct 2018 official: no sample here; runs from other or unrecorded repositories · 300 ran (of which 75 constructed an object rather than computing a result; 234 with no instrument failure: 18 honoured, 5 violated, 211 with no contract checked; 66 where Syntology's instrument failed) · 359 unverified (164 pointer-only for licence)
Training Complex Models with Multi-Task Weak Supervision 1 1 5 Oct 2018 not harvested
Emo2Vec: Learning Generalized Emotion Representation by Multi-task Training 1 4 12 Sep 2018 not harvested
Cell-aware Stacked LSTMs for Modeling Sentences 0 2 7 Sep 2018 not harvested
Convolutional Neural Networks with Recurrent Neural Filters 2 2 28 Aug 2018 not harvested
Task-oriented Word Embedding for Text Classification 1 1 1 Aug 2018 not harvested
A Multi-sentiment-resource Enhanced Attention Network for Sentiment Classification 0 1 13 Jul 2018 not harvested
A Helping Hand: Transfer Learning for Deep Sentiment Analysis 0 1 1 Jul 2018 not harvested
Information Aggregation via Dynamic Routing for Sequence Encoding 2 2 5 Jun 2018 not harvested
Baseline Needs More Love: On Simple Word-Embedding-Based Models and Associated Pooling Mechanisms 2 2 24 May 2018 not harvested
Improved Sentence Modeling using Suffix Bidirectional LSTM 0 2 18 May 2018 not harvested
A La Carte Embedding: Cheap but Effective Induction of Semantic Feature Vectors 1 2 14 May 2018 official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified
Investigating Capsule Networks with Dynamic Routing for Text Classification 4 1 29 Mar 2018 not harvested
Universal Sentence Encoder 24 1 29 Mar 2018 18 ran (of which 0 constructed an object rather than computing a result; 17 with no instrument failure: 0 honoured, 0 violated, 17 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (1 pointer-only for licence)
Deep contextualized word representations 46 1 15 Feb 2018 30 ran (of which 12 constructed an object rather than computing a result; 24 with no instrument failure: 2 honoured, 0 violated, 22 with no contract checked; 6 where Syntology's instrument failed) · 28 unverified (25 pointer-only for licence)
Sentiment Analysis by Capsules 1 1 1 Feb 2018 not harvested
GPU Kernels for Block-Sparse Weights 1 1 1 Dec 2017 not harvested
Exploring Joint Neural Model for Sentence Level Discourse Parsing and Sentiment Analysis 0 2 1 Aug 2017 not harvested
Learned in Translation: Contextualized Word Vectors 5 2 1 Aug 2017 community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (2 pointer-only for licence)
On the Role of Text Preprocessing in Neural Network Architectures: An Evaluation Study on Text Categorization and Sentiment Analysis 3 1 6 Jul 2017 not harvested
Learning to Generate Reviews and Discovering Sentiment 2 1 5 Apr 2017 0 ran · 1 unverified
All-but-the-Top: Simple and Effective Postprocessing for Word Representations 4 1 5 Feb 2017 21 ran (of which 0 constructed an object rather than computing a result; 21 with no instrument failure: 0 honoured, 0 violated, 21 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified (2 pointer-only for licence)
Text Classification Improved by Integrating Bidirectional LSTM with Two-dimensional Max Pooling 3 1 21 Nov 2016 not harvested
Neural Semantic Encoders 3 1 14 Jul 2016 not harvested
Harnessing Deep Neural Networks with Logic Rules 2 1 21 Mar 2016 not harvested
A C-LSTM Neural Network for Text Classification 10 2 27 Nov 2015 not harvested
Ask Me Anything: Dynamic Memory Networks for Natural Language Processing 10 1 24 Jun 2015 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 1 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified
Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks 16 3 28 Feb 2015 community repositories only · 12 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 6 where Syntology's instrument failed) · 3 unverified (6 pointer-only for licence)
Convolutional Neural Networks for Sentence Classification 118 1 25 Aug 2014 53 ran (of which 0 constructed an object rather than computing a result; 40 with no instrument failure: 6 honoured, 1 violated, 33 with no contract checked; 13 where Syntology's instrument failed) · 24 unverified (21 pointer-only for licence)
Less Grammar, More Features 1 1 1 Jun 2014 not harvested
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank 2 2 1 Oct 2013 not harvested

Dataset loaders archive 2025-07-28

7 loaders as listed in the archive; links are outbound and not re-checked here.

Tasks archive 2025-07-28

License archive 2025-07-28

Unknown

Modalities archive 2025-07-28

Languages archive 2025-07-28

Variants archive 2025-07-28

  • SST-2
  • SST-2 Binary classification Dev
  • SST-5
  • sst2-es-mt
  • SST2
  • SST-2 Binary classification
  • SST-5 Fine-grained classification
  • SST

8 variant names, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections