Datasets › SemEval-2014 Task-4

SemEval-2014 Task-4

Introduced by Maria Pontiki et al. in SemEval-2014 Task 4: Aspect Based Sentiment Analysis1 Aug 2014 archive 2025-07-28

Sentiment analysis is increasingly viewed as a vital task both from an academic and a commercial standpoint. The majority of current approaches, however, attempt to detect the overall polarity of a sentence, paragraph, or text span, regardless of the entities mentioned (e.g., laptops, restaurants) and their aspects (e.g., battery, screen; food, service). By contrast, this task is concerned with aspect based sentiment analysis (ABSA), where the goal is to identify the aspects of given target entities and the sentiment expressed towards each aspect. Datasets consisting of customer reviews with human-authored annotations identifying the mentioned aspects of the target entities and the sentiment polarity of each aspect will be provided.

Subtask 2: Aspect term polarity

For a given set of aspect terms within a sentence, determine whether the polarity of each aspect term is positive, negative, neutral or conflict (i.e., both positive and negative).

For example:

“I loved their fajitas” → {fajitas: positive} “I hated their fajitas, but their salads were great” → {fajitas: negative, salads: positive} “The fajitas are their first plate” → {fajitas: neutral} “The fajitas were great to taste, but not to see” → {fajitas: conflict}

Benchmarks archive 2025-07-28

All 4 leaderboards whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

First row (archive order)PaperCode
Aspect-Based Sentiment Analysis (ABSA) SemEval-2014 Task-4 MT-ISA Mean Acc (Restaurant + Laptop) 89.21 Multi-Task Learning with LLMs for Implicit Sentiment... — 48 Compare
Aspect Extraction SemEval-2014 Task-4 InstructABSA Laptop (F1) 92.30 InstructABSA: Instruction Learning for Aspect Based... kevinscaria/instructabsa 6 Compare
Aspect-oriented Opinion Extraction SemEval-2014 Task-4 BARTABSA Restaurant 2014 (F1) 85.38 A Unified Generative Framework for Aspect-Based... yhcc/BARTABSA +2 5 Compare
Aspect Category Detection SemEval-2014 Task-4 pxp Average Recall 0.72 Latent Aspect Detection from Online Unsolicited Customer Reviews MohammadForouhesh/latent-aspect-detection 1 Compare

Papers archive 2025-07-28

papers with a benchmark row: 52 · with a code link: 41 · where Syntology ran a sample: 5 (4 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument) Syntology

Show: all papers with a benchmark rowonly where code ran (5 of 52 with a benchmark row: 4 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument)

Page 1 of 1: papers 1 to 52 of 52 with a leaderboard row on this dataset's benchmarks, newest first by the archive's date (ties by slug; undated papers last).

The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset, not that list; the archive's count for this dataset is 107. The Syntology column is from Syntology's graph, stated per sample; it is not part of any archive number. A line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified” (C is a part of N, never taken away from it); the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. When the archive marks a repository official for the paper, the cell starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record.

PaperCodeResultsDateSamples run Syntology
Multi-Task Learning with LLMs for Implicit Sentiment Analysis: Data-level and Task-level Automatic Weight Learning 0 1 12 Dec 2024 not harvested
Masking The Bias : From Echo Chambers to Large Scale Aspect-Based Sentiment Analysis 1 1 2 Sep 2024 not harvested
RVISA: Reasoning and Verification for Implicit Sentiment Analysis 0 1 2 Jul 2024 not harvested
You Only Read Once: Constituency-Oriented Relational Graph Convolutional Network for Multi-Aspect Multi-Sentiment Classification 1 1 24 Mar 2024 not harvested
InstructABSA: Instruction Learning for Aspect Based Sentiment Analysis 1 2 16 Feb 2023 not harvested
Latent Aspect Detection from Online Unsolicited Customer Reviews 1 1 14 Apr 2022 not harvested
Towards Unifying the Label Space for Aspect- and Sentence-based Sentiment Analysis 1 1 14 Mar 2022 not harvested
LSA: Modeling Aspect Sentiment Coherency via Local Sentiment Aggregation 1 1 16 Oct 2021 not harvested
Understand me, if you refer to Aspect Knowledge: Knowledge-aware Gated Recurrent Memory Network 1 1 5 Aug 2021 not harvested
Aspect-based Sentiment Analysis using BERT with Disentangled Attention 1 1 18 Jul 2021 not harvested
A Unified Generative Framework for Aspect-Based Sentiment Analysis 3 1 8 Jun 2021 not harvested
Does syntax matter? A strong baseline for Aspect-based Sentiment Analysis with RoBERTa 1 1 11 Apr 2021 not harvested
A Joint Training Dual-MRC Framework for Aspect Based Sentiment Analysis 0 1 4 Jan 2021 not harvested
Does BERT Understand Sentiment? Leveraging Comparisons Between Contextual and Non-Contextual Embeddings to Improve Aspect-Based Sentiment Models 0 1 23 Nov 2020 not harvested
Introducing Syntactic Structures into Target Opinion Word Extraction with Deep Learning 0 1 26 Oct 2020 not harvested
Improving BERT Performance for Aspect-Based Sentiment Analysis 2 2 22 Oct 2020 official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 2 honoured, 0 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 4 unverified (2 pointer-only for licence)
Automated Concatenation of Embeddings for Structured Prediction 2 1 10 Oct 2020 not harvested
Aspect Based Sentiment Analysis with Aspect-Specific Opinion Spans 1 1 6 Oct 2020 not harvested
Don't Eclipse Your Arts Due to Small Discrepancies: Boundary Repositioning with a Pointer Network for Aspect Extraction 0 1 1 Jul 2020 not harvested
Investigating Typed Syntactic Dependencies for Targeted Sentiment Classification Using Graph Attention Neural Network 1 1 22 Feb 2020 not harvested
Adversarial Training for Aspect-Based Sentiment Analysis with BERT 4 2 30 Jan 2020 not harvested
Latent Opinions Transfer Network for Target-Oriented Opinion Words Extraction 1 1 7 Jan 2020 not harvested
A Multi-task Learning Model for Chinese-oriented Aspect Polarity Classification and Aspect Term Extraction 6 1 17 Dec 2019 not harvested
Parameterized Convolutional Neural Networks for Aspect Level Sentiment Classification 0 1 13 Sep 2019 not harvested
Adapt or Get Left Behind: Domain Adaptation through BERT Language Model Finetuning for Aspect-Target Sentiment Classification 3 1 30 Aug 2019 official: harvested, nothing ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified
Attention and Lexicon Regularized LSTM for Aspect-based Sentiment Analysis 1 2 1 Jul 2019 not harvested
An Interactive Multi-Task Learning Network for End-to-End Aspect-Based Sentiment Analysis 3 1 17 Jun 2019 not harvested
Modeling Sentiment Dependencies with Graph Convolutional Networks for Aspect-level Sentiment Classification 1 1 11 Jun 2019 not harvested
Progressive Self-Supervised Attention Learning for Aspect-Level Sentiment Analysis 1 1 4 Jun 2019 not harvested
Target-oriented Opinion Words Extraction with Target-fused Neural Sequence Labeling 1 1 1 Jun 2019 not harvested
BERT Post-Training for Review Reading Comprehension and Aspect-based Sentiment Analysis 1 1 3 Apr 2019 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (1 pointer-only for licence)
Attentional Encoder Network for Targeted Sentiment Classification 5 3 25 Feb 2019 not harvested
Exploiting Coarse-to-Fine Task Transfer for Aspect-level Sentiment Classification 1 1 16 Nov 2018 not harvested
Variational Semi-supervised Aspect-term Sentiment Analysis via Transformer 0 1 24 Oct 2018 not harvested
Hierarchical Attention Based Position-Aware Network for Aspect-Level Sentiment Analysis 1 1 1 Oct 2018 not harvested
IARM: Inter-Aspect Relation Modeling with Memory Networks in Aspect-Based Sentiment Analysis 1 1 1 Oct 2018 not harvested
Multi-grained Attention Network for Aspect-Level Sentiment Classification 1 1 1 Oct 2018 not harvested
A Position-aware Bidirectional Attention Network for Aspect-level Sentiment Analysis 1 1 1 Aug 2018 not harvested
Effective Attention Modeling for Aspect-Level Sentiment Classification 0 1 1 Aug 2018 not harvested
Target-Sensitive Memory Networks for Aspect Sentiment Classification 0 2 1 Jul 2018 not harvested
Exploiting Document Knowledge for Aspect-level Sentiment Classification 1 1 12 Jun 2018 not harvested
Double Embeddings and CNN-based Sequence Labeling for Aspect Extraction 2 1 11 May 2018 0 ran · 1 unverified
Transformation Networks for Target-Oriented Sentiment Classification 2 2 3 May 2018 not harvested
Aspect-Based Sentiment Analysis Using Bitmask Bidirectional Long Short Term Memory Networks 0 1 1 May 2018 not harvested
Aspect Level Sentiment Classification with Attention-over-Attention Neural Networks 2 1 18 Apr 2018 not harvested
Learning Latent Opinions for Aspect-Level Sentiment Classification 1 1 1 Apr 2018 not harvested
Left-Center-Right Separated Neural Network for Aspect-based Sentiment Analysis with Rotatory Attention 1 1 3 Feb 2018 not harvested
Interactive Attention Networks for Aspect-Level Sentiment Classification 5 1 4 Sep 2017 not harvested
Recurrent Attention Network on Memory for Aspect Sentiment Analysis 3 1 1 Sep 2017 not harvested
Attention-based LSTM for Aspect-level Sentiment Classification 8 1 1 Nov 2016 not harvested
Aspect Level Sentiment Classification with Deep Memory Network 8 1 28 May 2016 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (2 pointer-only for licence)
Effective LSTMs for Target-Dependent Sentiment Classification 10 1 3 Dec 2015 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified

Dataset loaders archive 2025-07-28

1 loader as listed in the archive; links are outbound and not re-checked here.

Tasks archive 2025-07-28

License archive 2025-07-28

No licence recorded in the archive. Absence here is not a statement about the dataset's terms.

Modalities archive 2025-07-28

No modality tagged.

Languages archive 2025-07-28

Variants archive 2025-07-28

  • SemEval-2014 Task-4

1 variant name, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections