Browse State-of-the-Art › Speech Emotion Recognition
Speech Emotion Recognition
139 papers with code · 16 benchmarks · 22 datasets archive 2025-07-28
Speech Emotion Recognition is a task of speech processing and computational paralinguistics that aims to recognize and categorize the emotions expressed in spoken language. The goal is to determine the emotional state of a speaker, such as happiness, anger, sadness, or frustration, from their speech patterns, such as prosody, pitch, and rhythm.
For multimodal emotion recognition, please upload your result to Multimodal Emotion Recognition on IEMOCAP
Description from the archive archive 2025-07-28; Papers-with-Code links inside it are rewritten to this site.
Benchmarks archive 2025-07-28
16 leaderboard tables shown for this task, 16 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted. 10 shown of 16 until expanded.
Syntology 1 newer paper was judged to report on this task's benchmarks so far (Claude Sonnet 4.5, reading their tables: a model's judgement, not a result; 0 placed): IEMOCAP (1 judged, 0 placed), ShEMO (1 judged, 0 placed). Drawn from 8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read).
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
22 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
4 subtasks in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 431 · with a code link: 139 · where Syntology ran a sample: 15 (13 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (15 of 431 tagged: 13 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument)
Page 1 of 5: papers 1 to 100 of 431, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
12 Jun 2017 595 repositories listed Syntology official: no sample here; runs from other or unrecorded repositories · 610 ran (of which 293 constructed an object rather than computing a result; 529 with no instrument failure: 45 honoured, 15 violated, 469 with no contract checked; 81 where Syntology's instrument failed) · 336 unverified (of 946 harvested samples) · 451 pointer-only (licence)The dominant sequence transduction models are based on complex recurrent or convolutional neural networks in an encoder-decoder configuration.
-
9 Sep 2015 161 repositories listed Syntology 163 ran (of which 126 constructed an object rather than computing a result; 152 with no instrument failure: 3 honoured, 0 violated, 149 with no contract checked; 11 where Syntology's instrument failed) · 143 unverified (of 306 harvested samples) · 163 pointer-only (licence)We adapt the ideas underlying the success of Deep Q-Learning to the continuous action domain.
-
5 Apr 2021 5 repositories listed Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)In the past decade, convolutional neural networks (CNNs) have been widely adopted as the main building block for end-to-end audio classification models, which aim to learn a direct mapping from audio spectrograms to…
-
12 Apr 2019 5 repositories listedIn this work, we adopt a feature-engineering based approach to tackle the task of speech emotion recognition.
-
10 Oct 2018 4 repositories listedSpeech emotion recognition is a challenging task, and extensive reliance has been placed on models that use audio features in building well-performing classifiers.
-
22 Jun 2023 3 repositories listedSpeech Emotion Recognition (SER) typically relies on utterance-level solutions.
-
5 Aug 2020 3 repositories listedWe propose a deep graph approach to address the task of speech emotion recognition.
-
23 May 2025 2 repositories listed Syntology community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 1 pointer-only (licence)Despite these advancements, CosyVoice 2 exhibits limitations in language coverage, domain diversity, data volume, text formats, and post-training techniques.
-
1 Jun 2024 2 repositories listedThe proposed approach offers several advantages, including the identification and removal of irrelevant and redundant features, leading to a more effective model.
-
23 Dec 2023 2 repositories listed Syntology official (archive's flag): 8 ran · 17 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 1 honoured, 2 violated, 8 with no contract checked; 6 where Syntology's instrument failed) · 3 unverified (of 20 harvested samples) · 9 pointer-only (licence)To the best of our knowledge, emotion2vec is the first universal representation model in various emotion-related tasks, filling a gap in the field.
-
7 Oct 2023 2 repositories listed Syntology 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)Previous mainstream audio-and-text LLMs use discrete audio tokens to represent both input and output audio; however, they suffer from performance degradation on tasks such as automatic speech recognition, speech-to-text…
-
18 Nov 2022 2 repositories listedSpeech Emotion Recognition (SER) is one of the essential perceptual methods of humans in understanding the situation and how to interact with others, therefore, in recent years, it has been tried to add the ability to…
-
7 Oct 2021 2 repositories listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 1 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 9 harvested samples) · 2 pointer-only (licence)To facilitate the process, here, we present the Speech Emotion Recognition Adaptation Benchmark (SERAB), a framework for evaluating the performance and generalization capacity of different approaches for utterance-level…
-
8 Apr 2021 2 repositories listedEmotion recognition datasets are relatively small, making the use of the more sophisticated deep learning approaches challenging.
-
28 Oct 2020 2 repositories listedEmotional voice conversion aims to transform emotional prosody in speech while preserving the linguistic content and speaker identity.
-
11 Jun 2019 2 repositories listedThis paper proposes a speech emotion recognition method based on speech features and speech transcriptions (text).
-
23 Apr 2019 2 repositories listedAs opposed to using knowledge from both the modalities separately, we propose a framework to exploit acoustic information in tandem with lexical data.
-
11 Jul 2025 1 repository listedRecent research has focused on applying speech large language model (SLLM) to improve speech emotion recognition (SER).
-
11 Jun 2025 1 repository listedSER is a challenging task due to the subjective nature of human emotions and their uneven representation under naturalistic conditions.
-
10 Jun 2025 1 repository listedIt leverages Wav2Vec2.
-
30 May 2025 1 repository listedWe demonstrate the effectiveness of MELT by fine-tuning four self-supervised learning (SSL) backbones and assessing speech emotion recognition performance across emotion datasets.
-
26 May 2025 1 repository listedSpeech emotion recognition predicts a speaker's emotional state from speech signals using discrete labels or continuous dimensions such as arousal, valence, and dominance (VAD).
-
26 May 2025 1 repository listedThis paper presents our proposed system in the context of the 2025 Speech Emotion Recognition in Naturalistic Conditions Challenge.
-
23 May 2025 1 repository listedSpeech emotion recognition (SER) in naturalistic settings remains a challenge due to the intrinsic variability, diverse recording conditions, and class imbalance.
-
30 Apr 2025 1 repository listedThe data was collected on smartphones in the actors homes and therefore includes at least 98 different acoustic environments.
-
25 Mar 2025 1 repository listedMultilingual speech emotion recognition aims to estimate a speaker's emotional state using a contactless method across different languages.
-
25 Feb 2025 1 repository listedLarge-scale audio language models (ALMs), such as Qwen2-Audio, are capable of comprehending diverse audio signal, performing audio analysis and generating textual responses.
-
1 Feb 2025 1 repository listedBy leveraging the properties of the fast discrete wavelet transform (FDWT), including the cascade algorithm, conjugate quadrature filter, and coefficient denoising, our approach introduces a learnable model for both…
-
23 Jan 2025 1 repository listedLarge Language Models (LLMs) have made significant progress in various downstream tasks, inspiring the development of Speech Understanding Language Models (SULMs) to enable comprehensive speech-based interactions.
-
11 Dec 2024 1 repository listedMajor depressive disorder is a prevalent and serious mental health condition that negatively impacts your emotions, thoughts, actions, and overall perception of the world.
-
29 Oct 2024 1 repository listed
-
10 Oct 2024 1 repository listed
-
25 Sep 2024 1 repository listed
-
17 Sep 2024 1 repository listed
-
16 Sep 2024 1 repository listed
-
14 Sep 2024 1 repository listed
-
9 Sep 2024 1 repository listed
-
21 Aug 2024 1 repository listed
-
14 Aug 2024 1 repository listed
-
17 Jul 2024 1 repository listed
-
1 Jul 2024 1 repository listed
-
20 Jun 2024 1 repository listed
-
13 Jun 2024 1 repository listed
-
12 Jun 2024 1 repository listed
-
11 Jun 2024 1 repository listed
-
11 Jun 2024 1 repository listed
-
10 Jun 2024 1 repository listed
-
10 Jun 2024 1 repository listed
-
6 Jun 2024 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 3 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples) · 3 pointer-only (licence)
-
30 May 2024 1 repository listed
-
26 May 2024 1 repository listed
-
7 May 2024 1 repository listed
-
29 Apr 2024 1 repository listed
-
9 Apr 2024 1 repository listed
-
26 Mar 2024 1 repository listed
-
22 Mar 2024 1 repository listed
-
21 Mar 2024 1 repository listed
-
7 Mar 2024 1 repository listed
-
4 Mar 2024 1 repository listed
-
20 Feb 2024 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)
-
20 Feb 2024 1 repository listed
-
27 Dec 2023 1 repository listed
-
18 Dec 2023 1 repository listed
-
18 Dec 2023 1 repository listed
-
29 Oct 2023 1 repository listed
-
17 Aug 2023 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
7 Aug 2023 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 5 harvested samples)
-
4 Aug 2023 1 repository listed
-
21 Jul 2023 1 repository listed
-
20 Jul 2023 1 repository listed
-
26 Jun 2023 1 repository listed
-
23 May 2023 1 repository listed
-
7 May 2023 1 repository listed
-
5 May 2023 1 repository listed
-
21 Apr 2023 1 repository listed
-
3 Mar 2023 1 repository listed
-
27 Feb 2023 1 repository listed
-
27 Feb 2023 1 repository listed
-
2 Jan 2023 1 repository listed
-
24 Dec 2022 1 repository listed
-
23 Dec 2022 1 repository listed Syntology official: no sample here; runs from other or unrecorded repositories · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
21 Dec 2022 1 repository listed
-
14 Nov 2022 1 repository listed
-
4 Nov 2022 1 repository listed
-
28 Oct 2022 1 repository listed
-
26 Oct 2022 1 repository listed
-
26 Oct 2022 1 repository listed
-
30 Sep 2022 1 repository listed
-
29 Jul 2022 1 repository listed
-
25 Jul 2022 1 repository listed
-
21 Jun 2022 1 repository listed
-
18 May 2022 1 repository listed
-
12 Apr 2022 1 repository listed
-
5 Apr 2022 1 repository listed
-
31 Mar 2022 1 repository listed
-
29 Mar 2022 1 repository listed
-
27 Mar 2022 1 repository listed
-
26 Mar 2022 1 repository listed
-
17 Mar 2022 1 repository listed
-
15 Mar 2022 1 repository listed
Syntology lines on 12 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections