Browse State-of-the-Art › Video Emotion Recognition
Video Emotion Recognition
9 papers with code · 2 benchmarks · 5 datasets archive 2025-07-28
Benchmarks archive 2025-07-28
2 leaderboard tables shown for this task, 2 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
Syntology 2 newer papers were judged to report on this task's benchmarks so far (Claude Sonnet 4.5, reading their tables: a model's judgement, not a result; 0 placed): CREMA-D (2 judged, 0 placed). Drawn from 8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read).
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| Ekman6 (6 rows) | VEMOCLAP | VEMOCLAP: A video emotion classification web application | — | — | Compare |
| CREMA-D (4 rows) | VAEmo | VAEmo: Efficient Representation Learning for Visual-Audio Emotion... | code | — | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
5 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 29 · with a code link: 9 · where Syntology ran a sample: 2 (2 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (2 of 29 tagged: 2 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 29 of 29, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from.
-
15 Jun 2020 2 repositories listedHumans are able to comprehend information from multiple domains for e. g. speech, text and visual.
-
21 Nov 2019 2 repositories listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)Spatial-temporal feature learning is of vital importance for video emotion recognition.
-
5 May 2025 1 repository listedAudiovisual emotion recognition (AVER) aims to infer human emotions from nonverbal visual-audio (VA) cues, offering modality-complementary and language-agnostic advantages.
-
25 Dec 2024 1 repository listedThis paper expands the cascaded network branch of the autoencoder-based multi-task learning (MTL) framework for dynamic facial expression recognition, namely Multi-Task Cascaded Autoencoder for Dynamic Facial Expression…
-
28 Apr 2024 1 repository listedIn comparison to state-of-the-art multimodal supervised learning models for dynamic emotion recognition, MultiMAE-DER enhances the weighted average recall (WAR) by 4.
-
29 Nov 2023 1 repository listedThe prevailing use of SVs to spread emotions leads to the necessity of conducting video emotion analysis (VEA) towards SVs.
-
1 Jan 2023 1 repository listedAutomatically predicting the emotions of user-generated videos (UGVs) receives increasing interest recently.
-
21 Sep 2022 1 repository listedIn the latest social networks, more and more people prefer to express their emotions in videos through text, speech, and rich facial expressions.
-
4 May 2021 1 repository listedIn this work, we describe our method for tackling the valence-arousal estimation challenge from ABAW FG-2020 Competition.
-
Visual and textual prompts for enhancing emotion recognition in video24 Apr 2025 0 repositories listedVision Large Language Models (VLLMs) exhibit promising potential for multi-modal understanding, yet their application to video-based emotion recognition remains limited by insufficient spatial and contextual awareness.
-
22 Oct 2024 0 repositories listedWe introduce VEMOCLAP: Video EMOtion Classifier using Pretrained features, the first readily available and open-source web application that analyzes the emotional content of any user-provided video.
-
FE-Adapter: Adapting Image-based Emotion Classifiers to Videos5 Aug 2024 0 repositories listedUtilizing large pre-trained models for specific tasks has yielded impressive results.
-
MART: Masked Affective RepresenTation Learning via Masked Temporal Distribution Distillation1 Jan 2024 0 repositories listedLimited training data is a long-standing problem for video emotion analysis (VEA).
-
Affective Video Content Analysis: Decade Review and New Perspectives26 Oct 2023 0 repositories listedVideo content is rich in semantics and has the ability to evoke various emotions in viewers.
-
Fuzzy Approach for Audio-Video Emotion Recognition in Computer Games for Children31 Aug 2023 0 repositories listedComputer games are widespread nowadays and enjoyed by people of all ages.
-
12 May 2023 0 repositories listedThis study proposes a versatile audio-visual learning (VAVL) framework for handling unimodal and multimodal systems for emotion regression and emotion classification tasks.
-
14 Oct 2022 0 repositories listedAlthough temporal patterns inherent in visual and audio signals are crucial for affective video content analysis, they have not been thoroughly explored yet.
-
ICANet: A Method of Short Video Emotion Recognition Driven by Multimodal Data24 Aug 2022 0 repositories listedWith the fast development of artificial intelligence and short videos, emotion recognition in short videos has become one of the most important research topics in human-computer interaction.
-
Multi-modal Residual Perceptron Network for Audio-Video Emotion Recognition21 Jul 2021 0 repositories listedAudio-Video Emotion Recognition is now attacked with Deep Neural Network modeling tools.
-
27 Dec 2020 0 repositories listedThe audio-video based emotion recognition aims to classify a given video into basic emotions.
-
Audio-video Emotion Recognition in the Wild using Deep Hybrid Networks20 Feb 2020 0 repositories listedThis paper presents an audiovisual-based emotion recognition hybrid network.
-
12 Feb 2020 0 repositories listed Syntology 4 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 7 harvested samples) · 7 pointer-only (licence)Emotion recognition in user-generated videos plays an important role in human-centered computing.
-
Multimodal Fusion with Deep Neural Networks for Audio-Video Emotion Recognition6 Jul 2019 0 repositories listedThis paper presents a novel deep neural network (DNN) for multimodal fusion of audio, video and text modalities for emotion recognition.
-
Deep Fusion: An Attention Guided Factorized Bilinear Pooling for Audio-video Emotion Recognition15 Jan 2019 0 repositories listedAutomatic emotion recognition (AER) is a challenging task due to the abstract concept and multiple expressions of emotion.
-
Context-aware Cascade Attention-based RNN for Video Emotion Recognition30 May 2018 0 repositories listedEmotion recognition can provide crucial information about the user in many applications when building human-computer interaction (HCI) systems.
-
Automatic Recognition of Facial Displays of Unfelt Emotions13 Jul 2017 0 repositories listedHumans modify their facial expressions in order to communicate their internal states and sometimes to mislead observers regarding their true emotional states.
-
Spatiotemporal Networks for Video Emotion Recognition3 Apr 2017 0 repositories listedOur experiment adapts several popular deep learning methods as well as some traditional methods on the problem of video emotion recognition.
-
Modelling Temporal Information Using Discrete Fourier Transform for Recognizing Emotions in User-generated Videos20 Mar 2016 0 repositories listedWith the widespread of user-generated Internet videos, emotion recognition in those videos attracts increasing research efforts.
-
16 Nov 2015 0 repositories listedEmotion is a key element in user-generated videos.
Syntology lines on 2 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections