Browse State-of-the-Art › Facial Action Unit Detection
Facial Action Unit Detection
21 papers with code · 3 benchmarks · 4 datasets archive 2025-07-28
Facial action unit detection is the task of detecting action units from a video of a face - for example, lip tightening and cheek raising.
( Image credit: Self-supervised Representation Learning from Videos for Facial Action Unit Detection )
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
3 leaderboard tables shown for this task, 3 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
Syntology 2 newer papers were judged to report on this task's benchmarks so far (Claude Sonnet 4.5, reading their tables: a model's judgement, not a result; 0 placed): DISFA (2 judged, 0 placed). Drawn from 8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read).
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| BP4D (10 rows) | FMAE-IAT | Representation Learning and Identity Adversarial Training for... | code | — | Compare |
| DISFA (8 rows) | Norface | Norface: Improving Facial Expression Analysis by Identity Normalization | code | — | Compare |
| BP4D+ (3 rows) | FMAE-IAT | Representation Learning and Identity Adversarial Training for... | code | — | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
4 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 96 · with a code link: 21 · where Syntology ran a sample: 3 (3 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3 of 96 tagged: 3 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 96 of 96, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
10 Feb 2020 3 repositories listed Syntology official (archive's flag): 1 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 1 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 7 harvested samples)We use the soft labels and the ground truth to train the student model.
-
9 Mar 2024 2 repositories listedIn conclusion, this paper provides valuable insights into the potential applications and challenges of MLLMs in human-centric computing.
-
15 Aug 2023 2 repositories listedAnatomically, there are innumerable correlations between AUs, which contain rich information and are vital for AU detection.
-
2 May 2022 2 repositories listed Syntology official (archive's flag): 2 ran · 7 ran (of which 4 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 7 harvested samples)While the relationship between a pair of AUs can be complex and unique, existing approaches fail to specifically and explicitly represent such cues for each pair of AUs in each facial display.
-
30 Mar 2021 2 repositories listedRecent work on Deep Learning in the area of face analysis has focused on supervised learning for specific tasks of interest (e. g. face recognition, facial landmark localization etc.)
-
11 Jan 2017 2 repositories listedLimited annotated data available for the recognition of facial expression and action units embarrasses the training of deep networks, which can learn disentangled invariant features.
-
1 Jun 2016 2 repositories listedRegion learning (RL) and multi-label learning (ML) have recently attracted increasing attentions in the field of facial Action Unit (AU) detection.
-
2 Oct 2024 1 repository listedSpecifically, we explore the mechanism of self-attention weight distribution, in which the self-attention weight distribution of each AU is regarded as spatial distribution and is adaptively learned under the constraint…
-
22 Jul 2024 1 repository listedFirst, the carefully designed normalization network struggles to directly remove the above task-irrelevant noise, by maintaining facial expression consistency but normalizing all original images to a common identity…
-
15 Jul 2024 1 repository listedTo fill this gap, we first show that subject identity in AU datasets creates shortcut learning for the model and leads to sub-optimal solutions to AU predictions.
-
9 Apr 2024 1 repository listed Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 11 harvested samples)Human facial action units (AUs) are mutually related in a hierarchical manner, as not only they are associated with each other in both spatial and temporal domains but also AUs located in the same/close facial regions…
-
7 Mar 2024 1 repository listedFacial Action Units (AU) is a vital concept in the realm of affective computing, and AU detection has always been a hot research topic.
-
9 Feb 2024 1 repository listedFor the Facial Action Unit (AU) detection task, accurately capturing the subtle facial differences between distinct AUs is essential for reliable detection.
-
23 Aug 2023 1 repository listedThe proposed FG-Net achieves a strong generalization ability for heatmap-based AU detection thanks to the generalizable and semantic-rich features extracted from the pre-trained generative model.
-
17 Feb 2021 1 repository listedTo automate parts of this process, we propose a Deep Learning-based method to detect EquiFACS units automatically from images.
-
18 Mar 2020 1 repository listedMoreover, to extract precise local features, we propose an adaptive attention learning module to refine the attention map of each AU adaptively.
-
24 Oct 2019 1 repository listedIn this work, we propose a semi-supervised approach for AU recognition utilizing a large number of web face images without AU labels and a relatively small face dataset with AU annotations inspired by the co-training…
-
1 Jun 2019 1 repository listedIn this paper, we aim to learn discriminative representation for facial action unit (AU) detection from large amount of videos without manual annotations.
-
25 Mar 2019 1 repository listedDue to the combination of source AU-related information and target AU-free information, the latent feature domain with transferred source label can be learned by maximizing the target-domain AU detection performance.
-
15 Mar 2018 1 repository listedFacial action unit (AU) detection and face alignment are two highly correlated tasks since facial landmarks can provide precise AU locations to facilitate the extraction of meaningful local features for AU detection.
-
25 Apr 2017 1 repository listedWe then move to the novel setup of the FERA 2017 Challenge, in which we propose a multi-view extension of our approach that operates by first predicting the viewpoint from which the video was taken, and then evaluating…
-
FG 2025 TrustFAA: the First Workshop on Towards Trustworthy Facial Affect Analysis: Advancing Insights of Fairness, Explainability, and Safety (TrustFAA)5 Jun 2025 0 repositories listedWith the increasing prevalence and deployment of Emotion AI-powered facial affect analysis (FAA) tools, concerns about the trustworthiness of these systems have become more prominent.
-
AU-TTT: Vision Test-Time Training model for Facial Action Unit Detection30 Mar 2025 0 repositories listedFacial Action Units (AUs) detection is a cornerstone of objective facial expression analysis and a critical focus in affective computing.
-
Decoupled Doubly Contrastive Learning for Cross Domain Facial Action Unit Detection12 Mar 2025 0 repositories listedDespite the impressive performance of current vision-based facial action unit (AU) detection approaches, they are heavily susceptible to the variations across different domains and the cross-domain AU detection methods…
-
Towards Unified Facial Action Unit Recognition Framework by Large Language Models13 Sep 2024 0 repositories listedFacial Action Units (AUs) are of great significance in the realm of affective computing.
-
Towards End-to-End Explainable Facial Action Unit Recognition via Vision-Language Joint Learning1 Aug 2024 0 repositories listedFacial action units (AUs), as defined in the Facial Action Coding System (FACS), have received significant research interest owing to their diverse range of applications in facial state analysis.
-
AUD-TGN: Advancing Action Unit Detection with Temporal Convolution and GPT-2 in Wild Audiovisual Contexts20 Mar 2024 0 repositories listedLeveraging the synergy of both audio data and visual data is essential for understanding human emotions and behaviors, especially in in-the-wild setting.
-
Leveraging Synthetic Data for Generalizable and Fair Facial Action Unit Detection15 Mar 2024 0 repositories listedFacial action unit (AU) detection is a fundamental block for objective facial expression analysis.
-
Contrastive Learning of Person-independent Representations for Facial Action Unit Detection6 Mar 2024 0 repositories listedFacial action unit (AU) detection, aiming to classify AU present in the facial image, has long suffered from insufficient AU annotations.
-
2 Jan 2024 0 repositories listedMulti-Task Learning (MTL) is a framework, where multiple related tasks are learned jointly and benefit from a shared representation space, or parameter transfer.
-
Boosting Facial Action Unit Detection Through Jointly Learning Facial Landmark Detection and Domain Separation and Reconstruction8 Oct 2023 0 repositories listed
-
Occlusion Aware Student Emotion Recognition based on Facial Action Unit Detection18 Jul 2023 0 repositories listed
-
Fighting over-fitting with quantization for learning deep neural networks on noisy labels21 Mar 2023 0 repositories listed
-
Multi-modal Facial Action Unit Detection with Large Pre-trained Models for the 5th Competition on Affective Behavior Analysis in-the-wild19 Mar 2023 0 repositories listed
-
Local Region Perception and Relationship Learning Combined with Feature Fusion for Facial Action Unit Detection15 Mar 2023 0 repositories listed
-
Self-supervised Facial Action Unit Detection with Region and Relation Learning10 Mar 2023 0 repositories listed
-
Biomechanics-Guided Facial Action Unit Detection Through Force Modeling1 Jan 2023 0 repositories listed
-
ReactioNet: Learning High-Order Facial Behavior from Universal Stimulus-Reaction by Dyadic Relation Reasoning1 Jan 2023 0 repositories listed
-
FAN-Trans: Online Knowledge Distillation for Facial Action Unit Detection11 Nov 2022 0 repositories listed
-
Facial Action Unit Detection and Intensity Estimation from Self-supervised Representation28 Oct 2022 0 repositories listed
-
Global-to-local Expression-aware Embeddings for Facial Action Unit Detection27 Oct 2022 0 repositories listed
-
Multimodal Channel-Mixing: Channel and Spatial Masked AutoEncoder on Facial Action Unit Detection25 Sep 2022 0 repositories listed
-
Causal Intervention for Subject-Deconfounded Facial Action Unit Recognition17 Apr 2022 0 repositories listed
-
Weakly Supervised Regional and Temporal Learning for Facial Action Unit Recognition1 Apr 2022 0 repositories listed
-
Facial Action Unit Recognition Based on Transfer Learning25 Mar 2022 0 repositories listed
-
Facial Action Unit Recognition With Multi-models Ensembling24 Mar 2022 0 repositories listed
-
Multi-modal Multi-label Facial Action Unit Detection with Transformer24 Mar 2022 0 repositories listed
-
Multi-Order Networks for Action Unit Detection1 Feb 2022 0 repositories listed
-
Knowledge-Driven Self-Supervised Representation Learning for Facial Action Unit Recognition1 Jan 2022 0 repositories listed
-
Self-Supervised Regional and Temporal Auxiliary Tasks for Facial Action Unit Recognition30 Jul 2021 0 repositories listed
-
Exploiting Semantic Embedding and Visual Feature for Facial Action Unit Detection19 Jun 2021 0 repositories listed
-
Facial Action Unit Detection With Transformers19 Jun 2021 0 repositories listed
-
Hybrid Message Passing With Performance-Driven Structures for Facial Action Unit Detection19 Jun 2021 0 repositories listed
-
Exploring Adversarial Learning for Deep Semi-Supervised Facial Action Unit Recognition4 Jun 2021 0 repositories listed
-
Meta Auxiliary Learning for Facial Action Unit Detection14 May 2021 0 repositories listed
-
Affect Analysis in-the-wild: Valence-Arousal, Expressions, Action Units and a Unified Framework29 Mar 2021 0 repositories listed
-
DeepFN: Towards Generalizable Facial Action Unit Recognition with Deep Face Normalization3 Mar 2021 0 repositories listed
-
Multi-Level Adaptive Region of Interest and Graph Learning for Facial Action Unit Recognition24 Feb 2021 0 repositories listed
-
PIAP-DF: Pixel-Interested and Anti Person-Specific Facial Action Unit Detection Net With Discrete Feedback Learning1 Jan 2021 0 repositories listed
-
Computational efficient deep neural network with difference attention maps for facial action unit detection24 Nov 2020 0 repositories listed
-
HiCOMEX: Facial Action Unit Recognition Based on Hierarchy Intensity Distribution and COMEX Relation Learning23 Sep 2020 0 repositories listed
-
Facial Action Unit Detection using 3D Facial Landmarks17 May 2020 0 repositories listed
-
Facial Action Unit Detection on ICU Data for Pain Assessment24 Apr 2020 0 repositories listed
-
GeoConv: Geodesic Guided Convolution for Facial Action Unit Recognition6 Mar 2020 0 repositories listed
-
Upper, Middle and Lower Region Learning for Facial Action Unit Detection10 Feb 2020 0 repositories listed
-
Facial Action Unit Detection via Adaptive Attention and Relation5 Jan 2020 0 repositories listed
-
Relation Modeling with Graph Convolutional Networks for Facial Action Unit Detection23 Oct 2019 0 repositories listed
-
Fast and Effective Adaptation of Facial Action Unit Detection Deep Model26 Sep 2019 0 repositories listed
-
Local Relationship Learning With Person-Specific Shape Regularization for Facial Action Unit Detection1 Jun 2019 0 repositories listed
-
Semantic Relationships Guided Representation Learning for Facial Action Unit Recognition22 Apr 2019 0 repositories listed
-
Learned 3D Shape Representations Using Fused Geometrically Augmented Images: Application to Facial Expression and Action Unit Detection8 Apr 2019 0 repositories listed
-
The Truth and Nothing but the Truth: Multimodal Analysis for Deception Detection11 Mar 2019 0 repositories listed
-
Facial Action Unit Detection Using Attention and Relation Learning10 Aug 2018 0 repositories listed
-
Transfer Learning for Action Unit Recognition19 Jul 2018 0 repositories listed
-
Expression Empowered ResiDen Network for Facial Action Unit Detection13 Jun 2018 0 repositories listed
-
Classifier Learning With Prior Probabilities for Facial Action Unit Recognition1 Jun 2018 0 repositories listed
-
Weakly Supervised Facial Action Unit Recognition Through Adversarial Training1 Jun 2018 0 repositories listed
-
The Intelligent ICU Pilot Study: Using Artificial Intelligence Technology for Autonomous Patient Monitoring25 Apr 2018 0 repositories listed
-
Deep Structure Inference Network for Facial Action Unit Recognition15 Mar 2018 0 repositories listed
-
Accurate Facial Parts Localization and Deep Learning for 3D Facial Expression Recognition4 Mar 2018 0 repositories listed
-
Deep Facial Action Unit Recognition From Partially Labeled Data1 Oct 2017 0 repositories listed
-
Constrained Joint Cascade Regression Framework for Simultaneous Facial Action Unit Recognition and Facial Landmark Detection23 Sep 2017 0 repositories listed
-
Optimizing Filter Size in Convolutional Neural Networks for Facial Action Unit Recognition26 Jul 2017 0 repositories listed
-
Incremental Boosting Convolutional Neural Network for Facial Action Unit Recognition17 Jul 2017 0 repositories listed
-
Improving Speech Related Facial Action Unit Recognition by Audiovisual Information Fusion29 Jun 2017 0 repositories listed
-
Learning with Privileged Information for Multi-Label Classification29 Mar 2017 0 repositories listed
-
FERA 2017 - Addressing Head Pose in the Third Facial Expression Recognition and Analysis Challenge14 Feb 2017 0 repositories listed
-
EAC-Net: A Region-based Deep Enhancing and Cropping Approach for Facial Action Unit Detection9 Feb 2017 0 repositories listed
-
Modeling Spatial and Temporal Cues for Multi-label Facial Action Unit Detection2 Aug 2016 0 repositories listed
-
Confidence Preserving Machine for Facial Action Unit Detection1 Dec 2015 0 repositories listed
-
Learning to Transfer: Transferring Latent Task Structures and Its Application to Person-Specific Facial Action Unit Detection1 Dec 2015 0 repositories listed
-
Multi-Conditional Latent Variable Model for Joint Facial Action Unit Detection1 Dec 2015 0 repositories listed
-
Time Series Classification using the Hidden-Unit Logistic Model16 Jun 2015 0 repositories listed
-
Joint Patch and Multi-Label Learning for Facial Action Unit Detection1 Jun 2015 0 repositories listed
-
Relative Facial Action Unit Detection1 May 2014 0 repositories listed
-
Selective Transfer Machine for Personalized Facial Action Unit Detection1 Jun 2013 0 repositories listed
Syntology lines on 3 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections