Datasets › HMDB51

HMDB51

Introduced in HMDB: A large video database for human motion recognition1 Jan 2011 archive 2025-07-28

The HMDB51 dataset is a large collection of realistic videos from various sources, including movies and web videos. The dataset is composed of 6,766 video clips from 51 action categories (such as “jump”, “kiss” and “laugh”), with each category containing at least 101 clips. The original evaluation scheme uses three different training/testing splits. In each split, each action class has 70 clips for training and 30 clips for testing. The average accuracy over these three splits is used to measure the final performance.

Source: Action Recognition with Trajectory-Pooled Deep-Convolutional Descriptors Image Source: https://serre-lab.clps.brown.edu/resource/hmdb-a-large-human-motion-database

Benchmarks archive 2025-07-28

All 10 leaderboards whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

First row (archive order)PaperCode
Action Recognition HMDB-51 VideoMAE V2-g Average accuracy of 3 splits 88.7 VideoMAE V2: Scaling Video Masked Autoencoders with Dual Masking OpenGVLab/VideoMAEv2 77 Compare
Self-Supervised Action Recognition HMDB51 MVD (ViT-B) Top-1 Accuracy 79.7 Masked Video Distillation: Rethinking Masked Feature... ruiwang2021/mvd +3 48 Compare
Zero-Shot Action Recognition HMDB51 MOV (ViT-L/14) Top-1 Accuracy 64.7 Multimodal Open-Vocabulary Video Classification via... — 29 Compare
Self-Supervised Action Recognition HMDB51 (finetuned) BraVe:V-FA (TSM-50x2) Top-1 Accuracy 77.8 Broaden Your Views for Self-Supervised Video Learning deepmind/brave 14 Compare
Few Shot Action Recognition HMDB51 STRM 1:1 Accuracy 77.3 Spatio-temporal Relation Modeling for Few-shot Action Recognition Anirudh257/strm 7 Compare
Skeleton Based Action Recognition HMDB51 Structured Keypoint Pooling Accuracy 70.9 Unified Keypoint-based Action Recognition Framework via... — 2 Compare
Action Classification HMDB51 DualPath w/ ViT-B/16 MLPs. Acc@1 75.6 Dual-path Adaptation from Image to Video Transformers park-jungin/dualpath 1 Compare
Action Recognition In Videos HMDB-51 STM (ImageNet+Kinetics pretrain) Average accuracy of 3 splits 72.2 STM: SpatioTemporal and Motion Encoding for Action Recognition — 1 Compare
Action Recognition HMDB51 MSQNet Accuracy 93.25 Actor-agnostic Multi-label Action Recognition with... mondalanindya/msqnet 1 Compare
Human Activity Recognition HMDB51 Label-Ranker Accuracy 61.18% Label Ranker: Self-Aware Preference for Classification... Peihao-Xiang/Label-Ranker 1 Compare

Papers archive 2025-07-28

papers with a benchmark row: 125 · with a code link: 82 · where Syntology ran a sample: 28 (22 with a run with no instrument failure, 6 where every run was a failure of Syntology's instrument) Syntology

Show: all papers with a benchmark rowonly where code ran (28 of 125 with a benchmark row: 22 with a run with no instrument failure, 6 where every run was a failure of Syntology's instrument)

Page 1 of 2: papers 1 to 100 of 125 with a leaderboard row on this dataset's benchmarks, newest first by the archive's date (ties by slug; undated papers last).

The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset, not that list; the archive's count for this dataset is 839. The Syntology column is from Syntology's graph, stated per sample; it is not part of any archive number. A line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified” (C is a part of N, never taken away from it); the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. When the archive marks a repository official for the paper, the cell starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record.

PaperCodeResultsDateSamples run Syntology
Label Ranker: Self-Aware Preference for Classification Label Position in Visual Masked Self-Supervised Pre-Trained Model 1 1 3 Mar 2025 not harvested
IoT-Based Real-Time Medical-Related Human Activity Recognition Using Skeletons and Multi-Stage Deep Learning for Healthcare 1 1 13 Jan 2025 not harvested
DejaVid: Encoder-Agnostic Learned Temporal Matching for Video Classification 1 1 1 Jan 2025 not harvested
LoCATe-GAT: Modeling Multi-Scale Local Context and Action Relationships for Zero-Shot Action Recognition 1 1 27 Nov 2024 not harvested
Leveraging Temporal Contextualization for Video Action Recognition 2 1 15 Apr 2024 official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (4 pointer-only for licence)
OST: Refining Text Knowledge with Optimal Spatio-Temporal Descriptor for General Video Recognition 1 1 30 Nov 2023 official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified
Asymmetric Masked Distillation for Pre-Training Small Foundation Models 0 1 6 Nov 2023 not harvested
ZeroI2V: Zero-Cost Adaptation of Pre-trained Transformers from Image to Video 2 1 2 Oct 2023 official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified
Orthogonal Temporal Interpolation for Zero-Shot Video Recognition 1 1 14 Aug 2023 official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (3 pointer-only for licence)
Actor-agnostic Multi-label Action Recognition with Multi-modal Query 1 2 20 Jul 2023 not harvested
Alternating Gradient Descent and Mixture-of-Experts for Integrated Multimodal Perception 0 1 10 May 2023 not harvested
Synthetic Sample Selection for Generalized Zero-Shot Learning 0 1 6 Apr 2023 not harvested
VicTR: Video-conditioned Text Representations for Activity Recognition 0 1 5 Apr 2023 not harvested
VideoMAE V2: Scaling Video Masked Autoencoders with Dual Masking 1 1 29 Mar 2023 official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified; every one of the 2 samples that ran constructed an object rather than computing a result
Unified Keypoint-based Action Recognition Framework via Structured Keypoint Pooling 0 1 27 Mar 2023 not harvested
Dual-path Adaptation from Image to Video Transformers 1 1 17 Mar 2023 not harvested
MAtch, eXpand and Improve: Unsupervised Finetuning for Zero-Shot Action Recognition with Language Knowledge 1 1 15 Mar 2023 official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (4 pointer-only for licence)
Bidirectional Cross-Modal Knowledge Exploration for Video Recognition with Pre-trained Vision-Language Models 5 2 31 Dec 2022 not harvested
Similarity Contrastive Estimation for Image and Video Soft Contrastive Self-Supervised Learning 2 1 21 Dec 2022 not harvested
VideoCoCa: Video-Text Modeling with Zero-Shot Transfer from Contrastive Captioners 0 1 9 Dec 2022 not harvested
Masked Video Distillation: Rethinking Masked Feature Modeling for Self-supervised Video Representation Learning 4 1 8 Dec 2022 not harvested
XKD: Cross-modal Knowledge Distillation with Domain Alignment for Video Representation Learning 1 2 25 Nov 2022 not harvested
EVEREST: Efficient Masked Video Autoencoder by Removing Redundant Spatiotemporal Tokens 2 1 19 Nov 2022 official (archive's flag): 3 ran · 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified; every one of the 3 samples that ran constructed an object rather than computing a result (6 pointer-only for licence)
Masked Motion Encoding for Self-Supervised Video Representation Learning 2 1 12 Oct 2022 not harvested
Expanding Language-Image Pretrained Models for General Video Recognition 2 1 4 Aug 2022 official (archive's flag): 3 ran · 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 3 samples that ran constructed an object rather than computing a result (3 pointer-only for licence)
Multimodal Open-Vocabulary Video Classification via Pre-Trained Vision and Language Models 0 2 15 Jul 2022 not harvested
Revisiting Classifier: Transferring Vision-Language Models for Video Recognition 5 1 4 Jul 2022 not harvested
SLIC: Self-Supervised Learning with Iterative Clustering for Human Action Videos 1 1 25 Jun 2022 not harvested
Learn2Augment: Learning to Composite Videos for Data Augmentation in Action Recognition 0 1 9 Jun 2022 not harvested
Cross-modal Representation Learning for Zero-shot Action Recognition 0 1 3 May 2022 not harvested
Hybrid Relation Guided Set Matching for Few-shot Action Recognition 1 1 28 Apr 2022 not harvested
Alignment-Uniformity aware Representation Learning for Zero-shot Video Classification 1 1 29 Mar 2022 official (archive's flag): 2 ran · 2 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (5 pointer-only for licence)
Rethinking Zero-shot Action Recognition: Learning from Latent Atomic Actions 1 1 28 Mar 2022 not harvested
VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training 9 2 23 Mar 2022 official (archive's flag): 9 ran · 10 ran (of which 6 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 0 violated, 7 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (12 pointer-only for licence)
Spatio-temporal Relation Modeling for Few-shot Action Recognition 1 1 9 Dec 2021 not harvested
Self-supervised Video Transformer 1 1 2 Dec 2021 official: harvested, nothing ran · 0 ran · 1 unverified
Self-Supervised Audio-Visual Representation Learning with Relaxed Cross-Modal Synchronicity 1 3 9 Nov 2021 not harvested
High-order Tensor Pooling with Attention for Action Recognition 0 2 11 Oct 2021 not harvested
Self-Supervised Video Representation Learning with Meta-Contrastive Network 0 2 19 Aug 2021 not harvested
Elaborative Rehearsal for Zero-shot Action Recognition 1 1 5 Aug 2021 official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 1 violated, 7 with no contract checked; 2 where Syntology's instrument failed) · 5 unverified
VIMPAC: Video Pre-Training via Masked Token Prediction and Contrastive Learning 1 1 21 Jun 2021 official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (1 pointer-only for licence)
Self-supervised Video Representation Learning with Cross-Stream Prototypical Contrasting 1 7 18 Jun 2021 not harvested
A Large-Scale Study on Unsupervised Spatiotemporal Representation Learning 2 1 29 Apr 2021 not harvested
VidTr: Video Transformer Without Convolutions 0 1 23 Apr 2021 not harvested
Broaden Your Views for Self-Supervised Video Learning 1 2 30 Mar 2021 official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified
Busy-Quiet Video Disentangling for Video Classification 2 1 29 Mar 2021 not harvested
VideoMoCo: Contrastive Video Representation Learning with Temporally Adversarial Examples 1 2 10 Mar 2021 official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (1 pointer-only for licence)
TCLR: Temporal Contrastive Learning for Video Representation 1 1 20 Jan 2021 official: harvested, nothing ran · 0 ran · 1 unverified
CLASTER: Clustering with Reinforcement Learning for Zero-Shot Action Recognition 0 1 18 Jan 2021 not harvested
Temporal-Relational CrossTransformers for Few-Shot Action Recognition 2 1 15 Jan 2021 official (archive's flag): 1 ran · 2 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (1 pointer-only for licence)
Tensor Representations for Action Recognition 1 1 28 Dec 2020 not harvested
SMART Frame Selection for Action Recognition 0 1 19 Dec 2020 not harvested
Bubblenet: A Disperse Recurrent Structure To Recognize Activities 0 1 30 Oct 2020 not harvested
Pretext-Contrastive Learning: Toward Good Practices in Self-supervised Video Representation Leaning 1 1 29 Oct 2020 not harvested
RSPNet: Relative Speed Perception for Unsupervised Video Representation Learning 1 1 27 Oct 2020 not harvested
Depth Guided Adaptive Meta-Fusion Network for Few-shot Video Recognition 1 1 20 Oct 2020 official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified
Self-supervised Co-training for Video Representation Learning 1 2 19 Oct 2020 official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified
Pose And Joint-Aware Action Recognition 1 2 16 Oct 2020 not harvested
PERF-Net: Pose Empowered RGB-Flow Net 0 1 28 Sep 2020 not harvested
Spatiotemporal Contrastive Video Representation Learning 4 6 9 Aug 2020 not harvested
Self-supervised Video Representation Learning Using Inter-intra Contrastive Framework 2 1 6 Aug 2020 official: no sample here; runs from other or unrecorded repositories · 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (4 pointer-only for licence)
Late Temporal Modeling in 3D CNN Architectures with BERT for Action Recognition 2 1 3 Aug 2020 not harvested
MotionSqueeze: Neural Motion Feature Learning for Video Understanding 2 1 20 Jul 2020 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (2 pointer-only for licence)
Self-Supervised MultiModal Versatile Networks 1 1 29 Jun 2020 not harvested
Audio-Visual Instance Discrimination with Cross-Modal Agreement 1 5 27 Apr 2020 not harvested
Omni-sourced Webly-supervised Learning for Video Recognition 3 1 29 Mar 2020 official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified
Temporally Coherent Embeddings for Self-Supervised Video Representation Learning 1 2 21 Mar 2020 official: harvested, nothing ran · 0 ran · 1 unverified (1 pointer-only for licence)
Rethinking Zero-shot Video Classification: End-to-end Training for Realistic Applications 1 1 3 Mar 2020 official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 5 unverified
Evolving Losses for Unsupervised Video Representation Learning 0 2 26 Feb 2020 not harvested
Learning spatio-temporal representations with temporal squeeze pooling 0 1 11 Feb 2020 not harvested
Self-supervising Action Recognition by Statistical Moment and Subspace Descriptors 0 1 14 Jan 2020 not harvested
Few-shot Action Recognition with Permutation-invariant Attention 1 1 12 Jan 2020 not harvested
Video Cloze Procedure for Self-Supervised Spatio-Temporal Learning 1 1 2 Jan 2020 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (3 pointer-only for licence)
Self-Supervised Learning by Cross-Modal Audio-Video Clustering 1 5 28 Nov 2019 official: harvested, nothing ran · 0 ran · 1 unverified
Video Representation Learning by Dense Predictive Coding 1 2 10 Sep 2019 official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified
Cooperative Cross-Stream Network for Discriminative Action Representation 0 1 27 Aug 2019 not harvested
STM: SpatioTemporal and Motion Encoding for Action Recognition 0 1 7 Aug 2019 not harvested
I Know the Relationships: Zero-Shot Action Recognition via Two-Stream Graph Convolutional Networks and Knowledge Graphs 1 1 17 Jul 2019 not harvested
R-STAN: Residual Spatial-Temporal Attention Network for Action Recognition 0 2 19 Jun 2019 not harvested
Hallucinating IDT Descriptors and I3D Optical Flow Features for Action Recognition with CNNs 0 1 13 Jun 2019 not harvested
Learning Spatio-Temporal Representation with Local and Global Diffusion 0 3 13 Jun 2019 not harvested
FASTER Recurrent Networks for Efficient Video Classification 0 1 10 Jun 2019 not harvested
MARS: Motion-Augmented RGB Stream for Action Recognition 1 1 1 Jun 2019 not harvested
Self-Supervised Spatiotemporal Learning via Video Clip Order Prediction 0 1 1 Jun 2019 not harvested
Hierarchical Feature Aggregation Networks for Video Action Recognition 0 1 29 May 2019 not harvested
Large Scale Holistic Video Understanding 1 1 25 Apr 2019 not harvested
Self-supervised Spatio-temporal Representation Learning for Videos by Predicting Motion and Appearance Statistics 1 1 7 Apr 2019 not harvested
Attention Distillation for Learning Video Representations 0 1 5 Apr 2019 not harvested
Contextual Action Cues from Camera Sensor for Multi-Stream Action Recognition 0 1 20 Mar 2019 not harvested
DistInit: Learning Video Representations Without a Single Labeled Video 0 1 26 Jan 2019 not harvested
DMC-Net: Generating Discriminative Motion Cues for Fast Compressed Video Action Recognition 0 3 11 Jan 2019 not harvested
D3D: Distilled 3D Networks for Video Action Recognition 1 3 19 Dec 2018 not harvested
SUSiNet: See, Understand and Summarize it 0 1 3 Dec 2018 not harvested
Self-Supervised Spatiotemporal Feature Learning via Video Rotation Prediction 0 1 28 Nov 2018 not harvested
Self-Supervised Video Representation Learning with Space-Time Cubic Puzzles 0 1 24 Nov 2018 not harvested
Representation Flow for Action Recognition 5 1 2 Oct 2018 not harvested
Contrastive Video Representation Learning via Adversarial Perturbations 0 1 24 Jul 2018 not harvested
Cooperative Learning of Audio and Video Models from Self-Supervised Synchronization 0 1 30 Jun 2018 not harvested
End-to-End Learning of Motion Representation for Video Understanding 1 1 2 Apr 2018 0 ran · 2 unverified
Towards Universal Representation for Unseen Action Recognition 0 2 22 Mar 2018 not harvested

Dataset loaders archive 2025-07-28

5 loaders as listed in the archive; links are outbound and not re-checked here.

Tasks archive 2025-07-28

License archive 2025-07-28

CC BY 4.0

Modalities archive 2025-07-28

Languages archive 2025-07-28

No language tagged.

Variants archive 2025-07-28

  • HMDB51-skeleton
  • HMDB51 (finetuned)
  • HMDB51
  • HMDB-51

4 variant names, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections