Datasets › HICO-DET

HICO-DET

Introduced by Yu-Wei Chao et al. in Learning to Detect Human-Object Interactions1 Jan 2018 archive 2025-07-28

HICO-DET is a dataset for detecting human-object interactions (HOI) in images. It contains 47,776 images (38,118 in train set and 9,658 in test set), 600 HOI categories constructed by 80 object categories and 117 verb classes. HICO-DET provides more than 150k annotated human-object pairs. V-COCO provides 10,346 images (2,533 for training, 2,867 for validating and 4,946 for testing) and 16,199 person instances. Each person has annotations for 29 action categories and there are no interaction labels including objects.

Source: Visual Compositional Learning for Human-Object Interaction Detection Image Source: http://www-personal.umich.edu/~ywchao/hico/

Benchmarks archive 2025-07-28

All 4 leaderboards whose dataset resolves to this page shown (sort by any header). "First row" is the archive's own first row at snapshot, in the archive's row order; nothing here re-ranks and metric direction is not asserted.

Papers archive 2025-07-28

papers with a benchmark row: 52 · with a code link: 49 · where Syntology ran a sample: 21 (18 with a run with no instrument failure, 3 where every run was a failure of Syntology's instrument) Syntology

Show: all papers with a benchmark rowonly where code ran (21 of 52 with a benchmark row: 18 with a run with no instrument failure, 3 where every run was a failure of Syntology's instrument)

Page 1 of 1: papers 1 to 52 of 52 with a leaderboard row on this dataset's benchmarks, newest first by the archive's date (ties by slug; undated papers last).

The archive's own "papers using this dataset" list was never published, so this is the benchmark-backed subset, not that list; the archive's count for this dataset is 180. The Syntology column is from Syntology's graph, stated per sample; it is not part of any archive number. A line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified” (C is a part of N, never taken away from it); the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced. When the archive marks a repository official for the paper, the cell starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record.

PaperCodeResultsDateSamples run Syntology
Dynamic Scene Understanding from Vision-Language Representations 0 1 20 Jan 2025 not harvested
Unseen No More: Unlocking the Potential of CLIP for Generative Zero-shot HOI Detection 1 1 12 Aug 2024 not harvested
RLIPv2: Fast Scaling of Relational Language-Image Pre-training 3 1 18 Aug 2023 official (archive's flag): 8 ran · 22 ran (of which 5 constructed an object rather than computing a result; 18 with no instrument failure: 0 honoured, 1 violated, 17 with no contract checked; 4 where Syntology's instrument failed) · 8 unverified
Exploring Predicate Visual Context in Detecting Human-Object Interactions 1 2 11 Aug 2023 official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (1 pointer-only for licence)
Focusing on what to decode and what to train: SOV Decoding with Specific Target Guided DeNoising and Vision Language Advisor 2 1 5 Jul 2023 not harvested
Boosting Human-Object Interaction Detection with Text-to-Image Diffusion Model 1 1 20 May 2023 not harvested
ViPLO: Vision Transformer based Pose-Conditioned Self-Loop Graph for Human-Object Interaction Detection 1 1 17 Apr 2023 not harvested
Relational Context Learning for Human-Object Interaction Detection 1 1 11 Apr 2023 official (archive's flag): 10 ran · 10 ran (of which 4 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (12 pointer-only for licence)
HOICLIP: Efficient Knowledge Transfer for HOI Detection with Vision-Language Models 1 1 28 Mar 2023 not harvested
Category Query Learning for Human-Object Interaction Classification 1 2 24 Mar 2023 official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified
ERNet: Efficient and Reliable Human-Object Interaction Detection 1 1 26 Jan 2023 not harvested
FGAHOI: Fine-Grained Anchors for Human-Object Interaction Detection 1 1 8 Jan 2023 not harvested
RLIP: Relational Language-Image Pre-training for Human-Object Interaction Detection 3 2 5 Sep 2022 official: harvested, nothing ran · 0 ran · 1 unverified
Mining Cross-Person Cues for Body-Part Interactiveness Learning in HOI Detection 1 1 28 Jul 2022 official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result
Exploring Structure-aware Transformer over Interaction Proposals for Human-Object Interaction Detection 1 1 13 Jun 2022 not harvested
Consistency Learning via Decoding Path Augmentation for Transformers in Human Object Interaction Detection 1 2 11 Apr 2022 not harvested
Discovering Human-Object Interaction Concepts via Self-Compositional Learning 2 2 27 Mar 2022 official: harvested, nothing ran · 0 ran · 1 unverified (1 pointer-only for licence)
GEN-VLKT: Simplify Association and Enhance Interaction Understanding for HOI Detection 1 1 26 Mar 2022 official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (2 pointer-only for licence)
Detecting Human-Object Interactions with Object-Guided Cross-Modal Calibrated Semantics 1 1 1 Feb 2022 official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 5 unverified
QAHOI: Query-Based Anchors for Human-Object Interaction Detection 1 1 16 Dec 2021 official (archive's flag): 14 ran · 14 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 1 violated, 4 with no contract checked; 8 where Syntology's instrument failed) · 1 unverified (5 pointer-only for licence)
The Overlooked Classifier in Human-Object Interaction Recognition 0 1 13 Dec 2021 not harvested
Efficient Two-Stage Detection of Human-Object Interactions with a Novel Unary-Pairwise Transformer 1 3 3 Dec 2021 official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (1 pointer-only for licence)
ACP++: Action Co-occurrence Priors for Human-Object Interaction Detection 1 1 9 Sep 2021 not harvested
Mining the Benefits of Two-stage and One-stage HOI Detection 1 1 11 Aug 2021 official (archive's flag): 3 ran · 3 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified
HOTR: End-to-End Human-Object Interaction Detection with Transformers 1 1 28 Apr 2021 official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result
Affordance Transfer Learning for Human-Object Interaction Detection 2 2 7 Apr 2021 not harvested
Detecting Human-Object Interaction via Fabricated Compositional Learning 1 1 15 Mar 2021 official: harvested, nothing ran · 0 ran · 1 unverified
Reformulating HOI Detection as Adaptive Set Prediction 1 1 10 Mar 2021 official: harvested, nothing ran · 0 ran · 1 unverified
QPIC: Query-Based Pairwise Human-Object Interaction Detection with Image-Wide Contextual Information 1 3 9 Mar 2021 official: harvested, nothing ran · 0 ran · 1 unverified
End-to-End Human Object Interaction Detection with HOI Transformer 1 2 8 Mar 2021 official: harvested, nothing ran · 0 ran · 1 unverified
Transferable Interactiveness Knowledge for Human-Object Interaction Detection 1 1 25 Jan 2021 not harvested
Spatially Conditioned Graphs for Detecting Human-Object Interactions 2 1 11 Dec 2020 not harvested
HOI Analysis: Integrating and Decomposing Human-Object Interaction 2 2 30 Oct 2020 not harvested
DIRV: Dense Interaction Region Voting for End-to-End Human-Object Interaction Detection 1 1 2 Oct 2020 official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (3 pointer-only for licence)
DRG: Dual Relation Graph for Human-Object Interaction Detection 1 1 26 Aug 2020 official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (2 pointer-only for licence)
ConsNet: Learning Consistency Graph for Zero-Shot Human-Object Interaction Detection 2 2 14 Aug 2020 not harvested
Polysemy Deciphering Network for Robust Human-Object Interaction Detection 2 1 7 Aug 2020 not harvested
Pose-based Modular Network for Human-Object Interaction Detection 1 1 5 Aug 2020 not harvested
Detecting Human-Object Interactions with Action Co-occurrence Priors 1 1 1 Aug 2020 not harvested
Visual Compositional Learning for Human-Object Interaction Detection 4 1 24 Jul 2020 community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified
Detailed 2D-3D Joint Representation for Human-Object Interaction 1 1 17 Apr 2020 official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified
PaStaNet: Toward Human Activity Knowledge Engine 2 1 2 Apr 2020 not harvested
VSGNet: Spatial Attention Network for Detecting Human Object Interactions Using Graph Convolutions 2 1 11 Mar 2020 official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified
PPDM: Parallel Point Detection and Matching for Real-time Human-Object Interaction Detection 1 1 30 Dec 2019 official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified
Activity Driven Weakly Supervised Object Detection 0 1 2 Apr 2019 not harvested
Transferable Interactiveness Knowledge for Human-Object Interaction Detection 3 2 20 Nov 2018 official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified
iCAN: Instance-Centric Attention Network for Human-Object Interaction Detection 4 1 30 Aug 2018 official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified
Learning Human-Object Interactions by Graph Parsing Neural Networks 1 1 23 Aug 2018 not harvested
PCL: Proposal Cluster Learning for Weakly Supervised Object Detection 4 1 9 Jul 2018 official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified
Detecting and Recognizing Human-Object Interactions 2 1 24 Apr 2017 not harvested
Weakly Supervised Deep Detection Networks 5 1 9 Nov 2015 community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (1 pointer-only for licence)
Contextual Action Recognition with R*CNN 2 1 5 May 2015 not harvested

Dataset loaders archive 2025-07-28

No loader listed in the archive.

Tasks archive 2025-07-28

License archive 2025-07-28

Unknown

Modalities archive 2025-07-28

Languages archive 2025-07-28

No language tagged.

Variants archive 2025-07-28

  • HICO-DET

1 variant name, as the archive lists them.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections