Browse State-of-the-Art › Action Anticipation
Action Anticipation
49 papers with code · 8 benchmarks · 11 datasets archive 2025-07-28
Next action anticipation is defined as observing 1, ... , T frames and predicting the action that happens after a gap of T_a seconds. It is important to note that a new action starts after T_a seconds that is not seen in the observed frames. Here T_a=1 second.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
8 leaderboard tables shown for this task, 8 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
11 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 110 · with a code link: 49 · where Syntology ran a sample: 18 (17 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (18 of 110 tagged: 17 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument)
Page 1 of 2: papers 1 to 100 of 110, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
23 Jun 2020 7 repositories listed Syntology community repositories only · 10 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 3 where Syntology's instrument failed) · 8 unverified (of 18 harvested samples)This paper introduces the pipeline to extend the largest dataset in egocentric vision, EPIC-KITCHENS.
-
1 Jun 2020 2 repositories listedFuture prediction, especially in long-range videos, requires reasoning from current and past observations.
-
4 May 2020 2 repositories listedThe experiments show that the proposed architecture is state-of-the-art in the domain of egocentric videos, achieving top performances in the 2019 EPIC-Kitchens egocentric action anticipation challenge.
-
10 Dec 2019 2 repositories listedThe hallucination task is treated as an auxiliary task, which can be used with any other action related task in a multitask learning setting.
-
22 May 2019 2 repositories listedOur method is ranked first in the public leaderboard of the EPIC-Kitchens egocentric action anticipation challenge 2019.
-
8 Apr 2018 2 repositories listedFirst-person vision is gaining interest as it offers a unique viewpoint on people's interaction with objects, their attention, and even intention.
-
11 Jun 2025 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 8 harvested samples) · 8 pointer-only (licence)Finally, we show how self-supervised learning can be applied to robotic planning tasks by post-training a latent action-conditioned world model, V-JEPA 2-AC, using less than 62 hours of unlabeled robot videos from the…
-
24 Apr 2025 1 repository listedTo capture the complexity in human activities, DARai is annotated at three levels of hierarchy: (i) high-level activities (L1) that are independent tasks, (ii) lower-level actions (L2) that are patterns shared between…
-
1 Jan 2025 1 repository listedLong-term dense action anticipation is very challenging since it requires predicting actions and their durations several minutes into the future based on provided video observations.
-
1 Jan 2025 1 repository listedExtensive experiments on benchmark datasets demonstrate the superiority of the proposed ActionLLM framework, encouraging a promising direction to explore LLMs in the context of action anticipation.
-
17 Sep 2024 1 repository listedVideo Language Models (VLMs) are crucial for generalizing across diverse tasks and using language cues to enhance learning.
-
5 Aug 2024 1 repository listedARR decomposes the action anticipation task into action recognition and sequence reasoning tasks, and effectively learns the statistical relationship between actions by next action prediction (NAP).
-
18 Jul 2024 1 repository listedIn this paper, we present our solutions for a spectrum of automation tasks in life-saving intervention procedures within the Trauma THOMPSON (T3) Challenge, encompassing action recognition, action anticipation, and…
-
16 Jul 2024 1 repository listedAs generator, we introduce a Gated Anticipation Network (GTAN) to model both observed and unobserved frames of a video in a mutual representation.
-
2 Jul 2024 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples)Action anticipation is the task of forecasting future activity from a partially observed sequence of events.
-
26 Jun 2024 1 repository listed Syntology official (archive's flag): 14 ran · 14 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 4 honoured, 0 violated, 5 with no contract checked; 5 where Syntology's instrument failed) · 1 unverified (of 15 harvested samples) · 15 pointer-only (licence)In this report, we present our solutions to the EgoVis Challenges in CVPR 2024, including five tracks in the Ego4D challenge and three tracks in the EPIC-Kitchens challenge.
-
24 Mar 2024 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 5 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples)Along with the videos we record high-quality gaze data and provide detailed multimodal annotations, formulating a playground for modeling the human ability to bridge asynchronous procedural actions from different…
-
6 Dec 2023 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)We present Egocentric Action Scene Graphs (EASGs), a new representation for long-form understanding of egocentric videos.
-
31 Oct 2023 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 5 harvested samples) · 2 pointer-only (licence)To recognize and predict human-object interactions, we use a Transformer-based neural architecture which allows the "retrieval" of relevant objects for action anticipation at various time scales.
-
31 Jul 2023 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 2 harvested samples)We propose to formulate the LTA task from two perspectives: a bottom-up approach that predicts the next actions autoregressively by modeling temporal dynamics; and a top-down approach that infers the goal of the actor…
-
4 Jul 2023 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)In this report, we describe the technical details of our approach for the Ego4D Long-Term Action Anticipation Challenge 2023.
-
28 Jun 2023 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 6 harvested samples) · 1 pointer-only (licence)We present Palm, a solution to the Long-Term Action Anticipation (LTA) task utilizing vision-language and large language models.
-
26 Jun 2023 1 repository listedIn this paper, we address the problem of short-term action anticipation, i. e., we want to predict an upcoming action one second before it happens.
-
22 May 2023 1 repository listedTo this end, we propose a novel approach that applies a guided attention mechanism between the objects, and the spatiotemporal features extracted from video clips, enhancing the motion and contextual information, and…
-
7 Feb 2023 1 repository listedObject affordance is an important concept in hand-object interaction, providing information on action possibilities based on human motor capacity and objects' physical property thus benefiting tasks such as action…
-
25 Nov 2022 1 repository listedOn the EK100 evaluation server, InAViT is the top-performing method on the public leaderboard (at the time of submission) where it outperforms the second-best model by 3.
-
23 Oct 2022 1 repository listedAlthough human action anticipation is a task which is inherently multi-modal, state-of-the-art methods on well known action anticipation datasets leverage this data by applying ensemble methods and averaging scores of…
-
20 Oct 2022 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)Action anticipation involves predicting future actions having observed the initial portion of a video.
-
12 Oct 2022 1 repository listedAnticipating future actions in a video is useful for many autonomous and assistive technologies.
-
27 Sep 2022 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)However, learning representations from videos can be challenging.
-
19 Sep 2022 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)
-
25 Jul 2022 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
1 Jul 2022 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples) · 1 pointer-only (licence)
-
28 Jun 2022 1 repository listed
-
2 Jun 2022 1 repository listed
-
27 May 2022 1 repository listed Syntology 5 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 1 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 8 harvested samples) · 8 pointer-only (licence)
-
28 Mar 2022 1 repository listed
-
20 Jan 2022 1 repository listed
-
15 Nov 2021 1 repository listed
-
28 Jul 2021 1 repository listed
-
18 Jun 2021 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 4 harvested samples) · 1 pointer-only (licence)
-
6 Jun 2021 1 repository listed
-
3 Jun 2021 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
17 Apr 2021 1 repository listed
-
28 Jun 2020 1 repository listed
-
13 May 2020 1 repository listed
-
25 Nov 2019 1 repository listed
-
16 Jul 2017 1 repository listed
-
21 Mar 2017 1 repository listed
-
Vision and Intention Boost Large Language Model in Long-Term Action Anticipation3 May 2025 0 repositories listed
-
Action Anticipation from SoccerNet Football Video Broadcasts16 Apr 2025 0 repositories listed
-
ICPR 2024 Competition on Rider Intention Prediction11 Mar 2025 0 repositories listed
-
Learning to Generate Long-term Future Narrations Describing Activities of Daily Living3 Mar 2025 0 repositories listed
-
Temporal Context Consistency Above All: Enhancing Long-Term Anticipation by Learning and Enforcing Temporal Constraints27 Dec 2024 0 repositories listed
-
ActFusion: a Unified Diffusion Model for Action Segmentation and Anticipation5 Dec 2024 0 repositories listed
-
HiMemFormer: Hierarchical Memory-Aware Transformer for Multi-Agent Action Anticipation3 Nov 2024 0 repositories listed
-
Human Action Anticipation: A Survey17 Oct 2024 0 repositories listed
-
VEDIT: Latent Prediction Architecture For Procedural Video Representation Learning4 Oct 2024 0 repositories listed
-
User-in-the-loop Evaluation of Multimodal LLMs for Activity Assistance4 Aug 2024 0 repositories listed
-
QueryMamba: A Mamba-Based Encoder-Decoder Architecture with a Statistical Verb-Noun Interaction Module for Video Action Forecasting @ Ego4D Long-Term Action Anticipation Challenge 20244 Jul 2024 0 repositories listed
-
VLM Agents Generate Their Own Memories: Distilling Experience into Embodied Programs of Thought20 Jun 2024 0 repositories listed
-
30 May 2024 0 repositories listed
-
PhilHumans: Benchmarking Machine Learning for Personal Health4 May 2024 0 repositories listed
-
Gaze-Guided Graph Neural Network for Action Anticipation Conditioned on Intention10 Apr 2024 0 repositories listed
-
Intention Action Anticipation Model with Guide-Feedback Loop Mechanism19 Mar 2024 0 repositories listed
-
On the Efficacy of Text-Based Input Modalities for Action Anticipation23 Jan 2024 0 repositories listed
-
1 Jan 2024 0 repositories listed
-
PALM: Predicting Actions through Language Models29 Nov 2023 0 repositories listed
-
DiffAnt: Diffusion Models for Action Anticipation27 Nov 2023 0 repositories listed
-
A Survey on Deep Learning Techniques for Action Anticipation29 Sep 2023 0 repositories listed
-
JOADAA: joint online action detection and action anticipation12 Sep 2023 0 repositories listed
-
Knowledge-Guided Short-Context Action Anticipation in Human-Centric Videos12 Sep 2023 0 repositories listed
-
Leveraging Next-Active Objects for Context-Aware Anticipation in Egocentric Videos16 Aug 2023 0 repositories listed
-
Multiscale Video Pretraining for Long-Term Activity Forecasting24 Jul 2023 0 repositories listed
-
VS-TransGRU: A Novel Transformer-GRU-based Framework Enhanced by Visual-Semantic Fusion for Egocentric Action Anticipation8 Jul 2023 0 repositories listed
-
Streaming egocentric action anticipation: An evaluation scheme and approach29 Jun 2023 0 repositories listed
-
Analysis over vision-based models for pedestrian action anticipation27 May 2023 0 repositories listed
-
Therbligs in Action: Video Understanding through Motion Primitives6 Apr 2023 0 repositories listed
-
Off-Policy Action Anticipation in Multi-Agent Reinforcement Learning4 Apr 2023 0 repositories listed
-
Leveraging Temporal Context in Low Representational Power Regimes1 Jan 2023 0 repositories listed
-
Inductive Attention for Video Action Anticipation17 Dec 2022 0 repositories listed
-
MECCANO: A Multimodal Egocentric Dataset for Humans Behavior Understanding in the Industrial-like Domain19 Sep 2022 0 repositories listed
-
12 Sep 2022 0 repositories listed
-
1st Place Solution to the EPIC-Kitchens Action Anticipation Challenge 202210 Jul 2022 0 repositories listed
-
NVIDIA-UNIBZ Submission for EPIC-KITCHENS-100 Action Anticipation Challenge 202222 Jun 2022 0 repositories listed
-
Precise Affordance Annotation for Egocentric Action Video Datasets11 Jun 2022 0 repositories listed
-
A-ACT: Action Anticipation through Cycle Transformations2 Apr 2022 0 repositories listed
-
Untrimmed Action Anticipation8 Feb 2022 0 repositories listed
-
Towards Streaming Egocentric Action Anticipation11 Oct 2021 0 repositories listed
-
Learning to Discriminate Information for Online Action Detection: Analysis and Application8 Sep 2021 0 repositories listed
-
SlowFast Rolling-Unrolling LSTMs for Action Anticipation in Egocentric Videos2 Sep 2021 0 repositories listed
-
Shifted Chunk Transformer for Spatio-Temporal Representational Learning26 Aug 2021 0 repositories listed
-
18 Jul 2021 0 repositories listed
-
Anticipating human actions by correlating past with the future with Jaccard similarity measures26 May 2021 0 repositories listed
-
Forecasting Action through Contact Representations from First Person Video1 Feb 2021 0 repositories listed
-
13 Jan 2021 0 repositories listed
-
Deep Sequence Learning for Video Anticipation: From Discrete and Deterministic to Continuous and Stochastic9 Oct 2020 0 repositories listed
-
Egocentric Object Manipulation Graphs5 Jun 2020 0 repositories listed
-
Knowledge Distillation for Action Anticipation via Label Smoothing16 Apr 2020 0 repositories listed
-
TTPP: Temporal Transformer with Progressive Prediction for Efficient Action Anticipation7 Mar 2020 0 repositories listed
Syntology lines on 18 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections