Papers › Representation Flow for Action Recognition

Representation Flow for Action Recognition

2 Oct 2018CVPR 2019 6arXiv:1810.01455archive 2025-07-28

AJ Piergiovanni, Michael S. Ryoo

In this paper, we propose a convolutional layer inspired by optical flow algorithms to learn motion representations. Our representation flow layer is a fully-differentiable layer designed to capture the `flow' of any representation channel within a convolutional neural network for action recognition. Its parameters for iterative flow optimization are learned in an end-to-end fashion together with the other CNN model parameters, maximizing the action recognition performance. Furthermore, we newly introduce the concept of learning `flow of flow' representations by stacking multiple representation flow layers. We conducted extensive experimental evaluations, confirming its advantages over previous recognition models using traditional optical flows in both computational speed and performance. Code/models available here: https://piergiaj.github.io/rep-flow-site/

PaperPDFConference PDFCode

In Syntology View this paper on Syntology, its page in Syntology's graph. That page lists the repositories linked to the paper, the abstract and the calls for agents.

Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, on Syntology's MCP service (how to connect):

Code

piergiaj/representation-flow-cvpr19 officialmentioned on GitHubpytorchSyntology: not harvested report
KiUngSong/Vision mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale (arXiv:2010.11929; that paper's own run record: 307 ran (of which 165 constructed an object rather than computing a result; 286 with no instrument failure: 8 honoured, 2 violated, 276 with no contract checked; 21 where Syntology's instrument failed) · 112 unverified) and MLP-Mixer: An all-MLP Architecture for Vision (arXiv:2105.01601; that paper's own run record: 114 ran (of which 77 constructed an object rather than computing a result; 104 with no instrument failure: 2 honoured, 1 violated, 101 with no contract checked; 10 where Syntology's instrument failed) · 20 unverified); nothing checks that they implement this paper's method. report
chunfeng0301/Flow mentioned on GitHubpaddleSyntology: not harvested report
liu824/representation-flow-for-action-recognition-paddlepaddle mentioned on GitHubpaddleSyntology: not harvested report
nikankind/Reproduce-Article-Representation-Flow-for-Action-Recognition-with-PaddlePaddle mentioned on GitHubpaddleApache-2.0Syntology: not harvested report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

A paper named beside a repository with no sample linked to this paper is shown with that paper's own run record, not this paper's: “ran” means executed on a synthesized input, not that the code is correct, and “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Papers are listed in arXiv-id order, at most three per repository.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Action ClassificationAction RecognitionAction Recognition In VideosActivity RecognitionActivity Recognition In VideosOptical Flow EstimationTemporal Action LocalizationVideo ClassificationVideo Understanding

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Action Classification Kinetics-400 RepFlow-50 ([2+1]D CNN, FcF, Non-local block) Acc@1 77.9 #132 of 207 Archive leaderboard report
Action Recognition HMDB-51 RepFlow-50 ([2+1]D CNN, FcF, Non-local block) Average accuracy of 3 splits 81.1 #17 of 77 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

SPEED

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections