{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/tensor-representations-for-action-recognition","title":"Tensor Representations for Action Recognition","arxiv_id":"2012.14371","date":"2020-12-28","proceeding":null,"authors":["Piotr Koniusz","Lei Wang","Anoop Cherian"],"abstract":"Human actions in video sequences are characterized by the complex interplay between spatial features and their temporal dynamics. In this paper, we propose novel tensor representations for compactly capturing such higher-order relationships between visual features for the task of action recognition. We propose two tensor-based feature representations, viz. (i) sequence compatibility kernel (SCK) and (ii) dynamics compatibility kernel (DCK). SCK builds on the spatio-temporal correlations between features, whereas DCK explicitly models the action dynamics of a sequence. We also explore generalization of SCK, coined SCK(+), that operates on subsequences to capture the local-global interplay of correlations, which can incorporate multi-modal inputs e.g., skeleton 3D body-joints and per-frame classifier scores obtained from deep learning models trained on videos. We introduce linearization of these kernels that lead to compact and fast descriptors. We provide experiments on (i) 3D skeleton action sequences, (ii) fine-grained video sequences, and (iii) standard non-fine-grained videos. As our final representations are tensors that capture higher-order relationships of features, they relate to co-occurrences for robust fine-grained recognition. We use higher-order tensors and so-called Eigenvalue Power Normalization (EPN) which have been long speculated to perform spectral detection of higher-order occurrences, thus detecting fine-grained relationships of features rather than merely count features in action sequences. We prove that a tensor of order r, built from Z* dimensional features, coupled with EPN indeed detects if at least one higher-order occurrence is `projected' into one of its binom(Z*,r) subspaces of dim. r represented by the tensor, thus forming a Tensor Power Normalization metric endowed with binom(Z*,r) such `detectors'.","url_abs":"https://arxiv.org/abs/2012.14371v3","url_pdf":"https://arxiv.org/pdf/2012.14371v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"tensor-representations-for-action-recognition","repo_url":"https://github.com/ElricXin/Skeleton-MixFormer","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"unanswered"}}],"tasks":[{"task_slug":"action-recognition-in-videos","task_name":"Action Recognition"},{"task_slug":"action-recognition-in-videos-2","task_name":"Action Recognition In Videos"},{"task_slug":"skeleton-based-action-recognition","task_name":"Skeleton Based Action Recognition"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/action-recognition-in-videos-on-hmdb-51","task":"Action Recognition","dataset":"HMDB-51","model":"SCK⊕(I3D)+IDT","rank_in_archive_order":5,"of":77,"metrics":{"Average accuracy of 3 splits":"86.11"},"uses_additional_data":true},{"leaderboard":"/sota/skeleton-based-action-recognition-on-florence","task":"Skeleton Based Action Recognition","dataset":"Florence 3D","model":"SCK⊕+DCK⊕","rank_in_archive_order":3,"of":7,"metrics":{"Accuracy":"97.45"},"uses_additional_data":false},{"leaderboard":"/sota/skeleton-based-action-recognition-on-florence","task":"Skeleton Based Action Recognition","dataset":"Florence 3D","model":"SCK+DCK","rank_in_archive_order":5,"of":7,"metrics":{"Accuracy":"95.23"},"uses_additional_data":false},{"leaderboard":"/sota/skeleton-based-action-recognition-on-ntu-rgbd","task":"Skeleton Based Action Recognition","dataset":"NTU RGB+D","model":"SCK⊕","rank_in_archive_order":38,"of":135,"metrics":{"Accuracy (CS)":"91.56","Accuracy (CV)":"94.75"},"uses_additional_data":true},{"leaderboard":"/sota/skeleton-based-action-recognition-on-ut","task":"Skeleton Based Action Recognition","dataset":"UT-Kinect","model":"SCK⊕+DCK⊕","rank_in_archive_order":2,"of":7,"metrics":{"Accuracy":"99.2"},"uses_additional_data":false},{"leaderboard":"/sota/skeleton-based-action-recognition-on-ut","task":"Skeleton Based Action Recognition","dataset":"UT-Kinect","model":"SCK+DCK","rank_in_archive_order":5,"of":7,"metrics":{"Accuracy":"98.2"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2012.14371","atlas_url":"https://app.syntology.ai/?focus=2012.14371","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"2012.14371"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"2012.14371\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"2012.14371"},"call":"get_concepts_for_paper(arxiv_id=\"2012.14371\")"}],"by_repo":[{"repo":"ElricXin/Skeleton-MixFormer","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"bbfcc60583f82aefde7387ff4f64d7b6b61f8323f6bf8e737041177f15864408","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}