{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/an-end-to-end-spatio-temporal-attention-model","title":"An End-to-End Spatio-Temporal Attention Model for Human Action Recognition from Skeleton Data","arxiv_id":"1611.06067","date":"2016-11-18","proceeding":null,"authors":["Sijie Song","Cuiling Lan","Junliang Xing","Wen-Jun Zeng","Jiaying Liu"],"abstract":"Human action recognition is an important task in computer vision. Extracting\ndiscriminative spatial and temporal features to model the spatial and temporal\nevolutions of different actions plays a key role in accomplishing this task. In\nthis work, we propose an end-to-end spatial and temporal attention model for\nhuman action recognition from skeleton data. We build our model on top of the\nRecurrent Neural Networks (RNNs) with Long Short-Term Memory (LSTM), which\nlearns to selectively focus on discriminative joints of skeleton within each\nframe of the inputs and pays different levels of attention to the outputs of\ndifferent frames. Furthermore, to ensure effective training of the network, we\npropose a regularized cross-entropy loss to drive the model learning process\nand develop a joint training strategy accordingly. Experimental results\ndemonstrate the effectiveness of the proposed model,both on the small human\naction recognition data set of SBU and the currently largest NTU dataset.","url_abs":"http://arxiv.org/abs/1611.06067v1","url_pdf":"http://arxiv.org/pdf/1611.06067v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"action-recognition-in-videos","task_name":"Action Recognition"},{"task_slug":"skeleton-based-action-recognition","task_name":"Skeleton Based Action Recognition"},{"task_slug":"action-recognition","task_name":"Temporal Action Localization"}],"methods":[{"method_slug":"sta-lstm","method_name":"STA-LSTM"},{"method_slug":"spatial-temporal-attention","method_name":"Spatial & Temporal Attention"}],"datasets_introduced":[],"methods_introduced":[{"slug":"sta-lstm","name":"STA-LSTM","full_name":"Spatio-Temporal Attention LSTM"},{"slug":"spatial-temporal-attention","name":"Spatial & Temporal Attention","full_name":"Spatial & Temporal Attention"}],"results":[{"leaderboard":"/sota/skeleton-based-action-recognition-on-ntu-rgbd","task":"Skeleton Based Action Recognition","dataset":"NTU RGB+D","model":"STA-LSTM","rank_in_archive_order":124,"of":135,"metrics":{"Accuracy (CS)":"73.4","Accuracy (CV)":"81.2"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/1611.06067","atlas_url":"https://app.syntology.ai/?focus=1611.06067","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1611.06067"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1611.06067\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1611.06067"},"call":"get_concepts_for_paper(arxiv_id=\"1611.06067\")"}],"by_repo":[],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":"the archive holds no code link for this paper","arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"887f4f1e5092e2d9891f2c2fb851ab5543cd53870ad20a8a39463f3ebf9d0740","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}