{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/spatiotemporal-residual-networks-for-video","title":"Spatiotemporal Residual Networks for Video Action Recognition","arxiv_id":"1611.02155","date":"2016-11-07","proceeding":"NeurIPS 2016 12","authors":["Christoph Feichtenhofer","Axel Pinz","Richard P. Wildes"],"abstract":"Two-stream Convolutional Networks (ConvNets) have shown strong performance\nfor human action recognition in videos. Recently, Residual Networks (ResNets)\nhave arisen as a new technique to train extremely deep architectures. In this\npaper, we introduce spatiotemporal ResNets as a combination of these two\napproaches. Our novel architecture generalizes ResNets for the spatiotemporal\ndomain by introducing residual connections in two ways. First, we inject\nresidual connections between the appearance and motion pathways of a two-stream\narchitecture to allow spatiotemporal interaction between the two streams.\nSecond, we transform pretrained image ConvNets into spatiotemporal networks by\nequipping these with learnable convolutional filters that are initialized as\ntemporal residual connections and operate on adjacent feature maps in time.\nThis approach slowly increases the spatiotemporal receptive field as the depth\nof the model increases and naturally integrates image ConvNet design\nprinciples. The whole model is trained end-to-end to allow hierarchical\nlearning of complex spatiotemporal features. We evaluate our novel\nspatiotemporal ResNet using two widely used action recognition benchmarks where\nit exceeds the previous state-of-the-art.","url_abs":"http://arxiv.org/abs/1611.02155v1","url_pdf":"http://arxiv.org/pdf/1611.02155v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"spatiotemporal-residual-networks-for-video","repo_url":"https://github.com/feichtenhofer/st-resnet","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":{"status":"ok"}}],"tasks":[{"task_slug":"action-recognition-in-videos","task_name":"Action Recognition"},{"task_slug":"action-recognition-in-videos-2","task_name":"Action Recognition In Videos"},{"task_slug":"action-recognition","task_name":"Temporal Action Localization"}],"methods":[{"method_slug":"1x1-convolution","method_name":"1x1 Convolution"},{"method_slug":"average-pooling","method_name":"Average Pooling"},{"method_slug":"batch-normalization","method_name":"Batch Normalization"},{"method_slug":"bottleneck-residual-block","method_name":"Bottleneck Residual Block"},{"method_slug":"convolution","method_name":"Convolution"},{"method_slug":"global-average-pooling","method_name":"Global Average Pooling"},{"method_slug":"kaiming-initialization","method_name":"Kaiming Initialization"},{"method_slug":"max-pooling","method_name":"Max Pooling"},{"method_slug":"relu","method_name":"ReLU"},{"method_slug":"residual-block","method_name":"Residual Block"},{"method_slug":"residual-connection","method_name":"Residual Connection"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/action-recognition-in-videos-on-hmdb-51","task":"Action Recognition","dataset":"HMDB-51","model":"ST-ResNet + IDT","rank_in_archive_order":54,"of":77,"metrics":{"Average accuracy of 3 splits":"70.3"},"uses_additional_data":false},{"leaderboard":"/sota/action-recognition-in-videos-on-ucf101","task":"Action Recognition","dataset":"UCF101","model":"ST-ResNet + IDT","rank_in_archive_order":51,"of":91,"metrics":{"3-fold Accuracy":"94.6"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/1611.02155","atlas_url":"https://app.syntology.ai/?focus=1611.02155","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1611.02155"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1611.02155\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1611.02155"},"call":"get_concepts_for_paper(arxiv_id=\"1611.02155\")"}],"by_repo":[{"repo":"feichtenhofer/st-resnet","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"8259e1ea8f3e5a6cceef5cac7f383d4c7ad63694e88e49e2191e7f08cd2393ba","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}