{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/learning-spatio-temporal-representation-with","title":"Learning Spatio-Temporal Representation with Pseudo-3D Residual Networks","arxiv_id":"1711.10305","date":"2017-11-28","proceeding":"ICCV 2017 10","authors":["Zhaofan Qiu","Ting Yao","Tao Mei"],"abstract":"Convolutional Neural Networks (CNN) have been regarded as a powerful class of\nmodels for image recognition problems. Nevertheless, it is not trivial when\nutilizing a CNN for learning spatio-temporal video representation. A few\nstudies have shown that performing 3D convolutions is a rewarding approach to\ncapture both spatial and temporal dimensions in videos. However, the\ndevelopment of a very deep 3D CNN from scratch results in expensive\ncomputational cost and memory demand. A valid question is why not recycle\noff-the-shelf 2D networks for a 3D CNN. In this paper, we devise multiple\nvariants of bottleneck building blocks in a residual learning framework by\nsimulating $3\\times3\\times3$ convolutions with $1\\times3\\times3$ convolutional\nfilters on spatial domain (equivalent to 2D CNN) plus $3\\times1\\times1$\nconvolutions to construct temporal connections on adjacent feature maps in\ntime. Furthermore, we propose a new architecture, named Pseudo-3D Residual Net\n(P3D ResNet), that exploits all the variants of blocks but composes each in\ndifferent placement of ResNet, following the philosophy that enhancing\nstructural diversity with going deep could improve the power of neural\nnetworks. Our P3D ResNet achieves clear improvements on Sports-1M video\nclassification dataset against 3D CNN and frame-based 2D CNN by 5.3% and 1.8%,\nrespectively. We further examine the generalization performance of video\nrepresentation produced by our pre-trained P3D ResNet on five different\nbenchmarks and three different tasks, demonstrating superior performances over\nseveral state-of-the-art techniques.","url_abs":"http://arxiv.org/abs/1711.10305v1","url_pdf":"http://arxiv.org/pdf/1711.10305v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"learning-spatio-temporal-representation-with","repo_url":"https://github.com/ZhaofanQiu/pseudo-3d-residual-networks","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"learning-spatio-temporal-representation-with","repo_url":"https://github.com/qijiezhao/pseudo-3d-pytorch","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"unanswered"}}],"tasks":[{"task_slug":"action-recognition-in-videos","task_name":"Action Recognition"},{"task_slug":"philosophy","task_name":"Philosophy"},{"task_slug":"video-classification","task_name":"Video Classification"},{"task_slug":null,"task_name":"valid"}],"methods":[{"method_slug":"1x1-convolution","method_name":"1x1 Convolution"},{"method_slug":"average-pooling","method_name":"Average Pooling"},{"method_slug":"batch-normalization","method_name":"Batch Normalization"},{"method_slug":"bottleneck-residual-block","method_name":"Bottleneck Residual Block"},{"method_slug":"convolution","method_name":"Convolution"},{"method_slug":"global-average-pooling","method_name":"Global Average Pooling"},{"method_slug":"kaiming-initialization","method_name":"Kaiming Initialization"},{"method_slug":"max-pooling","method_name":"Max Pooling"},{"method_slug":"relu","method_name":"ReLU"},{"method_slug":"residual-block","method_name":"Residual Block"},{"method_slug":"residual-connection","method_name":"Residual Connection"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/action-recognition-in-videos-on-activitynet","task":"Action Recognition","dataset":"ActivityNet","model":"P3D","rank_in_archive_order":13,"of":16,"metrics":{"mAP":"78.9"},"uses_additional_data":false},{"leaderboard":"/sota/action-recognition-in-videos-on-sports-1m","task":"Action Recognition","dataset":"Sports-1M","model":"P3D","rank_in_archive_order":7,"of":9,"metrics":{"Clip Hit@1":"47.9","Video hit@1 ":"66.4","Video hit@5":"87.4"},"uses_additional_data":false},{"leaderboard":"/sota/action-recognition-in-videos-on-ucf101","task":"Action Recognition","dataset":"UCF101","model":"P3D (ImageNet + Sports1M)","rank_in_archive_order":74,"of":91,"metrics":{"3-fold Accuracy":"88.6"},"uses_additional_data":true}],"syntology":{"syntology_url":"https://syntology.ai/paper/1711.10305","atlas_url":"https://app.syntology.ai/?focus=1711.10305","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1711.10305"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1711.10305\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1711.10305"},"call":"get_concepts_for_paper(arxiv_id=\"1711.10305\")"}],"by_repo":[{"repo":"ZhaofanQiu/pseudo-3d-residual-networks","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"qijiezhao/pseudo-3d-pytorch","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"83dd241a44bdc3240a96cd4106ce41d1c10d7362f5464d14dae63256ceebf2fb","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}