{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/stfcn-spatio-temporal-fcn-for-semantic-video","title":"STFCN: Spatio-Temporal FCN for Semantic Video Segmentation","arxiv_id":"1608.05971","date":"2016-08-21","proceeding":null,"authors":["Mohsen Fayyaz","Mohammad Hajizadeh Saffar","Mohammad Sabokrou","Mahmood Fathy","Reinhard klette","Fay Huang"],"abstract":"This paper presents a novel method to involve both spatial and temporal\nfeatures for semantic video segmentation. Current work on convolutional neural\nnetworks(CNNs) has shown that CNNs provide advanced spatial features supporting\na very good performance of solutions for both image and video analysis,\nespecially for the semantic segmentation task. We investigate how involving\ntemporal features also has a good effect on segmenting video data. We propose a\nmodule based on a long short-term memory (LSTM) architecture of a recurrent\nneural network for interpreting the temporal characteristics of video frames\nover time. Our system takes as input frames of a video and produces a\ncorrespondingly-sized output; for segmenting the video our method combines the\nuse of three components: First, the regional spatial features of frames are\nextracted using a CNN; then, using LSTM the temporal features are added;\nfinally, by deconvolving the spatio-temporal features we produce pixel-wise\npredictions. Our key insight is to build spatio-temporal convolutional networks\n(spatio-temporal CNNs) that have an end-to-end architecture for semantic video\nsegmentation. We adapted fully some known convolutional network architectures\n(such as FCN-AlexNet and FCN-VGG16), and dilated convolution into our\nspatio-temporal CNNs. Our spatio-temporal CNNs achieve state-of-the-art\nsemantic segmentation, as demonstrated for the Camvid and NYUDv2 datasets.","url_abs":"http://arxiv.org/abs/1608.05971v2","url_pdf":"http://arxiv.org/pdf/1608.05971v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"stfcn-spatio-temporal-fcn-for-semantic-video","repo_url":"https://github.com/MohsenFayyaz89/STFCN","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"torch","reach":null}],"tasks":[{"task_slug":"segmentation","task_name":"Segmentation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"},{"task_slug":"video-segmentation","task_name":"Video Segmentation"},{"task_slug":"video-semantic-segmentation","task_name":"Video Semantic Segmentation"}],"methods":[{"method_slug":"convolution","method_name":"Convolution"},{"method_slug":"dilated-convolution","method_name":"Dilated Convolution"},{"method_slug":"lstm","method_name":"LSTM"},{"method_slug":"sigmoid-activation","method_name":"Sigmoid Activation"},{"method_slug":"tanh-activation","method_name":"Tanh Activation"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1608.05971","atlas_url":"https://app.syntology.ai/?focus=1608.05971","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1608.05971"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1608.05971\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1608.05971"},"call":"get_concepts_for_paper(arxiv_id=\"1608.05971\")"}],"by_repo":[{"repo":"MohsenFayyaz89/STFCN","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"ba285f0d0cc3c0616b5f0c25b726cb9cd092deea228669515a1791886cb33a93","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}