{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/lstm-cf-unifying-context-modeling-and-fusion","title":"LSTM-CF: Unifying Context Modeling and Fusion with LSTMs for RGB-D Scene Labeling","arxiv_id":"1604.05000","date":"2016-04-18","proceeding":null,"authors":["Zhen Li","Yukang Gan","Xiaodan Liang","Yizhou Yu","Hui Cheng","Liang Lin"],"abstract":"Semantic labeling of RGB-D scenes is crucial to many intelligent applications\nincluding perceptual robotics. It generates pixelwise and fine-grained label\nmaps from simultaneously sensed photometric (RGB) and depth channels. This\npaper addresses this problem by i) developing a novel Long Short-Term Memorized\nContext Fusion (LSTM-CF) Model that captures and fuses contextual information\nfrom multiple channels of photometric and depth data, and ii) incorporating\nthis model into deep convolutional neural networks (CNNs) for end-to-end\ntraining. Specifically, contexts in photometric and depth channels are,\nrespectively, captured by stacking several convolutional layers and a long\nshort-term memory layer; the memory layer encodes both short-range and\nlong-range spatial dependencies in an image along the vertical direction.\nAnother long short-term memorized fusion layer is set up to integrate the\ncontexts along the vertical direction from different channels, and perform\nbi-directional propagation of the fused vertical contexts along the horizontal\ndirection to obtain true 2D global contexts. At last, the fused contextual\nrepresentation is concatenated with the convolutional features extracted from\nthe photometric channels in order to improve the accuracy of fine-scale\nsemantic labeling. Our proposed model has set a new state of the art, i.e.,\n48.1% and 49.4% average class accuracy over 37 categories (2.2% and 5.4%\nimprovement) on the large-scale SUNRGBD dataset and the NYUDv2dataset,\nrespectively.","url_abs":"http://arxiv.org/abs/1604.05000v3","url_pdf":"http://arxiv.org/pdf/1604.05000v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"lstm-cf-unifying-context-modeling-and-fusion","repo_url":"https://github.com/icemansina/LSTM-CF","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":null}],"tasks":[{"task_slug":"scene-labeling","task_name":"Scene Labeling"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers","held":null,"reason":"arxiv_id_not_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"by_repo":[{"repo":"icemansina/LSTM-CF","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"ddd2ec82150fac0aa9b2f68bdb6fcba48dcb0f8f0d789a0264a3cb7aa4f49b7a","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}