{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/hyperseg-patch-wise-hypernetwork-for-real","title":"HyperSeg: Patch-wise Hypernetwork for Real-time Semantic Segmentation","arxiv_id":"2012.11582","date":"2020-12-21","proceeding":"CVPR 2021 1","authors":["Yuval Nirkin","Lior Wolf","Tal Hassner"],"abstract":"We present a novel, real-time, semantic segmentation network in which the encoder both encodes and generates the parameters (weights) of the decoder. Furthermore, to allow maximal adaptivity, the weights at each decoder block vary spatially. For this purpose, we design a new type of hypernetwork, composed of a nested U-Net for drawing higher level context features, a multi-headed weight generating module which generates the weights of each block in the decoder immediately before they are consumed, for efficient memory utilization, and a primary network that is composed of novel dynamic patch-wise convolutions. Despite the usage of less-conventional blocks, our architecture obtains real-time performance. In terms of the runtime vs. accuracy trade-off, we surpass state of the art (SotA) results on popular semantic segmentation benchmarks: PASCAL VOC 2012 (val. set) and real-time semantic segmentation on Cityscapes, and CamVid. The code is available: https://nirkin.com/hyperseg.","url_abs":"https://arxiv.org/abs/2012.11582v2","url_pdf":"https://arxiv.org/pdf/2012.11582v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"hyperseg-patch-wise-hypernetwork-for-real","repo_url":"https://github.com/YuvalNirkin/hyperseg","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}}],"tasks":[{"task_slug":"decoder","task_name":"Decoder"},{"task_slug":"dichotomous-image-segmentation","task_name":"Dichotomous Image Segmentation"},{"task_slug":"real-time-semantic-segmentation","task_name":"Real-Time Semantic Segmentation"},{"task_slug":"segmentation","task_name":"Segmentation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"}],"methods":[{"method_slug":"concatenated-skip-connection","method_name":"Concatenated Skip Connection"},{"method_slug":"convolution","method_name":"Convolution"},{"method_slug":"hypernetwork","method_name":"HyperNetwork"},{"method_slug":"max-pooling","method_name":"Max Pooling"},{"method_slug":"relu","method_name":"ReLU"},{"method_slug":"u-net","method_name":"U-Net"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/dichotomous-image-segmentation-on-dis-te1","task":"Dichotomous Image Segmentation","dataset":"DIS-TE1","model":"HySM","rank_in_archive_order":7,"of":22,"metrics":{"E-measure":"0.803","HCE":"205","MAE":"0.082","S-Measure":"0.761","max F-Measure":"0.695","weighted F-measure":"0.597"},"uses_additional_data":false},{"leaderboard":"/sota/dichotomous-image-segmentation-on-dis-te2","task":"Dichotomous Image Segmentation","dataset":"DIS-TE2","model":"HySM","rank_in_archive_order":7,"of":22,"metrics":{"E-measure":"0.832","HCE":"451","MAE":"0.085","S-Measure":"0.794","max F-Measure":"0.759","weighted F-measure":"0.667"},"uses_additional_data":false},{"leaderboard":"/sota/dichotomous-image-segmentation-on-dis-te3","task":"Dichotomous Image Segmentation","dataset":"DIS-TE3","model":"HySM","rank_in_archive_order":8,"of":22,"metrics":{"E-measure":"0.857","HCE":"887","MAE":"0.079","S-Measure":"0.811","max F-Measure":"0.792","weighted F-measure":"0.701"},"uses_additional_data":false},{"leaderboard":"/sota/dichotomous-image-segmentation-on-dis-te4","task":"Dichotomous Image Segmentation","dataset":"DIS-TE4","model":"HySM","rank_in_archive_order":8,"of":22,"metrics":{"E-measure":"0.842","HCE":"3331","MAE":"0.091","S-Measure":"0.802","max F-Measure":"0.782","weighted F-measure":"0.693"},"uses_additional_data":false},{"leaderboard":"/sota/dichotomous-image-segmentation-on-dis-vd","task":"Dichotomous Image Segmentation","dataset":"DIS-VD","model":"HySM","rank_in_archive_order":10,"of":24,"metrics":{"E-measure":"0.814","HCE":"1324","MAE":"0.096","S-Measure":"0.773","max F-Measure":"0.734","weighted F-measure":"0.640"},"uses_additional_data":false},{"leaderboard":"/sota/real-time-semantic-segmentation-on-camvid","task":"Real-Time Semantic Segmentation","dataset":"CamVid","model":"HyperSeg-L","rank_in_archive_order":7,"of":29,"metrics":{"Frame (fps)":"16.6","Time (ms)":"60.2","mIoU":"79.1"},"uses_additional_data":true},{"leaderboard":"/sota/real-time-semantic-segmentation-on-camvid","task":"Real-Time Semantic Segmentation","dataset":"CamVid","model":"HyperSeg-S","rank_in_archive_order":9,"of":29,"metrics":{"Frame (fps)":"38.0","Time (ms)":"26.3","mIoU":"78.4"},"uses_additional_data":false},{"leaderboard":"/sota/real-time-semantic-segmentation-on-cityscapes","task":"Real-Time Semantic Segmentation","dataset":"Cityscapes test","model":"HyperSeg-M","rank_in_archive_order":11,"of":39,"metrics":{"Frame (fps)":"36.9","Time (ms)":"27.1","mIoU":"75.8%"},"uses_additional_data":false},{"leaderboard":"/sota/semantic-segmentation-on-pascal-voc-2012-val","task":"Semantic Segmentation","dataset":"PASCAL VOC 2012 val","model":"HyperSeg-L","rank_in_archive_order":9,"of":29,"metrics":{"mIoU":"80.61%"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2012.11582","atlas_url":"https://app.syntology.ai/?focus=2012.11582","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"2012.11582"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"2012.11582\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"2012.11582"},"call":"get_concepts_for_paper(arxiv_id=\"2012.11582\")"}],"by_repo":[{"repo":"YuvalNirkin/hyperseg","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"123996d54861a2f8a6039d927a79faad024cbe251dc942210ce670c95b99c7eb","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}