{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/unetr-transformers-for-3d-medical-image","title":"UNETR: Transformers for 3D Medical Image Segmentation","arxiv_id":"2103.10504","date":"2021-03-18","proceeding":null,"authors":["Ali Hatamizadeh","Yucheng Tang","Vishwesh Nath","Dong Yang","Andriy Myronenko","Bennett Landman","Holger Roth","Daguang Xu"],"abstract":"Fully Convolutional Neural Networks (FCNNs) with contracting and expanding paths have shown prominence for the majority of medical image segmentation applications since the past decade. In FCNNs, the encoder plays an integral role by learning both global and local features and contextual representations which can be utilized for semantic output prediction by the decoder. Despite their success, the locality of convolutional layers in FCNNs, limits the capability of learning long-range spatial dependencies. Inspired by the recent success of transformers for Natural Language Processing (NLP) in long-range sequence learning, we reformulate the task of volumetric (3D) medical image segmentation as a sequence-to-sequence prediction problem. We introduce a novel architecture, dubbed as UNEt TRansformers (UNETR), that utilizes a transformer as the encoder to learn sequence representations of the input volume and effectively capture the global multi-scale information, while also following the successful \"U-shaped\" network design for the encoder and decoder. The transformer encoder is directly connected to a decoder via skip connections at different resolutions to compute the final semantic segmentation output. We have validated the performance of our method on the Multi Atlas Labeling Beyond The Cranial Vault (BTCV) dataset for multi-organ segmentation and the Medical Segmentation Decathlon (MSD) dataset for brain tumor and spleen segmentation tasks. Our benchmarks demonstrate new state-of-the-art performance on the BTCV leaderboard. Code: https://monai.io/research/unetr","url_abs":"https://arxiv.org/abs/2103.10504v3","url_pdf":"https://arxiv.org/pdf/2103.10504v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"unetr-transformers-for-3d-medical-image","repo_url":"https://github.com/Project-MONAI/research-contributions/tree/master/UNETR/BTCV","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null},{"paper_slug":"unetr-transformers-for-3d-medical-image","repo_url":"https://github.com/MIC-DKFZ/MedNeXt","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"unetr-transformers-for-3d-medical-image","repo_url":"https://github.com/baai-dcai/segvol","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"unetr-transformers-for-3d-medical-image","repo_url":"https://github.com/davidiommi/Pytorch--3D-Medical-Images-Segmentation--SALMON","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"unetr-transformers-for-3d-medical-image","repo_url":"https://github.com/mkara44/unetr_pytorch","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"unetr-transformers-for-3d-medical-image","repo_url":"https://github.com/tamasino52/UNETR","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"unetr-transformers-for-3d-medical-image","repo_url":"https://github.com/tamasino52/UNeTR-Pose","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"unetr-transformers-for-3d-medical-image","repo_url":"https://github.com/Project-MONAI/MONAI","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"unetr-transformers-for-3d-medical-image","repo_url":"https://github.com/Project-MONAI/tutorials/blob/master/3d_segmentation/unetr_btcv_segmentation_3d.ipynb","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"unetr-transformers-for-3d-medical-image","repo_url":"https://github.com/The-AI-Summer/self-attention-cv","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"3d-medical-imaging-segmentation","task_name":"3D Medical Imaging Segmentation"},{"task_slug":"decoder","task_name":"Decoder"},{"task_slug":"image-segmentation","task_name":"Image Segmentation"},{"task_slug":"medical-image-segmentation","task_name":"Medical Image Segmentation"},{"task_slug":"organ-segmentation","task_name":"Organ Segmentation"},{"task_slug":"segmentation","task_name":"Segmentation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"}],"methods":[{"method_slug":"1x1-convolution","method_name":"1x1 Convolution"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"batch-normalization","method_name":"Batch Normalization"},{"method_slug":"concatenated-skip-connection","method_name":"Concatenated Skip Connection"},{"method_slug":"convolution","method_name":"Convolution"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"max-pooling","method_name":"Max Pooling"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"position-wise-feed-forward-layer","method_name":"Position-Wise Feed-Forward Layer"},{"method_slug":"relu","method_name":"ReLU"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"u-net","method_name":"U-Net"},{"method_slug":"unetr","method_name":"UNETR"}],"datasets_introduced":[],"methods_introduced":[{"slug":"unetr","name":"UNETR","full_name":"UNet Transformer"}],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/2103.10504","atlas_url":"https://app.syntology.ai/?focus=2103.10504","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"2103.10504"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"2103.10504\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"2103.10504"},"call":"get_concepts_for_paper(arxiv_id=\"2103.10504\")"}],"by_repo":[{"repo":"Project-MONAI/research-contributions","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0,"harvested_for_other_papers":1,"harvested_for":["2204.00631"],"harvested_for_calls":[{"arxiv_id":"2204.00631","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"2204.00631"},"call":"get_harvested_code_for_paper(arxiv_id=\"2204.00631\")"}]},{"repo":"MIC-DKFZ/MedNeXt","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0,"harvested_for_other_papers":1,"harvested_for":["2303.09975"],"harvested_for_calls":[{"arxiv_id":"2303.09975","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"2303.09975"},"call":"get_harvested_code_for_paper(arxiv_id=\"2303.09975\")"}]},{"repo":"baai-dcai/segvol","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0,"harvested_for_other_papers":1,"harvested_for":["2311.13385"],"harvested_for_calls":[{"arxiv_id":"2311.13385","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"2311.13385"},"call":"get_harvested_code_for_paper(arxiv_id=\"2311.13385\")"}]},{"repo":"davidiommi/Pytorch--3D-Medical-Images-Segmentation--SALMON","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"mkara44/unetr_pytorch","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"tamasino52/UNETR","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"tamasino52/UNeTR-Pose","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"Project-MONAI/MONAI","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0,"harvested_for_other_papers":1,"harvested_for":["2307.05916"],"harvested_for_calls":[{"arxiv_id":"2307.05916","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"2307.05916"},"call":"get_harvested_code_for_paper(arxiv_id=\"2307.05916\")"}]},{"repo":"Project-MONAI/tutorials","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"The-AI-Summer/self-attention-cv","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0,"harvested_for_other_papers":2,"harvested_for":["1803.02155","2102.05095"],"harvested_for_calls":[{"arxiv_id":"1803.02155","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"1803.02155"},"call":"get_harvested_code_for_paper(arxiv_id=\"1803.02155\")"},{"arxiv_id":"2102.05095","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"2102.05095"},"call":"get_harvested_code_for_paper(arxiv_id=\"2102.05095\")"}]}],"by_repo_harvested_for_is":"harvested_for: the arXiv ids (as Syntology's graph holds them) of every paper whose samples Syntology's graph links to this repository, in arXiv-id order, complete; the page names the first 3 and says how many more. A link only: it does not say the papers are the same work, that one copied the other, or that the code implements this paper's method; harvested_for_calls gives the get_harvested_code_for_paper call for each arXiv-shaped id among them","by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"e80dc23b4a4f94c2b6dffbe5f46056a9a8993d62f3dc2a90f21d5537c135ce83","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}