{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/models-genesis-generic-autodidactic-models","title":"Models Genesis: Generic Autodidactic Models for 3D Medical Image Analysis","arxiv_id":"1908.06912","date":"2019-08-19","proceeding":null,"authors":["Zongwei Zhou","Vatsal Sodha","Md Mahfuzur Rahman Siddiquee","Ruibin Feng","Nima Tajbakhsh","Michael B. Gotway","Jianming Liang"],"abstract":"Transfer learning from natural image to medical image has established as one of the most practical paradigms in deep learning for medical image analysis. However, to fit this paradigm, 3D imaging tasks in the most prominent imaging modalities (e.g., CT and MRI) have to be reformulated and solved in 2D, losing rich 3D anatomical information and inevitably compromising the performance. To overcome this limitation, we have built a set of models, called Generic Autodidactic Models, nicknamed Models Genesis, because they are created ex nihilo (with no manual labeling), self-taught (learned by self-supervision), and generic (served as source models for generating application-specific target models). Our extensive experiments demonstrate that our Models Genesis significantly outperform learning from scratch in all five target 3D applications covering both segmentation and classification. More importantly, learning a model from scratch simply in 3D may not necessarily yield performance better than transfer learning from ImageNet in 2D, but our Models Genesis consistently top any 2D approaches including fine-tuning the models pre-trained from ImageNet as well as fine-tuning the 2D versions of our Models Genesis, confirming the importance of 3D anatomical information and significance of our Models Genesis for 3D medical imaging. This performance is attributed to our unified self-supervised learning framework, built on a simple yet powerful observation: the sophisticated yet recurrent anatomy in medical images can serve as strong supervision signals for deep models to learn common anatomical representation automatically via self-supervision. As open science, all pre-trained Models Genesis are available at https://github.com/MrGiovanni/ModelsGenesis.","url_abs":"https://arxiv.org/abs/1908.06912v1","url_pdf":"https://arxiv.org/pdf/1908.06912v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"models-genesis-generic-autodidactic-models","repo_url":"https://github.com/MrGiovanni/ModelsGenesis","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"tf","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"models-genesis-generic-autodidactic-models","repo_url":"https://github.com/cswin/AWC","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"anatomy","task_name":"Anatomy"},{"task_slug":"brain-tumor-segmentation","task_name":"Brain Tumor Segmentation"},{"task_slug":"liver-segmentation","task_name":"Liver Segmentation"},{"task_slug":"lung-nodule-detection","task_name":"Lung Nodule Detection"},{"task_slug":"lung-nodule-segmentation","task_name":"Lung Nodule Segmentation"},{"task_slug":"medical-image-analysis","task_name":"Medical Image Analysis"},{"task_slug":"medical-image-segmentation","task_name":"Medical Image Segmentation"},{"task_slug":"pulmonary-embolism-detection","task_name":"Pulmonary Embolism Detection"},{"task_slug":"self-supervised-learning","task_name":"Self-Supervised Learning"},{"task_slug":"transfer-learning","task_name":"Transfer Learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/brain-tumor-segmentation-on-brats-2013","task":"Brain Tumor Segmentation","dataset":"BRATS-2013","model":"ModelGenesis","rank_in_archive_order":2,"of":3,"metrics":{"Dice Score":"0.9258"},"uses_additional_data":false},{"leaderboard":"/sota/liver-segmentation-on-lits2017","task":"Liver Segmentation","dataset":"LiTS2017","model":"ModelGenesis","rank_in_archive_order":4,"of":9,"metrics":{"Dice":"91.13","IoU":"79.52"},"uses_additional_data":false},{"leaderboard":"/sota/lung-nodule-detection-on-luna2016-fpred","task":"Lung Nodule Detection","dataset":"LUNA2016 FPRED","model":"ModelGenesis","rank_in_archive_order":2,"of":2,"metrics":{"AUC":"98.2"},"uses_additional_data":false},{"leaderboard":"/sota/lung-nodule-segmentation-on-lidc-idri","task":"Lung Nodule Segmentation","dataset":"LIDC-IDRI","model":"ModelGenesis","rank_in_archive_order":1,"of":2,"metrics":{"Dice":"75.86","IoU":"77.62"},"uses_additional_data":false},{"leaderboard":"/sota/medical-image-segmentation-on-medical","task":"Medical Image Segmentation","dataset":"Medical Segmentation Decathlon","model":"Models Genesis","rank_in_archive_order":4,"of":5,"metrics":{"Dice (Average)":"76.97","NSD":"87.19"},"uses_additional_data":false},{"leaderboard":"/sota/pulmonary-embolism-detection-on-pe-cad-fpred","task":"Pulmonary Embolism Detection","dataset":"PE-CAD FPRED","model":"ModelGenesis","rank_in_archive_order":1,"of":1,"metrics":{"AUC":"88.04"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/1908.06912","atlas_url":"https://app.syntology.ai/?focus=1908.06912","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1908.06912"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1908.06912\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1908.06912"},"call":"get_concepts_for_paper(arxiv_id=\"1908.06912\")"}],"by_repo":[{"repo":"MrGiovanni/ModelsGenesis","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"cswin/AWC","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"d4788012d58ff50794b445321c97039922ccfa0d8f0c8322d21d8eddc61254a4","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}