{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/stpnet-scale-aware-text-prompt-network-for","title":"STPNet: Scale-aware Text Prompt Network for Medical Image Segmentation","arxiv_id":"2504.01561","date":"2025-04-02","proceeding":null,"authors":["Dandan Shan","Zihan Li","Yunxiang Li","Qingde Li","Jie Tian","Qingqi Hong"],"abstract":"Accurate segmentation of lesions plays a critical role in medical image analysis and diagnosis. Traditional segmentation approaches that rely solely on visual features often struggle with the inherent uncertainty in lesion distribution and size. To address these issues, we propose STPNet, a Scale-aware Text Prompt Network that leverages vision-language modeling to enhance medical image segmentation. Our approach utilizes multi-scale textual descriptions to guide lesion localization and employs retrieval-segmentation joint learning to bridge the semantic gap between visual and linguistic modalities. Crucially, STPNet retrieves relevant textual information from a specialized medical text repository during training, eliminating the need for text input during inference while retaining the benefits of cross-modal learning. We evaluate STPNet on three datasets: COVID-Xray, COVID-CT, and Kvasir-SEG. Experimental results show that our vision-language approach outperforms state-of-the-art segmentation methods, demonstrating the effectiveness of incorporating textual semantic knowledge into medical image analysis. The code has been made publicly on https://github.com/HUANGLIZI/STPNet.","url_abs":"https://arxiv.org/abs/2504.01561v1","url_pdf":"https://arxiv.org/pdf/2504.01561v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"stpnet-scale-aware-text-prompt-network-for","repo_url":"https://github.com/huanglizi/stpnet","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"image-segmentation","task_name":"Image Segmentation"},{"task_slug":"language-modeling","task_name":"Language Modeling"},{"task_slug":"language-modelling","task_name":"Language Modelling"},{"task_slug":"lesion-segmentation","task_name":"Lesion Segmentation"},{"task_slug":"medical-image-analysis","task_name":"Medical Image Analysis"},{"task_slug":"medical-image-segmentation","task_name":"Medical Image Segmentation"},{"task_slug":"segmentation","task_name":"Segmentation"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/lesion-segmentation-on","task":"Lesion Segmentation","dataset":"","model":"STPNet","rank_in_archive_order":1,"of":17,"metrics":{"Dice":"76.18"},"uses_additional_data":false},{"leaderboard":"/sota/lesion-segmentation-on","task":"Lesion Segmentation","dataset":"","model":"CMIRNet","rank_in_archive_order":2,"of":17,"metrics":{"Dice":"73.69"},"uses_additional_data":false},{"leaderboard":"/sota/lesion-segmentation-on","task":"Lesion Segmentation","dataset":"","model":"LAVT","rank_in_archive_order":3,"of":17,"metrics":{"Dice":"73.29"},"uses_additional_data":false},{"leaderboard":"/sota/lesion-segmentation-on","task":"Lesion Segmentation","dataset":"","model":"SAM2UNet","rank_in_archive_order":4,"of":17,"metrics":{"Dice":"72.91"},"uses_additional_data":false},{"leaderboard":"/sota/lesion-segmentation-on","task":"Lesion Segmentation","dataset":"","model":"nnUNet","rank_in_archive_order":5,"of":17,"metrics":{"Dice":"72.59"},"uses_additional_data":false},{"leaderboard":"/sota/lesion-segmentation-on","task":"Lesion Segmentation","dataset":"","model":"GLoRIA","rank_in_archive_order":6,"of":17,"metrics":{"Dice":"72.42"},"uses_additional_data":false},{"leaderboard":"/sota/lesion-segmentation-on","task":"Lesion Segmentation","dataset":"","model":"ViLT","rank_in_archive_order":7,"of":17,"metrics":{"Dice":"72.36"},"uses_additional_data":false},{"leaderboard":"/sota/lesion-segmentation-on","task":"Lesion Segmentation","dataset":"","model":"ConVIRT","rank_in_archive_order":8,"of":17,"metrics":{"Dice":"72.06"},"uses_additional_data":false},{"leaderboard":"/sota/lesion-segmentation-on","task":"Lesion Segmentation","dataset":"","model":"CLIP","rank_in_archive_order":9,"of":17,"metrics":{"Dice":"71.97"},"uses_additional_data":false},{"leaderboard":"/sota/lesion-segmentation-on","task":"Lesion Segmentation","dataset":"","model":"UNet++","rank_in_archive_order":10,"of":17,"metrics":{"Dice":"71.75"},"uses_additional_data":false},{"leaderboard":"/sota/lesion-segmentation-on","task":"Lesion Segmentation","dataset":"","model":"UniLSeg","rank_in_archive_order":11,"of":17,"metrics":{"Dice":"71.6"},"uses_additional_data":false},{"leaderboard":"/sota/lesion-segmentation-on","task":"Lesion Segmentation","dataset":"","model":"TransUNet","rank_in_archive_order":12,"of":17,"metrics":{"Dice":"71.24"},"uses_additional_data":false},{"leaderboard":"/sota/lesion-segmentation-on","task":"Lesion Segmentation","dataset":"","model":"TGANet","rank_in_archive_order":13,"of":17,"metrics":{"Dice":"70.29"},"uses_additional_data":false},{"leaderboard":"/sota/lesion-segmentation-on","task":"Lesion Segmentation","dataset":"","model":"UCTransNet","rank_in_archive_order":14,"of":17,"metrics":{"Dice":"66.74"},"uses_additional_data":false},{"leaderboard":"/sota/lesion-segmentation-on","task":"Lesion Segmentation","dataset":"","model":"AttUNet","rank_in_archive_order":15,"of":17,"metrics":{"Dice":"65.57"},"uses_additional_data":false},{"leaderboard":"/sota/lesion-segmentation-on","task":"Lesion Segmentation","dataset":"","model":"Swin-UNet","rank_in_archive_order":16,"of":17,"metrics":{"Dice":"63.29"},"uses_additional_data":false},{"leaderboard":"/sota/lesion-segmentation-on","task":"Lesion Segmentation","dataset":"","model":"UNet","rank_in_archive_order":17,"of":17,"metrics":{"Dice":"62.96"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2504.01561","atlas_url":"https://app.syntology.ai/?focus=2504.01561","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"2504.01561"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"2504.01561\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"2504.01561"},"call":"get_concepts_for_paper(arxiv_id=\"2504.01561\")"}],"by_repo":[{"repo":"huanglizi/stpnet","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"4a19304d2e2ee26b591b626bca88f18bd0d10c06640cf49e4281d51610510970","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}