Browse State-of-the-Art › Medical Visual Question Answering
Medical Visual Question Answering
47 papers with code · 0 benchmarks · 11 datasets archive 2025-07-28
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
11 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 97 · with a code link: 47 · where Syntology ran a sample: 24 (20 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (24 of 97 tagged: 20 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 97 of 97, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
30 Jan 2023 17 repositories listed Syntology community repositories only · 4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified; every one of the 4 samples that ran constructed an object rather than computing a result (of 8 harvested samples) · 1 pointer-only (licence)The cost of vision-and-language pre-training has become increasingly prohibitive due to end-to-end training of large-scale models.
-
2 Mar 2023 5 repositories listedTherefore, training an effective generalist biomedical model requires high-quality multimodal data, such as parallel image-text pairs.
-
29 Apr 2022 5 repositories listed Syntology 18 ran (of which 6 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 1 violated, 10 with no contract checked; 7 where Syntology's instrument failed) · 6 unverified (of 24 harvested samples) · 8 pointer-only (licence)Building models that can be rapidly adapted to novel tasks using only a handful of annotated examples is an open challenge for multimodal machine learning research.
-
7 Mar 2020 5 repositories listed Syntology 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 2 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)To achieve this goal, the first step is to create a visual question answering (VQA) dataset where the AI agent is presented with a pathology image together with a question and is asked to give the correct answer.
-
27 Jul 2023 4 repositories listedHowever, existing models typically have to be fine-tuned on sizeable down-stream datasets, which poses a significant limitation as in many medical applications data is scarce, necessitating models that are capable of…
-
28 Oct 2023 3 repositories listed Syntology official (archive's flag): 12 ran · 20 ran (of which 0 constructed an object rather than computing a result; 17 with no instrument failure: 0 honoured, 0 violated, 17 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 20 harvested samples)To develop our dataset, we first construct two uni-modal resources: 1) The MIMIC-CXR-VQA dataset, our newly created medical visual question answering (VQA) benchmark, specifically designed to augment the imaging…
-
23 Sep 2024 2 repositories listed Syntology official (archive's flag): 12 ran · 12 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 4 where Syntology's instrument failed) · 16 unverified (of 28 harvested samples) · 28 pointer-only (licence)Multimodal Large Language Models (MLLMs) have tremendous potential to improve the accuracy, availability, and cost-effectiveness of healthcare by providing automated solutions or serving as aids to medical professionals.
-
17 May 2023 2 repositories listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples) · 2 pointer-only (licence)Medical Visual Question Answering (MedVQA) presents a significant opportunity to enhance diagnostic accuracy and healthcare delivery by leveraging artificial intelligence to interpret and answer questions based on…
-
13 Mar 2023 2 repositories listed Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 5 where Syntology's instrument failed) · 4 unverified (of 13 harvested samples) · 7 pointer-only (licence)Foundation models trained on large-scale dataset gain a recent surge in CV and NLP.
-
24 Nov 2022 2 repositories listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 6 where Syntology's instrument failed) · 4 unverified (of 10 harvested samples) · 3 pointer-only (licence)Medical image visual question answering (VQA) is a task to answer clinical questions, given a radiographic image, which is a challenging problem that requires a model to integrate both vision and language information.
-
19 May 2021 2 repositories listed Syntology official (archive's flag): 3 ran · 8 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 3 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples) · 3 pointer-only (licence)However, most of the existing medical VQA methods rely on external data for transfer learning, while the meta-data within the dataset is not fully utilized.
-
18 Feb 2021 2 repositories listedWe show that SLAKE can be used to facilitate the development and evaluation of Med-VQA systems.
-
26 Sep 2019 2 repositories listedTraditional approaches for Visual Question Answering (VQA) require large amount of labeled data for training.
-
18 May 2025 1 repository listed Syntology official: no sample here; runs from other or unrecorded repositories · 11 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified (of 16 harvested samples)The rapid advancement of Large Language Models (LLMs) has stimulated interest in multi-agent collaboration for addressing complex medical tasks.
-
9 Feb 2025 1 repository listedTo address these issues, we introduce the Cross-Modal Clinical Knowledge Distiller (ClinKD), an innovative framework designed to enhance image-text alignment and establish more effective medical knowledge adaptation…
-
18 Dec 2024 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)Artificial intelligence has advanced in Medical Visual Question Answering (Med-VQA), but prevalent research tends to focus on the accuracy of the answers, often overlooking the reasoning paths and interpretability…
-
10 Dec 2024 1 repository listedThis paper introduces BiMediX2, a bilingual (Arabic-English) Bio-Medical EXpert Large Multimodal Model (LMM) with a unified architecture that integrates text and visual modalities, enabling advanced image understanding…
-
19 Nov 2024 1 repository listedUnlike general vision-and-language models trained on diverse, non-specialized datasets, MVLMs are purpose-built for the medical domain, automatically extracting and interpreting critical information from medical images…
-
6 Oct 2024 1 repository listed Syntology official (archive's flag): 15 ran · 15 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 1 honoured, 1 violated, 7 with no contract checked; 6 where Syntology's instrument failed) · 0 unverified (of 15 harvested samples) · 15 pointer-only (licence)In recent advancements, multimodal large language models (MLLMs) have been fine-tuned on specific medical image datasets to address medical visual question answering (Med-VQA) tasks.
-
2 Sep 2024 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 3 unverified (of 3 harvested samples) · 3 pointer-only (licence)We introduce Kvasir-VQA, an extended dataset derived from the HyperKvasir and Kvasir-Instrument datasets, augmented with question-and-answer annotations to facilitate advanced machine learning tasks in Gastrointestinal…
-
17 Aug 2024 1 repository listed Syntology official (archive's flag): 7 ran · 8 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 1 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples) · 8 pointer-only (licence)This study introduces the Federated Medical Knowledge Injection (FEDMEKI) platform, a new benchmark designed to address the unique challenges of integrating medical knowledge into foundation models under privacy…
-
16 Aug 2024 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 6 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples) · 8 pointer-only (licence)The application of the Multi-modal Large Language Models (MLLMs) in medical clinical scenarios remains underexplored.
-
9 Aug 2024 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 1 pointer-only (licence)In particular, surgical VQA can enhance the interpretation of surgical data, aiding in accurate diagnoses, effective education, and clinical interventions.
-
6 Aug 2024 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 6 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples) · 8 pointer-only (licence)Unlike the existing multimodal datasets, which are limited by the availability of image-text pairs, we have developed the first automated pipeline that scales up multimodal data by generating multigranular visual and…
-
6 Aug 2024 1 repository listedWith growing interest in recent years, medical visual question answering (Med-VQA) has rapidly evolved, with multimodal large language models (MLLMs) emerging as an alternative to classical model architectures.
-
28 Jun 2024 1 repository listed Syntology official (archive's flag): 9 ran · 9 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 4 where Syntology's instrument failed) · 10 unverified (of 19 harvested samples)Large Vision-Language Models (LVLMs) have shown significant potential in assisting medical diagnosis by leveraging extensive biomedical datasets.
-
30 May 2024 1 repository listedThis study reveals that when subjected to simple probing evaluation, state-of-the-art models perform worse than random guessing on medical diagnosis questions.
-
19 Apr 2024 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified (of 7 harvested samples) · 7 pointer-only (licence)In this paper, we propose the Latent Prompt Assist model (LaPA) for medical visual question answering.
-
22 Mar 2024 1 repository listedChest X-ray images are commonly used for predicting acute and chronic cardiopulmonary conditions, but efforts to integrate them with structured clinical data face challenges due to incomplete electronic health records…
-
14 Feb 2024 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 6 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples) · 8 pointer-only (licence)Importantly, all images in this benchmark are sourced from authentic medical scenarios, ensuring alignment with the requirements of the medical field and suitability for evaluating LVLMs.
-
10 Feb 2024 1 repository listed
-
11 Jan 2024 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
10 Jan 2024 1 repository listed
-
5 Jan 2024 1 repository listed
-
22 Jul 2023 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
11 Jul 2023 1 repository listed
-
11 Jul 2023 1 repository listed
-
3 Jul 2023 1 repository listed
-
26 May 2023 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples) · 7 pointer-only (licence)
-
18 May 2023 1 repository listed
-
26 Apr 2023 1 repository listed
-
10 Mar 2023 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
1 Oct 2022 1 repository listed
-
1 May 2022 1 repository listed
-
24 May 2021 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)
-
27 Sep 2020 1 repository listed
-
3 Sep 2020 1 repository listed
-
Barriers in Integrating Medical Visual Question Answering into Radiology Workflows: A Scoping Review and Clinicians' Insights9 Jul 2025 0 repositories listed
-
SMMILE: An Expert-Driven Benchmark for Multimodal Medical In-Context Learning26 Jun 2025 0 repositories listed
-
GEMeX-ThinkVG: Towards Thinking with Visual Grounding in Medical VQA via Reinforcement Learning22 Jun 2025 0 repositories listed
-
CAPO: Reinforcing Consistent Reasoning in Medical Decision-Making15 Jun 2025 0 repositories listed
-
Kvasir-VQA-x1: A Multimodal Dataset for Medical Reasoning and Robust MedVQA in Gastrointestinal Endoscopy11 Jun 2025 0 repositories listed
-
MedOrch: Medical Diagnosis with Tool-Augmented Reasoning Agents for Flexible Extensibility30 May 2025 0 repositories listed
-
A Causal Approach to Mitigate Modality Preference Bias in Medical Visual Question Answering22 May 2025 0 repositories listed
-
Toward Effective Reinforcement Learning Fine-Tuning for Medical VQA in Vision-Language Models20 May 2025 0 repositories listed
-
Structure Causal Models and LLMs Integration in Medical Visual Question Answering5 May 2025 0 repositories listed
-
Bridging the Semantic Gaps: Improving Medical VQA Consistency with LLM-Augmented Question Sets16 Apr 2025 0 repositories listed
-
Hierarchical Modeling for Medical Visual Question Answering with Cross-Attention Fusion4 Apr 2025 0 repositories listed
-
Vision-Amplified Semantic Entropy for Hallucination Detection in Medical Visual Question Answering26 Mar 2025 0 repositories listed
-
DiN: Diffusion Model for Robust Medical VQA with Semantic Noisy Labels24 Mar 2025 0 repositories listed
-
Alignment, Mining and Fusion: Representation Alignment with Hard Negative Mining and Selective Knowledge Fusion for Medical Visual Question Answering1 Jan 2025 0 repositories listed
-
GEMeX: A Large-Scale, Groundable, and Explainable Medical VQA Benchmark for Chest X-ray Diagnosis25 Nov 2024 0 repositories listed
-
Med-2E3: A 2D-Enhanced 3D Medical Multimodal Large Language Model19 Nov 2024 0 repositories listed
-
Efficient Bilinear Attention-based Fusion for Medical Visual Question Answering28 Oct 2024 0 repositories listed
-
R-LLaVA: Improving Med-VQA Understanding through Visual Region of Interest27 Oct 2024 0 repositories listed
-
Which Client is Reliable?: A Reliable and Personalized Prompt-based Federated Learning for Medical Image Question Answering23 Oct 2024 0 repositories listed
-
LLaVA-Ultra: Large Chinese Language and Vision Assistant for Ultrasound19 Oct 2024 0 repositories listed
-
ZALM3: Zero-Shot Enhancement of Vision-Language Alignment via In-Context Information in Multi-Turn Multimodal Medical Dialogue26 Sep 2024 0 repositories listed
-
Prompting Medical Large Vision-Language Models to Diagnose Pathologies by Visual Question Answering31 Jul 2024 0 repositories listed
-
TM-PATHVQA:90000+ Textless Multilingual Questions for Medical Visual Question Answering16 Jul 2024 0 repositories listed
-
Tri-VQA: Triangular Reasoning Medical Visual Question Answering for Multi-Attribute Analysis21 Jun 2024 0 repositories listed
-
Detecting and Evaluating Medical Hallucinations in Large Vision Language Models14 Jun 2024 0 repositories listed
-
Efficiency in Focus: LayerNorm as a Catalyst for Fine-tuning Medical Visual Language Pre-trained Models25 Apr 2024 0 repositories listed
-
Fusion of Domain-Adapted Vision and Language Models for Medical Visual Question Answering24 Apr 2024 0 repositories listed
-
Grounded Knowledge-Enhanced Medical VLP for Chest X-Ray23 Apr 2024 0 repositories listed
-
WangLab at MEDIQA-M3G 2024: Multimodal Medical Answer Generation using Large Language Models22 Apr 2024 0 repositories listed
-
MedThink: Explaining Medical Visual Question Answering via Multimodal Decision-Making Rationale18 Apr 2024 0 repositories listed
-
Enhancing Generalization in Medical Visual Question Answering Tasks via Gradient-Guided Model Perturbation5 Mar 2024 0 repositories listed
-
Prompt-based Personalized Federated Learning for Medical Visual Question Answering15 Feb 2024 0 repositories listed
-
Free Form Medical Visual Question Answering in Radiology23 Jan 2024 0 repositories listed
-
BESTMVQA: A Benchmark Evaluation System for Medical Visual Question Answering13 Dec 2023 0 repositories listed
-
A Systematic Evaluation of GPT-4V's Multimodal Capability for Medical Image Analysis31 Oct 2023 0 repositories listed
-
Visual Question Answering in the Medical Domain20 Sep 2023 0 repositories listed
-
UIT-Saviors at MEDVQA-GI 2023: Improving Multimodal Learning with Image Enhancement for Gastrointestinal Visual Question Answering6 Jul 2023 0 repositories listed
-
Q2ATransformer: Improving Medical VQA via an Answer Querying Decoder4 Apr 2023 0 repositories listed
-
Medical visual question answering using joint self-supervised learning25 Feb 2023 0 repositories listed
-
Interpretable Medical Image Visual Question Answering via Multi-Modal Relationship Graph Learning19 Feb 2023 0 repositories listed
-
UnICLAM:Contrastive Representation Learning with Adversarial Masking for Unified and Interpretable Medical Vision Question Answering21 Dec 2022 0 repositories listed
-
MF2-MVQA: A Multi-stage Feature Fusion method for Medical Visual Question Answering11 Nov 2022 0 repositories listed
-
RepsNet: Combining Vision with Language for Automated Medical Reports27 Sep 2022 0 repositories listed
-
7 Jul 2022 0 repositories listed
-
Does CLIP Benefit Visual Question Answering in the Medical Domain as Much as it Does in the General Domain?27 Dec 2021 0 repositories listed
-
Medical Visual Question Answering: A Survey19 Nov 2021 0 repositories listed
-
V-Learning -- A Simple, Efficient, Decentralized Algorithm for Multiagent RL27 Oct 2021 0 repositories listed
-
MuVAM: A Multi-View Attention-based Model for Medical Visual Question Answering7 Jul 2021 0 repositories listed
-
Leveraging Medical Visual Question Answering with Supporting Facts28 May 2019 0 repositories listed
-
20 Nov 2018 0 repositories listed
Syntology lines on 25 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections