Browse State-of-the-Art › Multi-modal Knowledge Graph
Multi-modal Knowledge Graph
15 papers with code · 0 benchmarks · 2 datasets archive 2025-07-28
Link to A Survey for Multi-modal Knowledge Graphs. Papers integrating Knowledge Graphs (KGs) and Multi-Modal Learning, focusing on research in two principal aspects: KG-driven Multi-Modal (KG4MM) learning, where KGs support multi-modal tasks, and Multi-Modal Knowledge Graph (MM4KG), which extends KG studies into the MMKG realm.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
2 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 26 · with a code link: 15 · where Syntology ran a sample: 3 (3 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (3 of 26 tagged: 3 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 26 of 26, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from.
-
8 Feb 2024 6 repositories listed Syntology community repositories only · 15 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 2 violated, 8 with no contract checked; 5 where Syntology's instrument failed) · 3 unverified (of 18 harvested samples) · 4 pointer-only (licence)In this survey, we carefully review over 300 articles, focusing on KG-aware research in two principal aspects: KG-driven Multi-Modal (KG4MM) learning, where KGs support multi-modal tasks, and Multi-Modal Knowledge Graph…
-
27 Aug 2024 2 repositories listedMulti-modal knowledge graphs (MMKGs), which ground various non-symbolic data (e. g., images and videos) into symbols, have attracted attention as resources enabling knowledge processing and machine learning across…
-
15 Apr 2024 2 repositories listedTo further augment the multi-modal representations, MyGO incorporates fine-grained contrastive learning to highlight the specificity of the entity representations.
-
DO-RAG: A Domain-Specific QA Framework Using Knowledge Graph-Enhanced Retrieval-Augmented Generation15 May 2025 1 repository listedDomain-specific QA systems require not just generative fluency but high factual accuracy grounded in structured expert knowledge.
-
27 May 2024 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples) · 8 pointer-only (licence)Learning high-quality multi-modal entity representations is an important goal of multi-modal knowledge graph (MMKG) representation learning, which can enhance reasoning tasks within the MMKGs, such as MMKG completion…
-
12 Mar 2024 1 repository listed Syntology official (archive's flag): 9 ran · 22 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 1 honoured, 0 violated, 8 with no contract checked; 13 where Syntology's instrument failed) · 3 unverified (of 25 harvested samples) · 5 pointer-only (licence)Compared to this, editing Large Vision-Language Models (LVLMs) faces extra challenges from diverse data modalities and complicated model components, and data for LVLMs editing are limited.
-
11 Mar 2024 1 repository listedIn this work, we explore the efficacy of models in accurately embedding entities within MMKGs through two pivotal tasks: Multi-modal Knowledge Graph Completion (MKGC) and Multi-modal Entity Alignment (MMEA).
-
22 Feb 2024 1 repository listedTo address the mentioned problems, we propose Adaptive Multi-modal Fusion and Modality Adversarial Training (AdaMF-MAT) to unleash the power of imbalanced modality information for MMKGC.
-
31 Jan 2024 1 repository listedThis study introduces a novel approach, DESAlign, which addresses these issues by applying a theoretical framework based on Dirichlet energy to ensure semantic consistency.
-
10 Oct 2023 1 repository listedTo address these challenges, we propose a novel MMEA transformer, called MoAlign, that hierarchically introduces neighbor features, multi-modal attributes, and entity types to enhance the alignment task.
-
13 Aug 2023 1 repository listedNevertheless, existing methods emphasize the design of elegant KGC models to facilitate modality interaction, neglecting the real-life problem of missing modalities in KGs.
-
9 Aug 2023 1 repository listedMulti-modal knowledge graphs (MMKGs) combine different modal data (e. g., text and image) for a comprehensive understanding of entities.
-
23 Apr 2023 1 repository listedNegative sampling (NS) is widely used in knowledge graph embedding (KGE), which aims to generate negative triples to make a positive-negative contrast during training.
-
14 Aug 2022 1 repository listedTo deal with that problem, in this paper, we propose a novel Multi-modal Siamese Network for Entity Alignment (MSNEA) to align entities in different MMKGs, in which multi-modal knowledge could be comprehensively…
-
20 Apr 2022 1 repository listedThe medical conversational system can relieve the burden of doctors and improve the efficiency of healthcare, especially during the pandemic.
-
Multi-modal Knowledge Graph Generation with Semantics-enriched Prompts18 Apr 2025 0 repositories listedMulti-modal Knowledge Graphs (MMKGs) have been widely applied across various domains for knowledge representation.
-
A Zero-shot Learning Method Based on Large Language Models for Multi-modal Knowledge Graph Embedding10 Mar 2025 0 repositories listedZero-shot learning (ZL) is crucial for tasks involving unseen categories, such as natural language processing, image classification, and cross-lingual transfer.
-
MMPKUBase: A Comprehensive and High-quality Chinese Multi-modal Knowledge Graph3 Aug 2024 0 repositories listedMulti-modal knowledge graphs have emerged as a powerful approach for information representation, combining data from different modalities such as text, images, and videos.
-
RECipe: Does a Multi-Modal Recipe Knowledge Graph Fit a Multi-Purpose Recommendation System?8 Aug 2023 0 repositories listedOver the past two decades, recommendation systems (RSs) have used machine learning (ML) solutions to recommend items, e.g., movies, books, and restaurants, to clients of a business or an online platform.
-
Do as I can, not as I get17 Jun 2023 0 repositories listedThis paper proposes a model called TMR to mine valuable information from simulated data environments.
-
Vision, Deduction and Alignment: An Empirical Study on Multi-modal Knowledge Graph Alignment17 Feb 2023 0 repositories listedEntity alignment (EA) for knowledge graphs (KGs) plays a critical role in knowledge engineering.
-
MMKGR: Multi-hop Multi-modal Knowledge Graph Reasoning3 Sep 2022 0 repositories listedMulti-modal knowledge graphs (MKGs) include not only the relation triplets, but also related multi-modal auxiliary data (i.e., texts and images), which enhance the diversity of knowledge.
-
Multi-Modal Knowledge Graph Construction and Application: A Survey11 Feb 2022 0 repositories listedRecent years have witnessed the resurgence of knowledge engineering which is featured by the fast growth of knowledge graphs.
-
AliMe MKG: A Multi-modal Knowledge Graph for Live-streaming E-commerce13 Sep 2021 0 repositories listedLive streaming is becoming an increasingly popular trend of sales in E-commerce.
-
Boosting Entity-aware Image Captioning with Multi-modal Knowledge Graph26 Jul 2021 0 repositories listedEntity-aware image captioning aims to describe named entities and events related to the image by utilizing the background knowledge in the associated article.
-
A Relational-learning Perspective to Multi-label Chest X-ray Classification10 Mar 2021 0 repositories listedMulti-label classification of chest X-ray images is frequently performed using discriminative approaches, i.e. learning to map an image directly to its binary labels.
Syntology lines on 3 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections