Browse State-of-the-Art › cross-modal alignment
cross-modal alignment
151 papers with code · 0 benchmarks · 1 dataset archive 2025-07-28
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
1 dataset whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 342 · with a code link: 151 · where Syntology ran a sample: 47 (38 with a run with no instrument failure, 9 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (47 of 342 tagged: 38 with a run with no instrument failure, 9 where every run was a failure of Syntology's instrument)
Page 1 of 4: papers 1 to 100 of 342, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
18 Apr 2022 4 repositories listedIn this paper, we propose LayoutLMv3 to pre-train multimodal Transformers for Document AI with unified text and image masking.
-
24 May 2022 3 repositories listedLarge-scale pretrained foundation models have been an emerging paradigm for building artificial intelligence (AI) systems, which can be quickly adapted to a wide range of downstream tasks.
-
8 Jul 2025 2 repositories listed Syntology official (archive's flag): 3 ran · 11 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 9 where Syntology's instrument failed) · 1 unverified (of 12 harvested samples) · 12 pointer-only (licence)The strong performance of Skywork-R1V3 primarily stems from our elaborate post-training RL framework, which effectively activates and enhances the model's reasoning ability, without the need for additional continue…
-
3 Jul 2025 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)We introduce DeSTA2.
-
12 Oct 2022 2 repositories listed Syntology official: not harvested · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)In this paper, we present a novel Multi-Granularity Cross-modal Alignment (MGCA) framework for generalized medical visual representation learning by harnessing the naturally exhibited semantic correspondences between…
-
17 Jun 2022 2 repositories listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)Vision-Language (VL) models with the Two-Tower architecture have dominated visual-language representation learning in recent years.
-
8 Jul 2025 1 repository listedReferring Remote Sensing Image Segmentation provides a flexible and fine-grained framework for remote sensing scene analysis via vision-language collaborative interpretation.
-
30 Jun 2025 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 7 where Syntology's instrument failed) · 4 unverified (of 11 harvested samples)Benefiting from the advances in large language models and cross-modal alignment, existing multimodal large language models have achieved prominent performance in image and short video understanding.
-
19 Jun 2025 1 repository listedPathology is essential for cancer diagnosis, with multiple instance learning (MIL) widely used for whole slide image (WSI) analysis.
-
11 Jun 2025 1 repository listedThis paper presents OmniDRCA, a parallel speech-text foundation model based on joint autoregressive modeling, featuring dual-resolution speech representations and contrastive cross-modal alignment.
-
11 Jun 2025 1 repository listedIn real-word scenarios, person re-identification (ReID) expects to identify a person-of-interest via the descriptive query, regardless of whether the query is a single modality or a combination of multiple modalities.
-
26 May 2025 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 3 honoured, 1 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 9 harvested samples) · 1 pointer-only (licence)Multimodal information retrieval (MIR) faces inherent challenges due to the heterogeneity of data sources and the complexity of cross-modal alignment.
-
23 May 2025 1 repository listedSpecifically, we first propose the online prompt learning using learnable text prompt as the identity-level semantic center to bridge the identity semantics of different spectra in online manner.
-
20 May 2025 1 repository listedThe text generation paradigm for audio tasks has opened new possibilities for unified audio understanding.
-
15 May 2025 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)Natural language image-caption datasets, widely used for training Large Multimodal Models, mainly focus on natural scenarios and overlook the intricate details of mathematical figures that are critical for…
-
15 May 2025 1 repository listed Syntology official (archive's flag): 22 ran · 23 ran (of which 13 constructed an object rather than computing a result; 19 with no instrument failure: 0 honoured, 0 violated, 19 with no contract checked; 4 where Syntology's instrument failed) · 5 unverified (of 28 harvested samples) · 28 pointer-only (licence)To address this issue, we propose a Multi-Stage Cross-modal Interaction (MSCI) model that effectively explores and utilizes intermediate-layer information from CLIP's visual encoder.
-
12 May 2025 1 repository listedAutomated Radiology report generation (RRG) aims at producing detailed descriptions of medical images, reducing radiologists' workload and improving access to high-quality diagnostic services.
-
10 May 2025 1 repository listedText-to-image synthesis has progressed to the point where models can generate visually compelling images from natural language prompts.
-
9 May 2025 1 repository listedLarge-scale pre-trained models have achieved remarkable success in language and image tasks, leading an increasing number of studies to explore the application of pre-trained image models, such as CLIP, in the domain of…
-
8 May 2025 1 repository listedVision-Language Models (VLMs) learn joint representations by mapping images and text into a shared latent space.
-
2 May 2025 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)Second, we resolve conflicting optimization goals by separating contrastive and reconstruction objectives through dedicated global tokens.
-
29 Apr 2025 1 repository listedMedical image reporting (MIR) aims to generate structured clinical descriptions from radiological images.
-
19 Apr 2025 1 repository listedWe introduce CrossWKV, a novel cross-attention mechanism for the state-based RWKV-7 model, designed to enhance the expressive power of text-to-image generation.
-
13 Apr 2025 1 repository listed3D captioning, which aims to describe the content of 3D scenes in natural language, remains highly challenging due to the inherent sparsity of point clouds and weak cross-modal alignment in existing methods.
-
8 Apr 2025 1 repository listedMotivated by this, we introduce Gaze-CIFAR-10, a human gaze time-series dataset, along with a dual-sequence gaze encoder that models the precise sequential localization of human attention on distinct local attributes.
-
3 Apr 2025 1 repository listedRobot vision has greatly benefited from advancements in multimodal fusion techniques and vision-language models (VLMs).
-
2 Apr 2025 1 repository listedIn this work, we propose COST, a contrastive one-stage transformer fusion framework for VL tracking, aiming to learn semantically consistent and unified VL representations.
-
30 Mar 2025 1 repository listedMedical image segmentation typically relies solely on visual data, overlooking the rich textual information clinicians use for diagnosis.
-
25 Mar 2025 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)We propose a training-free method for open-vocabulary semantic segmentation using Vision-and-Language Models (VLMs).
-
24 Mar 2025 1 repository listedPre-trained Vision Foundation Models (VFMs) provide strong visual representations for a wide range of applications.
-
24 Mar 2025 1 repository listed
-
19 Mar 2025 1 repository listed
-
8 Mar 2025 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
6 Mar 2025 1 repository listed
-
5 Mar 2025 1 repository listed Syntology official (archive's flag): 13 ran · 13 ran (of which 12 constructed an object rather than computing a result; 13 with no instrument failure: 0 honoured, 0 violated, 13 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 16 harvested samples) · 16 pointer-only (licence)
-
24 Feb 2025 1 repository listed
-
23 Feb 2025 1 repository listed
-
20 Feb 2025 1 repository listed
-
16 Feb 2025 1 repository listed Syntology 8 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 1 violated, 2 with no contract checked; 4 where Syntology's instrument failed) · 4 unverified (of 12 harvested samples) · 5 pointer-only (licence)
-
12 Feb 2025 1 repository listed
-
12 Feb 2025 1 repository listed
-
6 Feb 2025 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 7 harvested samples)
-
5 Feb 2025 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)
-
15 Jan 2025 1 repository listed
-
1 Jan 2025 1 repository listed
-
1 Jan 2025 1 repository listed
-
1 Jan 2025 1 repository listed
-
30 Dec 2024 1 repository listed
-
17 Dec 2024 1 repository listed
-
12 Dec 2024 1 repository listed
-
12 Dec 2024 1 repository listed
-
2 Dec 2024 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
27 Nov 2024 1 repository listed
-
31 Oct 2024 1 repository listed
-
21 Oct 2024 1 repository listed
-
17 Oct 2024 1 repository listed
-
14 Oct 2024 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
9 Oct 2024 1 repository listed Syntology official (archive's flag): 12 ran · 12 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 10 where Syntology's instrument failed) · 0 unverified (of 12 harvested samples) · 1 pointer-only (licence)
-
3 Oct 2024 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (of 6 harvested samples) · 6 pointer-only (licence)
-
30 Sep 2024 1 repository listed
-
20 Sep 2024 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 9 harvested samples) · 9 pointer-only (licence)
-
17 Sep 2024 1 repository listed
-
17 Sep 2024 1 repository listed
-
29 Aug 2024 1 repository listed
-
29 Aug 2024 1 repository listed
-
28 Aug 2024 1 repository listed
-
16 Aug 2024 1 repository listed
-
15 Aug 2024 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples) · 9 pointer-only (licence)
-
2 Aug 2024 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 1 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)
-
25 Jul 2024 1 repository listed
-
22 Jul 2024 1 repository listed
-
18 Jul 2024 1 repository listed
-
16 Jul 2024 1 repository listed
-
7 Jul 2024 1 repository listed
-
25 Jun 2024 1 repository listed Syntology official (archive's flag): 16 ran · 16 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 3 violated, 6 with no contract checked; 7 where Syntology's instrument failed) · 6 unverified (of 22 harvested samples) · 22 pointer-only (licence)
-
19 Jun 2024 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 4 harvested samples)
-
12 Jun 2024 1 repository listed
-
12 Jun 2024 1 repository listed
-
7 Jun 2024 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
2 Jun 2024 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 4 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (of 11 harvested samples)
-
31 May 2024 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)
-
29 May 2024 1 repository listed
-
28 May 2024 1 repository listed
-
23 May 2024 1 repository listed
-
15 May 2024 1 repository listed
-
21 Apr 2024 1 repository listed
-
20 Apr 2024 1 repository listed
-
13 Apr 2024 1 repository listed
-
13 Mar 2024 1 repository listed
-
2 Mar 2024 1 repository listed
-
29 Feb 2024 1 repository listed
-
16 Jan 2024 1 repository listed
-
2 Jan 2024 1 repository listed Syntology official (archive's flag): 1 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
1 Jan 2024 1 repository listed
-
25 Dec 2023 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
22 Dec 2023 1 repository listed
-
19 Dec 2023 1 repository listed Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 8 where Syntology's instrument failed) · 3 unverified (of 13 harvested samples) · 13 pointer-only (licence)
-
19 Dec 2023 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 3 pointer-only (licence)
-
16 Dec 2023 1 repository listed
-
13 Dec 2023 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
Syntology lines on 32 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections