Browse State-of-the-Art › Caption Generation
Caption Generation
119 papers with code · 0 benchmarks · 2 datasets archive 2025-07-28
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
2 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 310 · with a code link: 119 · where Syntology ran a sample: 33 (28 with a run with no instrument failure, 5 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (33 of 310 tagged: 28 with a run with no instrument failure, 5 where every run was a failure of Syntology's instrument)
Page 1 of 4: papers 1 to 100 of 310, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
10 Feb 2015 92 repositories listed Syntology 58 ran (of which 0 constructed an object rather than computing a result; 45 with no instrument failure: 3 honoured, 0 violated, 42 with no contract checked; 13 where Syntology's instrument failed) · 26 unverified (of 84 harvested samples) · 14 pointer-only (licence)Inspired by recent work in machine translation and object detection, we introduce an attention based model that automatically learns to describe the content of images.
-
30 Oct 2017 24 repositories listed Syntology community repositories only · 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 3 pointer-only (licence)Over the last decade, Convolutional Neural Network (CNN) models have been highly successful in solving complex vision problems.
-
8 Sep 2014 21 repositories listed Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified (of 6 harvested samples) · 6 pointer-only (licence)We present a simple regularization technique for Recurrent Neural Networks (RNNs) with Long Short-Term Memory (LSTM) units.
-
1 Apr 2015 18 repositories listedIn this paper we describe the Microsoft COCO Caption dataset and evaluation server.
-
27 Mar 2017 12 repositories listedWhen a recurrent neural network language model is used for caption generation, the image information can be fed to the neural network either by directly incorporating it in the RNN -- conditioning the language model by…
-
3 May 2015 4 repositories listedOur LSTM model is trained on video-sentence pairs and learns to associate a sequence of video frames to a sequence of words in order to generate a description of the event in the video clip.
-
19 Feb 2015 4 repositories listed Syntology 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)Bayesian optimization is an effective methodology for the global optimization of functions with expensive evaluations.
-
Music Understanding LLaMA: Advancing Text-to-Music Generation with Question Answering and Captioning22 Aug 2023 3 repositories listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)To fill this gap, we present a methodology for generating question-answer pairs from existing audio captioning datasets and introduce the MusicQA Dataset designed for answering open-ended music-related questions.
-
17 Feb 2021 3 repositories listedThe availability of large-scale image captioning and visual question answering datasets has contributed significantly to recent successes in vision-and-language pre-training.
-
24 May 2018 3 repositories listed Syntology official (archive's flag): 12 ran · 16 ran (of which 0 constructed an object rather than computing a result; 15 with no instrument failure: 2 honoured, 0 violated, 13 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 17 harvested samples) · 2 pointer-only (licence)In this survey, we consider seq2seq problems from the RL point of view and provide a formulation combining the power of RL methods in decision-making with sequence-to-sequence models that enable remembering long-term…
-
24 Jul 2016 3 repositories listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)We present an approach to training neural networks to generate sequences using actor-critic methods from reinforcement learning (RL).
-
16 Oct 2023 2 repositories listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 6 harvested samples)Figurative and non-literal expressions are profoundly integrated in human communication.
-
2 Jan 2023 2 repositories listedExperiments on the COCO dataset with two settings: Open Vocabulary Instance Segmentation (OVIS) and Open Set Panoptic Segmentation (OSPS) demonstrate the superiority of the CGG.
-
11 Sep 2021 2 repositories listedDevelopers of text generation models rely on automated evaluation metrics as a stand-in for slow and expensive manual evaluations.
-
17 Aug 2021 2 repositories listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples)Dense video captioning aims to generate multiple associated captions with their temporal locations from the video.
-
19 Feb 2018 2 repositories listed Syntology official (archive's flag): 2 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 1 pointer-only (licence)We propose a conditional non-autoregressive neural sequence model based on iterative refinement.
-
21 Dec 2017 2 repositories listedFinally, a comprehensive review is presented on the proposed data set to fully advance the task of remote sensing caption.
-
6 Dec 2017 2 repositories listedOur extensive experiments show that our algorithm can successfully craft visually-similar adversarial examples with randomly targeted captions or keywords, and the adversarial examples can be made highly transferable to…
-
26 Sep 2017 2 repositories listedWe present a new approach to the design of deep networks for natural language processing (NLP), based on the general technique of Tensor Product Representations (TPRs) for encoding and processing symbol structures in…
-
22 Aug 2017 2 repositories listedWe demonstrate through a variety of applications that our approach is able to localize the discriminative image locations across different network architectures, diverse vision tasks and data modalities.
-
22 Aug 2017 2 repositories listedWe propose a simple technique for encouraging generative RNNs to plan ahead.
-
21 Dec 2016 2 repositories listedLanguage Models based on recurrent neural networks have dominated recent image caption generation tasks.
-
15 Jul 2016 2 repositories listedWe propose DSD, a dense-sparse-dense training flow, for regularizing deep neural networks and achieving better optimization performance.
-
9 Dec 2015 2 repositories listedIn this paper, we describe the system for generating textual descriptions of short video clips using recurrent neural networks (RNN), which we used while participating in the Large Scale Movie Description Challenge 2015…
-
30 Jun 2025 1 repository listedExtensive experiments on various settings, including vision-language understanding, visual grounding, and region caption generation, demonstrate the effectiveness of our DenseWorld-1M dataset and labeling models.
-
18 Jun 2025 1 repository listedDetailed captions that accurately reflect the characteristics of a music piece can enrich music databases and drive forward research in music AI.
-
1 Jun 2025 1 repository listedHigh-quality, large-scale audio captioning is crucial for advancing audio understanding, yet current automated methods often generate captions that lack fine-grained detail and contextual accuracy, primarily due to…
-
29 May 2025 1 repository listedVideo captions play a crucial role in text-to-video generation tasks, as their quality directly influences the semantic coherence and visual fidelity of the generated videos.
-
20 May 2025 1 repository listedTo address these limitations, we introduce LoVR, a benchmark specifically designed for long video-text retrieval.
-
25 Apr 2025 1 repository listedVideo Question Answering (VQA) inherently relies on multimodal reasoning, integrating visual, temporal, and linguistic cues to achieve a deeper understanding of video content.
-
13 Apr 2025 1 repository listed
-
16 Mar 2025 1 repository listed
-
13 Mar 2025 1 repository listed
-
5 Feb 2025 1 repository listed
-
31 Jan 2025 1 repository listed Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 11 harvested samples) · 11 pointer-only (licence)
-
5 Jan 2025 1 repository listed
-
23 Dec 2024 1 repository listed
-
15 Dec 2024 1 repository listed
-
28 Nov 2024 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
4 Nov 2024 1 repository listed Syntology official (archive's flag): 4 ran · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 2 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (of 9 harvested samples) · 3 pointer-only (licence)
-
18 Oct 2024 1 repository listed
-
17 Oct 2024 1 repository listed
-
12 Oct 2024 1 repository listed
-
9 Oct 2024 1 repository listed
-
2 Oct 2024 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 2 honoured, 0 violated, 2 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples)
-
15 Aug 2024 1 repository listed
-
6 Aug 2024 1 repository listed
-
30 Jul 2024 1 repository listed
-
19 Jul 2024 1 repository listed
-
16 Jul 2024 1 repository listed
-
22 Jun 2024 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples) · 6 pointer-only (licence)
-
19 Jun 2024 1 repository listed
-
15 Jun 2024 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (of 10 harvested samples)
-
12 May 2024 1 repository listed
-
3 Apr 2024 1 repository listed
-
6 Mar 2024 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 1 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified (of 10 harvested samples) · 10 pointer-only (licence)
-
Automatic Report Generation for Histopathology images using pre-trained Vision Transformers and BERT3 Dec 2023 1 repository listed
-
1 Dec 2023 1 repository listed
-
NeuSyRE: Neuro-Symbolic Visual Understanding and Reasoning Framework based on Scene Graph Enrichment5 Nov 2023 1 repository listed
-
15 Oct 2023 1 repository listed
-
28 Sep 2023 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 2 harvested samples) · 2 pointer-only (licence)
-
18 Sep 2023 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 8 harvested samples) · 8 pointer-only (licence)
-
15 Sep 2023 1 repository listed
-
6 Sep 2023 1 repository listed
-
8 Aug 2023 1 repository listed Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 1 violated, 1 with no contract checked; 8 where Syntology's instrument failed) · 2 unverified (of 12 harvested samples) · 1 pointer-only (licence)
-
31 Jul 2023 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 3 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
20 Jul 2023 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
6 Jun 2023 1 repository listed
-
4 Feb 2023 1 repository listed
-
17 Nov 2022 1 repository listed
-
5 Nov 2022 1 repository listed
-
14 Oct 2022 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 4 where Syntology's instrument failed) · 2 unverified (of 9 harvested samples) · 9 pointer-only (licence)
-
16 Sep 2022 1 repository listed
-
30 Jun 2022 1 repository listed
-
26 May 2022 1 repository listed
-
22 May 2022 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 5 harvested samples)
-
22 Apr 2022 1 repository listed
-
29 Mar 2022 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result (of 2 harvested samples)
-
10 Jan 2022 1 repository listed
-
9 Dec 2021 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 4 pointer-only (licence)
-
2 Dec 2021 1 repository listed
-
30 Nov 2021 1 repository listed
-
25 Nov 2021 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
15 Nov 2021 1 repository listed
-
1 Nov 2021 1 repository listed
-
24 Oct 2021 1 repository listed
-
21 Oct 2021 1 repository listed Syntology official (archive's flag): 7 ran · 9 ran (of which 4 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 12 harvested samples) · 8 pointer-only (licence)
-
20 Oct 2021 1 repository listed
-
12 Oct 2021 1 repository listed
-
7 Sep 2021 1 repository listed
-
4 Sep 2021 1 repository listed
-
18 Aug 2021 1 repository listed
-
18 Jul 2021 1 repository listed
-
11 Jun 2021 1 repository listed
-
12 May 2021 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
23 Apr 2021 1 repository listed
-
22 Mar 2021 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
23 Feb 2021 1 repository listed
-
13 Dec 2020 1 repository listed
-
8 Dec 2020 1 repository listed
Syntology lines on 30 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections