Browse State-of-the-Art › Text-to-Music Generation
Text-to-Music Generation
25 papers with code · 2 benchmarks · 6 datasets archive 2025-07-28
Benchmarks archive 2025-07-28
2 leaderboard tables shown for this task, 2 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| MusicCaps (21 rows) | MeLFusion (image-conditioned) | MeLFusion: Synthesizing Music from Image and Language Cues using... | code | Syntology official (archive's flag): 12 ran · 12 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 4 honoured, 2 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified | Compare |
| MusicBench (1 row) | Mustango (non-pretrained) | Mustango: Toward Controllable Text-to-Music Generation | code | Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 3 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
6 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 37 · with a code link: 25 · where Syntology ran a sample: 15 (15 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (15 of 37 tagged: 15 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 37 of 37, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
8 Jun 2023 8 repositories listed Syntology 15 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 8 where Syntology's instrument failed) · 3 unverified (of 18 harvested samples) · 9 pointer-only (licence)We tackle the task of conditional music generation.
-
26 Jan 2023 5 repositories listed Syntology 10 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 1 honoured, 3 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 6 unverified (of 16 harvested samples) · 4 pointer-only (licence)We introduce MusicLM, a model generating high-fidelity music from text descriptions such as "a calming violin melody backed by a distorted guitar riff".
-
14 Nov 2023 4 repositories listed Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 3 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 9 harvested samples) · 6 pointer-only (licence)Through extensive experiments, we show that the quality of the music generated by Mustango is state-of-the-art, and the controllability through music-specific text prompts greatly outperforms other models such as…
-
Music Understanding LLaMA: Advancing Text-to-Music Generation with Question Answering and Captioning22 Aug 2023 3 repositories listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)To fill this gap, we present a methodology for generating question-answer pairs from existing audio captioning datasets and introduce the MusicQA Dataset designed for answering open-ended music-related questions.
-
27 Jan 2023 3 repositories listedRecent years have seen the rapid development of large generative models for text; however, much less research has explored the connection between text and another "language" of communication -- music.
-
1 Sep 2024 2 repositories listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (of 9 harvested samples) · 9 pointer-only (licence)This paper explores a simple extension of diffusion-based rectified flow Transformers for text-to-music generation, termed as FluxMusic.
-
21 Jul 2024 2 repositories listedHowever, textual prompts alone cannot precisely control temporal musical features such as chords and rhythm of the generated music.
-
24 May 2024 2 repositories listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 2 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 7 harvested samples)Text-to-music (TTM) generation, which converts textual descriptions into audio, opens up innovative avenues for multimedia creation.
-
7 Feb 2024 2 repositories listed Syntology official (archive's flag): 4 ran · 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 2 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 2 pointer-only (licence)Generating long-form 44.
-
10 Aug 2023 2 repositories listed Syntology official (archive's flag): 8 ran · 16 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 4 honoured, 4 violated, 5 with no contract checked; 3 where Syntology's instrument failed) · 11 unverified (of 27 harvested samples) · 19 pointer-only (licence)Any audio can be translated into LOA based on AudioMAE, a self-supervised pre-trained representation learning model.
-
9 Aug 2023 2 repositories listedDespite the task's significance, prevailing generative models exhibit limitations in music quality, computational efficiency, and generalization.
-
21 Nov 2022 2 repositories listedBenefiting from large-scale datasets and pre-trained models, the field of generative models has recently gained significant momentum.
-
13 Feb 2025 1 repository listedRecent advancements in neural audio codecs have enabled the use of tokenized audio representations in various audio generation tasks, such as text-to-speech, text-to-audio, and text-to-music generation.
-
26 Dec 2024 1 repository listedRecent years have seen significant progress in Text-To-Audio (TTA) synthesis, enabling users to enrich their creative workflows with synthetic audio generated from natural language prompts.
-
6 Nov 2024 1 repository listedThis paper investigates the capabilities of text-to-audio music generation models in producing long-form music with prompts that change over time, focusing on soundtrack generation for Tabletop Role-Playing Games…
-
30 Sep 2024 1 repository listedWe present the Melody-Guided Music Generation (MG2) model, a novel approach using melody to guide the text-to-music generation that, despite a simple method and limited resources, achieves excellent performance.
-
19 Jul 2024 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 2 harvested samples)Open generative models are vitally important for the community, allowing for fine-tunes and serving as baselines when presenting new models.
-
18 Jun 2024 1 repository listed Syntology 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)It is an open challenge to obtain high quality training data, especially captions, for text-to-audio models.
-
7 Jun 2024 1 repository listed Syntology official (archive's flag): 12 ran · 12 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 4 honoured, 2 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 12 harvested samples) · 12 pointer-only (licence)MeLFusion is a text-to-music diffusion model with a novel "visual synapse", which effectively infuses the semantics from the visual modality into the generated music.
-
9 Feb 2024 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)This paper introduces a novel approach to the editing of music generated by such models, enabling the modification of specific attributes, such as genre, mood and instrument, while maintaining other aspects unchanged.
-
1 Feb 2024 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 5 where Syntology's instrument failed) · 2 unverified (of 10 harvested samples) · 1 pointer-only (licence)Here, we exploit this capability and introduce PAM, a no-reference metric for assessing audio quality for different audio processing tasks.
-
16 Nov 2023 1 repository listed Syntology official: no sample here; runs from other or unrecorded repositories · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)We introduce the Song Describer dataset (SDD), a new crowdsourced corpus of high-quality audio-caption pairs, designed for the evaluation of music-and-language models.
-
7 Nov 2023 1 repository listedWhile the image-domain Uni-ControlNet method already allows generation with any subset of controls, we devise a new strategy to allow creators to input controls that are only partially specified in time.
-
20 Sep 2023 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)In this work, we investigate the personalization of text-to-music diffusion models in a few-shot setting.
-
3 Aug 2023 1 repository listed Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 2 honoured, 3 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 4 unverified (of 14 harvested samples) · 14 pointer-only (licence)Diffusion models have shown promising results in cross-modal generation tasks, including text-to-image and text-to-audio generation.
-
MuseControlLite: Multifunctional Music Generation with Lightweight Conditioners23 Jun 2025 0 repositories listedWe propose MuseControlLite, a lightweight mechanism designed to fine-tune text-to-music generation models for precise conditioning using various time-varying musical attributes and reference audio signals.
-
Diff-TONE: Timestep Optimization for iNstrument Editing in Text-to-Music Diffusion Models18 Jun 2025 0 repositories listedBreakthroughs in text-to-music generation models are transforming the creative landscape, equipping musicians with innovative tools for composition and experimentation like never before.
-
Auto-Regressive vs Flow-Matching: a Comparative Study of Modeling Paradigms for Text-to-Music Generation10 Jun 2025 0 repositories listedRecent progress in text-to-music generation has enabled models to synthesize high-quality musical segments, full compositions, and even respond to fine-grained control signals, e.g. chord progressions.
-
Diffusion based Text-to-Music Generation with Global and Local Text based Conditioning24 Jan 2025 0 repositories listedDiffusion based Text-To-Music (TTM) models generate music corresponding to text descriptions.
-
MusicFlow: Cascaded Flow Matching for Text Guided Music Generation27 Oct 2024 0 repositories listedWe introduce MusicFlow, a cascaded text-to-music generation model based on flow matching.
-
Editing Music with Melody and Text: Using ControlNet for Diffusion Transformer7 Oct 2024 0 repositories listed
-
Combining audio control and style transfer using latent diffusion31 Jul 2024 0 repositories listed
-
The Interpretation Gap in Text-to-Music Generation Models14 Jul 2024 0 repositories listed
-
JEN-1 DreamStyler: Customized Musical Concept Learning via Pivotal Parameters Tuning18 Jun 2024 0 repositories listed
-
25 May 2023 0 repositories listed
-
ERNIE-Music: Text-to-Waveform Music Generation with Diffusion Models9 Feb 2023 0 repositories listed
-
8 Feb 2023 0 repositories listed
Syntology lines on 16 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections