{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/dataset/cocochorales","name":"CocoChorales","full_name":null,"description_markdown":"# The CocoChorales Dataset\r\n\r\n**CocoChorales** is a dataset consisting of over 1400 hours of audio mixtures containing four-part chorales performed by 13 instruments, all synthesized with realistic-sounding generative models. CocoChorales contains mixes, sources, and MIDI data, as well as annotations for note expression (e.g., per-note volume and vibrato) and synthesis parameters (e.g., multi-f0).\r\n\r\n## Dataset\r\n\r\nWe created CocoChorales using two generative models produced by Magenta: [Coconet](https://magenta.tensorflow.org/coconet) and [MIDI-DDSP](https://magenta.tensorflow.org/midi-ddsp). The dataset was created in two stages. First, we used a trained Coconet model to generate a large set of four-part chorales in the style of J.S. Bach. The output of this first stage is a set of note sequences, stored as MIDI, to which we assign a tempo and add random timing variations to each note (for added realism).\r\n\r\nIn the second stage, we use MIDI-DDSP to synthesize these MIDI files into audio, resulting in audio clips that sound like the chorales were performed by live musicians. This MIDI-DDSP model was trained on [URMP](https://labsites.rochester.edu/air/projects/URMP.html). We define a set of ensembles that consist of the following instruments, in Soprano, Alto, Tenor, Bass (SATB) order:\r\n\r\n<ul>\r\n  <li><strong>String Ensemble</strong>: Violin 1, Violin 2, Viola, Cello.</li>\r\n  <li><strong>Brass Ensemble</strong>: Trumpet, French Horn, Trombone, Tuba.</li>\r\n  <li><strong>Woodwind Ensemble</strong>: Flute, Oboe, Clarinet, Bassoon.</li>\r\n  <li><strong>Random Ensemble</strong>: Each SATB part is randomly assigned an instrument according to the following:\r\n    <ul class=\"nested\">\r\n      <li><em>Soprano</em>: Violin, Flute, Trumpet, Clarinet, Oboe.</li>\r\n      <li><em>Alto</em>: Violin, Viola, Flute, Clarinet, Oboe, Saxophone, Trumpet, French Horn.</li>\r\n      <li><em>Tenor</em>: Viola, Cello, Clarinet, Saxophone, Trombone, French Horn.</li>\r\n      <li><em>Bass</em>: Cello, Double Bass, Bassoon, Tuba.</li>\r\n    </ul>\r\n  </li>\r\n</ul>\r\n\r\n\r\nEach instrument in the ensemble is synthesized separately, with annotations for the high-level expressions used for each note (e.g., vibrato, note volume, note brightness, etc; all expressions shown [here](https://midi-ddsp.github.io/#note_expression_control), and more details in Sections 3.2 and B.3 of the [MIDI-DDSP paper](https://openreview.net/pdf?id=UseMOjWENv)) as well as detailed low-level annotations for synthesis parameters (e.g., f<sub>0</sub>’s, amplitudes of each harmonic, etc). Because the MIDI-DDSP model skews sharp, we randomly applied pitch augmentation to the f<sub>0</sub>’s (see Figure 2, [here](https://arxiv.org/pdf/2209.14458.pdf)) to . All four audio clips for each instrument in the ensemble are then mixed together to produce an example in the dataset.\r\n\r\nBecause all of the data in CocoChorales originate from generative models, all of the annotations perfectly correspond to the audio data. All in all, the dataset contains 240,000 examples, 60,000 mixes from each one of the four ensemble types above. Each ensemble has its own train/validation/test split All of the audio is 16 kHz, 16-bit PCM data. Each example contains:\r\n\r\n\r\n<ul>\r\n  <li>A mixture</li>\r\n  <li>Source audio for all four instruments\r\n    <ul class=\"nested\">\r\n      <li>Gain applied to each source</li>\r\n    </ul>\r\n  </li>\r\n  <li>MIDI with tempo and precise timing</li>\r\n  <li>The name of the ensemble with instrument names</li>\r\n  <li>Note expression annotations for every note:\r\n    <ul class=\"nested\">\r\n      <li>Volume, Volume Fluctuation, Volume Peak Position, Vibrato, Brightness, and Attack Noise used by MIDI-DDSP to synthesize every note (see Sections 3.2 and B.3 of the MIDI-DDSP paper for more details)</li>\r\n    </ul>\r\n  </li>\r\n  <li>Synthesis parameters for every source (250 Hz):\r\n    <ul class=\"nested\">\r\n      <li>Fundamental frequency (f<sub>0</sub>), amplitude, amplitude of all harmonics, filtered noise parameters</li>\r\n      <li>Amount of pitch augmentation applied</li>\r\n    </ul>\r\n  </li>\r\n</ul>\r\n\r\n\r\n## Further Details\r\n\r\nA detailed view of the contents of the CocoChorales dataset is provided [at this link](https://github.com/lukewys/chamber-ensemble-generator/blob/master/data_format.md).\r\n\r\n# Download\r\n\r\nFor download instructions, please see [this github page](https://github.com/lukewys/chamber-ensemble-generator#dataset-download). The compressed version of the full dataset is 2.9 Tb, and the uncompressed version is larger than 4 Tb. There is a \"tiny\" version for download as well.\r\n\r\nMD5 Hashes for all zipped files in the download are provided [here](https://storage.googleapis.com/magentadata/datasets/cocochorales/cocochorales_full_v1_zipped/cocochorales_md5s.txt).\r\n\r\n\r\n# License\r\n\r\nThe CocoChorales dataset was made by [Yusong Wu](https://lukewys.github.io/) and is available under the [Creative Commons Attribution 4.0 International (CC-BY 4.0)](https://creativecommons.org/licenses/by/4.0/).\r\n\r\n\r\n# How to Cite\r\n\r\nIf you use CocoChorales in your work, we ask that you cite the following [paper](https://arxiv.org/abs/2209.14458) where it was introduced:\r\n\r\n```\r\nYusong Wu, Josh Gardner, Ethan Manilow, Ian Simon, Curtis Hawthorne, and Jesse Engel.\r\n“The Chamber Ensemble Generator: Limitless High-Quality MIR Data via Generative Modeling.”\r\narXiv preprint, arXiv:2209.14458, 2022.\r\n```\r\n\r\nYou can also use the following bibtex entry:\r\n\r\n```\r\n@article{wu2022chamber,\r\n  title = {The Chamber Ensemble Generator: Limitless High-Quality MIR Data via Generative Modeling},\r\n  author = {Wu, Yusong and Gardner, Josh and Manilow, Ethan and Simon, Ian and Hawthorne, Curtis and Engel, Jesse},\r\n  journal={arXiv preprint arXiv:2209.14458},\r\n  year = {2022},\r\n}\r\n```","description_withheld":null,"homepage":"https://magenta.tensorflow.org/datasets/cocochorales","introduced_date":"2022-09-28","introduced_date_note":null,"introduced_by":{"paper":"/paper/the-chamber-ensemble-generator-limitless-high","title":"The Chamber Ensemble Generator: Limitless High-Quality MIR Data via Generative Modeling","first_author":"Yusong Wu","url":null},"license":{"name":"CC-BY 4.0","url":"https://creativecommons.org/licenses/by/4.0/"},"modalities":[{"name":"Audio","url":"/datasets/modality/audio"}],"tasks":[{"name":"Music Transcription","url":"/task/music-transcription","datasets_with_task":"/datasets/task/music-transcription"},{"name":"Music Source Separation","url":"/task/music-source-separation","datasets_with_task":"/datasets/task/music-source-separation"},{"name":"Multi-task Audio Source Seperation","url":"/task/multi-task-audio-source-seperation","datasets_with_task":"/datasets/task/multi-task-audio-source-seperation"}],"languages":[],"variants":["CocoChorales"],"data_loaders":[],"num_papers_in_archive":7,"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28"},"benchmarks":[],"papers":{"order":"date (newest first), then slug","population":"every paper with a leaderboard row on this dataset's benchmarks (the benchmark-backed subset): the archive's own papers-using-this-dataset list was never published, so this is not that list; num_papers_in_archive is the archive's own count","page":1,"pages_in_order":1,"rows_per_page":100,"shown":0,"of":0,"counts":{"papers_with_a_benchmark_row":0,"with_a_code_link":0,"where_syntology_ran_a_sample":0,"not_listed_spam_title":0,"listed":0,"listed_where_code_ran":0,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":0,"every_run_a_failure_of_syntologys_instrument":0,"listed_with_a_run_with_no_instrument_failure":0,"listed_every_run_a_failure_of_syntologys_instrument":0,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers with at least one leaderboard row on this dataset's benchmarks; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"items":[],"full_list":"papers_with_a_benchmark_row: every listed paper, in this order"},"papers_with_a_benchmark_row":[],"papers_where_code_ran":0,"papers_where_code_ran_first_page":null,"papers_where_code_ran_caption":"We ran code from the paper's repository; we did not run it on this dataset or check it against this dataset's benchmarks.","pages":[],"row_route":"each paper's syntology object carries sample_list (this site's paper page, #ran), syntology_url (syntology.ai's page for the paper, only when that route probed live) and mcp (the agent call that lists the paper's harvested samples; not a verdict on the paper)","developers":"https://syntology.ai/developers","syntology_totals":{"read_at":"2026-10-05T00:36:11+00:00","papers_with_samples":0,"samples_harvested":0,"samples_ran":0,"samples_constructed":0,"samples_ran_checked":0,"samples_ran_instrument_failed":0,"samples_unverified":0,"pointer_only_for_licence":0,"papers_with_no_sample_that_ran":0,"papers_with_a_sample_that_ran":0,"papers_with_a_run_with_no_instrument_failure":0,"papers_where_every_run_was_an_instrument_failure":0,"note":"the per-paper counts of every listed paper (all pages), summed; not a rate"},"key_notes":{"samples_ran_checked":"legacy name, kept unchanged so existing readers do not break: it counts the samples that ran with no instrument failure (honoured, violated, and ran with no contract checked); it does not mean a contract was checked, and the pages print it as 'K with no instrument failure', not 'K checked'","samples_constructed":"a sub-count of the samples that ran, never subtracted from them and never a failure: an executed sample whose run returned an instance of its own class (fixture_out_type equals the entry name): the run built an object and did not compute a result (Syntology's RAN record, counts.constructed)"},"since_archive_judged":{"papers":0,"papers_placed":0,"judged_by":{"model":"a model","models_as_recorded":[],"from":"lb_rows_run_verified.jsonl: each record's `model` field (the extractor's call that wrote decisions[])"},"note":"a model's judgement from the paper's own tables that they report on this leaderboard, not a result: no value from a paper that was not placed is printed or carried here; papers counts each paper once over these leaderboards","backfill":"8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read)","backfill_complete":false,"leaderboards":[]},"papers_note":"The archive never published its papers-using-dataset list; these are papers with a leaderboard row on this dataset's benchmarks.","record_sha256":"e1025fa1cc50810861b2ececa0a60ce2ffc8cdd1861eba634d0b3552dd8f7429","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}