{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/task/audio-captioning","name":"Audio captioning","slug":"audio-captioning","description_markdown":"Audio Captioning is the task of describing audio using text. The general approach is to use an audio encoder to encode the audio (example: PANN, CAV-MAE), and to use a decoder (example: transformer) to generate the text.\r\nTo judge the quality of audio captions, though machine translation metrics (BLEU, METEOR, ROUGE)  and image captioning metrics (SPICE, CIDER) are used, they are not very well-suited. Attempts have been made to use pretrained language model based metrics such as Sentence-BERT.","categories":[{"name":"Audio","url":"/area/audio"}],"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","slug_source":"archive_url"},"counts":{"papers_tagged":119,"papers_with_code":62,"benchmarks":2,"benchmark_tables_in_archive":2,"benchmark_tables_shown":2,"benchmark_tables_withheld_as_spam":0,"benchmark_definition":"a leaderboard table with at least one row; benchmark_tables_shown also counts the zero-row tables; benchmark_tables_in_archive adds the tables withheld as spam","datasets":5,"subtasks":2,"parent_tasks":0},"benchmarks":[{"leaderboard":"/sota/audio-captioning-on-audiocaps","slug":"audio-captioning-on-audiocaps","dataset":"AudioCaps","dataset_url":"/dataset/audiocaps","rows_in_archive":18,"metrics":["SPIDEr","CIDEr","SPICE","BLEU-4","METEOR","ROUGE-L","FENSE","SPIDEr-FL","#params (M)","ROUGE","Sentence-BERT"],"first_row_in_archive_order":{"model":"MQ-Cap","paper_title":"Enhancing Retrieval-Augmented Audio Captioning with Generation-Assisted Multimodal Querying and Progressive Learning","paper_url":"/paper/audio-captioning-via-generative-pair-to-pair","paper_date":"2024-10-14","arxiv_id":"2410.10913","code_links":[],"syntology":null}},{"leaderboard":"/sota/audio-captioning-on-clotho","slug":"audio-captioning-on-clotho","dataset":"Clotho","dataset_url":"/dataset/clotho","rows_in_archive":11,"metrics":["SPIDEr","CIDEr","SPICE","BLEU-4","METEOR","ROUGE-L","FENSE","SPIDEr-FL","Sentence-BERT"],"first_row_in_archive_order":{"model":"SLAM-AAC","paper_title":"SLAM-AAC: Enhancing Audio Captioning with Paraphrasing Augmentation and CLAP-Refine through LLMs","paper_url":"/paper/slam-aac-enhancing-audio-captioning-with","paper_date":"2024-10-12","arxiv_id":"2410.09503","code_links":[{"title":"X-LANCE/SLAM-LLM","url":"https://github.com/X-LANCE/SLAM-LLM"}],"syntology":null}}],"datasets":[{"url":"/dataset/audiocaps","name":"AudioCaps","full_name":"","num_papers_in_archive":279},{"url":"/dataset/clotho","name":"Clotho","full_name":"Clotho","num_papers_in_archive":202},{"url":"/dataset/wavcaps","name":"WavCaps","full_name":"","num_papers_in_archive":41},{"url":"/dataset/macs","name":"MACS","full_name":"Multi-Annotator Captioned Soundscapes","num_papers_in_archive":10},{"url":"/dataset/longvale","name":"LongVALE","full_name":"","num_papers_in_archive":2}],"subtasks":[{"url":"/task/retrieval-augmented-few-shot-in-context-audio","name":"Retrieval-augmented Few-shot In-context Audio Captioning"},{"url":"/task/zero-shot-audio-captioning","name":"Zero-shot Audio Captioning"}],"parent_tasks":[],"papers":{"order":"repositories listed in the archive (most first), then date (newest first), then slug; the archive holds no stars","population":"every paper the archive tags with this task (distinct papers; spam titles not listed). 'of' counts the papers listed; until 2026-09-25 it counted only the papers with a code link, and that number is of_with_code","page":1,"pages_in_order":2,"rows_per_page":100,"shown":100,"of":119,"of_with_code":62,"tagged_in_all":119,"counts":{"archive_papers_tagged":119,"with_a_code_link":62,"where_syntology_ran_a_sample":17,"not_listed_spam_title":0,"listed":119,"listed_where_code_ran":17,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":16,"every_run_a_failure_of_syntologys_instrument":1,"listed_with_a_run_with_no_instrument_failure":16,"listed_every_run_a_failure_of_syntologys_instrument":1,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"items":[{"url":"/paper/clotho-an-audio-captioning-dataset","slug":"clotho-an-audio-captioning-dataset","title":"Clotho: An Audio Captioning Dataset","date":"2019-10-21","arxiv_id":"1910.09387","repositories_listed":7,"syntology":{"n":21,"n_ran":19,"n_constructed":0,"n_ran_checked":16,"n_instrument":3,"n_unverified":2,"n_honours":0,"n_violates":0,"n_no_contract":16,"n_pointer_only":5,"phrase":"19 ran (of which 0 constructed an object rather than computing a result; 16 with no instrument failure: 0 honoured, 0 violated, 16 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified","sample_list":"/paper/clotho-an-audio-captioning-dataset#ran","syntology_url":"https://syntology.ai/paper/1910.09387","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1910.09387"}},"official":null}},{"url":"/paper/wavcaps-a-chatgpt-assisted-weakly-labelled","slug":"wavcaps-a-chatgpt-assisted-weakly-labelled","title":"WavCaps: A ChatGPT-Assisted Weakly-Labelled Audio Captioning Dataset for Audio-Language Multimodal Research","date":"2023-03-30","arxiv_id":"2303.17395","repositories_listed":3,"syntology":{"n":12,"n_ran":9,"n_constructed":0,"n_ran_checked":9,"n_instrument":0,"n_unverified":3,"n_honours":0,"n_violates":0,"n_no_contract":9,"n_pointer_only":0,"phrase":"9 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified","sample_list":"/paper/wavcaps-a-chatgpt-assisted-weakly-labelled#ran","syntology_url":"https://syntology.ai/paper/2303.17395","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2303.17395"}},"official":{"repos":["xinhaomei/wavcaps"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/m2d2-exploring-general-purpose-audio-language","slug":"m2d2-exploring-general-purpose-audio-language","title":"M2D2: Exploring General-purpose Audio-Language Representations Beyond CLAP","date":"2025-03-28","arxiv_id":"2503.22104","repositories_listed":2,"syntology":null},{"url":"/paper/lavcap-llm-based-audio-visual-captioning","slug":"lavcap-llm-based-audio-visual-captioning","title":"LAVCap: LLM-based Audio-Visual Captioning using Optimal Transport","date":"2025-01-16","arxiv_id":"2501.09291","repositories_listed":2,"syntology":null},{"url":"/paper/understanding-sounds-missing-the-questions","slug":"understanding-sounds-missing-the-questions","title":"Understanding Sounds, Missing the Questions: The Challenge of Object Hallucination in Large Audio-Language Models","date":"2024-06-12","arxiv_id":"2406.08402","repositories_listed":2,"syntology":null},{"url":"/paper/qwen-audio-advancing-universal-audio","slug":"qwen-audio-advancing-universal-audio","title":"Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Models","date":"2023-11-14","arxiv_id":"2311.07919","repositories_listed":2,"syntology":{"n":7,"n_ran":5,"n_constructed":0,"n_ran_checked":3,"n_instrument":2,"n_unverified":2,"n_honours":3,"n_violates":0,"n_no_contract":0,"n_pointer_only":7,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 3 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified","sample_list":"/paper/qwen-audio-advancing-universal-audio#ran","syntology_url":"https://syntology.ai/paper/2311.07919","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2311.07919"}},"official":{"repos":["qwenlm/qwen-audio"],"state":"official (archive's flag): 5 ran","n_ran":5,"n_constructed":0,"n_ran_no_instrument_failure":3,"n_unverified":2,"ran_from_kinds":["official"]}}},{"url":"/paper/lauragpt-listen-attend-understand-and","slug":"lauragpt-listen-attend-understand-and","title":"LauraGPT: Listen, Attend, Understand, and Regenerate Audio with GPT","date":"2023-10-07","arxiv_id":"2310.04673","repositories_listed":2,"syntology":{"n":3,"n_ran":3,"n_constructed":0,"n_ran_checked":3,"n_instrument":0,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":3,"n_pointer_only":0,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/lauragpt-listen-attend-understand-and#ran","syntology_url":"https://syntology.ai/paper/2310.04673","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2310.04673"}},"official":null}},{"url":"/paper/vast-a-vision-audio-subtitle-text-omni-1","slug":"vast-a-vision-audio-subtitle-text-omni-1","title":"VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Dataset","date":"2023-05-29","arxiv_id":"2305.18500","repositories_listed":2,"syntology":{"n":42,"n_ran":35,"n_constructed":4,"n_ran_checked":25,"n_instrument":10,"n_unverified":7,"n_honours":4,"n_violates":1,"n_no_contract":20,"n_pointer_only":8,"phrase":"35 ran (of which 4 constructed an object rather than computing a result; 25 with no instrument failure: 4 honoured, 1 violated, 20 with no contract checked; 10 where Syntology's instrument failed) · 7 unverified","sample_list":"/paper/vast-a-vision-audio-subtitle-text-omni-1#ran","syntology_url":"https://syntology.ai/paper/2305.18500","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2305.18500"}},"official":{"repos":["txh-mercury/vast"],"state":"official (archive's flag): 12 ran","n_ran":12,"n_constructed":4,"n_ran_no_instrument_failure":9,"n_unverified":7,"ran_from_kinds":["listed","official"]}}},{"url":"/paper/cl4ac-a-contrastive-loss-for-audio-captioning","slug":"cl4ac-a-contrastive-loss-for-audio-captioning","title":"CL4AC: A Contrastive Loss for Audio Captioning","date":"2021-07-21","arxiv_id":"2107.09990","repositories_listed":2,"syntology":{"n":1,"n_ran":1,"n_constructed":0,"n_ran_checked":0,"n_instrument":1,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":1,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/cl4ac-a-contrastive-loss-for-audio-captioning#ran","syntology_url":"https://syntology.ai/paper/2107.09990","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2107.09990"}},"official":{"repos":["liuxubo717/cl4ac","liuxubo717/contrastive_loss_for_audio_captioning"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]}}},{"url":"/paper/video-salmonn-2-captioning-enhanced-audio","slug":"video-salmonn-2-captioning-enhanced-audio","title":"video-SALMONN 2: Captioning-Enhanced Audio-Visual Large Language Models","date":"2025-06-18","arxiv_id":"2506.15220","repositories_listed":1,"syntology":{"n":8,"n_ran":6,"n_constructed":0,"n_ran_checked":3,"n_instrument":3,"n_unverified":2,"n_honours":1,"n_violates":0,"n_no_contract":2,"n_pointer_only":1,"phrase":"6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified","sample_list":"/paper/video-salmonn-2-captioning-enhanced-audio#ran","syntology_url":"https://syntology.ai/paper/2506.15220","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2506.15220"}},"official":{"repos":["bytedance/video-salmonn-2"],"state":"official (archive's flag): 6 ran","n_ran":6,"n_constructed":0,"n_ran_no_instrument_failure":3,"n_unverified":2,"ran_from_kinds":["official"]}}},{"url":"/paper/fusionaudio-1-2m-towards-fine-grained-audio","slug":"fusionaudio-1-2m-towards-fine-grained-audio","title":"FusionAudio-1.2M: Towards Fine-grained Audio Captioning with Multimodal Contextual Fusion","date":"2025-06-01","arxiv_id":"2506.01111","repositories_listed":1,"syntology":null},{"url":"/paper/solla-towards-a-speech-oriented-llm-that","slug":"solla-towards-a-speech-oriented-llm-that","title":"Solla: Towards a Speech-Oriented LLM That Hears Acoustic Context","date":"2025-03-19","arxiv_id":"2503.15338","repositories_listed":1,"syntology":null},{"url":"/paper/mellow-a-small-audio-language-model-for","slug":"mellow-a-small-audio-language-model-for","title":"Mellow: a small audio language model for reasoning","date":"2025-03-11","arxiv_id":"2503.08540","repositories_listed":1,"syntology":{"n":6,"n_ran":3,"n_constructed":0,"n_ran_checked":1,"n_instrument":2,"n_unverified":3,"n_honours":1,"n_violates":0,"n_no_contract":0,"n_pointer_only":1,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified","sample_list":"/paper/mellow-a-small-audio-language-model-for#ran","syntology_url":"https://syntology.ai/paper/2503.08540","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2503.08540"}},"official":{"repos":["soham97/mellow"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":3,"ran_from_kinds":["official"]}}},{"url":"/paper/adiff-explaining-audio-difference-using","slug":"adiff-explaining-audio-difference-using","title":"ADIFF: Explaining audio difference using natural language","date":"2025-02-06","arxiv_id":"2502.04476","repositories_listed":1,"syntology":{"n":4,"n_ran":3,"n_constructed":0,"n_ran_checked":1,"n_instrument":2,"n_unverified":1,"n_honours":1,"n_violates":0,"n_no_contract":0,"n_pointer_only":1,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/adiff-explaining-audio-difference-using#ran","syntology_url":"https://syntology.ai/paper/2502.04476","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2502.04476"}},"official":{"repos":["soham97/adiff"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":1,"ran_from_kinds":["official"]}}},{"url":"/paper/llms-can-see-and-hear-without-any-training","slug":"llms-can-see-and-hear-without-any-training","title":"LLMs can see and hear without any training","date":"2025-01-30","arxiv_id":"2501.18096","repositories_listed":1,"syntology":null},{"url":"/paper/etta-elucidating-the-design-space-of-text-to","slug":"etta-elucidating-the-design-space-of-text-to","title":"ETTA: Elucidating the Design Space of Text-to-Audio Models","date":"2024-12-26","arxiv_id":"2412.19351","repositories_listed":1,"syntology":null},{"url":"/paper/audiosetcaps-an-enriched-audio-caption","slug":"audiosetcaps-an-enriched-audio-caption","title":"AudioSetCaps: An Enriched Audio-Caption Dataset using Automated Generation Pipeline with Large Audio and Language Models","date":"2024-11-28","arxiv_id":"2411.18953","repositories_listed":1,"syntology":{"n":4,"n_ran":4,"n_constructed":0,"n_ran_checked":1,"n_instrument":3,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":1,"n_pointer_only":4,"phrase":"4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/audiosetcaps-an-enriched-audio-caption#ran","syntology_url":"https://syntology.ai/paper/2411.18953","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2411.18953"}},"official":{"repos":["jishengbai/audiosetcaps"],"state":"official (archive's flag): 4 ran","n_ran":4,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}},{"url":"/paper/tell-what-you-hear-from-what-you-see-video-to","slug":"tell-what-you-hear-from-what-you-see-video-to","title":"Tell What You Hear From What You See -- Video to Audio Generation Through Text","date":"2024-11-08","arxiv_id":"2411.05679","repositories_listed":1,"syntology":{"n":6,"n_ran":6,"n_constructed":0,"n_ran_checked":5,"n_instrument":1,"n_unverified":0,"n_honours":0,"n_violates":2,"n_no_contract":3,"n_pointer_only":6,"phrase":"6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 2 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/tell-what-you-hear-from-what-you-see-video-to#ran","syntology_url":"https://syntology.ai/paper/2411.05679","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2411.05679"}},"official":{"repos":["DragonLiu1995/multimodal-llm-for-audio-gen"],"state":"official (archive's flag): 6 ran","n_ran":6,"n_constructed":0,"n_ran_no_instrument_failure":5,"n_unverified":0,"ran_from_kinds":["official"]}}},{"url":"/paper/drcap-decoding-clap-latents-with-retrieval","slug":"drcap-decoding-clap-latents-with-retrieval","title":"DRCap: Decoding CLAP Latents with Retrieval-Augmented Generation for Zero-shot Audio Captioning","date":"2024-10-12","arxiv_id":"2410.09472","repositories_listed":1,"syntology":null},{"url":"/paper/slam-aac-enhancing-audio-captioning-with","slug":"slam-aac-enhancing-audio-captioning-with","title":"SLAM-AAC: Enhancing Audio Captioning with Paraphrasing Augmentation and CLAP-Refine through LLMs","date":"2024-10-12","arxiv_id":"2410.09503","repositories_listed":1,"syntology":null},{"url":"/paper/an-eye-for-an-ear-zero-shot-audio-description","slug":"an-eye-for-an-ear-zero-shot-audio-description","title":"An Eye for an Ear: Zero-shot Audio Description Leveraging an Image Captioner using Audiovisual Distribution Alignment","date":"2024-10-08","arxiv_id":"2410.05997","repositories_listed":1,"syntology":null},{"url":"/paper/opensep-leveraging-large-language-models-with","slug":"opensep-leveraging-large-language-models-with","title":"OpenSep: Leveraging Large Language Models with Textual Inversion for Open World Audio Separation","date":"2024-09-28","arxiv_id":"2409.19270","repositories_listed":1,"syntology":null},{"url":"/paper/clair-a-leveraging-large-language-models-to","slug":"clair-a-leveraging-large-language-models-to","title":"CLAIR-A: Leveraging Large Language Models to Judge Audio Captions","date":"2024-09-19","arxiv_id":"2409.12962","repositories_listed":1,"syntology":null},{"url":"/paper/enclap-analyzing-the-enclap-framework-for","slug":"enclap-analyzing-the-enclap-framework-for","title":"EnCLAP++: Analyzing the EnCLAP Framework for Optimizing Automated Audio Captioning Performance","date":"2024-09-02","arxiv_id":"2409.01201","repositories_listed":1,"syntology":null},{"url":"/paper/taming-data-and-transformers-for-audio-1","slug":"taming-data-and-transformers-for-audio-1","title":"Taming Data and Transformers for Audio Generation","date":"2024-06-27","arxiv_id":"2406.19388","repositories_listed":1,"syntology":null},{"url":"/paper/enhancing-automated-audio-captioning-via","slug":"enhancing-automated-audio-captioning-via","title":"Enhancing Automated Audio Captioning via Large Language Models with Optimized Audio Encoding","date":"2024-06-19","arxiv_id":"2406.13275","repositories_listed":1,"syntology":{"n":8,"n_ran":5,"n_constructed":0,"n_ran_checked":1,"n_instrument":4,"n_unverified":3,"n_honours":0,"n_violates":1,"n_no_contract":0,"n_pointer_only":0,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 3 unverified","sample_list":"/paper/enhancing-automated-audio-captioning-via#ran","syntology_url":"https://syntology.ai/paper/2406.13275","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2406.13275"}},"official":{"repos":["frankenliu/LOAE"],"state":"official (archive's flag): 5 ran","n_ran":5,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":3,"ran_from_kinds":["official"]}}},{"url":"/paper/2406-15487","slug":"2406-15487","title":"Improving Text-To-Audio Models with Synthetic Captions","date":"2024-06-18","arxiv_id":"2406.15487","repositories_listed":1,"syntology":{"n":4,"n_ran":3,"n_constructed":0,"n_ran_checked":3,"n_instrument":0,"n_unverified":1,"n_honours":1,"n_violates":0,"n_no_contract":2,"n_pointer_only":4,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/2406-15487#ran","syntology_url":"https://syntology.ai/paper/2406.15487","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2406.15487"}},"official":null}},{"url":"/paper/audio-flamingo-a-novel-audio-language-model","slug":"audio-flamingo-a-novel-audio-language-model","title":"Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dialogue Abilities","date":"2024-02-02","arxiv_id":"2402.01831","repositories_listed":1,"syntology":{"n":3,"n_ran":3,"n_constructed":0,"n_ran_checked":3,"n_instrument":0,"n_unverified":0,"n_honours":0,"n_violates":3,"n_no_contract":0,"n_pointer_only":3,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 3 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/audio-flamingo-a-novel-audio-language-model#ran","syntology_url":"https://syntology.ai/paper/2402.01831","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2402.01831"}},"official":{"repos":["NVIDIA/audio-flamingo"],"state":"official: no sample here; runs from other or unrecorded repositories","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["unlocated"]}}},{"url":"/paper/enclap-combining-neural-audio-codec-and-audio","slug":"enclap-combining-neural-audio-codec-and-audio","title":"EnCLAP: Combining Neural Audio Codec and Audio-Text Joint Embedding for Automated Audio Captioning","date":"2024-01-31","arxiv_id":"2401.17690","repositories_listed":1,"syntology":null},{"url":"/paper/learning-audio-concepts-from-counterfactual","slug":"learning-audio-concepts-from-counterfactual","title":"Learning Audio Concepts from Counterfactual Natural Language","date":"2024-01-10","arxiv_id":"2401.04935","repositories_listed":1,"syntology":null},{"url":"/paper/audiolog-llms-powered-long-audio-logging-with","slug":"audiolog-llms-powered-long-audio-logging-with","title":"AudioLog: LLMs-Powered Long Audio Logging with Hybrid Token-Semantic Contrastive Learning","date":"2023-11-21","arxiv_id":"2311.12371","repositories_listed":1,"syntology":null},{"url":"/paper/zero-shot-audio-captioning-with-audio","slug":"zero-shot-audio-captioning-with-audio","title":"Zero-shot audio captioning with audio-language model guidance and audio context keywords","date":"2023-11-14","arxiv_id":"2311.08396","repositories_listed":1,"syntology":{"n":17,"n_ran":13,"n_constructed":0,"n_ran_checked":13,"n_instrument":0,"n_unverified":4,"n_honours":0,"n_violates":0,"n_no_contract":13,"n_pointer_only":17,"phrase":"13 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 0 honoured, 0 violated, 13 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified","sample_list":"/paper/zero-shot-audio-captioning-with-audio#ran","syntology_url":"https://syntology.ai/paper/2311.08396","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2311.08396"}},"official":{"repos":["explainableml/zeraucap"],"state":"official (archive's flag): 13 ran","n_ran":13,"n_constructed":0,"n_ran_no_instrument_failure":13,"n_unverified":4,"ran_from_kinds":["official"]}}},{"url":"/paper/salmonn-towards-generic-hearing-abilities-for","slug":"salmonn-towards-generic-hearing-abilities-for","title":"SALMONN: Towards Generic Hearing Abilities for Large Language Models","date":"2023-10-20","arxiv_id":"2310.13289","repositories_listed":1,"syntology":null},{"url":"/paper/weakly-supervised-automated-audio-captioning","slug":"weakly-supervised-automated-audio-captioning","title":"Weakly-supervised Automated Audio Captioning via text only training","date":"2023-09-21","arxiv_id":"2309.12242","repositories_listed":1,"syntology":null},{"url":"/paper/recap-retrieval-augmented-audio-captioning","slug":"recap-retrieval-augmented-audio-captioning","title":"RECAP: Retrieval-Augmented Audio Captioning","date":"2023-09-18","arxiv_id":"2309.09836","repositories_listed":1,"syntology":{"n":8,"n_ran":5,"n_constructed":0,"n_ran_checked":5,"n_instrument":0,"n_unverified":3,"n_honours":0,"n_violates":0,"n_no_contract":5,"n_pointer_only":8,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified","sample_list":"/paper/recap-retrieval-augmented-audio-captioning#ran","syntology_url":"https://syntology.ai/paper/2309.09836","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2309.09836"}},"official":{"repos":["sreyan88/recap"],"state":"official (archive's flag): 5 ran","n_ran":5,"n_constructed":0,"n_ran_no_instrument_failure":5,"n_unverified":3,"ran_from_kinds":["official"]}}},{"url":"/paper/training-audio-captioning-models-without","slug":"training-audio-captioning-models-without","title":"Training Audio Captioning Models without Audio","date":"2023-09-14","arxiv_id":"2309.07372","repositories_listed":1,"syntology":null},{"url":"/paper/audio-difference-captioning-utilizing","slug":"audio-difference-captioning-utilizing","title":"Audio Difference Captioning Utilizing Similarity-Discrepancy Disentanglement","date":"2023-08-23","arxiv_id":"2308.11923","repositories_listed":1,"syntology":null},{"url":"/paper/crowdsourcing-and-evaluating-text-based-audio","slug":"crowdsourcing-and-evaluating-text-based-audio","title":"Crowdsourcing and Evaluating Text-Based Audio Retrieval Relevances","date":"2023-06-16","arxiv_id":"2306.09820","repositories_listed":1,"syntology":null},{"url":"/paper/pengi-an-audio-language-model-for-audio-tasks-1","slug":"pengi-an-audio-language-model-for-audio-tasks-1","title":"Pengi: An Audio Language Model for Audio Tasks","date":"2023-05-19","arxiv_id":"2305.11834","repositories_listed":1,"syntology":{"n":4,"n_ran":3,"n_constructed":0,"n_ran_checked":1,"n_instrument":2,"n_unverified":1,"n_honours":1,"n_violates":0,"n_no_contract":0,"n_pointer_only":1,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified","sample_list":"/paper/pengi-an-audio-language-model-for-audio-tasks-1#ran","syntology_url":"https://syntology.ai/paper/2305.11834","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2305.11834"}},"official":{"repos":["microsoft/pengi"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":1,"ran_from_kinds":["official"]}}},{"url":"/paper/a-whisper-transformer-for-audio-captioning","slug":"a-whisper-transformer-for-audio-captioning","title":"A Whisper transformer for audio captioning trained with synthetic captions and transfer learning","date":"2023-05-15","arxiv_id":"2305.09690","repositories_listed":1,"syntology":null},{"url":"/paper/valor-vision-audio-language-omni-perception","slug":"valor-vision-audio-language-omni-perception","title":"VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset","date":"2023-04-17","arxiv_id":"2304.08345","repositories_listed":1,"syntology":null},{"url":"/paper/prefix-tuning-for-automated-audio-captioning","slug":"prefix-tuning-for-automated-audio-captioning","title":"Prefix tuning for automated audio captioning","date":"2023-03-30","arxiv_id":"2303.17489","repositories_listed":1,"syntology":null},{"url":"/paper/is-my-automatic-audio-captioning-system-so","slug":"is-my-automatic-audio-captioning-system-so","title":"Is my automatic audio captioning system so bad? spider-max: a metric to consider several caption candidates","date":"2022-11-14","arxiv_id":"2211.08983","repositories_listed":1,"syntology":null},{"url":"/paper/visually-aware-audio-captioning-with-adaptive","slug":"visually-aware-audio-captioning-with-adaptive","title":"Visually-Aware Audio Captioning With Adaptive Audio-Visual Attention","date":"2022-10-28","arxiv_id":"2210.16428","repositories_listed":1,"syntology":null},{"url":"/paper/audio-retrieval-with-wavtext5k-and-clap","slug":"audio-retrieval-with-wavtext5k-and-clap","title":"Audio Retrieval with WavText5K and CLAP Training","date":"2022-09-28","arxiv_id":"2209.14275","repositories_listed":1,"syntology":null},{"url":"/paper/automated-audio-captioning-and-language-based","slug":"automated-audio-captioning-and-language-based","title":"Automated Audio Captioning and Language-Based Audio Retrieval","date":"2022-07-08","arxiv_id":"2207.04156","repositories_listed":1,"syntology":null},{"url":"/paper/dcase-2022-challenge-task-6b-language-based","slug":"dcase-2022-challenge-task-6b-language-based","title":"Language-based Audio Retrieval Task in DCASE 2022 Challenge","date":"2022-06-13","arxiv_id":"2206.06108","repositories_listed":1,"syntology":null},{"url":"/paper/multimodal-knowledge-alignment-with","slug":"multimodal-knowledge-alignment-with","title":"Multimodal Knowledge Alignment with Reinforcement Learning","date":"2022-05-25","arxiv_id":"2205.12630","repositories_listed":1,"syntology":null},{"url":"/paper/caption-feature-space-regularization-for","slug":"caption-feature-space-regularization-for","title":"Caption Feature Space Regularization for Audio Captioning","date":"2022-04-18","arxiv_id":"2204.08409","repositories_listed":1,"syntology":null},{"url":"/paper/local-information-assisted-attention-free","slug":"local-information-assisted-attention-free","title":"Local Information Assisted Attention-free Decoder for Audio Captioning","date":"2022-01-10","arxiv_id":"2201.03217","repositories_listed":1,"syntology":null},{"url":"/paper/audio-retrieval-with-natural-language-queries-1","slug":"audio-retrieval-with-natural-language-queries-1","title":"Audio Retrieval with Natural Language Queries: A Benchmark Study","date":"2021-12-17","arxiv_id":"2112.09418","repositories_listed":1,"syntology":null},{"url":"/paper/automated-audio-captioning-by-fine-tuning","slug":"automated-audio-captioning-by-fine-tuning","title":"AUTOMATED AUDIO CAPTIONING BY FINE-TUNING BART WITH AUDIOSET TAGS","date":"2021-11-15","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/can-audio-captions-be-evaluated-with-image","slug":"can-audio-captions-be-evaluated-with-image","title":"Can Audio Captions Be Evaluated with Image Caption Metrics?","date":"2021-10-10","arxiv_id":"2110.04684","repositories_listed":1,"syntology":{"n":1,"n_ran":0,"n_constructed":0,"n_ran_checked":0,"n_instrument":0,"n_unverified":1,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":1,"phrase":"0 ran · 1 unverified","sample_list":"/paper/can-audio-captions-be-evaluated-with-image#ran","syntology_url":"https://syntology.ai/paper/2110.04684","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2110.04684"}},"official":{"repos":["blmoistawinde/fense"],"state":"official: harvested, nothing ran","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":1,"ran_from_kinds":[]}}},{"url":"/paper/an-encoder-decoder-based-audio-captioning","slug":"an-encoder-decoder-based-audio-captioning","title":"An Encoder-Decoder Based Audio Captioning System With Transfer and Reinforcement Learning","date":"2021-08-05","arxiv_id":"2108.02752","repositories_listed":1,"syntology":null},{"url":"/paper/audio-captioning-transformer","slug":"audio-captioning-transformer","title":"Audio Captioning Transformer","date":"2021-07-21","arxiv_id":"2107.09817","repositories_listed":1,"syntology":null},{"url":"/paper/continual-learning-for-automated-audio","slug":"continual-learning-for-automated-audio","title":"Continual Learning for Automated Audio Captioning Using The Learning Without Forgetting Approach","date":"2021-07-16","arxiv_id":"2107.08028","repositories_listed":1,"syntology":null},{"url":"/paper/the-sjtu-system-for-dcase2021-challenge-task","slug":"the-sjtu-system-for-dcase2021-challenge-task","title":"THE SJTU SYSTEM FOR DCASE2021 CHALLENGE TASK 6: AUDIO CAPTIONING BASED ON ENCODER PRE-TRAINING AND REINFORCEMENT LEARNING","date":"2021-07-06","arxiv_id":null,"repositories_listed":1,"syntology":null},{"url":"/paper/muscaps-generating-captions-for-music-audio","slug":"muscaps-generating-captions-for-music-audio","title":"MusCaps: Generating Captions for Music Audio","date":"2021-04-24","arxiv_id":"2104.11984","repositories_listed":1,"syntology":null},{"url":"/paper/wavetransformer-a-novel-architecture-for","slug":"wavetransformer-a-novel-architecture-for","title":"WaveTransformer: A Novel Architecture for Audio Captioning Based on Learning Temporal and Time-Frequency Information","date":"2020-10-21","arxiv_id":"2010.11098","repositories_listed":1,"syntology":null},{"url":"/paper/multi-task-regularization-based-on-infrequent","slug":"multi-task-regularization-based-on-infrequent","title":"Multi-task Regularization Based on Infrequent Classes for Audio Captioning","date":"2020-07-09","arxiv_id":"2007.04660","repositories_listed":1,"syntology":null},{"url":"/paper/temporal-sub-sampling-of-audio-feature","slug":"temporal-sub-sampling-of-audio-feature","title":"Temporal Sub-sampling of Audio Feature Sequences for Automated Audio Captioning","date":"2020-07-06","arxiv_id":"2007.02676","repositories_listed":1,"syntology":null},{"url":"/paper/what-does-a-car-ssette-tape-tell","slug":"what-does-a-car-ssette-tape-tell","title":"Audio Caption in a Car Setting with a Sentence-Level Loss","date":"2019-05-31","arxiv_id":"1905.13448","repositories_listed":1,"syntology":null},{"url":null,"slug":"2506-10312","title":"AC/DC: LLM-based Audio Comprehension via Dialogue Continuation","date":"2025-06-12","arxiv_id":"2506.10312","repositories_listed":0,"syntology":null},{"url":null,"slug":"clap-art-automated-audio-captioning-with","title":"CLAP-ART: Automated Audio Captioning with Semantic-rich Audio Representation Tokenizer","date":"2025-06-01","arxiv_id":"2506.00800","repositories_listed":0,"syntology":null},{"url":null,"slug":"mitigating-audiovisual-mismatch-in-visual","title":"Mitigating Audiovisual Mismatch in Visual-Guide Audio Captioning","date":"2025-05-28","arxiv_id":"2505.22045","repositories_listed":0,"syntology":null},{"url":null,"slug":"tacos-temporally-aligned-audio-captions-for","title":"TACOS: Temporally-aligned Audio CaptiOnS for Language-Audio Pretraining","date":"2025-05-12","arxiv_id":"2505.07609","repositories_listed":0,"syntology":null},{"url":null,"slug":"audio-flamingo-2-an-audio-language-model-with","title":"Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilities","date":"2025-03-06","arxiv_id":"2503.03983","repositories_listed":0,"syntology":null},{"url":null,"slug":"enhancing-speech-large-language-models-with","title":"Enhancing Speech Large Language Models with Prompt-Aware Mixture of Audio Encoders","date":"2025-02-21","arxiv_id":"2502.15178","repositories_listed":0,"syntology":null},{"url":null,"slug":"unbiased-sliced-wasserstein-kernels-for-high","title":"Unbiased Sliced Wasserstein Kernels for High-Quality Audio Captioning","date":"2025-02-08","arxiv_id":"2502.05435","repositories_listed":0,"syntology":null},{"url":null,"slug":"cosyaudio-improving-audio-generation-with","title":"CosyAudio: Improving Audio Generation with Confidence Scores and Synthetic Captions","date":"2025-01-28","arxiv_id":"2501.16761","repositories_listed":0,"syntology":null},{"url":null,"slug":"audio-cot-exploring-chain-of-thought","title":"Audio-CoT: Exploring Chain-of-Thought Reasoning in Large Audio Language Model","date":"2025-01-13","arxiv_id":"2501.07246","repositories_listed":0,"syntology":null},{"url":null,"slug":"classifier-guided-captioning-across","title":"Classifier-Guided Captioning Across Modalities","date":"2025-01-03","arxiv_id":"2501.03183","repositories_listed":0,"syntology":null},{"url":null,"slug":"emotioncaps-enhancing-audio-captioning","title":"EmotionCaps: Enhancing Audio Captioning Through Emotion-Augmented Data Generation","date":"2024-10-15","arxiv_id":"2410.12028","repositories_listed":0,"syntology":null},{"url":"/paper/audio-captioning-via-generative-pair-to-pair","slug":"audio-captioning-via-generative-pair-to-pair","title":"Enhancing Retrieval-Augmented Audio Captioning with Generation-Assisted Multimodal Querying and Progressive Learning","date":"2024-10-14","arxiv_id":"2410.10913","repositories_listed":0,"syntology":null},{"url":null,"slug":"enhancing-multimodal-llm-for-detailed-and","title":"Enhancing Multimodal LLM for Detailed and Accurate Video Captioning using Multi-Round Preference Optimization","date":"2024-10-09","arxiv_id":"2410.06682","repositories_listed":0,"syntology":null},{"url":null,"slug":"enhancing-low-resource-language-and","title":"Enhancing Low-Resource Language and Instruction Following Capabilities of Audio Language Models","date":"2024-09-17","arxiv_id":"2409.10999","repositories_listed":0,"syntology":null},{"url":null,"slug":"towards-diverse-and-efficient-audio","title":"Towards Diverse and Efficient Audio Captioning via Diffusion Models","date":"2024-09-14","arxiv_id":"2409.09401","repositories_listed":0,"syntology":null},{"url":null,"slug":"enhancing-temporal-understanding-in-audio","title":"Enhancing Temporal Understanding in Audio Question Answering for Large Audio Language Models","date":"2024-09-10","arxiv_id":"2409.06223","repositories_listed":0,"syntology":null},{"url":null,"slug":"expanding-on-enclap-with-auxiliary-retrieval","title":"Expanding on EnCLAP with Auxiliary Retrieval Model for Automated Audio Captioning","date":"2024-09-02","arxiv_id":"2409.01160","repositories_listed":0,"syntology":null},{"url":null,"slug":"audio-dialogues-dialogues-dataset-for-audio","title":"Audio Dialogues: Dialogues dataset for audio and music understanding","date":"2024-04-11","arxiv_id":"2404.07616","repositories_listed":0,"syntology":null},{"url":null,"slug":"improved-baselines-for-data-efficient","title":"Improved Baselines for Data-efficient Perceptual Augmentation of LLMs","date":"2024-03-20","arxiv_id":"2403.13499","repositories_listed":0,"syntology":null},{"url":null,"slug":"a-large-scale-dataset-for-audio-language","title":"Auto-ACD: A Large-scale Dataset for Audio-Language Representation Learning","date":"2023-09-20","arxiv_id":"2309.11500","repositories_listed":0,"syntology":null},{"url":null,"slug":"audio-difference-learning-for-audio","title":"Audio Difference Learning for Audio Captioning","date":"2023-09-15","arxiv_id":"2309.08141","repositories_listed":0,"syntology":null},{"url":null,"slug":"parameter-efficient-audio-captioning-with","title":"Parameter Efficient Audio Captioning With Faithful Guidance Using Audio-text Shared Latent Representation","date":"2023-09-06","arxiv_id":"2309.03340","repositories_listed":0,"syntology":null},{"url":null,"slug":"generating-realistic-images-from-in-the-wild","title":"Generating Realistic Images from In-the-wild Sounds","date":"2023-09-05","arxiv_id":"2309.02405","repositories_listed":0,"syntology":null},{"url":null,"slug":"killing-two-birds-with-one-stone-can-an-audio","title":"Killing two birds with one stone: Can an audio captioning system also be used for audio-text retrieval?","date":"2023-08-29","arxiv_id":"2308.15090","repositories_listed":0,"syntology":null},{"url":"/paper/rethinking-transfer-and-auxiliary-learning","slug":"rethinking-transfer-and-auxiliary-learning","title":"Rethinking Transfer and Auxiliary Learning for Improving Audio Captioning Transformer","date":"2023-08-20","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"improving-audio-caption-fluency-with","title":"Improving Audio Caption Fluency with Automatic Error Correction","date":"2023-06-16","arxiv_id":"2306.10090","repositories_listed":0,"syntology":null},{"url":null,"slug":"dual-transformer-decoder-based-features","title":"Dual Transformer Decoder based Features Fusion Network for Automated Audio Captioning","date":"2023-05-30","arxiv_id":"2305.18753","repositories_listed":0,"syntology":null},{"url":null,"slug":"efficient-audio-captioning-transformer-with","title":"Efficient Audio Captioning Transformer with Patchout and Text Guidance","date":"2023-04-06","arxiv_id":"2304.02916","repositories_listed":0,"syntology":null},{"url":null,"slug":"towards-generating-diverse-audio-captions-via","title":"Towards Generating Diverse Audio Captions via Adversarial Training","date":"2022-12-05","arxiv_id":"2212.02033","repositories_listed":0,"syntology":null},{"url":null,"slug":"impact-of-visual-assistance-for-automated","title":"Impact of visual assistance for automated audio captioning","date":"2022-11-18","arxiv_id":"2211.10539","repositories_listed":0,"syntology":null},{"url":"/paper/diversity-and-bias-in-audio-captioning","slug":"diversity-and-bias-in-audio-captioning","title":"Diversity and bias in audio captioning datasets","date":"2022-11-15","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"investigations-in-audio-captioning-addressing","title":"Investigations in Audio Captioning: Addressing Vocabulary Imbalance and Evaluating Suitability of Language-Centric Performance Metrics","date":"2022-11-12","arxiv_id":"2211.06547","repositories_listed":0,"syntology":null},{"url":"/paper/improving-audio-language-learning-with-mixgen","slug":"improving-audio-language-learning-with-mixgen","title":"Exploring Train and Test-Time Augmentations for Audio-Language Learning","date":"2022-10-31","arxiv_id":"2210.17143","repositories_listed":0,"syntology":null},{"url":null,"slug":"automated-audio-captioning-via-fusion-of-low","title":"Automated Audio Captioning via Fusion of Low- and High- Dimensional Features","date":"2022-10-10","arxiv_id":"2210.05037","repositories_listed":0,"syntology":null},{"url":null,"slug":"text-to-audio-grounding-based-novel-metric","title":"Text-to-Audio Grounding Based Novel Metric for Evaluating Audio Caption Similarity","date":"2022-10-03","arxiv_id":"2210.06354","repositories_listed":0,"syntology":null},{"url":null,"slug":"language-based-audio-retrieval-task-in-dcase","title":"Language-based Audio Retrieval Task in DCASE 2022 Challenge","date":"2022-09-20","arxiv_id":"2209.09967","repositories_listed":0,"syntology":null},{"url":null,"slug":"an-investigation-on-selecting-audio-pre","title":"An investigation on selecting audio pre-trained models for audio captioning","date":"2022-08-12","arxiv_id":"2208.06127","repositories_listed":0,"syntology":null},{"url":null,"slug":"automated-audio-captioning-with-epochal","title":"Automated Audio Captioning with Epochal Difficult Captions for Curriculum Learning","date":"2022-06-04","arxiv_id":"2206.01918","repositories_listed":0,"syntology":null}],"syntology_records":18,"syntology_note":"a paper without a record is not a recorded non-run: it may lack an arXiv id or simply be absent from the graph layer"},"key_notes":{"n_ran_checked":"legacy name, kept unchanged so existing readers do not break: it counts the samples that ran with no instrument failure (honoured, violated, and ran with no contract checked); it does not mean a contract was checked, and the pages print it as 'K with no instrument failure', not 'K checked'","n_constructed":"a sub-count of the samples that ran, never subtracted from them and never a failure: an executed sample whose run returned an instance of its own class (fixture_out_type equals the entry name): the run built an object and did not compute a result (Syntology's RAN record, counts.constructed)"},"since_archive_judged":{"papers":1,"papers_placed":0,"judged_by":{"model":"Claude Sonnet 4.5","models_as_recorded":["global.anthropic.claude-sonnet-4-5-20250929-v1:0"],"from":"lb_rows_run_verified.jsonl: each record's `model` field (the extractor's call that wrote decisions[])"},"note":"a model's judgement from the paper's own tables that they report on this leaderboard, not a result: no value from a paper that was not placed is printed or carried here; papers counts each paper once over these leaderboards","backfill":"8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read)","backfill_complete":false,"leaderboards":[{"leaderboard":"/sota/audio-captioning-on-audiocaps","since_archive":"/sota/audio-captioning-on-audiocaps#since-judged","papers_judged":1,"placed":0},{"leaderboard":"/sota/audio-captioning-on-clotho","since_archive":"/sota/audio-captioning-on-clotho#since-judged","papers_judged":1,"placed":0}]},"papers_where_code_ran":17,"papers_where_code_ran_first_page":"/task/audio-captioning/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not run it on this task or check it against the task's benchmarks.","pages":[{"order":"archive","page":2,"of":2,"url":"/task/audio-captioning/papers/2","json":"/task/audio-captioning/papers/2.json","rows":19},{"order":"ran","page":1,"of":1,"url":"/task/audio-captioning/papers/ran/1","json":"/task/audio-captioning/papers/ran/1.json","rows":17}],"description_links":{"kept":0,"unwrapped_to_text":0,"bare_urls_linked":0,"relative_images_dropped":0,"rule":"internal links are kept only when the target slug exists in the catalog"},"syntology":{"read_at":"2026-10-05T00:36:11+00:00","claim":"Per-sample execution status on synthesized fixtures ('ran N of M samples'); not a correctness claim and not a ranking signal.","status_vocabulary":{"ran_honours":"ran, honoured the contract we drafted","ran_violates":"ran, violated the contract we drafted","ran_draft_wrong":"ran; our contract draft was wrong, not the code","ran_fixture":"ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT)","ran":"ran on a synthesized input","unverified":"unverified (harvested, no recorded run)"},"row_route":"each syntology object on a benchmark's first row and on a paper carries sample_list (this site's paper page, #ran), syntology_url (syntology.ai's page for the paper, only when that route probed live) and mcp (the agent call that lists the paper's harvested samples; not a verdict on the paper)","developers":"https://syntology.ai/developers"},"not_shown":{"libraries":"the archive has no per-task library table","trend_sparklines":"the Trend column of the benchmarks table was a rendered image; it is not in the archive","social_and_latest_sorts":"stars and social signals are not in the archive"},"record_sha256":"7801083f5bec688a00972e0088deb254623500f8a0827417f84fa8d28f0c6451","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}