{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/dataset/esc-50","name":"ESC-50","full_name":"ESC-50","description_markdown":"The **ESC-50** dataset is a labeled collection of 2000 environmental audio recordings suitable for benchmarking methods of environmental sound classification. It comprises 2000 5s-clips of 50 different classes across natural, human and domestic sounds, again, drawn from Freesound.org.\r\n\r\nSource: [The NIGENS General Sound Events Database](https://arxiv.org/abs/1902.08314)\r\nImage Source: [https://github.com/karolpiczak/ESC-50](https://github.com/karolpiczak/ESC-50)","description_withheld":null,"homepage":"https://github.com/karolpiczak/ESC-50","introduced_date":"2015-01-01","introduced_date_note":null,"introduced_by":{"paper":null,"title":"ESC: Dataset for Environmental Sound Classification","first_author":null,"url":"https://doi.org/10.1145/2733373.2806390"},"license":{"name":"CC BY-NC 3.0","url":"https://creativecommons.org/licenses/by-nc/3.0/"},"modalities":[{"name":"Audio","url":"/datasets/modality/audio"}],"tasks":[{"name":"Image Classification","url":"/task/image-classification","datasets_with_task":"/datasets/task/image-classification"},{"name":"Audio Classification","url":"/task/audio-classification","datasets_with_task":"/datasets/task/audio-classification"},{"name":"Few-Shot Audio Classification","url":"/task/few-shot-audio-classification","datasets_with_task":"/datasets/task/few-shot-audio-classification"},{"name":"Data Augmentation","url":"/task/data-augmentation","datasets_with_task":"/datasets/task/data-augmentation"},{"name":"Zero-shot Audio Classification","url":"/task/zero-shot-audio-classification","datasets_with_task":"/datasets/task/zero-shot-audio-classification"},{"name":"Environmental Sound Classification","url":"/task/environmental-sound-classification","datasets_with_task":"/datasets/task/environmental-sound-classification"},{"name":"Self-Supervised Audio Classification","url":"/task/self-supervised-audio-classification","datasets_with_task":"/datasets/task/self-supervised-audio-classification"},{"name":"Environment Sound Classification","url":"/task/environment-sound-classification","datasets_with_task":"/datasets/task/environment-sound-classification"},{"name":"Zero-Shot Environment Sound Classification","url":"/task/zero-shot-environment-sound-classification","datasets_with_task":"/datasets/task/zero-shot-environment-sound-classification"}],"languages":[],"variants":["ESC-50"],"data_loaders":[{"repo":"https://github.com/activeloopai/Hub","url":"https://docs.activeloop.ai/datasets/esc-50-dataset","frameworks":["tf","pytorch"]},{"repo":"https://github.com/karolpiczak/ESC-50","url":"https://github.com/karolpiczak/ESC-50","frameworks":[]}],"num_papers_in_archive":387,"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28"},"benchmarks":[{"leaderboard":"/sota/audio-classification-on-esc-50","task":"Audio Classification","dataset_variant":"ESC-50","rows":29,"metrics":["Top-1 Accuracy","PRE-TRAINING DATASET","Accuracy (5-fold)"],"first_row_in_archive_order":{"model":"OmniVec2","paper":"/paper/omnivec2-a-novel-transformer-based-network","metrics":{"Accuracy (5-fold)":"99.1","PRE-TRAINING DATASET":"Multiple","Top-1 Accuracy":"99.1"},"code_links":[]},"note":"rows are the archive's own order at snapshot; nothing here re-ranks them"},{"leaderboard":"/sota/few-shot-audio-classification-on-esc-50","task":"Few-Shot Audio Classification","dataset_variant":"ESC-50","rows":10,"metrics":["Top-1 Accuracy(5-Way-1-Shot)"],"first_row_in_archive_order":{"model":"Meta-Curvature (CRNN)","paper":"/paper/metaaudio-a-few-shot-audio-classification","metrics":{"Top-1 Accuracy(5-Way-1-Shot)":"76.17 +- 0.41"},"code_links":[{"title":"cheggan/metaaudio-a-few-shot-audio-classification-benchmark","url":"https://github.com/cheggan/metaaudio-a-few-shot-audio-classification-benchmark"}]},"note":"rows are the archive's own order at snapshot; nothing here re-ranks them"},{"leaderboard":"/sota/environmental-sound-classification-on-esc-50","task":"Environmental Sound Classification","dataset_variant":"ESC-50","rows":1,"metrics":["Accuracy"],"first_row_in_archive_order":{"model":"AudioCLIP","paper":"/paper/audioclip-extending-clip-to-image-text-and","metrics":{"Accuracy":"97.15"},"code_links":[{"title":"iver56/audiomentations","url":"https://github.com/iver56/audiomentations"},{"title":"asteroid-team/torch-audiomentations","url":"https://github.com/asteroid-team/torch-audiomentations"},{"title":"AndreyGuzhov/AudioCLIP","url":"https://github.com/AndreyGuzhov/AudioCLIP"},{"title":"julirao/whisper_audio_classification","url":"https://github.com/julirao/whisper_audio_classification"}]},"note":"rows are the archive's own order at snapshot; nothing here re-ranks them"},{"leaderboard":"/sota/image-classification-on-esc-50","task":"Image Classification","dataset_variant":"ESC-50","rows":1,"metrics":["Top 1 Accuracy"],"first_row_in_archive_order":{"model":"SDGM-D","paper":"/paper/performance-of-gaussian-mixture-model","metrics":{"Top 1 Accuracy":"87"},"code_links":[{"title":"cvmlmu/dgmmc","url":"https://github.com/cvmlmu/dgmmc"}]},"note":"rows are the archive's own order at snapshot; nothing here re-ranks them"}],"papers":{"order":"date (newest first), then slug","population":"every paper with a leaderboard row on this dataset's benchmarks (the benchmark-backed subset): the archive's own papers-using-this-dataset list was never published, so this is not that list; num_papers_in_archive is the archive's own count","page":1,"pages_in_order":1,"rows_per_page":100,"shown":27,"of":27,"counts":{"papers_with_a_benchmark_row":27,"with_a_code_link":22,"where_syntology_ran_a_sample":8,"not_listed_spam_title":0,"listed":27,"listed_where_code_ran":8,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":7,"every_run_a_failure_of_syntologys_instrument":1,"listed_with_a_run_with_no_instrument_failure":7,"listed_every_run_a_failure_of_syntologys_instrument":1,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers with at least one leaderboard row on this dataset's benchmarks; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"items":[{"paper":"/paper/m2d2-exploring-general-purpose-audio-language","slug":"m2d2-exploring-general-purpose-audio-language","title":"M2D2: Exploring General-purpose Audio-Language Representations Beyond CLAP","date":"2025-03-28","arxiv_id":"2503.22104","rows_on_this_dataset":1,"code_links":2,"syntology":null},{"paper":"/paper/masked-latent-prediction-and-classification","slug":"masked-latent-prediction-and-classification","title":"Masked Latent Prediction and Classification for Self-Supervised Audio Representation Learning","date":"2025-02-17","arxiv_id":"2502.12031","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/lhgnn-local-higher-order-graph-neural","slug":"lhgnn-local-higher-order-graph-neural","title":"LHGNN: Local-Higher Order Graph Neural Networks For Audio Classification and Tagging","date":"2025-01-07","arxiv_id":"2501.03464","rows_on_this_dataset":1,"code_links":0,"syntology":null},{"paper":"/paper/performance-of-gaussian-mixture-model","slug":"performance-of-gaussian-mixture-model","title":"Performance of Gaussian Mixture Model Classifiers on Embedded Feature Spaces","date":"2024-10-17","arxiv_id":"2410.13421","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/m2d-clap-masked-modeling-duo-meets-clap-for","slug":"m2d-clap-masked-modeling-duo-meets-clap-for","title":"M2D-CLAP: Masked Modeling Duo Meets CLAP for Learning General-purpose Audio-Language Representation","date":"2024-06-04","arxiv_id":"2406.02032","rows_on_this_dataset":1,"code_links":2,"syntology":null},{"paper":"/paper/masked-modeling-duo-towards-a-universal-audio","slug":"masked-modeling-duo-towards-a-universal-audio","title":"Masked Modeling Duo: Towards a Universal Audio Pre-training Framework","date":"2024-04-09","arxiv_id":"2404.06095","rows_on_this_dataset":2,"code_links":2,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":7,"samples_ran":7,"samples_constructed":0,"samples_ran_checked":4,"samples_ran_instrument_failed":3,"samples_unverified":0,"pointer_only_for_licence":7,"official":{"repos":["nttcslab/m2d","nttcslab/eval-audio-repr"],"state":"official (archive's flag): 7 ran","n_ran":7,"n_constructed":0,"n_ran_no_instrument_failure":4,"n_unverified":0,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/masked-modeling-duo-towards-a-universal-audio#ran","syntology_url":"https://syntology.ai/paper/2404.06095","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2404.06095"}}}},{"paper":"/paper/internvideo2-scaling-video-foundation-models","slug":"internvideo2-scaling-video-foundation-models","title":"InternVideo2: Scaling Foundation Models for Multimodal Video Understanding","date":"2024-03-22","arxiv_id":"2403.15377","rows_on_this_dataset":1,"code_links":2,"syntology":null},{"paper":"/paper/eat-self-supervised-pre-training-with","slug":"eat-self-supervised-pre-training-with","title":"EAT: Self-Supervised Pre-Training with Efficient Audio Transformer","date":"2024-01-07","arxiv_id":"2401.03497","rows_on_this_dataset":1,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":17,"samples_ran":13,"samples_constructed":0,"samples_ran_checked":10,"samples_ran_instrument_failed":3,"samples_unverified":4,"pointer_only_for_licence":3,"official":{"repos":["cwx-worst-one/eat"],"state":"official (archive's flag): 13 ran","n_ran":13,"n_constructed":0,"n_ran_no_instrument_failure":10,"n_unverified":4,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/eat-self-supervised-pre-training-with#ran","syntology_url":"https://syntology.ai/paper/2401.03497","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2401.03497"}}}},{"paper":"/paper/omnivec2-a-novel-transformer-based-network","slug":"omnivec2-a-novel-transformer-based-network","title":"OmniVec2 - A Novel Transformer based Network for Large Scale Multimodal and Multitask Learning","date":"2024-01-01","arxiv_id":null,"rows_on_this_dataset":1,"code_links":0,"syntology":null},{"paper":"/paper/omnivec-learning-robust-representations-with","slug":"omnivec-learning-robust-representations-with","title":"OmniVec: Learning robust representations with cross modal sharing","date":"2023-11-07","arxiv_id":"2311.05709","rows_on_this_dataset":1,"code_links":0,"syntology":null},{"paper":"/paper/dynamic-convolutional-neural-networks-as","slug":"dynamic-convolutional-neural-networks-as","title":"Dynamic Convolutional Neural Networks as Efficient Pre-trained Audio Models","date":"2023-10-24","arxiv_id":"2310.15648","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/mt-slvr-multi-task-self-supervised-learning","slug":"mt-slvr-multi-task-self-supervised-learning","title":"MT-SLVR: Multi-Task Self-Supervised Learning for Transformation In(Variant) Representations","date":"2023-05-29","arxiv_id":"2305.17191","rows_on_this_dataset":3,"code_links":1,"syntology":null},{"paper":"/paper/beats-audio-pre-training-with-acoustic","slug":"beats-audio-pre-training-with-acoustic","title":"BEATs: Audio Pre-Training with Acoustic Tokenizers","date":"2022-12-18","arxiv_id":"2212.09058","rows_on_this_dataset":1,"code_links":4,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":18,"samples_ran":16,"samples_constructed":0,"samples_ran_checked":12,"samples_ran_instrument_failed":4,"samples_unverified":2,"pointer_only_for_licence":4,"official":{"repos":["microsoft/unilm"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/beats-audio-pre-training-with-acoustic#ran","syntology_url":"https://syntology.ai/paper/2212.09058","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2212.09058"}}}},{"paper":"/paper/efficient-large-scale-audio-tagging-via","slug":"efficient-large-scale-audio-tagging-via","title":"Efficient Large-scale Audio Tagging via Transformer-to-CNN Knowledge Distillation","date":"2022-11-09","arxiv_id":"2211.04772","rows_on_this_dataset":1,"code_links":2,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":2,"samples_ran":2,"samples_constructed":0,"samples_ran_checked":1,"samples_ran_instrument_failed":1,"samples_unverified":0,"pointer_only_for_licence":1,"official":{"repos":["fschmid56/efficientat"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/efficient-large-scale-audio-tagging-via#ran","syntology_url":"https://syntology.ai/paper/2211.04772","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2211.04772"}}}},{"paper":"/paper/lerac-learning-rate-curriculum","slug":"lerac-learning-rate-curriculum","title":"Learning Rate Curriculum","date":"2022-05-18","arxiv_id":"2205.09180","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/end-to-end-audio-strikes-back-boosting","slug":"end-to-end-audio-strikes-back-boosting","title":"End-to-End Audio Strikes Back: Boosting Augmentations Towards An Efficient Audio Classification Network","date":"2022-04-25","arxiv_id":"2204.11479","rows_on_this_dataset":3,"code_links":1,"syntology":null},{"paper":"/paper/metaaudio-a-few-shot-audio-classification","slug":"metaaudio-a-few-shot-audio-classification","title":"MetaAudio: A Few-Shot Audio Classification Benchmark","date":"2022-04-05","arxiv_id":"2204.02121","rows_on_this_dataset":7,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":1,"samples_ran":1,"samples_constructed":0,"samples_ran_checked":0,"samples_ran_instrument_failed":1,"samples_unverified":0,"pointer_only_for_licence":1,"official":{"repos":["cheggan/metaaudio-a-few-shot-audio-classification-benchmark"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/metaaudio-a-few-shot-audio-classification#ran","syntology_url":"https://syntology.ai/paper/2204.02121","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2204.02121"}}}},{"paper":"/paper/septr-separable-transformer-for-audio","slug":"septr-separable-transformer-for-audio","title":"SepTr: Separable Transformer for Audio Spectrogram Processing","date":"2022-03-17","arxiv_id":"2203.09581","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/hts-at-a-hierarchical-token-semantic-audio","slug":"hts-at-a-hierarchical-token-semantic-audio","title":"HTS-AT: A Hierarchical Token-Semantic Audio Transformer for Sound Classification and Detection","date":"2022-02-02","arxiv_id":"2202.00874","rows_on_this_dataset":1,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":9,"samples_ran":9,"samples_constructed":0,"samples_ran_checked":5,"samples_ran_instrument_failed":4,"samples_unverified":0,"pointer_only_for_licence":3,"official":{"repos":["retrocirce/hts-audio-transformer"],"state":"official (archive's flag): 9 ran","n_ran":9,"n_constructed":0,"n_ran_no_instrument_failure":5,"n_unverified":0,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/hts-at-a-hierarchical-token-semantic-audio#ran","syntology_url":"https://syntology.ai/paper/2202.00874","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2202.00874"}}}},{"paper":"/paper/audioclip-extending-clip-to-image-text-and","slug":"audioclip-extending-clip-to-image-text-and","title":"AudioCLIP: Extending CLIP to Image, Text and Audio","date":"2021-06-24","arxiv_id":"2106.13043","rows_on_this_dataset":1,"code_links":4,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":6,"samples_ran":6,"samples_constructed":0,"samples_ran_checked":6,"samples_ran_instrument_failed":0,"samples_unverified":0,"pointer_only_for_licence":0,"official":{"repos":["AndreyGuzhov/AudioCLIP"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/audioclip-extending-clip-to-image-text-and#ran","syntology_url":"https://syntology.ai/paper/2106.13043","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2106.13043"}}}},{"paper":"/paper/ast-audio-spectrogram-transformer","slug":"ast-audio-spectrogram-transformer","title":"AST: Audio Spectrogram Transformer","date":"2021-04-05","arxiv_id":"2104.01778","rows_on_this_dataset":1,"code_links":5,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":3,"samples_ran":2,"samples_constructed":0,"samples_ran_checked":2,"samples_ran_instrument_failed":0,"samples_unverified":1,"pointer_only_for_licence":0,"official":{"repos":["YuanGongND/ast"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/ast-audio-spectrogram-transformer#ran","syntology_url":"https://syntology.ai/paper/2104.01778","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2104.01778"}}}},{"paper":"/paper/multi-format-contrastive-learning-of-audio","slug":"multi-format-contrastive-learning-of-audio","title":"Multi-Format Contrastive Learning of Audio Representations","date":"2021-03-11","arxiv_id":"2103.06508","rows_on_this_dataset":1,"code_links":0,"syntology":null},{"paper":"/paper/environmental-sound-classification-on-the","slug":"environmental-sound-classification-on-the","title":"Environmental Sound Classification on the Edge: A Pipeline for Deep Acoustic Networks on Extremely Resource-Constrained Devices","date":"2021-03-05","arxiv_id":"2103.03483","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/audio-visual-instance-discrimination-with","slug":"audio-visual-instance-discrimination-with","title":"Audio-Visual Instance Discrimination with Cross-Modal Agreement","date":"2020-04-27","arxiv_id":"2004.12943","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/self-supervised-learning-by-cross-modal-audio","slug":"self-supervised-learning-by-cross-modal-audio","title":"Self-Supervised Learning by Cross-Modal Audio-Video Clustering","date":"2019-11-28","arxiv_id":"1911.12667","rows_on_this_dataset":2,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":1,"samples_ran":0,"samples_constructed":0,"samples_ran_checked":0,"samples_ran_instrument_failed":0,"samples_unverified":1,"pointer_only_for_licence":0,"official":{"repos":["HumamAlwassel/XDC"],"state":"official: harvested, nothing ran","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":1,"ran_from_kinds":[]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/self-supervised-learning-by-cross-modal-audio#ran","syntology_url":"https://syntology.ai/paper/1911.12667","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1911.12667"}}}},{"paper":"/paper/cooperative-learning-of-audio-and-video","slug":"cooperative-learning-of-audio-and-video","title":"Cooperative Learning of Audio and Video Models from Self-Supervised Synchronization","date":"2018-06-30","arxiv_id":"1807.00230","rows_on_this_dataset":1,"code_links":0,"syntology":null},{"paper":"/paper/look-listen-and-learn","slug":"look-listen-and-learn","title":"Look, Listen and Learn","date":"2017-05-23","arxiv_id":"1705.08168","rows_on_this_dataset":1,"code_links":1,"syntology":null}],"full_list":"papers_with_a_benchmark_row: every listed paper, in this order"},"papers_with_a_benchmark_row":[{"paper":"/paper/m2d2-exploring-general-purpose-audio-language","slug":"m2d2-exploring-general-purpose-audio-language","title":"M2D2: Exploring General-purpose Audio-Language Representations Beyond CLAP","date":"2025-03-28","arxiv_id":"2503.22104","rows_on_this_dataset":1,"code_links":2,"syntology":null},{"paper":"/paper/masked-latent-prediction-and-classification","slug":"masked-latent-prediction-and-classification","title":"Masked Latent Prediction and Classification for Self-Supervised Audio Representation Learning","date":"2025-02-17","arxiv_id":"2502.12031","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/lhgnn-local-higher-order-graph-neural","slug":"lhgnn-local-higher-order-graph-neural","title":"LHGNN: Local-Higher Order Graph Neural Networks For Audio Classification and Tagging","date":"2025-01-07","arxiv_id":"2501.03464","rows_on_this_dataset":1,"code_links":0,"syntology":null},{"paper":"/paper/performance-of-gaussian-mixture-model","slug":"performance-of-gaussian-mixture-model","title":"Performance of Gaussian Mixture Model Classifiers on Embedded Feature Spaces","date":"2024-10-17","arxiv_id":"2410.13421","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/m2d-clap-masked-modeling-duo-meets-clap-for","slug":"m2d-clap-masked-modeling-duo-meets-clap-for","title":"M2D-CLAP: Masked Modeling Duo Meets CLAP for Learning General-purpose Audio-Language Representation","date":"2024-06-04","arxiv_id":"2406.02032","rows_on_this_dataset":1,"code_links":2,"syntology":null},{"paper":"/paper/masked-modeling-duo-towards-a-universal-audio","slug":"masked-modeling-duo-towards-a-universal-audio","title":"Masked Modeling Duo: Towards a Universal Audio Pre-training Framework","date":"2024-04-09","arxiv_id":"2404.06095","rows_on_this_dataset":2,"code_links":2,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":7,"samples_ran":7,"samples_constructed":0,"samples_ran_checked":4,"samples_ran_instrument_failed":3,"samples_unverified":0,"pointer_only_for_licence":7,"official":{"repos":["nttcslab/m2d","nttcslab/eval-audio-repr"],"state":"official (archive's flag): 7 ran","n_ran":7,"n_constructed":0,"n_ran_no_instrument_failure":4,"n_unverified":0,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/masked-modeling-duo-towards-a-universal-audio#ran","syntology_url":"https://syntology.ai/paper/2404.06095","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2404.06095"}}}},{"paper":"/paper/internvideo2-scaling-video-foundation-models","slug":"internvideo2-scaling-video-foundation-models","title":"InternVideo2: Scaling Foundation Models for Multimodal Video Understanding","date":"2024-03-22","arxiv_id":"2403.15377","rows_on_this_dataset":1,"code_links":2,"syntology":null},{"paper":"/paper/eat-self-supervised-pre-training-with","slug":"eat-self-supervised-pre-training-with","title":"EAT: Self-Supervised Pre-Training with Efficient Audio Transformer","date":"2024-01-07","arxiv_id":"2401.03497","rows_on_this_dataset":1,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":17,"samples_ran":13,"samples_constructed":0,"samples_ran_checked":10,"samples_ran_instrument_failed":3,"samples_unverified":4,"pointer_only_for_licence":3,"official":{"repos":["cwx-worst-one/eat"],"state":"official (archive's flag): 13 ran","n_ran":13,"n_constructed":0,"n_ran_no_instrument_failure":10,"n_unverified":4,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/eat-self-supervised-pre-training-with#ran","syntology_url":"https://syntology.ai/paper/2401.03497","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2401.03497"}}}},{"paper":"/paper/omnivec2-a-novel-transformer-based-network","slug":"omnivec2-a-novel-transformer-based-network","title":"OmniVec2 - A Novel Transformer based Network for Large Scale Multimodal and Multitask Learning","date":"2024-01-01","arxiv_id":null,"rows_on_this_dataset":1,"code_links":0,"syntology":null},{"paper":"/paper/omnivec-learning-robust-representations-with","slug":"omnivec-learning-robust-representations-with","title":"OmniVec: Learning robust representations with cross modal sharing","date":"2023-11-07","arxiv_id":"2311.05709","rows_on_this_dataset":1,"code_links":0,"syntology":null},{"paper":"/paper/dynamic-convolutional-neural-networks-as","slug":"dynamic-convolutional-neural-networks-as","title":"Dynamic Convolutional Neural Networks as Efficient Pre-trained Audio Models","date":"2023-10-24","arxiv_id":"2310.15648","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/mt-slvr-multi-task-self-supervised-learning","slug":"mt-slvr-multi-task-self-supervised-learning","title":"MT-SLVR: Multi-Task Self-Supervised Learning for Transformation In(Variant) Representations","date":"2023-05-29","arxiv_id":"2305.17191","rows_on_this_dataset":3,"code_links":1,"syntology":null},{"paper":"/paper/beats-audio-pre-training-with-acoustic","slug":"beats-audio-pre-training-with-acoustic","title":"BEATs: Audio Pre-Training with Acoustic Tokenizers","date":"2022-12-18","arxiv_id":"2212.09058","rows_on_this_dataset":1,"code_links":4,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":18,"samples_ran":16,"samples_constructed":0,"samples_ran_checked":12,"samples_ran_instrument_failed":4,"samples_unverified":2,"pointer_only_for_licence":4,"official":{"repos":["microsoft/unilm"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/beats-audio-pre-training-with-acoustic#ran","syntology_url":"https://syntology.ai/paper/2212.09058","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2212.09058"}}}},{"paper":"/paper/efficient-large-scale-audio-tagging-via","slug":"efficient-large-scale-audio-tagging-via","title":"Efficient Large-scale Audio Tagging via Transformer-to-CNN Knowledge Distillation","date":"2022-11-09","arxiv_id":"2211.04772","rows_on_this_dataset":1,"code_links":2,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":2,"samples_ran":2,"samples_constructed":0,"samples_ran_checked":1,"samples_ran_instrument_failed":1,"samples_unverified":0,"pointer_only_for_licence":1,"official":{"repos":["fschmid56/efficientat"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/efficient-large-scale-audio-tagging-via#ran","syntology_url":"https://syntology.ai/paper/2211.04772","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2211.04772"}}}},{"paper":"/paper/lerac-learning-rate-curriculum","slug":"lerac-learning-rate-curriculum","title":"Learning Rate Curriculum","date":"2022-05-18","arxiv_id":"2205.09180","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/end-to-end-audio-strikes-back-boosting","slug":"end-to-end-audio-strikes-back-boosting","title":"End-to-End Audio Strikes Back: Boosting Augmentations Towards An Efficient Audio Classification Network","date":"2022-04-25","arxiv_id":"2204.11479","rows_on_this_dataset":3,"code_links":1,"syntology":null},{"paper":"/paper/metaaudio-a-few-shot-audio-classification","slug":"metaaudio-a-few-shot-audio-classification","title":"MetaAudio: A Few-Shot Audio Classification Benchmark","date":"2022-04-05","arxiv_id":"2204.02121","rows_on_this_dataset":7,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":1,"samples_ran":1,"samples_constructed":0,"samples_ran_checked":0,"samples_ran_instrument_failed":1,"samples_unverified":0,"pointer_only_for_licence":1,"official":{"repos":["cheggan/metaaudio-a-few-shot-audio-classification-benchmark"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/metaaudio-a-few-shot-audio-classification#ran","syntology_url":"https://syntology.ai/paper/2204.02121","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2204.02121"}}}},{"paper":"/paper/septr-separable-transformer-for-audio","slug":"septr-separable-transformer-for-audio","title":"SepTr: Separable Transformer for Audio Spectrogram Processing","date":"2022-03-17","arxiv_id":"2203.09581","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/hts-at-a-hierarchical-token-semantic-audio","slug":"hts-at-a-hierarchical-token-semantic-audio","title":"HTS-AT: A Hierarchical Token-Semantic Audio Transformer for Sound Classification and Detection","date":"2022-02-02","arxiv_id":"2202.00874","rows_on_this_dataset":1,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":9,"samples_ran":9,"samples_constructed":0,"samples_ran_checked":5,"samples_ran_instrument_failed":4,"samples_unverified":0,"pointer_only_for_licence":3,"official":{"repos":["retrocirce/hts-audio-transformer"],"state":"official (archive's flag): 9 ran","n_ran":9,"n_constructed":0,"n_ran_no_instrument_failure":5,"n_unverified":0,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/hts-at-a-hierarchical-token-semantic-audio#ran","syntology_url":"https://syntology.ai/paper/2202.00874","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2202.00874"}}}},{"paper":"/paper/audioclip-extending-clip-to-image-text-and","slug":"audioclip-extending-clip-to-image-text-and","title":"AudioCLIP: Extending CLIP to Image, Text and Audio","date":"2021-06-24","arxiv_id":"2106.13043","rows_on_this_dataset":1,"code_links":4,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":6,"samples_ran":6,"samples_constructed":0,"samples_ran_checked":6,"samples_ran_instrument_failed":0,"samples_unverified":0,"pointer_only_for_licence":0,"official":{"repos":["AndreyGuzhov/AudioCLIP"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/audioclip-extending-clip-to-image-text-and#ran","syntology_url":"https://syntology.ai/paper/2106.13043","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2106.13043"}}}},{"paper":"/paper/ast-audio-spectrogram-transformer","slug":"ast-audio-spectrogram-transformer","title":"AST: Audio Spectrogram Transformer","date":"2021-04-05","arxiv_id":"2104.01778","rows_on_this_dataset":1,"code_links":5,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":3,"samples_ran":2,"samples_constructed":0,"samples_ran_checked":2,"samples_ran_instrument_failed":0,"samples_unverified":1,"pointer_only_for_licence":0,"official":{"repos":["YuanGongND/ast"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/ast-audio-spectrogram-transformer#ran","syntology_url":"https://syntology.ai/paper/2104.01778","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2104.01778"}}}},{"paper":"/paper/multi-format-contrastive-learning-of-audio","slug":"multi-format-contrastive-learning-of-audio","title":"Multi-Format Contrastive Learning of Audio Representations","date":"2021-03-11","arxiv_id":"2103.06508","rows_on_this_dataset":1,"code_links":0,"syntology":null},{"paper":"/paper/environmental-sound-classification-on-the","slug":"environmental-sound-classification-on-the","title":"Environmental Sound Classification on the Edge: A Pipeline for Deep Acoustic Networks on Extremely Resource-Constrained Devices","date":"2021-03-05","arxiv_id":"2103.03483","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/audio-visual-instance-discrimination-with","slug":"audio-visual-instance-discrimination-with","title":"Audio-Visual Instance Discrimination with Cross-Modal Agreement","date":"2020-04-27","arxiv_id":"2004.12943","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/self-supervised-learning-by-cross-modal-audio","slug":"self-supervised-learning-by-cross-modal-audio","title":"Self-Supervised Learning by Cross-Modal Audio-Video Clustering","date":"2019-11-28","arxiv_id":"1911.12667","rows_on_this_dataset":2,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":1,"samples_ran":0,"samples_constructed":0,"samples_ran_checked":0,"samples_ran_instrument_failed":0,"samples_unverified":1,"pointer_only_for_licence":0,"official":{"repos":["HumamAlwassel/XDC"],"state":"official: harvested, nothing ran","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":1,"ran_from_kinds":[]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/self-supervised-learning-by-cross-modal-audio#ran","syntology_url":"https://syntology.ai/paper/1911.12667","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1911.12667"}}}},{"paper":"/paper/cooperative-learning-of-audio-and-video","slug":"cooperative-learning-of-audio-and-video","title":"Cooperative Learning of Audio and Video Models from Self-Supervised Synchronization","date":"2018-06-30","arxiv_id":"1807.00230","rows_on_this_dataset":1,"code_links":0,"syntology":null},{"paper":"/paper/look-listen-and-learn","slug":"look-listen-and-learn","title":"Look, Listen and Learn","date":"2017-05-23","arxiv_id":"1705.08168","rows_on_this_dataset":1,"code_links":1,"syntology":null}],"papers_where_code_ran":8,"papers_where_code_ran_first_page":"/dataset/esc-50/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not run it on this dataset or check it against this dataset's benchmarks.","pages":[{"order":"ran","page":1,"of":1,"url":"/dataset/esc-50/papers/ran/1","json":"/dataset/esc-50/papers/ran/1.json","rows":8}],"row_route":"each paper's syntology object carries sample_list (this site's paper page, #ran), syntology_url (syntology.ai's page for the paper, only when that route probed live) and mcp (the agent call that lists the paper's harvested samples; not a verdict on the paper)","developers":"https://syntology.ai/developers","syntology_totals":{"read_at":"2026-10-05T00:36:11+00:00","papers_with_samples":9,"samples_harvested":64,"samples_ran":56,"samples_constructed":0,"samples_ran_checked":40,"samples_ran_instrument_failed":16,"samples_unverified":8,"pointer_only_for_licence":19,"papers_with_no_sample_that_ran":1,"papers_with_a_sample_that_ran":8,"papers_with_a_run_with_no_instrument_failure":7,"papers_where_every_run_was_an_instrument_failure":1,"note":"the per-paper counts of every listed paper (all pages), summed; not a rate"},"key_notes":{"samples_ran_checked":"legacy name, kept unchanged so existing readers do not break: it counts the samples that ran with no instrument failure (honoured, violated, and ran with no contract checked); it does not mean a contract was checked, and the pages print it as 'K with no instrument failure', not 'K checked'","samples_constructed":"a sub-count of the samples that ran, never subtracted from them and never a failure: an executed sample whose run returned an instance of its own class (fixture_out_type equals the entry name): the run built an object and did not compute a result (Syntology's RAN record, counts.constructed)"},"since_archive_judged":{"papers":1,"papers_placed":0,"judged_by":{"model":"Claude Sonnet 4.5","models_as_recorded":["global.anthropic.claude-sonnet-4-5-20250929-v1:0"],"from":"lb_rows_run_verified.jsonl: each record's `model` field (the extractor's call that wrote decisions[])"},"note":"a model's judgement from the paper's own tables that they report on this leaderboard, not a result: no value from a paper that was not placed is printed or carried here; papers counts each paper once over these leaderboards","backfill":"8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read)","backfill_complete":false,"leaderboards":[{"leaderboard":"/sota/audio-classification-on-esc-50","since_archive":"/sota/audio-classification-on-esc-50#since-judged","papers_judged":1,"placed":0},{"leaderboard":"/sota/environmental-sound-classification-on-esc-50","since_archive":"/sota/environmental-sound-classification-on-esc-50#since-judged","papers_judged":1,"placed":0}]},"papers_note":"The archive never published its papers-using-dataset list; these are papers with a leaderboard row on this dataset's benchmarks.","record_sha256":"9ae3761b5e7041c47faff0286127760797d6fa4a513aaa96bc7b5c54a7408ad4","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}