Browse State-of-the-Art › Audio Tagging
Audio Tagging
49 papers with code · 1 benchmark · 10 datasets archive 2025-07-28
Audio tagging is a task to predict the tags of audio clips. Audio tagging tasks include music tagging, acoustic scene classification, audio event classification, etc.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
1 leaderboard table shown for this task, 1 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| AudioSet (11 rows) | CAV-MAE (Audio-Visual) | Contrastive Audio-Visual Masked Autoencoder | code | Syntology official: harvested, nothing ran · 0 ran · 1 unverified | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
10 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 81 · with a code link: 49 · where Syntology ran a sample: 10 (8 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (10 of 81 tagged: 8 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 81 of 81, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
5 Apr 2021 5 repositories listed Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)In the past decade, convolutional neural networks (CNNs) have been widely adopted as the main building block for end-to-end audio classification models, which aim to learn a direct mapping from audio spectrograms to…
-
27 Jun 2018 5 repositories listed Syntology 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples)We present an end-to-end deep learning approach to denoising speech signals by processing the raw waveform directly.
-
14 Sep 2019 4 repositories listed Syntology official (archive's flag): 6 ran · 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples)Pronounced as "musician", the musicnn library contains a set of pre-trained musically motivated convolutional neural networks for music audio tagging: https://github.com/jordipons/musicnn.
-
26 Jul 2018 3 repositories listedThe goal of the task is to build an audio tagging system that can recognize the category of an audio clip from a subset of 41 diverse categories drawn from the AudioSet Ontology.
-
28 Mar 2025 2 repositories listedIn the second stage, it learns CLAP features using the audio features learned from the LLM-based embeddings.
-
25 Sep 2023 2 repositories listedDilated convolution with learnable spacings (DCLS) is a recent convolution method in which the positions of the kernel elements are learned throughout training by backpropagation.
-
7 Jun 2023 2 repositories listedIn order to tackle both clip-level and frame-level tasks, this paper proposes Audio Teacher-Student Transformer (ATST), with a clip-level version (named ATST-Clip) and a frame-level version (named ATST-Frame)…
-
9 Nov 2022 2 repositories listed Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 1 pointer-only (licence)We provide models of different complexity levels, scaling from low-complexity models up to a new state-of-the-art performance of .
-
11 Oct 2021 2 repositories listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples)However, one of the main shortcomings of transformer models, compared to the well-established CNNs, is the computational complexity.
-
24 Aug 2020 2 repositories listedThis paper describes CRNNs we used to participate in Task 5 of the DCASE 2020 challenge.
-
7 Jun 2019 2 repositories listedThe task evaluates systems for multi-label audio tagging using a large set of noisy-labeled data, and a much smaller set of manually-labeled data, under a large vocabulary setting of 80 everyday sound classes.
-
30 Oct 2018 2 repositories listedAudio tagging is challenging due to the limited size of data and noisy labels.
-
27 Jun 2018 2 repositories listedWe present an end-to-end deep learning approach to denoising speech signals by processing the raw waveform directly.
-
24 Feb 2017 2 repositories listedIn this paper, we propose to use a convolutional neural network (CNN) to extract robust features from mel-filter banks (MFBs), spectrograms or even raw waveforms for audio tagging.
-
13 Jul 2016 2 repositories listedFor the unsupervised feature learning, we propose to use a symmetric or asymmetric deep de-noising auto-encoder (sDAE or aDAE) to generate new data-driven features from the Mel-Filter Banks (MFBs) features.
-
28 Mar 2025 1 repository listedImmersive communication has made significant advancements, especially with the release of the codec for Immersive Voice and Audio Services.
-
26 Mar 2025 1 repository listedAudioSet is one of the most used and largest datasets in audio tagging, containing about 2 million audio samples that are manually labeled with 527 event categories organized into an ontology.
-
19 Mar 2025 1 repository listedLarge Language Models (LLMs) have recently shown remarkable ability to process not only text but also multimodal inputs such as speech and audio.
-
14 Mar 2025 1 repository listedWe target the problem of developing new low-complexity networks for the sound event detection task.
-
17 Feb 2025 1 repository listedTherefore, we propose a new method: MAsked latenT Prediction And Classification (MATPAC), which is trained with two pretext tasks solved jointly.
-
17 Sep 2024 1 repository listedWe introduce Label-Combination Prototypical Networks (LC-Protonets) to address the problem of multi-label few-shot classification, where a model must generalize to new classes based on only a few available examples.
-
22 Jul 2024 1 repository listedThe broadcasting industry is increasingly adopting IP techniques, revolutionising both live and pre-recorded content production, from news gathering to live music events.
-
4 Jul 2024 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)To the best of our knowledge, it is the first SSM that outperforms the Transformers on AudioSet and achieves an mAP of 48.
-
18 Dec 2023 1 repository listedIn the age of music streaming platforms, the task of automatically tagging music audio has garnered significant attention, driving researchers to devise methods aimed at enhancing performance metrics on standard…
-
24 Oct 2023 1 repository listedAudio Spectrogram Transformers are excellent at exploiting large datasets, creating powerful pre-trained models that surpass CNNs when fine-tuned on downstream tasks.
-
15 Jun 2023 1 repository listedIn this paper, we analyze how the performance of large-scale pretrained audio neural networks designed for audio pattern recognition changes when deployed on a hardware such as Raspberry Pi.
-
30 May 2023 1 repository listedSounds carry an abundance of information about activities and events in our everyday environment, such as traffic noise, road works, music, or people talking.
-
16 Apr 2023 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)However, such semantic consistency from the synchronization is hard to guarantee in unconstrained videos, due to the irrelevant modality noise and differentiated semantic correlation.
-
23 Jan 2023 1 repository listed Syntology 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 1 pointer-only (licence)Attention-based models are appealing for multimodal processing because inputs from multiple modalities can be concatenated and fed to a single backbone network - thus requiring very little fusion engineering.
-
22 Nov 2022 1 repository listedThe proposed metric, ontology-aware mean average precision (OmAP) addresses the weaknesses of mAP by utilizing the AudioSet ontology information during the evaluation.
-
26 Oct 2022 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
2 Oct 2022 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
16 Dec 2021 1 repository listed
-
15 Dec 2021 1 repository listed Syntology official (archive's flag): 9 ran · 9 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 2 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 10 harvested samples) · 3 pointer-only (licence)
-
5 Oct 2021 1 repository listed
-
10 Jul 2021 1 repository listed
-
6 Jul 2021 1 repository listed
-
27 May 2021 1 repository listed
-
25 May 2021 1 repository listed
-
22 Apr 2021 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
1 Mar 2021 1 repository listed
-
16 Feb 2021 1 repository listed
-
2 Feb 2021 1 repository listed
-
22 Oct 2020 1 repository listed
-
21 Sep 2020 1 repository listed
-
17 Jun 2019 1 repository listed
-
6 Jun 2019 1 repository listed
-
6 Aug 2018 1 repository listed
-
11 Jul 2016 1 repository listed
-
Performance improvement of spatial semantic segmentation with enriched audio features and agent-based error correction for DCASE 2025 Challenge Task 426 Jun 2025 0 repositories listed
-
USAD: Universal Speech and Audio Representation via Distillation23 Jun 2025 0 repositories listed
-
Enhancing Speech Emotion Recognition with Graph-Based Multimodal Fusion and Prosodic Features for the Speech Emotion Recognition in Naturalistic Conditions Challenge at Interspeech 20252 Jun 2025 0 repositories listed
-
Knowledge Distillation for Real-Time Classification of Early Media in Voice Communications28 Oct 2024 0 repositories listed
-
MT2KD: Towards A General-Purpose Encoder for Speech, Speaker, and Audio Events25 Sep 2024 0 repositories listed
-
Normalizing Energy Consumption for Hardware-Independent Evaluation9 Sep 2024 0 repositories listed
-
From Computation to Consumption: Exploring the Compute-Energy Link for Training and Testing Neural Networks for SED Systems8 Sep 2024 0 repositories listed
-
A Framework for Synthetic Audio Conversations Generation using Large Language Models2 Sep 2024 0 repositories listed
-
Audio Mamba: Pretrained Audio State Space Model For Audio Tagging22 May 2024 0 repositories listed
-
ATGNN: Audio Tagging Graph Neural Network2 Nov 2023 0 repositories listed
-
Joint Music and Language Attention Models for Zero-shot Music Tagging16 Oct 2023 0 repositories listed
-
Killing two birds with one stone: Can an audio captioning system also be used for audio-text retrieval?29 Aug 2023 0 repositories listed
-
Compressing audio CNNs with graph centrality based filter pruning5 May 2023 0 repositories listed
-
Leveraging Audio-Tagging Assisted Sound Event Detection using Weakified Strong Labels and Frequency Dynamic Convolutions25 Apr 2023 0 repositories listed
-
AST-SED: An Effective Sound Event Detection Method Based on Audio Spectrogram Transformer7 Mar 2023 0 repositories listed
-
Incremental Learning of Acoustic Scenes and Sound Events28 Feb 2023 0 repositories listed
-
Tackling the Cocktail Fork Problem for Separation and Transcription of Real-World Soundtracks14 Dec 2022 0 repositories listed
-
Machine Learning-based Classification of Birds through Birdsong9 Dec 2022 0 repositories listed
-
SpectNet : End-to-End Audio Signal Classification Using Learnable Spectrograms17 Nov 2022 0 repositories listed
-
Impact of temporal resolution on convolutional recurrent networks for audio tagging and sound event detection26 Sep 2022 0 repositories listed
-
Multi-encoder attention-based architectures for sound recognition with partial visual assistance26 Sep 2022 0 repositories listed
-
Improved Zero-Shot Audio Tagging & Classification with Patchout Spectrogram Transformers24 Aug 2022 0 repositories listed
-
Connecting the Dots between Audio and Text without Parallel Data through Visual Knowledge Transfer16 Jan 2022 0 repositories listed
-
Audiovisual transfer learning for audio tagging and sound event detection9 Jun 2021 0 repositories listed
-
What is the ground truth? Reliability of multi-annotator data for audio tagging9 Apr 2021 0 repositories listed
-
Joint framework with deep feature distillation and adaptive focal loss for weakly supervised audio tagging and acoustic event detection23 Mar 2021 0 repositories listed
-
Enhancing Audio Augmentation Methods with Consistency Learning9 Feb 2021 0 repositories listed
-
Audio Tagging by Cross Filtering Noisy Labels16 Jul 2020 0 repositories listed
-
Acoustic Scene Classification using Audio Tagging19 Apr 2020 0 repositories listed
-
Multi-Branch Learning for Weakly-Labeled Sound Event Detection22 Feb 2020 0 repositories listed
-
Combining High-Level Features of Raw Audio Waves and Mel-Spectrograms for Audio Tagging26 Nov 2018 0 repositories listed
-
Fully DNN-based Multi-label regression for audio tagging24 Jun 2016 0 repositories listed
Syntology lines on 12 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections