Browse State-of-the-Art › Self-Knowledge Distillation
Self-Knowledge Distillation
36 papers with code · 0 benchmarks · 0 datasets archive 2025-07-28
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
No dataset record in the archive lists this task.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 68 · with a code link: 36 · where Syntology ran a sample: 13 (10 with a run with no instrument failure, 3 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (13 of 68 tagged: 10 with a run with no instrument failure, 3 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 68 of 68, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
7 May 2020 5 repositories listed Syntology community repositories only · 9 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 11 harvested samples) · 1 pointer-only (licence)Keywords: entropy minimisation, maximum entropy, confidence penalty, self knowledge distillation, label correction, label noise, semi-supervised learning, output regularisation
-
5 Feb 2024 4 repositories listed Syntology community repositories only · 11 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 3 honoured, 0 violated, 5 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified (of 14 harvested samples) · 5 pointer-only (licence)It can simultaneously perform the three common retrieval functionalities of embedding model: dense retrieval, multi-vector retrieval, and sparse retrieval, which provides a unified model foundation for real-world IR…
-
6 Jun 2021 3 repositories listed Syntology official (archive's flag): 1 ran · 4 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified (of 9 harvested samples) · 5 pointer-only (licence)In federated learning, a strong global model is collaboratively learned by aggregating clients' locally trained models.
-
24 Aug 2023 2 repositories listed Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 11 harvested samples) · 1 pointer-only (licence)FedSOL is designed to identify gradients of local objectives that are inherently orthogonal to directions affecting the proximal objective.
-
25 Sep 2019 2 repositories listed Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 13 harvested samples)Without any extra computation cost, Tf-KD achieves up to 0.
-
25 Jun 2025 1 repository listedFederated learning aims to train a global model in a distributed environment that is close to the performance of centralized training.
-
21 Jan 2025 1 repository listedWith the advent of the COVID-19 pandemic, ultrasound imaging has emerged as a promising technique for COVID-19 detection, due to its non-invasive nature, affordability, and portability.
-
16 Sep 2024 1 repository listedSecond, we employ a two-branch framework empowered by knowledge distillation, enabling the model to take both the filtered and original images as input, largely reducing the burden of downstream tasks.
-
29 Jul 2024 1 repository listedRecent advancements in deep convolutional neural networks have significantly improved the performance of saliency prediction.
-
26 Jul 2024 1 repository listed Syntology 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)Foundation models pretrained on large-scale datasets are revolutionizing the field of computational pathology (CPath).
-
25 Jun 2024 1 repository listedSecondly, we employ efficient channel attention modules in the local-spatial stream to make the network focus on facial regions that are highly relevant to micro-expressions.
-
12 Jun 2024 1 repository listedTransformer encoder with connectionist temporal classification (CTC) framework is widely used for automatic speech recognition (ASR).
-
31 May 2024 1 repository listedTo address these challenges, we introduce a novel skeleton-based training framework (C²VL) based on Cross-modal Contrastive learning that uses the progressive distillation to learn task-agnostic human skeleton action…
-
1 May 2024 1 repository listedSemi-supervised learning for medical image segmentation presents a unique challenge of efficiently using limited labeled data while leveraging abundant unlabeled data.
-
15 Feb 2024 1 repository listedNeural Networks (NNs) have been driving machine learning progress in recent years, but their larger models present challenges in resource-limited environments.
-
25 Jan 2024 1 repository listedDeep clustering has gained significant attention due to its capability in learning clustering-friendly representations without labeled data.
-
7 Dec 2023 1 repository listedThe weak guidance is implemented as a knowledge distillation loss with (shifted) zero-shot predictions.
-
29 Sep 2023 1 repository listedOur approach seeks to enhance cross-lingual QA transfer using a high-performing multilingual model trained on a large-scale dataset, complemented by a few thousand aligned QA examples across languages.
-
3 Aug 2023 1 repository listedThe experiments verify that, our proposition is significantly superior to the state-of-the-art ones, and with real-time running efficiency.
-
29 Jul 2023 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 3 unverified (of 8 harvested samples) · 5 pointer-only (licence)Different from the previous self-knowledge distillation, this stage finetunes the student's head with only 20% training time as a plug-and-play training strategy.
-
25 Jun 2023 1 repository listedTherefore, improving the adversarial robustness of these models is crucial for ITS.
-
23 Jun 2023 1 repository listedAbstract Meaning Representation (AMR) is a Semantic Parsing formalism that aims at providing a semantic graph abstraction representing a given text.
-
16 May 2023 1 repository listedSpecifically, we introduce a Distillation with Reverse Guidance (DRG) method that considers different levels of information extracted by the model, including edge, shape, and detail of the input data, to construct a…
-
23 Mar 2023 1 repository listedWe decompose the KD loss and find the non-target loss from it forces the student's non-target logits to match the teacher's, but the sum of the two non-target logits is different, preventing them from being identical.
-
15 Mar 2023 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples)Algorithmic fairness has become an important machine learning problem, especially for mission-critical Web applications.
-
27 Feb 2023 1 repository listedIt then provides a comprehensive summary of three types of Graph-based Knowledge Distillation methods, namely Graph-based Knowledge Distillation for deep neural networks (DKD), Graph-based Knowledge Distillation for…
-
30 Sep 2022 1 repository listedElectrocardiogram (ECG) signal is one of the most effective sources of information mainly employed for the diagnosis and prediction of cardiovascular diseases (CVDs) connected with the abnormalities in heart rhythm.
-
22 Aug 2022 1 repository listedFor the input-level, we design a new data augmentation technique as Phase MixUp, which highlights task-relevant objects in the interpolations, thus enhancing input-level regularization and class consistency for target…
-
11 Aug 2022 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 3 samples that ran constructed an object rather than computing a result (of 4 harvested samples) · 4 pointer-only (licence)MixSKD mutually distills feature maps and probability distributions between the random pair of original images and their mixup images in a meaningful way.
-
13 Dec 2021 1 repository listedOur approach leverages bidirectional temporal augmentation and knowledge-enhanced fine-tuning to synthesize authentic pseudo-prior items that retain user preferences and capture deeper item semantic correlations, thus…
-
14 Nov 2021 1 repository listed
-
15 Mar 2021 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified; the one sample that ran constructed an object rather than computing a result (of 3 harvested samples)
-
25 Feb 2021 1 repository listed
-
15 Sep 2020 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
22 Jun 2020 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 3 pointer-only (licence)
-
31 Mar 2020 1 repository listed Syntology official (archive's flag): 1 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
MoLe-VLA: Dynamic Layer-skipping Vision Language Action Model via Mixture-of-Layers for Efficient Robot Manipulation26 Mar 2025 0 repositories listed
-
xVLM2Vec: Adapting LVLM-based embedding models to multilinguality using Self-Knowledge Distillation12 Mar 2025 0 repositories listed
-
Investigating and Enhancing Vision-Audio Capability in Omnimodal Large Language Models27 Feb 2025 0 repositories listed
-
Generative Dataset Distillation Based on Self-knowledge Distillation8 Jan 2025 0 repositories listed
-
Towards Satellite Non-IID Imagery: A Spectral Clustering-Assisted Federated Learning Approach17 Oct 2024 0 repositories listed
-
SeCoKD: Aligning Large Language Models for In-Context Learning with Fewer Shots20 Jun 2024 0 repositories listed
-
Self-Knowledge Distillation for Learning Ambiguity14 Jun 2024 0 repositories listed
-
Weakly Supervised Monocular 3D Detection with a Single-View Image29 Feb 2024 0 repositories listed
-
X Modality Assisting RGBT Object Tracking27 Dec 2023 0 repositories listed
-
Double Reverse Regularization Network Based on Self-Knowledge Distillation for SAR Object Classification26 Nov 2023 0 repositories listed
-
Three Factors to Improve Out-of-Distribution Detection2 Aug 2023 0 repositories listed
-
Self-Knowledge Distillation for Surgical Phase Recognition15 Jun 2023 0 repositories listed
-
Confidence Attention and Generalization Enhanced Distillation for Continuous Video Domain Adaptation18 Mar 2023 0 repositories listed
-
You Do Not Need Additional Priors or Regularizers in Retinex-Based Low-Light Image Enhancement1 Jan 2023 0 repositories listed
-
Siamese Sleep Transformer For Robust Sleep Stage Scoring With Self-knowledge Distillation and Selective Batch Sampling12 Dec 2022 0 repositories listed
-
AI-KD: Adversarial learning and Implicit regularization for self-Knowledge Distillation20 Nov 2022 0 repositories listed
-
TASKED: Transformer-based Adversarial learning for human activity recognition using wearable sensors via Self-KnowledgE Distillation14 Sep 2022 0 repositories listed
-
A Novel Self-Knowledge Distillation Approach with Siamese Representation Learning for Action Recognition3 Sep 2022 0 repositories listed
-
Self-Knowledge Distillation via Dropout11 Aug 2022 0 repositories listed
-
Confidence-aware Self-Semantic Distillation on Knowledge Graph Embedding7 Jun 2022 0 repositories listed
-
Self-Knowledge Distillation based Self-Supervised Learning for Covid-19 Detection from Chest X-Ray Images7 Jun 2022 0 repositories listed
-
Spatial Likelihood Voting with Self-Knowledge Distillation for Weakly Supervised Object Detection14 Apr 2022 0 repositories listed
-
Look Backward and Forward: Self-Knowledge Distillation with Bidirectional Decoder for Neural Machine Translation10 Mar 2022 0 repositories listed
-
Iterative Self Knowledge Distillation -- From Pothole Classification to Fine-Grained and COVID Recognition4 Feb 2022 0 repositories listed
-
Extracting knowledge from features with multilevel abstraction4 Dec 2021 0 repositories listed
-
Student Helping Teacher: Teacher Evolution via Self-Knowledge Distillation1 Oct 2021 0 repositories listed
-
Black-Box Dissector: Towards Erasing-based Hard-Label Model Stealing Attack3 May 2021 0 repositories listed
-
17 Mar 2021 0 repositories listed
-
Stochastic Precision Ensemble: Self-Knowledge Distillation for Quantized Deep Neural Networks30 Sep 2020 0 repositories listed
-
Extending Label Smoothing Regularization with Self-Knowledge Distillation11 Sep 2020 0 repositories listed
-
SELF-KNOWLEDGE DISTILLATION ADVERSARIAL ATTACK25 Sep 2019 0 repositories listed
-
Self-Knowledge Distillation in Natural Language Processing2 Aug 2019 0 repositories listed
Syntology lines on 13 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections