Methods › General › Knowledge Distillation › Collaborative Distillation
Collaborative Distillation
Introduced by Huan Wang et al. in Collaborative Distillation for Ultra-Resolution Universal Style Transfer
archive 2025-07-28 Description, source and code snippet are the archive's method entry.
Collaborative Distillation is a new knowledge distillation method (named Collaborative Distillation) for encoder-decoder based neural style transfer to reduce the number of convolutional filters. The main idea is underpinned by a finding that the encoder-decoder pairs construct an exclusive collaborative relationship, which is regarded as a new kind of knowledge for style transfer models.
In Syntology name not resolved (unknown_name). The lookup matched no method, paper or venue by this name; that asserts nothing about whether code exists.
Near matches the lookup lists, each a different name: Two-stage Collaborative Distillation (TCoD); distillation-based collaborative learning algorithm based on neural network architecture; Self-Distillation; Text Distillation; Live Distillation; self-distillation; block distillation; X-Ray Distillation.
Syntology's have check for this name (free, it answers coverage only), read 2026-10-05; ask it again live. A level is the served verification level of that one answer; nothing here is summed across methods.
Papers archive 2025-07-28
archive papers tagged: 9 · with a code link: 7 · where Syntology ran a sample: 2 (2 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (2 of 9 tagged: 2 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 9 of 9, newest first by the archive's date (ties by slug), in archive order.
Repository counts are the archive's code-links table. A Syntology line states what Syntology ran from that paper's harvested code, as “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. It is per sample and not a correctness claim. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from.
-
Noise Fusion-based Distillation Learning for Anomaly Detection in Complex Industrial Environments 19 Jun 2025 · 0 repositories · arXiv:2506.16050
-
Continual Collaborative Distillation for Recommender System 29 May 2024 · 2 repositories · arXiv:2405.19046
-
Federated Learning via Input-Output Collaborative Distillation 22 Dec 2023 · 1 repository · arXiv:2312.14478
-
Multi-label Emotion Analysis in Conversation via Multimodal Knowledge Distillation 27 Oct 2023 · 0 repositories
-
DevFormer: A Symmetric Transformer for Context-Aware Device Placement 26 May 2022 · 5 repositories · arXiv:2205.13225Syntology official (archive's flag): 12 ran · 16 ran (of which 4 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 7 where Syntology's instrument failed) · 7 unverified (of 23 harvested samples) · 2 pointer-only (licence)
-
Revisiting Discriminator in GAN Compression: A Generator-discriminator Cooperative Compression Scheme 27 Oct 2021 · 1 repository · arXiv:2110.14439
-
Complementary Calibration: Boosting General Continual Learning with Collaborative Distillation and Self-Supervision 3 Sep 2021 · 1 repository · arXiv:2109.02426
-
Compressing Facial Makeup Transfer Networks by Collaborative Distillation and Kernel Decomposition 16 Sep 2020 · 1 repository · arXiv:2009.07604
-
Collaborative Distillation for Ultra-Resolution Universal Style Transfer 18 Mar 2020 · 1 repository · arXiv:2003.08436Syntology official (archive's flag): 7 ran · 7 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 8 harvested samples) · 1 pointer-only (licence)
Tasks archive 2025-07-28
17 tasks the archive attaches to papers tagged with this method, by distinct papers. A task without a page in the catalog is plain text.
Usage over time archive 2025-07-28
Components: the archive holds no method-to-method composition, so PwC's Components table cannot be rebuilt; the Papers list carries no Results column for the same reason (the archive does not join its leaderboard rows to method tags).
Categories archive 2025-07-28
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections