{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/method/hydra","slug":"hydra","name":"Hydra","full_name":"Hydra","full_name_withheld":false,"description_markdown":"**Hydra** is a multi-headed neural network for model distillation with a shared body network. The shared body network learns a joint feature representation that enables each head to capture the predictive behavior of each ensemble member.  Existing distillation methods often train a distillation network to imitate the prediction of a larger network. Hydra instead learns to distill the individual predictions of each ensemble member into separate light-weight head models while amortizing the computation through a shared heavy-weight body network. This retains the diversity of ensemble member predictions which is otherwise lost in knowledge distillation.","description_state":"present","introduced_year":null,"introduced_by":{"title":null,"paper":null,"first_author":null,"n_authors":0,"url_abs":null,"archive_paper_url":null},"source":{"url":"https://arxiv.org/abs/2001.04694v2","title":"Hydra: Preserving Ensemble Diversity for Model Distillation","url_on_a_paper_host":true},"code_snippet_url":null,"code_snippet_url_on_a_code_host":false,"categories":[{"area":"General","area_id":"general","collection":"Knowledge Distillation","url":"/methods/category/knowledge-distillation","pwc_aliases":[]}],"n_papers_tagged":34,"archive_num_papers":null,"papers_newest_first":[{"paper":"/paper/hydranet-momentum-driven-state-space-duality","slug":"hydranet-momentum-driven-state-space-duality","title":"HydraNet: Momentum-Driven State Space Duality for Multi-Granularity Tennis Tournaments Analysis","date":"2025-05-28","arxiv_id":"2505.21882","n_code_links":1,"syntology":null},{"paper":null,"slug":"hydra-an-agentic-reasoning-approach-for","title":"Hydra: An Agentic Reasoning Approach for Enhancing Adversarial Robustness and Mitigating Hallucinations in Vision-Language Models","date":"2025-04-19","arxiv_id":"2504.14395","n_code_links":0,"syntology":null},{"paper":null,"slug":"a-novel-mamba-based-sequential-recommendation","title":"A Novel Mamba-based Sequential Recommendation Method","date":"2025-04-10","arxiv_id":"2504.07398","n_code_links":0,"syntology":null},{"paper":null,"slug":"impact-of-data-patterns-on-biotype","title":"Dataset Properties Shape the Success of Neuroimaging-Based Patient Stratification: A Benchmarking Analysis Across Clustering Algorithms","date":"2025-03-15","arxiv_id":"2503.12066","n_code_links":0,"syntology":null},{"paper":"/paper/swift-hydra-self-reinforcing-generative","slug":"swift-hydra-self-reinforcing-generative","title":"Swift Hydra: Self-Reinforcing Generative Framework for Anomaly Detection with Multiple Mamba Models","date":"2025-03-09","arxiv_id":"2503.06413","n_code_links":1,"syntology":null},{"paper":null,"slug":"an-efficient-attention-mechanism-for","title":"An Efficient Attention Mechanism for Sequential Recommendation Tasks: HydraRec","date":"2025-01-02","arxiv_id":"2501.01242","n_code_links":0,"syntology":null},{"paper":null,"slug":"mixture-of-neural-fields-for-heterogeneous","title":"Mixture of neural fields for heterogeneous reconstruction in cryo-EM","date":"2024-12-12","arxiv_id":"2412.09420","n_code_links":0,"syntology":null},{"paper":"/paper/sinetra-a-versatile-framework-for-evaluating","slug":"sinetra-a-versatile-framework-for-evaluating","title":"SINETRA: a Versatile Framework for Evaluating Single Neuron Tracking in Behaving Animals","date":"2024-11-14","arxiv_id":"2411.09462","n_code_links":1,"syntology":null},{"paper":null,"slug":"rethinking-positive-pairs-in-contrastive","title":"Rethinking Positive Pairs in Contrastive Learning","date":"2024-10-23","arxiv_id":"2410.18200","n_code_links":0,"syntology":null},{"paper":null,"slug":"hydra-sgg-hybrid-relation-assignment-for-one","title":"Hydra-SGG: Hybrid Relation Assignment for One-stage Scene Graph Generation","date":"2024-09-16","arxiv_id":"2409.10262","n_code_links":0,"syntology":null},{"paper":null,"slug":"hydra-hybrid-data-multiplexing-and-run-time","title":"HYDRA: Hybrid Data Multiplexing and Run-time Layer Configurable DNN Accelerator","date":"2024-09-08","arxiv_id":"2409.04976","n_code_links":0,"syntology":null},{"paper":"/paper/trans-tokenization-and-cross-lingual","slug":"trans-tokenization-and-cross-lingual","title":"Trans-Tokenization and Cross-lingual Vocabulary Transfers: Language Adaptation of LLMs for Low-Resource NLP","date":"2024-08-08","arxiv_id":"2408.04303","n_code_links":1,"syntology":{"ran":0,"of":1,"n_ran_checked":0,"n_instrument":0,"unverified":1,"pointer_only":0,"phrase":"0 ran · 1 unverified","official":{"repos":["lagom-nlp/transtokenizer"],"state":"official: harvested, nothing ran","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":1,"ran_from_kinds":[]}}},{"paper":null,"slug":"genrec-a-flexible-data-generator-for","title":"Flexible Generation of Preference Data for Recommendation Analysis","date":"2024-07-23","arxiv_id":"2407.16594","n_code_links":0,"syntology":null},{"paper":"/paper/hydra-bidirectional-state-space-models","slug":"hydra-bidirectional-state-space-models","title":"Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers","date":"2024-07-13","arxiv_id":"2407.09941","n_code_links":1,"syntology":{"ran":9,"of":10,"n_ran_checked":3,"n_instrument":6,"unverified":1,"pointer_only":1,"phrase":"9 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 6 where Syntology's instrument failed) · 1 unverified","official":{"repos":["goombalab/hydra"],"state":"official (archive's flag): 9 ran","n_ran":9,"n_constructed":0,"n_ran_no_instrument_failure":3,"n_unverified":1,"ran_from_kinds":["official"]}}},{"paper":"/paper/m3leo-a-multi-modal-multi-label-earth","slug":"m3leo-a-multi-modal-multi-label-earth","title":"M3LEO: A Multi-Modal, Multi-Label Earth Observation Dataset Integrating Interferometric SAR and Multispectral Data","date":"2024-06-06","arxiv_id":"2406.04230","n_code_links":1,"syntology":null},{"paper":"/paper/hydra-model-factorization-framework-for-black","slug":"hydra-model-factorization-framework-for-black","title":"HYDRA: Model Factorization Framework for Black-Box LLM Personalization","date":"2024-06-05","arxiv_id":"2406.02888","n_code_links":1,"syntology":{"ran":16,"of":16,"n_ran_checked":4,"n_instrument":12,"unverified":0,"pointer_only":16,"phrase":"16 ran (of which 2 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 12 where Syntology's instrument failed) · 0 unverified","official":{"repos":["night-chen/hydra"],"state":"official (archive's flag): 16 ran","n_ran":16,"n_constructed":2,"n_ran_no_instrument_failure":4,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"anyfit-controllable-virtual-try-on-for-any","title":"AnyFit: Controllable Virtual Try-on for Any Combination of Attire Across Any Scenario","date":"2024-05-28","arxiv_id":"2405.18172","n_code_links":0,"syntology":null},{"paper":"/paper/pytorch-ie-fast-and-reproducible-prototyping","slug":"pytorch-ie-fast-and-reproducible-prototyping","title":"PyTorch-IE: Fast and Reproducible Prototyping for Information Extraction","date":"2024-05-16","arxiv_id":"2406.00007","n_code_links":1,"syntology":null},{"paper":"/paper/unleashing-hydra-hybrid-fusion-depth","slug":"unleashing-hydra-hybrid-fusion-depth","title":"Unleashing HyDRa: Hybrid Fusion, Depth Consistency and Radar for Unified 3D Perception","date":"2024-03-12","arxiv_id":"2403.07746","n_code_links":1,"syntology":null},{"paper":null,"slug":"hydra-computer-vision-for-data-quality","title":"Hydra: Computer Vision for Data Quality Monitoring","date":"2024-03-01","arxiv_id":"2403.00689","n_code_links":0,"syntology":null},{"paper":"/paper/hydra-sequentially-dependent-draft-heads-for","slug":"hydra-sequentially-dependent-draft-heads-for","title":"Hydra: Sequentially-Dependent Draft Heads for Medusa Decoding","date":"2024-02-07","arxiv_id":"2402.05109","n_code_links":1,"syntology":{"ran":8,"of":10,"n_ran_checked":5,"n_instrument":3,"unverified":2,"pointer_only":4,"phrase":"8 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 1 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified","official":{"repos":["zankner/hydra"],"state":"official (archive's flag): 8 ran","n_ran":8,"n_constructed":0,"n_ran_no_instrument_failure":5,"n_unverified":2,"ran_from_kinds":["official"]}}},{"paper":"/paper/newsreclib-a-pytorch-lightning-library-for","slug":"newsreclib-a-pytorch-lightning-library-for","title":"NewsRecLib: A PyTorch-Lightning Library for Neural News Recommendation","date":"2023-10-02","arxiv_id":"2310.01146","n_code_links":1,"syntology":{"ran":4,"of":4,"n_ran_checked":4,"n_instrument":0,"unverified":0,"pointer_only":0,"phrase":"4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","official":{"repos":["andreeaiana/newsreclib"],"state":"official (archive's flag): 4 ran","n_ran":4,"n_constructed":0,"n_ran_no_instrument_failure":4,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":"/paper/hydra-multi-head-low-rank-adaptation-for","slug":"hydra-multi-head-low-rank-adaptation-for","title":"Hydra: Multi-head Low-rank Adaptation for Parameter Efficient Fine-tuning","date":"2023-09-13","arxiv_id":"2309.06922","n_code_links":1,"syntology":null},{"paper":null,"slug":"the-hydra-effect-emergent-self-repair-in","title":"The Hydra Effect: Emergent Self-repair in Language Model Computations","date":"2023-07-28","arxiv_id":"2307.15771","n_code_links":0,"syntology":null},{"paper":null,"slug":"orthogonal-view-microscope-for-the","title":"Orthogonal-view Microscope for the Biomechanics Investigations of Aquatic Organisms","date":"2023-07-24","arxiv_id":"2307.13079","n_code_links":0,"syntology":null},{"paper":"/paper/regulas-a-bioinformatics-tool-for-the","slug":"regulas-a-bioinformatics-tool-for-the","title":"regulAS: A Bioinformatics Tool for the Integrative Analysis of Alternative Splicing Regulome using RNA-Seq data","date":"2023-07-17","arxiv_id":"2307.08800","n_code_links":1,"syntology":null},{"paper":null,"slug":"non-bilaterians-as-model-systems-for-tissue","title":"Non-bilaterians as Model Systems for Tissue Mechanics","date":"2023-06-02","arxiv_id":"2306.01935","n_code_links":0,"syntology":null},{"paper":null,"slug":"efficient-domain-adaptation-for-speech","title":"Efficient Domain Adaptation for Speech Foundation Models","date":"2023-02-03","arxiv_id":"2302.01496","n_code_links":0,"syntology":null},{"paper":"/paper/schnetpack-2-0-a-neural-network-toolbox-for","slug":"schnetpack-2-0-a-neural-network-toolbox-for","title":"SchNetPack 2.0: A neural network toolbox for atomistic machine learning","date":"2022-12-11","arxiv_id":"2212.05517","n_code_links":2,"syntology":{"ran":4,"of":4,"n_ran_checked":4,"n_instrument":0,"unverified":0,"pointer_only":0,"phrase":"4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","official":{"repos":["atomistic-machine-learning/schnetpack","atomistic-machine-learning/schnetpack-gschnet"],"state":"official (archive's flag): 4 ran","n_ran":4,"n_constructed":0,"n_ran_no_instrument_failure":4,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"hydra-attention-efficient-attention-with-many","title":"Hydra Attention: Efficient Attention with Many Heads","date":"2022-09-15","arxiv_id":"2209.07484","n_code_links":0,"syntology":null},{"paper":null,"slug":"hydra-hybrid-server-power-model","title":"Hydra: Hybrid Server Power Model","date":"2022-07-20","arxiv_id":"2207.10217","n_code_links":0,"syntology":null},{"paper":"/paper/hydra-a-system-for-large-multi-model-deep","slug":"hydra-a-system-for-large-multi-model-deep","title":"Hydra: A System for Large Multi-Model Deep Learning","date":"2021-10-16","arxiv_id":"2110.08633","n_code_links":1,"syntology":null},{"paper":null,"slug":"model-parallel-model-selection-for-deep","title":"Model-Parallel Model Selection for Deep Learning Systems","date":"2021-07-14","arxiv_id":"2107.06469","n_code_links":0,"syntology":null},{"paper":"/paper/hydra-preserving-ensemble-diversity-for-model-1","slug":"hydra-preserving-ensemble-diversity-for-model-1","title":"Hydra: Preserving Ensemble Diversity for Model Distillation","date":"2020-01-14","arxiv_id":"2001.04694","n_code_links":1,"syntology":{"ran":3,"of":3,"n_ran_checked":1,"n_instrument":2,"unverified":0,"pointer_only":3,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified","official":null}}],"papers_shown":34,"papers_order":"date (newest first), then slug","paper_counts":{"archive_papers_tagged":34,"with_a_code_link":16,"where_syntology_ran_a_sample":6,"not_listed_spam_title":0,"listed":34,"listed_where_code_ran":6,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":6,"every_run_a_failure_of_syntologys_instrument":0,"listed_with_a_run_with_no_instrument_failure":6,"listed_every_run_a_failure_of_syntologys_instrument":0,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"papers_where_code_ran":6,"papers_where_code_ran_first_page":"/method/hydra/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not isolate this method inside it.","pages":[{"order":"ran","page":1,"of":1,"url":"/method/hydra/papers/ran/1","json":"/method/hydra/papers/ran/1.json","rows":6}],"tasks":[{"task":"/task/language-modelling","name":"Language Modelling","papers":4},{"task":"/task/recommendation-systems","name":"Recommendation Systems","papers":4},{"task":"/task/model","name":"model","papers":4},{"task":"/task/benchmarking","name":"Benchmarking","papers":3},{"task":"/task/language-modeling","name":"Language Modeling","papers":3},{"task":"/task/mamba","name":"Mamba","papers":3},{"task":"/task/deep-learning","name":"Deep Learning","papers":2},{"task":"/task/model-selection","name":"Model Selection","papers":2},{"task":"/task/scheduling","name":"Scheduling","papers":2},{"task":"/task/sequential-recommendation","name":"Sequential Recommendation","papers":2},{"task":"/task/transfer-learning","name":"Transfer Learning","papers":2},{"task":"/task/3d-multi-object-tracking","name":"3D Multi-Object Tracking","papers":1},{"task":"/task/3d-object-detection","name":"3D Object Detection","papers":1},{"task":"/task/3d-object-detection-roi","name":"3D Object Detection (RoI)","papers":1},{"task":"/task/3d-reconstruction","name":"3D Reconstruction","papers":1},{"task":"/task/3d-semantic-occupancy-prediction","name":"3D Semantic Occupancy Prediction","papers":1},{"task":"/task/adversarial-attack","name":"Adversarial Attack","papers":1},{"task":"/task/adversarial-defense","name":"Adversarial Defense","papers":1},{"task":"/task/adversarial-robustness","name":"Adversarial Robustness","papers":1},{"task":"/task/anomaly-detection","name":"Anomaly Detection","papers":1}],"tasks_shown":20,"n_tasks":51,"usage_by_year":[{"year":"2020","papers":1},{"year":"2021","papers":2},{"year":"2022","papers":3},{"year":"2023","papers":7},{"year":"2024","papers":15},{"year":"2025","papers":6}],"row_source":"embedded","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/hydra"},"syntology_read_at":"2026-10-05T00:36:11+00:00","syntology":{"source":"Syntology's have check for this name (the free coverage lookup), read from Syntology's graph","have_url":"https://syntology.ai/api/graph/have?x=Hydra","read_at":"2026-10-05T00:57:39+00:00","query":"Hydra","kind":"method","have":"declared_code","tier":"repo_known","verified_implementation":false,"level":null,"level_meaning":"the served verification level, per answer; never summed across methods","resolved_to":{"method":"Hydra","origin_arxiv_id":"2001.04694"},"resolution":"exact","resolved_name_differs":false,"absence_asserted":false,"absence_unchecked":null,"no_code_is_about_this_method":false,"subject":"unknown","archive_paper_arxiv_id":null,"repositories":{"listed":2,"in_graph":2,"list_truncated":false,"strongest_link":"mentioned_in_github"},"retrieve_with":null,"name_competition":{"verdict":"outranked","may_be_wrong_sense":true,"bearers_found":8,"served":{"arxiv_id":"2001.04694","citations":66},"leading_other_bearer":{"arxiv_id":"2201.13360","title":"Hydra: A Real-time Spatial Perception System for 3D Scene Graph Construction and Optimization","citations":343,"named_by":["title_prefix"],"bearer_name":"Hydra: A Real-time Spatial Perception System for 3D Scene Graph Construction and Optimization","ask_with":"have('2201.13360')"},"n_other_bearers_listed":5,"note":"'Hydra' is ALSO the name of the paper 'Hydra: A Real-time Spatial Perception System for 3D Scene Graph Construction and Optimization' (arXiv:2201.13360, 343 citations), which is cited FAR more than the paper this answer is about (66). This answer may be about the wrong Hydra. If you meant the better-known one, ask again with that entry of `also_named`."},"name_competition_text":"The same name also belongs to the paper “Hydra: A Real-time Spatial Perception System for 3D Scene Graph Construction and Optimization” (arXiv:2201.13360, 343 citations), which the lookup finds cited far more than the paper this answer is about (66 citations), so this answer may be about a different sense of the name.","near_matches":null,"code_nearby":[],"code_nearby_caption":null,"origin_paper":{"arxiv_id":"2001.04694","page":"/paper/hydra-preserving-ensemble-diversity-for-model-1","syntology_url":"https://syntology.ai/paper/2001.04694","in_graph_layer":true,"samples":3,"ran":3,"n_ran_checked":1,"n_instrument":2,"unverified":0,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified","instrument_means":"failures of Syntology's instrument, not of the code"},"line":"repository known, no verified implementation (declared_code; repositories: 2 listed of 2 in the graph, strongest link: mentioned on GitHub). The archive credits no paper with an arXiv id for this method, so whether this answer (about arXiv:2001.04694) is about this method is not checked.","level_legend":null},"syntology_have_state":"loaded","record_sha256":"2fcda04049c48594a60b14181180a42a26932eef91f70a9d84cec61fd0925bfe","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}