{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/exploring-dual-model-knowledge-distillation","title":"Exploring Dual Model Knowledge Distillation for Anomaly Detection","arxiv_id":null,"date":"2023-06-27","proceeding":"Preprint 2023 6","authors":["Thomine Simon","Snoussi Hichem"],"abstract":"Unsupervised anomaly detection holds significant importance in large-scale industrial manufacturing. Recent methods have capitalized on the benefits of utilizing\r\na classifier pretrained on natural images to extract representative features from\r\nspecific layers. These extracted features are subsequently processed using various\r\ntechniques. Notably, memory bank-based methods have demonstrated exceptional accuracy; however, they often incur a trade-off in terms of latency.\r\nThis latency trade-off poses a challenge in real-time industrial applications\r\nwhere prompt anomaly detection and response are crucial. Indeed, alternative\r\napproaches such as knowledge distillation and normalized flow have demonstrated\r\npromising performance in unsupervised anomaly detection while maintaining low\r\nlatency. In this paper, we aim to revisit the concept of knowledge distillation\r\nin the context of unsupervised anomaly detection, emphasizing the significance\r\nof feature selection. By employing distinctive features and leveraging different\r\nmodels, we intend to highlight the importance of carefully selecting and utilizing relevant features specifically tailored for the task of anomaly detection. This\r\narticle introduces a novel approach based on dual model knowledge distillation\r\nfor anomaly detection. The proposed method leverages both deep and shallow\r\nlayers to incorporate various types of semantic information.","url_abs":"https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4493018","url_pdf":"https://deliverypdf.ssrn.com/delivery.php?ID=538097071083081007079106111070126005010087014021019030101042034001033016061118121089080088080005011077120091089078122092093023077093071001093031051117071028109107100027070067095007111118093007040004021110064012012098017089065101080122082097115020120067000019102078083105069026064111079115104&EXT=pdf&INDEX=TRUE","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"anomaly-detection","task_name":"Anomaly Detection"},{"task_slug":"knowledge-distillation","task_name":"Knowledge Distillation"},{"task_slug":"unsupervised-anomaly-detection","task_name":"Unsupervised Anomaly Detection"},{"task_slug":"feature-selection","task_name":"feature selection"},{"task_slug":"model","task_name":"model"}],"methods":[{"method_slug":"knowledge-distillation","method_name":"Knowledge Distillation"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/anomaly-detection-on-mvtec-ad-textures","task":"Anomaly Detection","dataset":"MVTEC AD textures","model":"DualModel","rank_in_archive_order":1,"of":4,"metrics":{"Detection AUROC":"99.94"},"uses_additional_data":false},{"leaderboard":"/sota/anomaly-detection-on-mvtec-ad","task":"Anomaly Detection","dataset":"MVTec AD","model":"DualModel","rank_in_archive_order":82,"of":148,"metrics":{"Detection AUROC":"96.2"},"uses_additional_data":false}],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers","held":null,"reason":"no_arxiv_id","checked_against":null,"by_repo":[],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":"the archive holds no code link for this paper","arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"c57a7c5f226aea93ec61d73b0da5b0189fb2ac09dce63079c53cb8633c6b4853","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}