{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/a-deep-knowledge-distillation-framework-for","title":"A Deep Knowledge Distillation framework for EEG assisted enhancement of single-lead ECG based sleep staging","arxiv_id":"2112.07252","date":"2021-12-14","proceeding":null,"authors":["Vaibhav Joshi","Sricharan Vijayarangan","Preejith SP","Mohanasankar Sivaprakasam"],"abstract":"Automatic Sleep Staging study is presently done with the help of Electroencephalogram (EEG) signals. Recently, Deep Learning (DL) based approaches have enabled significant progress in this area, allowing for near-human accuracy in automated sleep staging. However, EEG based sleep staging requires an extensive as well as an expensive clinical setup. Moreover, the requirement of an expert for setup and the added inconvenience to the subject under study renders it unfavourable in a point of care context. Electrocardiogram (ECG), an unobtrusive alternative to EEG, is more suitable, but its performance, unsurprisingly, remains sub-par compared to EEG-based sleep staging. Naturally, it would be helpful to transfer knowledge from EEG to ECG, ultimately enhancing the model's performance on ECG based inputs. Knowledge Distillation (KD) is a renowned concept in DL that looks to transfer knowledge from a better but potentially more cumbersome teacher model to a compact student model. Building on this concept, we propose a cross-modal KD framework to improve ECG-based sleep staging performance with assistance from features learned through models trained on EEG. Additionally, we also conducted multiple experiments on the individual components of the proposed model to get better insight into the distillation approach. Data of 200 subjects from the Montreal Archive of Sleep Studies (MASS) was utilized for our study. The proposed model showed a 14.3\\% and 13.4\\% increase in weighted-F1-score in 4-class and 3-class sleep staging, respectively. This demonstrates the viability of KD for performance improvement of single-channel ECG based sleep staging in 4-class(W-L-D-R) and 3-class(W-N-R) classification.","url_abs":"https://arxiv.org/abs/2112.07252v2","url_pdf":"https://arxiv.org/pdf/2112.07252v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"a-deep-knowledge-distillation-framework-for","repo_url":"https://github.com/acrophase/sleep_staging_kd","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"ecg-based-sleep-staging","task_name":"ECG based Sleep Staging"},{"task_slug":"eeg-1","task_name":"EEG"},{"task_slug":"eeg-based-sleep-staging","task_name":"EEG based sleep staging"},{"task_slug":"eeg","task_name":"Electroencephalogram (EEG)"},{"task_slug":"knowledge-distillation","task_name":"Knowledge Distillation"},{"task_slug":"sleep-stage-detection","task_name":"Sleep Stage Detection"},{"task_slug":"sleep-staging","task_name":"Sleep Staging"},{"task_slug":"w-r-l-d-sleep-staging","task_name":"W-R-L-D Sleep Staging"},{"task_slug":"w-r-n-sleep-staging","task_name":"W-R-N Sleep Staging"}],"methods":[{"method_slug":"knowledge-distillation","method_name":"Knowledge Distillation"},{"method_slug":"teacher-tutor-student-knowledge-distillation","method_name":"Teacher-Tutor-Student Knowledge Distillation"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/sleep-stage-detection-on-montreal-archive-of","task":"Sleep Stage Detection","dataset":"Montreal Archive of Sleep Studies","model":"U-time EEG only (4 classes)","rank_in_archive_order":2,"of":2,"metrics":{"Accuracy":"85%"},"uses_additional_data":false},{"leaderboard":"/sota/w-r-l-d-sleep-staging-on-montreal-archive-of","task":"W-R-L-D Sleep Staging","dataset":"Montreal Archive of Sleep Studies","model":"EEG 1-ch","rank_in_archive_order":1,"of":2,"metrics":{"Weighted F1":"0.85"},"uses_additional_data":false},{"leaderboard":"/sota/w-r-l-d-sleep-staging-on-montreal-archive-of","task":"W-R-L-D Sleep Staging","dataset":"Montreal Archive of Sleep Studies","model":"ECG 1-ch after KD","rank_in_archive_order":2,"of":2,"metrics":{"Weighted F1":"0.51"},"uses_additional_data":false},{"leaderboard":"/sota/w-r-n-sleep-staging-on-montreal-archive-of","task":"W-R-N Sleep Staging","dataset":"Montreal Archive of Sleep Studies","model":"EEG 1-ch","rank_in_archive_order":1,"of":2,"metrics":{"Weighted F1":"0.90"},"uses_additional_data":false},{"leaderboard":"/sota/w-r-n-sleep-staging-on-montreal-archive-of","task":"W-R-N Sleep Staging","dataset":"Montreal Archive of Sleep Studies","model":"ECG 1-ch after KD","rank_in_archive_order":2,"of":2,"metrics":{"Weighted F1":"0.66"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2112.07252","atlas_url":"https://app.syntology.ai/?focus=2112.07252","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"2112.07252"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"2112.07252\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"2112.07252"},"call":"get_concepts_for_paper(arxiv_id=\"2112.07252\")"}],"by_repo":[{"repo":"acrophase/sleep_staging_kd","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"8d33a19b1758fbbc11c24a521386d4530d15795e5b7b6a1672c8ff68ef752774","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}