{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/emotion-recognition-in-speech-using-cross","title":"Emotion Recognition in Speech using Cross-Modal Transfer in the Wild","arxiv_id":"1808.05561","date":"2018-08-16","proceeding":null,"authors":["Samuel Albanie","Arsha Nagrani","Andrea Vedaldi","Andrew Zisserman"],"abstract":"Obtaining large, human labelled speech datasets to train models for emotion\nrecognition is a notoriously challenging task, hindered by annotation cost and\nlabel ambiguity. In this work, we consider the task of learning embeddings for\nspeech classification without access to any form of labelled audio. We base our\napproach on a simple hypothesis: that the emotional content of speech\ncorrelates with the facial expression of the speaker. By exploiting this\nrelationship, we show that annotations of expression can be transferred from\nthe visual domain (faces) to the speech domain (voices) through cross-modal\ndistillation. We make the following contributions: (i) we develop a strong\nteacher network for facial emotion recognition that achieves the state of the\nart on a standard benchmark; (ii) we use the teacher to train a student, tabula\nrasa, to learn representations (embeddings) for speech emotion recognition\nwithout access to labelled audio data; and (iii) we show that the speech\nemotion embedding can be used for speech emotion recognition on external\nbenchmark datasets. Code, models and data are available.","url_abs":"http://arxiv.org/abs/1808.05561v1","url_pdf":"http://arxiv.org/pdf/1808.05561v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"emotion-recognition","task_name":"Emotion Recognition"},{"task_slug":"facial-emotion-recognition","task_name":"Facial Emotion Recognition"},{"task_slug":"facial-expression-recognition","task_name":"Facial Expression Recognition (FER)"},{"task_slug":"speech-emotion-recognition","task_name":"Speech Emotion Recognition"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/facial-expression-recognition-on-ferplus","task":"Facial Expression Recognition (FER)","dataset":"FERPlus","model":"SENet Teacher","rank_in_archive_order":3,"of":4,"metrics":{"Accuracy(pretrained)":"88.88"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/1808.05561","atlas_url":"https://app.syntology.ai/?focus=1808.05561","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1808.05561"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1808.05561\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1808.05561"},"call":"get_concepts_for_paper(arxiv_id=\"1808.05561\")"}],"by_repo":[],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":"the archive holds no code link for this paper","arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"ad294a8da4db19ebce0a6d44e01dc09d611d5a5bc943677db27539de5cbc6786","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}