{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/squared-earth-movers-distance-based-loss-for","title":"Squared Earth Mover's Distance-based Loss for Training Deep Neural Networks","arxiv_id":"1611.05916","date":"2016-11-17","proceeding":null,"authors":["Le Hou","Chen-Ping Yu","Dimitris Samaras"],"abstract":"In the context of single-label classification, despite the huge success of\ndeep learning, the commonly used cross-entropy loss function ignores the\nintricate inter-class relationships that often exist in real-life tasks such as\nage classification. In this work, we propose to leverage these relationships\nbetween classes by training deep nets with the exact squared Earth Mover's\nDistance (also known as Wasserstein distance) for single-label classification.\nThe squared EMD loss uses the predicted probabilities of all classes and\npenalizes the miss-predictions according to a ground distance matrix that\nquantifies the dissimilarities between classes. We demonstrate that on datasets\nwith strong inter-class relationships such as an ordering between classes, our\nexact squared EMD losses yield new state-of-the-art results. Furthermore, we\npropose a method to automatically learn this matrix using the CNN's own\nfeatures during training. We show that our method can learn a ground distance\nmatrix efficiently with no inter-class relationship priors and yield the same\nperformance gain. Finally, we show that our method can be generalized to\napplications that lack strong inter-class relationships and still maintain\nstate-of-the-art performance. Therefore, with limited computational overhead,\none can always deploy the proposed loss function on any dataset over the\nconventional cross-entropy.","url_abs":"http://arxiv.org/abs/1611.05916v4","url_pdf":"http://arxiv.org/pdf/1611.05916v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"squared-earth-movers-distance-based-loss-for","repo_url":"https://github.com/MilesGrey/emd","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok"}},{"paper_slug":"squared-earth-movers-distance-based-loss-for","repo_url":"https://github.com/glanceable-io/ordinal-log-loss","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}},{"paper_slug":"squared-earth-movers-distance-based-loss-for","repo_url":"https://github.com/luke321321/portfolio","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"unanswered"}}],"tasks":[{"task_slug":"age-classification","task_name":"Age Classification"},{"task_slug":"classification","task_name":"General Classification"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1611.05916","atlas_url":"https://app.syntology.ai/?focus=1611.05916","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1611.05916"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1611.05916\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1611.05916"},"call":"get_concepts_for_paper(arxiv_id=\"1611.05916\")"}],"by_repo":[{"repo":"MilesGrey/emd","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"glanceable-io/ordinal-log-loss","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"luke321321/portfolio","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"eb311020fdb2f2f3e990e04038478ea7344075ca7737bf6b1d285ee314630cdf","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}