{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/conditional-variance-penalties-and-domain","title":"Conditional Variance Penalties and Domain Shift Robustness","arxiv_id":"1710.11469","date":"2017-10-31","proceeding":null,"authors":["Christina Heinze-Deml","Nicolai Meinshausen"],"abstract":"When training a deep neural network for image classification, one can broadly\ndistinguish between two types of latent features of images that will drive the\nclassification. We can divide latent features into (i) \"core\" or \"conditionally\ninvariant\" features $X^\\text{core}$ whose distribution $X^\\text{core}\\vert Y$,\nconditional on the class $Y$, does not change substantially across domains and\n(ii) \"style\" features $X^{\\text{style}}$ whose distribution $X^{\\text{style}}\n\\vert Y$ can change substantially across domains. Examples for style features\ninclude position, rotation, image quality or brightness but also more complex\nones like hair color, image quality or posture for images of persons. Our goal\nis to minimize a loss that is robust under changes in the distribution of these\nstyle features. In contrast to previous work, we assume that the domain itself\nis not observed and hence a latent variable.\n  We do assume that we can sometimes observe a typically discrete identifier or\n\"$\\mathrm{ID}$ variable\". In some applications we know, for example, that two\nimages show the same person, and $\\mathrm{ID}$ then refers to the identity of\nthe person. The proposed method requires only a small fraction of images to\nhave $\\mathrm{ID}$ information. We group observations if they share the same\nclass and identifier $(Y,\\mathrm{ID})=(y,\\mathrm{id})$ and penalize the\nconditional variance of the prediction or the loss if we condition on\n$(Y,\\mathrm{ID})$. Using a causal framework, this conditional variance\nregularization (CoRe) is shown to protect asymptotically against shifts in the\ndistribution of the style variables. Empirically, we show that the CoRe penalty\nimproves predictive accuracy substantially in settings where domain changes\noccur in terms of image quality, brightness and color while we also look at\nmore complex changes such as changes in movement and posture.","url_abs":"http://arxiv.org/abs/1710.11469v5","url_pdf":"http://arxiv.org/pdf/1710.11469v5.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"conditional-variance-penalties-and-domain","repo_url":"https://github.com/christinaheinze/core","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok"}}],"tasks":[{"task_slug":"classification","task_name":"General Classification"},{"task_slug":"image-classification","task_name":"Image Classification"},{"task_slug":"image-classification","task_name":"image-classification"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1710.11469","atlas_url":"https://app.syntology.ai/?focus=1710.11469","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1710.11469"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1710.11469\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1710.11469"},"call":"get_concepts_for_paper(arxiv_id=\"1710.11469\")"}],"by_repo":[{"repo":"christinaheinze/core","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"9c8ec17cdab115f21a8e0af346d5ce0a5c7b7697957be672f1ef75925a62befe","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}