{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/entropic-causal-inference","title":"Entropic Causal Inference","arxiv_id":"1611.04035","date":"2016-11-12","proceeding":null,"authors":["Murat Kocaoglu","Alexandros G. Dimakis","Sriram Vishwanath","Babak Hassibi"],"abstract":"We consider the problem of identifying the causal direction between two\ndiscrete random variables using observational data. Unlike previous work, we\nkeep the most general functional model but make an assumption on the unobserved\nexogenous variable: Inspired by Occam's razor, we assume that the exogenous\nvariable is simple in the true causal direction. We quantify simplicity using\nR\\'enyi entropy. Our main result is that, under natural assumptions, if the\nexogenous variable has low $H_0$ entropy (cardinality) in the true direction,\nit must have high $H_0$ entropy in the wrong direction. We establish several\nalgorithmic hardness results about estimating the minimum entropy exogenous\nvariable. We show that the problem of finding the exogenous variable with\nminimum entropy is equivalent to the problem of finding minimum joint entropy\ngiven $n$ marginal distributions, also known as minimum entropy coupling\nproblem. We propose an efficient greedy algorithm for the minimum entropy\ncoupling problem, that for $n=2$ provably finds a local optimum. This gives a\ngreedy algorithm for finding the exogenous variable with minimum $H_1$ (Shannon\nEntropy). Our greedy entropy-based causal inference algorithm has similar\nperformance to the state of the art additive noise models in real datasets. One\nadvantage of our approach is that we make no use of the values of random\nvariables but only their distributions. Our method can therefore be used for\ncausal inference for both ordinal and also categorical data, unlike additive\nnoise models.","url_abs":"http://arxiv.org/abs/1611.04035v2","url_pdf":"http://arxiv.org/pdf/1611.04035v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"entropic-causal-inference","repo_url":"https://github.com/mkocaoglu/Entropic-Causality","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"none","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"causal-inference","task_name":"Causal Inference"}],"methods":[{"method_slug":"causal-inference","method_name":"Causal inference"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1611.04035","atlas_url":"https://app.syntology.ai/?focus=1611.04035","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1611.04035"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1611.04035\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1611.04035"},"call":"get_concepts_for_paper(arxiv_id=\"1611.04035\")"}],"by_repo":[{"repo":"mkocaoglu/Entropic-Causality","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"3f492665ac7a1eca1a9cbfff7a546d6f585cb4d19061d768454c210bad42cdcb","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}