{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/the-information-sieve","title":"The Information Sieve","arxiv_id":"1507.02284","date":"2015-07-08","proceeding":null,"authors":["Greg Ver Steeg","Aram Galstyan"],"abstract":"We introduce a new framework for unsupervised learning of representations\nbased on a novel hierarchical decomposition of information. Intuitively, data\nis passed through a series of progressively fine-grained sieves. Each layer of\nthe sieve recovers a single latent factor that is maximally informative about\nmultivariate dependence in the data. The data is transformed after each pass so\nthat the remaining unexplained information trickles down to the next layer.\nUltimately, we are left with a set of latent factors explaining all the\ndependence in the original data and remainder information consisting of\nindependent noise. We present a practical implementation of this framework for\ndiscrete variables and apply it to a variety of fundamental tasks in\nunsupervised learning including independent component analysis, lossy and\nlossless compression, and predicting missing values in data.","url_abs":"http://arxiv.org/abs/1507.02284v3","url_pdf":"http://arxiv.org/pdf/1507.02284v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"the-information-sieve","repo_url":"https://github.com/gregversteeg/discrete_sieve","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"the-information-sieve","repo_url":"https://github.com/gregversteeg/LinearSieve","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":null}],"tasks":[{"task_slug":"missing-values","task_name":"Missing Values"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers","held":null,"reason":"arxiv_id_not_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"by_repo":[{"repo":"gregversteeg/discrete_sieve","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"gregversteeg/LinearSieve","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"d3ca175679307d3f62acf48fc497e050734c3f9658a8f9f6a751b24e89c1ea89","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}