{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/discovering-influential-factors-in","title":"Discovering Influential Factors in Variational Autoencoder","arxiv_id":"1809.01804","date":"2018-09-06","proceeding":null,"authors":["Shiqi Liu","Jingxin Liu","Qian Zhao","Xiangyong Cao","Huibin Li","Hongy-ing Meng","Sheng Liu","Deyu Meng"],"abstract":"In the field of machine learning, it is still a critical issue to identify\nand supervise the learned representation without manually intervening or\nintuition assistance to extract useful knowledge or serve for the downstream\ntasks. In this work, we focus on supervising the influential factors extracted\nby the variational autoencoder(VAE). The VAE is proposed to learn independent\nlow dimension representation while facing the problem that sometimes pre-set\nfactors are ignored. We argue that the mutual information of the input and each\nlearned factor of the representation plays a necessary indicator of discovering\nthe influential factors. We find the VAE objective inclines to induce mutual\ninformation sparsity in factor dimension over the data intrinsic dimension and\nresults in some non-influential factors whose function on data reconstruction\ncould be ignored. We show mutual information also influences the lower bound of\nVAE's reconstruction error and downstream classification task. To make such\nindicator applicable, we design an algorithm for calculating the mutual\ninformation for VAE and prove its consistency. Experimental results on MNIST,\nCelebA and DEAP datasets show that mutual information can help determine\ninfluential factors, of which some are interpretable and can be used to further\ngeneration and classification tasks, and help discover the variant that\nconnects with emotion on DEAP dataset.","url_abs":"http://arxiv.org/abs/1809.01804v2","url_pdf":"http://arxiv.org/pdf/1809.01804v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"discovering-influential-factors-in","repo_url":"https://github.com/647LiuSQ/Discovering-influential-factors-in-variational-autoencoders","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"tf","reach":null}],"tasks":[{"task_slug":"classification","task_name":"General Classification"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers","held":null,"reason":"arxiv_id_not_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"by_repo":[{"repo":"647LiuSQ/Discovering-influential-factors-in-variational-autoencoders","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"5d0de24f4e2b0e676577e960965729d1fa44b8f17cae00cb5a06a2fd9707681c","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}