{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/method/beta-vae","slug":"beta-vae","name":"Beta-VAE","full_name":"Beta-VAE","full_name_withheld":false,"description_markdown":"**Beta-VAE** is a type of variational autoencoder that seeks to discover disentangled latent factors. It modifies [VAEs](https://paperswithcode.com/method/vae) with an adjustable hyperparameter $\\beta$ that balances latent channel capacity and independence constraints with reconstruction accuracy. The idea is to maximize the probability of generating the real data while keeping the distance between the real and estimated distributions small, under a threshold $\\epsilon$. We can use the Kuhn-Tucker conditions to write this as a single equation:\r\n\r\n$$ \\mathcal{F}\\left(\\theta, \\phi, \\beta; \\mathbf{x}, \\mathbf{z}\\right) = \\mathbb{E}\\_{q\\_{\\phi}\\left(\\mathbf{z}|\\mathbf{x}\\right)}\\left[\\log{p}\\_{\\theta}\\left(\\mathbf{x}\\mid\\mathbf{z}\\right)\\right] - \\beta\\left[D\\_{KL}\\left(\\log{q}\\_{\\theta}\\left(\\mathbf{z}\\mid\\mathbf{x}\\right)||p\\left(\\mathbf{z}\\right)\\right) - \\epsilon\\right]$$\r\n\r\nwhere the KKT multiplier $\\beta$ is the regularization coefficient that constrains the capacity of the latent channel $\\mathbf{z}$ and puts implicit independence pressure on the learnt posterior due to the isotropic nature of the Gaussian prior $p\\left(\\mathbf{z}\\right)$.\r\n\r\nWe write this again using the complementary slackness assumption to get the Beta-VAE formulation:\r\n\r\n$$ \\mathcal{F}\\left(\\theta, \\phi, \\beta; \\mathbf{x}, \\mathbf{z}\\right) \\geq  \\mathcal{L}\\left(\\theta, \\phi, \\beta; \\mathbf{x}, \\mathbf{z}\\right) = \\mathbb{E}\\_{q\\_{\\phi}\\left(\\mathbf{z}|\\mathbf{x}\\right)}\\left[\\log{p}\\_{\\theta}\\left(\\mathbf{x}\\mid\\mathbf{z}\\right)\\right] - \\beta\\{D}\\_{KL}\\left(\\log{q}\\_{\\theta}\\left(\\mathbf{z}\\mid\\mathbf{x}\\right)||p\\left(\\mathbf{z}\\right)\\right)$$","description_state":"present","introduced_year":null,"introduced_by":{"title":"beta-VAE: Learning Basic Visual Concepts with a Constrained Variational Framework","paper":"/paper/beta-vae-learning-basic-visual-concepts-with","first_author":"Irina Higgins","n_authors":8,"url_abs":null,"archive_paper_url":"https://paperswithcode.com/paper/beta-vae-learning-basic-visual-concepts-with"},"source":{"url":"https://openreview.net/forum?id=Sy2fzU9gl","title":"beta-VAE: Learning Basic Visual Concepts with a Constrained Variational Framework","url_on_a_paper_host":true},"code_snippet_url":"https://github.com/AntixK/PyTorch-VAE/blob/master/models/beta_vae.py","code_snippet_url_on_a_code_host":true,"categories":[{"area":"Computer Vision","area_id":"computer-vision","collection":"Likelihood-Based Generative Models","url":"/methods/category/likelihood-based-generative-models","pwc_aliases":[]},{"area":"Computer Vision","area_id":"computer-vision","collection":"Generative Models","url":"/methods/category/generative-models","pwc_aliases":[]}],"n_papers_tagged":30,"archive_num_papers":30,"papers_newest_first":[{"paper":null,"slug":"causal-intervention-framework-for-variational","title":"Causal Intervention Framework for Variational Auto Encoder Mechanistic Interpretability","date":"2025-05-06","arxiv_id":"2505.03530","n_code_links":0,"syntology":null},{"paper":null,"slug":"alternatives-of-unsupervised-representations","title":"Alternatives of Unsupervised Representations of Variables on the Latent Space","date":"2024-10-26","arxiv_id":"2410.20172","n_code_links":0,"syntology":null},{"paper":null,"slug":"comparison-of-autoencoder-encodings-for-ecg","title":"Comparison of Autoencoder Encodings for ECG Representation in Downstream Prediction Tasks","date":"2024-10-03","arxiv_id":"2410.02937","n_code_links":0,"syntology":null},{"paper":"/paper/lewis-s-signaling-game-as-beta-vae-for","slug":"lewis-s-signaling-game-as-beta-vae-for","title":"Lewis's Signaling Game as beta-VAE For Natural Word Lengths and Segments","date":"2023-11-08","arxiv_id":"2311.04453","n_code_links":1,"syntology":null},{"paper":null,"slug":"from-conceptual-spaces-to-quantum-concepts","title":"From Conceptual Spaces to Quantum Concepts: Formalising and Learning Structured Conceptual Models","date":"2023-11-06","arxiv_id":"2401.08585","n_code_links":0,"syntology":null},{"paper":"/paper/learning-minimal-representations-of","slug":"learning-minimal-representations-of","title":"Learning minimal representations of stochastic processes with variational autoencoders","date":"2023-07-21","arxiv_id":"2307.11608","n_code_links":1,"syntology":null},{"paper":null,"slug":"impact-of-disentanglement-on-pruning-neural","title":"Impact of Disentanglement on Pruning Neural Networks","date":"2023-07-19","arxiv_id":"2307.09994","n_code_links":0,"syntology":null},{"paper":"/paper/identification-of-rare-cortical-folding","slug":"identification-of-rare-cortical-folding","title":"Identification of Rare Cortical Folding Patterns using Unsupervised Deep Learning","date":"2022-11-29","arxiv_id":"2211.16213","n_code_links":1,"syntology":null},{"paper":null,"slug":"analysis-of-master-vein-attacks-on-finger","title":"Analysis of Master Vein Attacks on Finger Vein Recognition Systems","date":"2022-10-18","arxiv_id":"2210.10667","n_code_links":0,"syntology":null},{"paper":"/paper/topicvae-topic-aware-disentanglement","slug":"topicvae-topic-aware-disentanglement","title":"TopicVAE: Topic-aware Disentanglement Representation Learning for Enhanced Recommendation","date":"2022-10-10","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":null,"slug":"the-conceptual-vae","title":"The Conceptual VAE","date":"2022-03-21","arxiv_id":"2203.11216","n_code_links":0,"syntology":null},{"paper":null,"slug":"designing-complex-experiments-by-applying","title":"Designing Complex Experiments by Applying Unsupervised Machine Learning","date":"2021-09-29","arxiv_id":"2110.01458","n_code_links":0,"syntology":null},{"paper":"/paper/be-more-active-understanding-the-differences","slug":"be-more-active-understanding-the-differences","title":"Be More Active! Understanding the Differences between Mean and Sampled Representations of Variational Autoencoders","date":"2021-09-26","arxiv_id":"2109.12679","n_code_links":1,"syntology":null},{"paper":"/paper/finding-simplicity-unsupervised-discovery-of","slug":"finding-simplicity-unsupervised-discovery-of","title":"Finding simplicity: unsupervised discovery of features, patterns, and order parameters via shift-invariant variational autoencoders","date":"2021-06-23","arxiv_id":"2106.12472","n_code_links":1,"syntology":null},{"paper":"/paper/recovering-barabsi-albert-parameters-of","slug":"recovering-barabsi-albert-parameters-of","title":"Recovering Barabási-Albert Parameters of Graphs through Disentanglement","date":"2021-05-03","arxiv_id":"2105.00997","n_code_links":1,"syntology":null},{"paper":null,"slug":"full-encoder-make-autoencoders-learn-like-pca","title":"Learning Stable Representations with Full Encoder","date":"2021-03-25","arxiv_id":"2103.14082","n_code_links":0,"syntology":null},{"paper":"/paper/dynamic-b-vaes-for-quantifying-biodiversity","slug":"dynamic-b-vaes-for-quantifying-biodiversity","title":"Dynamic $β$-VAEs for quantifying biodiversity by clustering optically recorded insect signals","date":"2021-02-10","arxiv_id":"2102.05526","n_code_links":1,"syntology":null},{"paper":null,"slug":"unsupervised-learning-of-slow-features-for-1","title":"Autoencoding Slow Representations for Semi-supervised Data Efficient Regression","date":"2020-12-11","arxiv_id":"2012.06279","n_code_links":0,"syntology":null},{"paper":null,"slug":"ai-discovering-a-coordinate-system-of","title":"AI Discovering a Coordinate System of Chemical Elements: Dual Representation by Variational Autoencoders","date":"2020-11-24","arxiv_id":"2011.12090","n_code_links":0,"syntology":null},{"paper":null,"slug":"unsupervised-anomaly-localization-using-vae","title":"Unsupervised anomaly localization using VAE and beta-VAE","date":"2020-05-19","arxiv_id":"2005.10686","n_code_links":0,"syntology":null},{"paper":null,"slug":"ai-giving-back-to-statistics-discovery-of-the","title":"AI Giving Back to Statistics? Discovery of the Coordinate System of Univariate Distributions by Beta Variational Autoencoder","date":"2020-04-06","arxiv_id":"2004.02687","n_code_links":0,"syntology":null},{"paper":"/paper/variational-learning-with-disentanglement","slug":"variational-learning-with-disentanglement","title":"Variational Learning with Disentanglement-PyTorch","date":"2019-12-11","arxiv_id":"1912.05184","n_code_links":1,"syntology":{"ran":1,"of":1,"n_ran_checked":0,"n_instrument":1,"unverified":0,"pointer_only":1,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","official":{"repos":["amir-abdi/disentanglement-pytorch"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"information-bottleneck-through-variational","title":"Information bottleneck through variational glasses","date":"2019-12-02","arxiv_id":"1912.00830","n_code_links":0,"syntology":null},{"paper":null,"slug":"flatsomatic-a-method-for-compression-of","title":"Flatsomatic: A Method for Compression of Somatic Mutation Profiles in Cancer","date":"2019-11-27","arxiv_id":"1911.13259","n_code_links":0,"syntology":null},{"paper":null,"slug":"a-preliminary-study-of-disentanglement-with","title":"A Preliminary Study of Disentanglement With Insights on the Inadequacy of Metrics","date":"2019-11-26","arxiv_id":"1911.11791","n_code_links":0,"syntology":null},{"paper":null,"slug":"disentangling-interpretable-generative","title":"Disentangling Interpretable Generative Parameters of Random and Real-World Graphs","date":"2019-10-12","arxiv_id":"1910.05639","n_code_links":0,"syntology":null},{"paper":"/paper/ib-gan-disentangled-representation-learning","slug":"ib-gan-disentangled-representation-learning","title":"IB-GAN: Disentangled Representation Learning with Information Bottleneck GAN","date":"2019-05-01","arxiv_id":null,"n_code_links":2,"syntology":null},{"paper":null,"slug":"isa-vae-independent-subspace-analysis-with","title":"ISA-VAE: Independent Subspace Analysis with Variational Autoencoders","date":"2019-05-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"the-information-autoencoding-family-a-1","title":"The Information-Autoencoding Family: A Lagrangian Perspective on Latent Variable Generative Modeling","date":"2018-01-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":"/paper/beta-vae-learning-basic-visual-concepts-with","slug":"beta-vae-learning-basic-visual-concepts-with","title":"beta-VAE: Learning Basic Visual Concepts with a Constrained Variational Framework","date":"2017-04-26","arxiv_id":null,"n_code_links":6,"syntology":null}],"papers_shown":30,"papers_order":"date (newest first), then slug","paper_counts":{"archive_papers_tagged":30,"with_a_code_link":11,"where_syntology_ran_a_sample":1,"not_listed_spam_title":0,"listed":30,"listed_where_code_ran":1,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":0,"every_run_a_failure_of_syntologys_instrument":1,"listed_with_a_run_with_no_instrument_failure":0,"listed_every_run_a_failure_of_syntologys_instrument":1,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"papers_where_code_ran":1,"papers_where_code_ran_first_page":"/method/beta-vae/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not isolate this method inside it.","pages":[{"order":"ran","page":1,"of":1,"url":"/method/beta-vae/papers/ran/1","json":"/method/beta-vae/papers/ran/1.json","rows":1}],"tasks":[{"task":"/task/disentanglement","name":"Disentanglement","papers":14},{"task":"/task/representation-learning","name":"Representation Learning","papers":5},{"task":"/task/clustering","name":"Clustering","papers":2},{"task":"/task/data-compression","name":"Data Compression","papers":2},{"task":"/task/graph-generation","name":"Graph Generation","papers":2},{"task":"/task/variational-inference","name":"Variational Inference","papers":2},{"task":"/task/anomaly-detection","name":"Anomaly Detection","papers":1},{"task":"/task/anomaly-localization","name":"Anomaly Localization","papers":1},{"task":"/task/machine-learning","name":"BIG-bench Machine Learning","papers":1},{"task":"/task/data-visualization","name":"Data Visualization","papers":1},{"task":"/task/decoder","name":"Decoder","papers":1},{"task":"/task/deep-learning","name":"Deep Learning","papers":1},{"task":"/task/finger-vein-recognition","name":"Finger Vein Recognition","papers":1},{"task":"/task/graph-embedding","name":"Graph Embedding","papers":1},{"task":"/task/graph-neural-network","name":"Graph Neural Network","papers":1},{"task":"/task/graph-representation-learning","name":"Graph Representation Learning","papers":1},{"task":"/task/model-compression","name":"Model Compression","papers":1},{"task":"/task/novelty-detection","name":"Novelty Detection","papers":1},{"task":"/task/recommendation-systems","name":"Recommendation Systems","papers":1},{"task":"/task/scheduling","name":"Scheduling","papers":1}],"tasks_shown":20,"n_tasks":22,"usage_by_year":[{"year":"2017","papers":1},{"year":"2018","papers":1},{"year":"2019","papers":7},{"year":"2020","papers":4},{"year":"2021","papers":6},{"year":"2022","papers":4},{"year":"2023","papers":4},{"year":"2024","papers":2},{"year":"2025","papers":1}],"row_source":"methods_table","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/beta-vae"},"syntology_read_at":"2026-10-05T00:36:11+00:00","syntology":{"source":"Syntology's have check for this name (the free coverage lookup), read from Syntology's graph","have_url":"https://syntology.ai/api/graph/have?x=Beta-VAE","read_at":"2026-10-05T00:53:03+00:00","query":"Beta-VAE","kind":"method","have":"unknown_name","tier":null,"verified_implementation":null,"level":null,"level_meaning":"the served verification level, per answer; never summed across methods","resolved_to":null,"resolution":null,"resolved_name_differs":false,"absence_asserted":false,"absence_unchecked":null,"no_code_is_about_this_method":false,"subject":null,"archive_paper_arxiv_id":null,"repositories":null,"retrieve_with":null,"name_competition":{"verdict":"none","may_be_wrong_sense":false,"bearers_found":0,"served":null,"leading_other_bearer":null,"n_other_bearers_listed":0,"note":"Nothing in this corpus is named 'Beta-VAE' -- no method node, no paper announcing it in its title, no expanded form declaring it as an acronym."},"name_competition_text":null,"near_matches":["BETA","M-VAE","σ-VAE","V-VAE","λ-VAE","Q-VAE","DA-VAE","DU-VAE"],"code_nearby":[],"code_nearby_caption":null,"origin_paper":null,"line":"name not resolved (unknown_name). The lookup matched no method, paper or venue by this name; that asserts nothing about whether code exists.","level_legend":null},"syntology_have_state":"loaded","record_sha256":"c93f5c46076a4cc3445684621963ac49fd50bd5f7f1354492aa2f75364250ebc","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}