{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/variational-memory-addressing-in-generative","title":"Variational Memory Addressing in Generative Models","arxiv_id":"1709.07116","date":"2017-09-21","proceeding":"NeurIPS 2017 12","authors":["Jörg Bornschein","andriy mnih","Daniel Zoran","Danilo J. Rezende"],"abstract":"Aiming to augment generative models with external memory, we interpret the\noutput of a memory module with stochastic addressing as a conditional mixture\ndistribution, where a read operation corresponds to sampling a discrete memory\naddress and retrieving the corresponding content from memory. This perspective\nallows us to apply variational inference to memory addressing, which enables\neffective training of the memory module by using the target information to\nguide memory lookups. Stochastic addressing is particularly well-suited for\ngenerative models as it naturally encourages multimodality which is a prominent\naspect of most high-dimensional datasets. Treating the chosen address as a\nlatent variable also allows us to quantify the amount of information gained\nwith a memory lookup and measure the contribution of the memory module to the\ngenerative process. To illustrate the advantages of this approach we\nincorporate it into a variational autoencoder and apply the resulting model to\nthe task of generative few-shot learning. The intuition behind this\narchitecture is that the memory module can pick a relevant template from memory\nand the continuous part of the model can concentrate on modeling remaining\nvariations. We demonstrate empirically that our model is able to identify and\naccess the relevant memory contents even with hundreds of unseen Omniglot\ncharacters in memory","url_abs":"http://arxiv.org/abs/1709.07116v1","url_pdf":"http://arxiv.org/pdf/1709.07116v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"variational-memory-addressing-in-generative","repo_url":"https://github.com/artemZholus/variational_memory_addressing","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}}],"tasks":[{"task_slug":"few-shot-learning","task_name":"Few-Shot Learning"},{"task_slug":"representation-learning","task_name":"Representation Learning"},{"task_slug":"variational-inference","task_name":"Variational Inference"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1709.07116","atlas_url":"https://app.syntology.ai/?focus=1709.07116","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1709.07116"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1709.07116\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1709.07116"},"call":"get_concepts_for_paper(arxiv_id=\"1709.07116\")"}],"by_repo":[{"repo":"artemZholus/variational_memory_addressing","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"65ea4d8619882207aa2f165b8093a8da7d59aeb47edfa849be56beb492f726e9","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}