{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/method/neural-turing-machine","slug":"neural-turing-machine","name":"Neural Turing Machine","full_name":"Neural Turing Machine","full_name_withheld":false,"description_markdown":"A **Neural Turing Machine** is a working memory neural network model. It couples a neural network architecture with external memory resources. The whole architecture is differentiable end-to-end with gradient descent. The models can infer tasks such as copying, sorting and associative recall.\r\n\r\nA Neural Turing Machine (NTM) architecture contains two basic components: a neural\r\nnetwork controller and a memory bank. The Figure presents a high-level diagram of the NTM\r\narchitecture. Like most neural networks, the controller interacts with the external world via\r\ninput and output vectors. Unlike a standard network, it also interacts with a memory matrix\r\nusing selective read and write operations. By analogy to the Turing machine we refer to the\r\nnetwork outputs that parameterise these operations as “heads.”\r\n\r\nEvery component of the architecture is differentiable. This is achieved by defining 'blurry' read and write operations that interact to a greater or lesser degree with all the elements in memory (rather\r\nthan addressing a single element, as in a normal Turing machine or digital computer). The\r\ndegree of blurriness is determined by an attentional “focus” mechanism that constrains each\r\nread and write operation to interact with a small portion of the memory, while ignoring the\r\nrest. Because interaction with the memory is highly sparse, the NTM is biased towards\r\nstoring data without interference. The memory location brought into attentional focus is\r\ndetermined by specialised outputs emitted by the heads. These outputs define a normalised\r\nweighting over the rows in the memory matrix (referred to as memory “locations”). Each\r\nweighting, one per read or write head, defines the degree to which the head reads or writes\r\nat each location. A head can thereby attend sharply to the memory at a single location or\r\nweakly to the memory at many locations","description_state":"present","introduced_year":null,"introduced_by":{"title":"Neural Turing Machines","paper":"/paper/neural-turing-machines","first_author":"Alex Graves","n_authors":3,"url_abs":null,"archive_paper_url":"https://paperswithcode.com/paper/neural-turing-machines"},"source":{"url":"http://arxiv.org/abs/1410.5401v2","title":"Neural Turing Machines","url_on_a_paper_host":true},"code_snippet_url":"https://github.com/carpedm20/NTM-tensorflow","code_snippet_url_on_a_code_host":true,"categories":[{"area":"Sequential","area_id":"sequential","collection":"Recurrent Neural Networks","url":"/methods/category/recurrent-neural-networks","pwc_aliases":[]},{"area":"General","area_id":"general","collection":"Working Memory Models","url":"/methods/category/working-memory-models","pwc_aliases":[]}],"n_papers_tagged":22,"archive_num_papers":22,"papers_newest_first":[{"paper":null,"slug":"intelligent-dos-and-ddos-detection-a-hybrid","title":"Intelligent DoS and DDoS Detection: A Hybrid GRU-NTM Approach to Network Security","date":"2025-04-10","arxiv_id":"2504.07478","n_code_links":0,"syntology":null},{"paper":"/paper/memory-augmented-conformer-for-improved-end","slug":"memory-augmented-conformer-for-improved-end","title":"Memory-augmented conformer for improved end-to-end long-form ASR","date":"2023-09-22","arxiv_id":"2309.13029","n_code_links":1,"syntology":null},{"paper":null,"slug":"fashionntm-multi-turn-fashion-image-retrieval","title":"FashionNTM: Multi-turn Fashion Image Retrieval via Cascaded Memory","date":"2023-08-20","arxiv_id":"2308.10170","n_code_links":0,"syntology":null},{"paper":"/paper/token-turing-machines","slug":"token-turing-machines","title":"Token Turing Machines","date":"2022-11-16","arxiv_id":"2211.09119","n_code_links":1,"syntology":null},{"paper":null,"slug":"unsupervised-speaker-adaptation-using","title":"Unsupervised Speaker Adaptation using Attention-based Speaker Memory for End-to-End ASR","date":"2020-02-14","arxiv_id":"2002.06165","n_code_links":0,"syntology":null},{"paper":null,"slug":"memory-augmented-recurrent-networks-for","title":"Memory-Augmented Recurrent Networks for Dialogue Coherence","date":"2019-10-16","arxiv_id":"1910.10487","n_code_links":0,"syntology":null},{"paper":null,"slug":"a-neural-turingmachine-for-conditional","title":"A Neural Turing~Machine for Conditional Transition Graph Modeling","date":"2019-07-15","arxiv_id":"1907.06432","n_code_links":0,"syntology":null},{"paper":null,"slug":"understanding-memory-modules-on-learning","title":"Understanding Memory Modules on Learning Simple Algorithms","date":"2019-07-01","arxiv_id":"1907.00820","n_code_links":0,"syntology":null},{"paper":null,"slug":"a-review-on-neural-turing-machine","title":"A review on Neural Turing Machine","date":"2019-04-10","arxiv_id":"1904.05061","n_code_links":0,"syntology":null},{"paper":"/paper/few-shot-generalization-across-dialogue-tasks","slug":"few-shot-generalization-across-dialogue-tasks","title":"Few-Shot Generalization Across Dialogue Tasks","date":"2018-11-28","arxiv_id":"1811.11707","n_code_links":2,"syntology":null},{"paper":null,"slug":"context-aware-neural-model-for-temporal","title":"Context-Aware Neural Model for Temporal Information Extraction","date":"2018-07-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"a-taxonomy-for-neural-memory-networks","title":"A Taxonomy for Neural Memory Networks","date":"2018-05-01","arxiv_id":"1805.00327","n_code_links":0,"syntology":null},{"paper":null,"slug":"meta-learning-via-feature-label-memory","title":"Meta-Learning via Feature-Label Memory Network","date":"2017-10-19","arxiv_id":"1710.07110","n_code_links":0,"syntology":null},{"paper":null,"slug":"attention-set-based-metric-learning-for-video","title":"Attention-Set based Metric Learning for Video Face Recognition","date":"2017-04-12","arxiv_id":"1704.03805","n_code_links":0,"syntology":null},{"paper":"/paper/tracking-the-world-state-with-recurrent","slug":"tracking-the-world-state-with-recurrent","title":"Tracking the World State with Recurrent Entity Networks","date":"2016-12-12","arxiv_id":"1612.03969","n_code_links":5,"syntology":{"ran":0,"of":3,"n_ran_checked":0,"n_instrument":0,"unverified":3,"pointer_only":0,"phrase":"0 ran · 3 unverified","official":{"repos":["facebook/MemNN"],"state":"official: not harvested","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":[]}}},{"paper":null,"slug":"neural-turing-machines-convergence-of-copy","title":"Neural Turing Machines: Convergence of Copy Tasks","date":"2016-12-07","arxiv_id":"1612.02336","n_code_links":0,"syntology":null},{"paper":"/paper/dynamic-neural-turing-machine-with-soft-and","slug":"dynamic-neural-turing-machine-with-soft-and","title":"Dynamic Neural Turing Machine with Soft and Hard Addressing Schemes","date":"2016-06-30","arxiv_id":"1607.00036","n_code_links":0,"syntology":null},{"paper":null,"slug":"lie-access-neural-turing-machine","title":"Lie Access Neural Turing Machine","date":"2016-02-28","arxiv_id":"1602.08671","n_code_links":0,"syntology":null},{"paper":null,"slug":"empirical-study-on-deep-learning-models-for","title":"Empirical Study on Deep Learning Models for Question Answering","date":"2015-10-26","arxiv_id":"1510.07526","n_code_links":0,"syntology":null},{"paper":null,"slug":"a-deep-memory-based-architecture-for-sequence","title":"A Deep Memory-based Architecture for Sequence-to-Sequence Learning","date":"2015-06-22","arxiv_id":"1506.06442","n_code_links":0,"syntology":null},{"paper":"/paper/reinforcement-learning-neural-turing-machines","slug":"reinforcement-learning-neural-turing-machines","title":"Reinforcement Learning Neural Turing Machines - Revised","date":"2015-05-04","arxiv_id":"1505.00521","n_code_links":1,"syntology":null},{"paper":"/paper/neural-turing-machines","slug":"neural-turing-machines","title":"Neural Turing Machines","date":"2014-10-20","arxiv_id":"1410.5401","n_code_links":34,"syntology":{"ran":5,"of":8,"n_ran_checked":4,"n_instrument":1,"unverified":3,"pointer_only":2,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 2 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified","official":null}}],"papers_shown":22,"papers_order":"date (newest first), then slug","paper_counts":{"archive_papers_tagged":22,"with_a_code_link":6,"where_syntology_ran_a_sample":1,"not_listed_spam_title":0,"listed":22,"listed_where_code_ran":1,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":1,"every_run_a_failure_of_syntologys_instrument":0,"listed_with_a_run_with_no_instrument_failure":1,"listed_every_run_a_failure_of_syntologys_instrument":0,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"papers_where_code_ran":1,"papers_where_code_ran_first_page":"/method/neural-turing-machine/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not isolate this method inside it.","pages":[{"order":"ran","page":1,"of":1,"url":"/method/neural-turing-machine/papers/ran/1","json":"/method/neural-turing-machine/papers/ran/1.json","rows":1}],"tasks":[{"task":"/task/question-answering","name":"Question Answering","papers":4},{"task":"/task/automatic-speech-recognition-2","name":"Automatic Speech Recognition","papers":2},{"task":"/task/automatic-speech-recognition","name":"Automatic Speech Recognition (ASR)","papers":2},{"task":"/task/machine-learning","name":"BIG-bench Machine Learning","papers":2},{"task":"/task/decoder","name":"Decoder","papers":2},{"task":"/task/information-retrieval","name":"Information Retrieval","papers":2},{"task":"/task/machine-translation","name":"Machine Translation","papers":2},{"task":"/task/retrieval","name":"Retrieval","papers":2},{"task":"/task/speech-recognition","name":"Speech Recognition","papers":2},{"task":"/task/translation","name":"Translation","papers":2},{"task":"/task/speech-recognition-1","name":"speech-recognition","papers":2},{"task":"/task/action-detection","name":"Action Detection","papers":1},{"task":"/task/activity-detection","name":"Activity Detection","papers":1},{"task":"/task/deep-learning","name":"Deep Learning","papers":1},{"task":"/task/dimensionality-reduction","name":"Dimensionality Reduction","papers":1},{"task":"/task/face-recognition","name":"Face Recognition","papers":1},{"task":"/task/form","name":"Form","papers":1},{"task":"/task/image-retrieval","name":"Image Retrieval","papers":1},{"task":"/task/intrusion-detection","name":"Intrusion Detection","papers":1},{"task":"/task/knowledge-graphs","name":"Knowledge Graphs","papers":1}],"tasks_shown":20,"n_tasks":32,"usage_by_year":[{"year":"2014","papers":1},{"year":"2015","papers":3},{"year":"2016","papers":4},{"year":"2017","papers":2},{"year":"2018","papers":3},{"year":"2019","papers":4},{"year":"2020","papers":1},{"year":"2022","papers":1},{"year":"2023","papers":2},{"year":"2025","papers":1}],"row_source":"methods_table","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/neural-turing-machine"},"syntology_read_at":"2026-10-05T00:36:11+00:00","syntology":{"source":"Syntology's have check for this name (the free coverage lookup), read from Syntology's graph","have_url":"https://syntology.ai/api/graph/have?x=Neural%20Turing%20Machine","read_at":"2026-10-05T00:59:36+00:00","query":"Neural Turing Machine","kind":"method","have":"unknown_name","tier":null,"verified_implementation":null,"level":null,"level_meaning":"the served verification level, per answer; never summed across methods","resolved_to":null,"resolution":null,"resolved_name_differs":false,"absence_asserted":false,"absence_unchecked":null,"no_code_is_about_this_method":false,"subject":null,"archive_paper_arxiv_id":"1410.5401","repositories":null,"retrieve_with":null,"name_competition":{"verdict":"none","may_be_wrong_sense":false,"bearers_found":0,"served":null,"leading_other_bearer":null,"n_other_bearers_listed":0,"note":"Nothing in this corpus is named 'Neural Turing Machine' -- no method node, no paper announcing it in its title, no expanded form declaring it as an acronym."},"name_competition_text":null,"near_matches":["deterministic multi-tape Turing machine","Turing machine with neural units (TMNU)","measure of undecidability of problems unsolvable by Turing machines","TURING","Turing-RL","World Machine","Graph Machine","Graph Machine"],"code_nearby":[],"code_nearby_caption":null,"origin_paper":null,"line":"name not resolved (unknown_name). The lookup matched no method, paper or venue by this name; that asserts nothing about whether code exists.","level_legend":null},"syntology_have_state":"loaded","record_sha256":"9a0d645ff61b79ca69f3274d972d4bc648c2dd7629b82d2e1ba75c6574f658f2","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}