{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/exploring-the-syntactic-abilities-of-rnns","title":"Exploring the Syntactic Abilities of RNNs with Multi-task Learning","arxiv_id":"1706.03542","date":"2017-06-12","proceeding":"CONLL 2017 8","authors":["Emile Enguehard","Yoav Goldberg","Tal Linzen"],"abstract":"Recent work has explored the syntactic abilities of RNNs using the\nsubject-verb agreement task, which diagnoses sensitivity to sentence structure.\nRNNs performed this task well in common cases, but faltered in complex\nsentences (Linzen et al., 2016). We test whether these errors are due to\ninherent limitations of the architecture or to the relatively indirect\nsupervision provided by most agreement dependencies in a corpus. We trained a\nsingle RNN to perform both the agreement task and an additional task, either\nCCG supertagging or language modeling. Multi-task training led to significantly\nlower error rates, in particular on complex sentences, suggesting that RNNs\nhave the ability to evolve more sophisticated syntactic representations than\nshown before. We also show that easily available agreement training data can\nimprove performance on other syntactic tasks, in particular when only a limited\namount of training data is available for those tasks. The multi-task paradigm\ncan also be leveraged to inject grammatical knowledge into language models.","url_abs":"http://arxiv.org/abs/1706.03542v1","url_pdf":"http://arxiv.org/pdf/1706.03542v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"exploring-the-syntactic-abilities-of-rnns","repo_url":"https://github.com/emengd/multitask-agreement","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":null}],"tasks":[{"task_slug":"ccg-supertagging","task_name":"CCG Supertagging"},{"task_slug":"language-modeling","task_name":"Language Modeling"},{"task_slug":"language-modelling","task_name":"Language Modelling"},{"task_slug":"multi-task-learning","task_name":"Multi-Task Learning"},{"task_slug":"sentence","task_name":"Sentence"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1706.03542","atlas_url":"https://app.syntology.ai/?focus=1706.03542","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1706.03542"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1706.03542\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1706.03542"},"call":"get_concepts_for_paper(arxiv_id=\"1706.03542\")"}],"by_repo":[{"repo":"emengd/multitask-agreement","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"ac088153a37872e5f2fdf53b53927e14c8f5ca9abc0e644b233f4e74a1bf8a31","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}