{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/revisiting-visual-question-answering","title":"Revisiting Visual Question Answering Baselines","arxiv_id":"1606.08390","date":"2016-06-27","proceeding":null,"authors":["Allan Jabri","Armand Joulin","Laurens van der Maaten"],"abstract":"Visual question answering (VQA) is an interesting learning setting for\nevaluating the abilities and shortcomings of current systems for image\nunderstanding. Many of the recently proposed VQA systems include attention or\nmemory mechanisms designed to support \"reasoning\". For multiple-choice VQA,\nnearly all of these systems train a multi-class classifier on image and\nquestion features to predict an answer. This paper questions the value of these\ncommon practices and develops a simple alternative model based on binary\nclassification. Instead of treating answers as competing choices, our model\nreceives the answer as input and predicts whether or not an\nimage-question-answer triplet is correct. We evaluate our model on the Visual7W\nTelling and the VQA Real Multiple Choice tasks, and find that even simple\nversions of our model perform competitively. Our best model achieves\nstate-of-the-art performance on the Visual7W Telling task and compares\nsurprisingly well with the most complex systems proposed for the VQA Real\nMultiple Choice task. We explore variants of the model and study its\ntransferability between both datasets. We also present an error analysis of our\nmodel that suggests a key problem of current VQA systems lies in the lack of\nvisual grounding of concepts that occur in the questions and answers. Overall,\nour results suggest that the performance of current VQA systems is not\nsignificantly better than that of systems designed to exploit dataset biases.","url_abs":"http://arxiv.org/abs/1606.08390v2","url_pdf":"http://arxiv.org/pdf/1606.08390v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"revisiting-visual-question-answering","repo_url":"https://github.com/Cold-Winter/vqs","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"caffe2","reach":{"status":"unanswered"}},{"paper_slug":"revisiting-visual-question-answering","repo_url":"https://github.com/arunmallya/simple-vqa","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"torch","reach":{"status":"ok"}},{"paper_slug":"revisiting-visual-question-answering","repo_url":"https://github.com/zixuwang1996/VQA-reading-list","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"unanswered"}}],"tasks":[{"task_slug":"binary-classification","task_name":"Binary Classification"},{"task_slug":"multiple-choice","task_name":"Multiple-choice"},{"task_slug":null,"task_name":"Triplet"},{"task_slug":"visual-grounding","task_name":"Visual Grounding"},{"task_slug":"visual-question-answering-1","task_name":"Visual Question Answering"},{"task_slug":"visual-question-answering","task_name":"Visual Question Answering (VQA)"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers","held":null,"reason":"arxiv_id_not_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"by_repo":[{"repo":"Cold-Winter/vqs","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"arunmallya/simple-vqa","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"zixuwang1996/VQA-reading-list","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"6a3c3f6cf975d4cf19c6ab9bb25ba9f86c081b999247530e66a05c0a595724f8","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}