{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/revisiting-modulated-convolutions-for-visual","title":"MoVie: Revisiting Modulated Convolutions for Visual Counting and Beyond","arxiv_id":"2004.11883","date":"2020-04-24","proceeding":"ICLR 2021 1","authors":["Duy-Kien Nguyen","Vedanuj Goswami","Xinlei Chen"],"abstract":"This paper focuses on visual counting, which aims to predict the number of occurrences given a natural image and a query (e.g. a question or a category). Unlike most prior works that use explicit, symbolic models which can be computationally expensive and limited in generalization, we propose a simple and effective alternative by revisiting modulated convolutions that fuse the query and the image locally. Following the design of residual bottleneck, we call our method MoVie, short for Modulated conVolutional bottlenecks. Notably, MoVie reasons implicitly and holistically and only needs a single forward-pass during inference. Nevertheless, MoVie showcases strong performance for counting: 1) advancing the state-of-the-art on counting-specific VQA tasks while being more efficient; 2) outperforming prior-art on difficult benchmarks like COCO for common object counting; 3) helped us secure the first place of 2020 VQA challenge when integrated as a module for 'number' related questions in generic VQA models. Finally, we show evidence that modulated convolutions such as MoVie can serve as a general mechanism for reasoning tasks beyond counting.","url_abs":"https://arxiv.org/abs/2004.11883v3","url_pdf":"https://arxiv.org/pdf/2004.11883v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"revisiting-modulated-convolutions-for-visual","repo_url":"https://github.com/facebookresearch/mmf/tree/master/projects/movie_mcan","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"object-counting","task_name":"Object Counting"},{"task_slug":"question-answering","task_name":"Question Answering"},{"task_slug":"visual-question-answering","task_name":"Visual Question Answering (VQA)"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/object-counting-on-howmany-qa","task":"Object Counting","dataset":"HowMany-QA","model":"MoVie-ResNeXt","rank_in_archive_order":1,"of":3,"metrics":{"Accuracy":"64","RMSE":"2.3"},"uses_additional_data":false},{"leaderboard":"/sota/object-counting-on-howmany-qa","task":"Object Counting","dataset":"HowMany-QA","model":"MoVie","rank_in_archive_order":2,"of":3,"metrics":{"Accuracy":"61.2","RMSE":"2.36"},"uses_additional_data":false},{"leaderboard":"/sota/object-counting-on-tallyqa-complex","task":"Object Counting","dataset":"TallyQA-Complex","model":"MoVie-ResNeXt","rank_in_archive_order":4,"of":6,"metrics":{"Accuracy":"56.8","RMSE":"1.43"},"uses_additional_data":false},{"leaderboard":"/sota/object-counting-on-tallyqa-complex","task":"Object Counting","dataset":"TallyQA-Complex","model":"MoVie","rank_in_archive_order":6,"of":6,"metrics":{"Accuracy":"54.1","RMSE":"1.52"},"uses_additional_data":false},{"leaderboard":"/sota/object-counting-on-tallyqa-simple","task":"Object Counting","dataset":"TallyQA-Simple","model":"MoVie-ResNeXt","rank_in_archive_order":4,"of":6,"metrics":{"Accuracy":"74.9","RMSE":"1"},"uses_additional_data":false},{"leaderboard":"/sota/object-counting-on-tallyqa-simple","task":"Object Counting","dataset":"TallyQA-Simple","model":"MoVie","rank_in_archive_order":6,"of":6,"metrics":{"Accuracy":"70.8","RMSE":"1.09"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2004.11883","atlas_url":"https://app.syntology.ai/?focus=2004.11883","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"2004.11883"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"2004.11883\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"2004.11883"},"call":"get_concepts_for_paper(arxiv_id=\"2004.11883\")"}],"by_repo":[{"repo":"facebookresearch/mmf","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"edb03f9344b85f63bfbbf7cb3e7cc385b663c5fdf85dc1178e1605dc65409754","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}