{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/excitation-backprop-for-rnns","title":"Excitation Backprop for RNNs","arxiv_id":"1711.06778","date":"2017-11-18","proceeding":"CVPR 2018 6","authors":["Sarah Adel Bargal","Andrea Zunino","Donghyun Kim","Jianming Zhang","Vittorio Murino","Stan Sclaroff"],"abstract":"Deep models are state-of-the-art for many vision tasks including video action\nrecognition and video captioning. Models are trained to caption or classify\nactivity in videos, but little is known about the evidence used to make such\ndecisions. Grounding decisions made by deep networks has been studied in\nspatial visual content, giving more insight into model predictions for images.\nHowever, such studies are relatively lacking for models of spatiotemporal\nvisual content - videos. In this work, we devise a formulation that\nsimultaneously grounds evidence in space and time, in a single pass, using\ntop-down saliency. We visualize the spatiotemporal cues that contribute to a\ndeep model's classification/captioning output using the model's internal\nrepresentation. Based on these spatiotemporal cues, we are able to localize\nsegments within a video that correspond with a specific action, or phrase from\na caption, without explicitly optimizing/training for these tasks.","url_abs":"http://arxiv.org/abs/1711.06778v3","url_pdf":"http://arxiv.org/pdf/1711.06778v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"excitation-backprop-for-rnns","repo_url":"https://github.com/sbargal/Caffe-ExcitationBP-RNNs","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":null}],"tasks":[{"task_slug":"action-recognition-in-videos","task_name":"Action Recognition"},{"task_slug":"action-recognition","task_name":"Temporal Action Localization"},{"task_slug":"video-captioning","task_name":"Video Captioning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers","held":null,"reason":"arxiv_id_not_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"by_repo":[{"repo":"sbargal/Caffe-ExcitationBP-RNNs","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"ff94bb584547015acd15bd407ddf5d0cb09ac1cf9674472e16e2a52fc1e90471","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}