{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/attention-clusters-purely-attention-based","title":"Attention Clusters: Purely Attention Based Local Feature Integration for Video Classification","arxiv_id":"1711.09550","date":"2017-11-27","proceeding":"CVPR 2018 6","authors":["Xiang Long","Chuang Gan","Gerard de Melo","Jiajun Wu","Xiao Liu","Shilei Wen"],"abstract":"Recently, substantial research effort has focused on how to apply CNNs or\nRNNs to better extract temporal patterns from videos, so as to improve the\naccuracy of video classification. In this paper, however, we show that temporal\ninformation, especially longer-term patterns, may not be necessary to achieve\ncompetitive results on common video classification datasets. We investigate the\npotential of a purely attention based local feature integration. Accounting for\nthe characteristics of such features in video classification, we propose a\nlocal feature integration framework based on attention clusters, and introduce\na shifting operation to capture more diverse signals. We carefully analyze and\ncompare the effect of different attention mechanisms, cluster sizes, and the\nuse of the shifting operation, and also investigate the combination of\nattention clusters for multimodal integration. We demonstrate the effectiveness\nof our framework on three real-world video classification datasets. Our model\nachieves competitive results across all of these. In particular, on the\nlarge-scale Kinetics dataset, our framework obtains an excellent single model\naccuracy of 79.4% in terms of the top-1 and 94.0% in terms of the top-5\naccuracy on the validation set. The attention clusters are the backbone of our\nwinner solution at ActivityNet Kinetics Challenge 2017. Code and models will be\nreleased soon.","url_abs":"http://arxiv.org/abs/1711.09550v1","url_pdf":"http://arxiv.org/pdf/1711.09550v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"attention-clusters-purely-attention-based","repo_url":"https://github.com/longxiang92/Flash-MNIST","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"attention-clusters-purely-attention-based","repo_url":"https://github.com/pomonam/AttentionCluster","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"unanswered"}},{"paper_slug":"attention-clusters-purely-attention-based","repo_url":"https://github.com/2024-MindSpore-1/Code6/tree/main/AttentionCluster","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"attention-clusters-purely-attention-based","repo_url":"https://github.com/MindSpore-paper-code-3/code6/tree/main/AttentionCluster","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"attention-clusters-purely-attention-based","repo_url":"https://github.com/mindspore-ai/models/tree/master/research/cv/AttentionCluster","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null}],"tasks":[{"task_slug":"classification-1","task_name":"Classification"},{"task_slug":"classification","task_name":"General Classification"},{"task_slug":"video-classification","task_name":"Video Classification"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1711.09550","atlas_url":"https://app.syntology.ai/?focus=1711.09550","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1711.09550"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1711.09550\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1711.09550"},"call":"get_concepts_for_paper(arxiv_id=\"1711.09550\")"}],"by_repo":[{"repo":"longxiang92/Flash-MNIST","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"pomonam/AttentionCluster","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"2024-MindSpore-1/Code6","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"MindSpore-paper-code-3/code6","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"mindspore-ai/models","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0,"harvested_for_other_papers":1,"harvested_for":["2208.08084"],"harvested_for_calls":[{"arxiv_id":"2208.08084","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"2208.08084"},"call":"get_harvested_code_for_paper(arxiv_id=\"2208.08084\")"}]}],"by_repo_harvested_for_is":"harvested_for: the arXiv ids (as Syntology's graph holds them) of every paper whose samples Syntology's graph links to this repository, in arXiv-id order, complete; the page names the first 3 and says how many more. A link only: it does not say the papers are the same work, that one copied the other, or that the code implements this paper's method; harvested_for_calls gives the get_harvested_code_for_paper call for each arXiv-shaped id among them","by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"d48dc7b17e31c350dff1449f489bc0d5b3d2c84bde132bc26f475657461050a5","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}