{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/glimpse-clouds-human-activity-recognition","title":"Glimpse Clouds: Human Activity Recognition from Unstructured Feature Points","arxiv_id":"1802.07898","date":"2018-02-22","proceeding":"CVPR 2018 6","authors":["Fabien Baradel","Christian Wolf","Julien Mille","Graham W. Taylor"],"abstract":"We propose a method for human activity recognition from RGB data that does\nnot rely on any pose information during test time and does not explicitly\ncalculate pose information internally. Instead, a visual attention module\nlearns to predict glimpse sequences in each frame. These glimpses correspond to\ninterest points in the scene that are relevant to the classified activities. No\nspatial coherence is forced on the glimpse locations, which gives the module\nliberty to explore different points at each frame and better optimize the\nprocess of scrutinizing visual information. Tracking and sequentially\nintegrating this kind of unstructured data is a challenge, which we address by\nseparating the set of glimpses from a set of recurrent tracking/recognition\nworkers. These workers receive glimpses, jointly performing subsequent motion\ntracking and activity prediction. The glimpses are soft-assigned to the\nworkers, optimizing coherence of the assignments in space, time and feature\nspace using an external memory module. No hard decisions are taken, i.e. each\nglimpse point is assigned to all existing workers, albeit with different\nimportance. Our methods outperform state-of-the-art methods on the largest\nhuman activity recognition dataset available to-date; NTU RGB+D Dataset, and on\na smaller human action recognition dataset Northwestern-UCLA Multiview Action\n3D Dataset. Our code is publicly available at\nhttps://github.com/fabienbaradel/glimpse_clouds.","url_abs":"http://arxiv.org/abs/1802.07898v4","url_pdf":"http://arxiv.org/pdf/1802.07898v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"glimpse-clouds-human-activity-recognition","repo_url":"https://github.com/fabienbaradel/glimpse_clouds","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"action-recognition-in-videos","task_name":"Action Recognition"},{"task_slug":"activity-prediction","task_name":"Activity Prediction"},{"task_slug":"activity-recognition","task_name":"Activity Recognition"},{"task_slug":"human-activity-recognition","task_name":"Human Activity Recognition"},{"task_slug":"skeleton-based-action-recognition","task_name":"Skeleton Based Action Recognition"},{"task_slug":"action-recognition","task_name":"Temporal Action Localization"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/action-recognition-in-videos-on-ntu-rgbd","task":"Action Recognition","dataset":"NTU RGB+D","model":"Glimpse Clouds (RGB only)","rank_in_archive_order":26,"of":28,"metrics":{"Accuracy (CS)":"86.6","Accuracy (CV)":"93.2"},"uses_additional_data":false},{"leaderboard":"/sota/skeleton-based-action-recognition-on-n-ucla","task":"Skeleton Based Action Recognition","dataset":"N-UCLA","model":"Glimpse Clouds","rank_in_archive_order":25,"of":25,"metrics":{"Accuracy":"87.6%"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/1802.07898","atlas_url":"https://app.syntology.ai/?focus=1802.07898","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1802.07898"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1802.07898\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1802.07898"},"call":"get_concepts_for_paper(arxiv_id=\"1802.07898\")"}],"by_repo":[{"repo":"fabienbaradel/glimpse_clouds","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"d448f3f9dca98d95f952093fc3ee346e19aa59149e474d819eb167b165dda329","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}