{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/robotic-vision-and-multi-view-synergy-action","title":"Robotic Vision and Multi-View Synergy: Action and activity recognition in assisted living scenarios","arxiv_id":null,"date":"2024-09-01","proceeding":"10th IEEE RAS/EMBS International Conference for Biomedical Robotics and Biomechatronics (BioRob) 2024 9","authors":["Mohammad Hossein Bamorovat Abadi","Mohamad Reza Shahabian Alashti","Patrick Holthaus","Catherine Menon","Farshid Amirabdollahian"],"abstract":"The significance of Human-Robot Interaction (HRI) is increasingly evident when integrating robotics within human-centric settings. A crucial component of effective HRI is Human Activity Recognition (HAR), which is instrumental in enabling robots to respond aptly in human presence, especially within Ambient Assisted Living (AAL) environments. Since robots are generally mobile and their visual perception is often compromised by motion and noise, this paper evaluates methods by merging the robot's mobile perspective with a static viewpoint utilising multi-view deep learning models. We introduce a dual-stream Convolutional 3D (C3D) model to improve vision-based HAR accuracy for robotic applications. Utilising the Robot House Multiview (RHM) dataset, which encompasses a robotic perspective along with three static views (Front, Back, Top), we examine the efficacy of our model and conduct comparisons with the dual-stream ConvNet and Slow-Fast models. The primary objective of this study is to enhance the accuracy of robot viewpoints by integrating them with static views using dual-stream models. The metrics for evaluation include Top-1 and Top-5 accuracy. Our findings reveal that the integration of static views with robotic perspectives significantly boosts HAR accuracy in both Top-1 and Top-5 metrics across all models tested. Moreover, the proposed dual-stream C3D model demonstrates superior performance compared to the other contemporary models in our evaluations.","url_abs":"https://ieeexplore.ieee.org/abstract/document/10719749/authors#authors","url_pdf":"https://uhra.herts.ac.uk/bitstream/handle/2299/28462/BamorovatAbadi2024.pdf?sequence=1","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"robotic-vision-and-multi-view-synergy-action","repo_url":"https://github.com/Bamorovat/RHM_DualStreamC3D","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"activity-recognition","task_name":"Activity Recognition"},{"task_slug":"human-activity-recognition","task_name":"Human Activity Recognition"}],"methods":[{"method_slug":"3d-cnn","method_name":"3D CNN"},{"method_slug":"dual-stream-c3d","method_name":"Dual-Stream C3D"}],"datasets_introduced":[],"methods_introduced":[{"slug":"dual-stream-c3d","name":"Dual-Stream C3D","full_name":"Dual-Stream C3D"}],"results":[{"leaderboard":"/sota/human-activity-recognition-on-rhm","task":"Human Activity Recognition","dataset":"RHM","model":"Dual-Stream C3D","rank_in_archive_order":1,"of":4,"metrics":{"Accuracy (Top-1)":"71.06"},"uses_additional_data":false},{"leaderboard":"/sota/human-activity-recognition-on-rhm","task":"Human Activity Recognition","dataset":"RHM","model":"Dual-Stream ConvNet","rank_in_archive_order":3,"of":4,"metrics":{"Accuracy (Top-1)":"62.77"},"uses_additional_data":false},{"leaderboard":"/sota/human-activity-recognition-on-rhm","task":"Human Activity Recognition","dataset":"RHM","model":"SlowFast (101)","rank_in_archive_order":4,"of":4,"metrics":{"Accuracy (Top-1)":"45.28"},"uses_additional_data":false}],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers","held":null,"reason":"no_arxiv_id","checked_against":null,"by_repo":[{"repo":"Bamorovat/RHM_DualStreamC3D","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"7b64594d09169ff8767b5136a38b6c61b1feaacadb716035334cf59ec30146f5","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}