{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/hierarchical-windowed-graph-attention-network","title":"Hierarchical Windowed Graph Attention Network and a Large Scale Dataset for Isolated Indian Sign Language Recognition","arxiv_id":"2407.14224","date":"2024-07-19","proceeding":null,"authors":["Suvajit Patra","Arkadip Maitra","Megha Tiwari","K. Kumaran","Swathy Prabhu","Swami Punyeshwarananda","Soumitra Samanta"],"abstract":"Automatic Sign Language (SL) recognition is an important task in the computer vision community. To build a robust SL recognition system, we need a considerable amount of data which is lacking particularly in Indian sign language (ISL). In this paper, we introduce a large-scale isolated ISL dataset and a novel SL recognition model based on skeleton graph structure. The dataset covers 2002 daily used common words in the deaf community recorded by 20 (10 male and 10 female) deaf adult signers (contains 40033 videos). We propose a SL recognition model namely Hierarchical Windowed Graph Attention Network (HWGAT) by utilizing the human upper body skeleton graph. The HWGAT tries to capture distinctive motions by giving attention to different body parts induced by the human skeleton graph. The utility of the proposed dataset and the usefulness of our model are evaluated through extensive experiments. We pre-trained the proposed model on the presented dataset and fine-tuned it across different sign language datasets further boosting the performance of 1.10, 0.46, 0.78, and 6.84 percentage points on INCLUDE, LSA64, AUTSL and WLASL respectively compared to the existing state-of-the-art keypoints-based models.","url_abs":"https://arxiv.org/abs/2407.14224v2","url_pdf":"https://arxiv.org/pdf/2407.14224v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"hierarchical-windowed-graph-attention-network","repo_url":"https://github.com/suvajit-patra/sl-hwgat","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"graph-attention","task_name":"Graph Attention"},{"task_slug":"hand-gesture-recognition","task_name":"Hand Gesture Recognition"},{"task_slug":"sign-language-recognition","task_name":"Sign Language Recognition"}],"methods":[{"method_slug":"attention","method_name":"Attention"},{"method_slug":"softmax","method_name":"Softmax"}],"datasets_introduced":[{"slug":"fdmse-isl","name":"FDMSE-ISL","full_name":""}],"methods_introduced":[],"results":[{"leaderboard":"/sota/sign-language-recognition-on-autsl","task":"Sign Language Recognition","dataset":"AUTSL","model":"HWGAT","rank_in_archive_order":5,"of":9,"metrics":{"Rank-1 Recognition Rate":"0.9580"},"uses_additional_data":true},{"leaderboard":"/sota/sign-language-recognition-on-fdmse-isl","task":"Sign Language Recognition","dataset":"FDMSE-ISL","model":"HWGAT","rank_in_archive_order":1,"of":1,"metrics":{"Top-1 Accuracy":"93.86"},"uses_additional_data":false},{"leaderboard":"/sota/sign-language-recognition-on-lsa64","task":"Sign Language Recognition","dataset":"LSA64","model":"HWGAT","rank_in_archive_order":3,"of":5,"metrics":{"Accuracy (%)":"98.59"},"uses_additional_data":true},{"leaderboard":"/sota/sign-language-recognition-on-wlasl-2000","task":"Sign Language Recognition","dataset":"WLASL-2000","model":"HWGAT","rank_in_archive_order":7,"of":9,"metrics":{"Top-1 Accuracy":"48.49"},"uses_additional_data":true}],"syntology":{"syntology_url":"https://syntology.ai/paper/2407.14224","atlas_url":"https://app.syntology.ai/?focus=2407.14224","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"2407.14224"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"2407.14224\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"2407.14224"},"call":"get_concepts_for_paper(arxiv_id=\"2407.14224\")"}],"by_repo":[{"repo":"suvajit-patra/sl-hwgat","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"34e96113af73881b6f846040347524147a28b4a042b5b98ac3582b99d618008f","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}