{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/a-low-power-neuromorphic-approach-for","title":"Retina : Low-Power Eye Tracking with Event Camera and Spiking Hardware","arxiv_id":"2312.00425","date":"2023-12-01","proceeding":null,"authors":["Pietro Bonazzi","Sizhen Bian","Giovanni Lippolis","Yawei Li","Sadique Sheik","Michele Magno"],"abstract":"This paper introduces a neuromorphic methodology for eye tracking, harnessing pure event data captured by a Dynamic Vision Sensor (DVS) camera. The framework integrates a directly trained Spiking Neuron Network (SNN) regression model and leverages a state-of-the-art low power edge neuromorphic processor - Speck, collectively aiming to advance the precision and efficiency of eye-tracking systems. First, we introduce a representative event-based eye-tracking dataset, \"Ini-30\", which was collected with two glass-mounted DVS cameras from thirty volunteers. Then,a SNN model, based on Integrate And Fire (IAF) neurons, named \"Retina\", is described , featuring only 64k parameters (6.63x fewer than the latest) and achieving pupil tracking error of only 3.24 pixels in a 64x64 DVS input. The continous regression output is obtained by means of convolution using a non-spiking temporal 1D filter slided across the output spiking layer. Finally, we evaluate Retina on the neuromorphic processor, showing an end-to-end power between 2.89-4.8 mW and a latency of 5.57-8.01 mS dependent on the time window. We also benchmark our model against the latest event-based eye-tracking method, \"3ET\", which was built upon event frames. Results show that Retina achieves superior precision with 1.24px less pupil centroid error and reduced computational complexity with 35 times fewer MAC operations. We hope this work will open avenues for further investigation of close-loop neuromorphic solutions and true event-based training pursuing edge performance.","url_abs":"https://arxiv.org/abs/2312.00425v2","url_pdf":"https://arxiv.org/pdf/2312.00425v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"a-low-power-neuromorphic-approach-for","repo_url":"https://github.com/pbonazzi/retina","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"pupil-detection","task_name":"Pupil Detection"},{"task_slug":"pupil-tracking","task_name":"Pupil Tracking"}],"methods":[{"method_slug":"convolution","method_name":"Convolution"},{"method_slug":"snn","method_name":"SNN"}],"datasets_introduced":[{"slug":"ini-30","name":"INI-30","full_name":""}],"methods_introduced":[],"results":[{"leaderboard":"/sota/pupil-detection-on-ini-30","task":"Pupil Detection","dataset":"INI-30","model":"CNN","rank_in_archive_order":1,"of":2,"metrics":{"Euclidean Distance":"0.5"},"uses_additional_data":false},{"leaderboard":"/sota/pupil-detection-on-ini-30","task":"Pupil Detection","dataset":"INI-30","model":"TinyissimoV8","rank_in_archive_order":2,"of":2,"metrics":{"Euclidean Distance":"1.75"},"uses_additional_data":false},{"leaderboard":"/sota/pupil-tracking-on-ini-30","task":"Pupil Tracking","dataset":"INI-30","model":"Retina","rank_in_archive_order":1,"of":2,"metrics":{"Euclidean Distance":"3.24"},"uses_additional_data":false},{"leaderboard":"/sota/pupil-tracking-on-ini-30","task":"Pupil Tracking","dataset":"INI-30","model":"3ET","rank_in_archive_order":2,"of":2,"metrics":{"Euclidean Distance":"4.48"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2312.00425","atlas_url":"https://app.syntology.ai/?focus=2312.00425","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"2312.00425"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"2312.00425\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"2312.00425"},"call":"get_concepts_for_paper(arxiv_id=\"2312.00425\")"}],"by_repo":[{"repo":"pbonazzi/retina","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"96b54e0274c31d6e700d02e142296c4483ab6b6f9ee3c6e7ae0bd9a82d45736c","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}