{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/oostraj-out-of-sight-trajectory-prediction","title":"OOSTraj: Out-of-Sight Trajectory Prediction With Vision-Positioning Denoising","arxiv_id":"2404.02227","date":"2024-04-02","proceeding":"CVPR 2024 1","authors":["Haichao Zhang","Yi Xu","HongSheng Lu","Takayuki Shimizu","Yun Fu"],"abstract":"Trajectory prediction is fundamental in computer vision and autonomous driving, particularly for understanding pedestrian behavior and enabling proactive decision-making. Existing approaches in this field often assume precise and complete observational data, neglecting the challenges associated with out-of-view objects and the noise inherent in sensor data due to limited camera range, physical obstructions, and the absence of ground truth for denoised sensor data. Such oversights are critical safety concerns, as they can result in missing essential, non-visible objects. To bridge this gap, we present a novel method for out-of-sight trajectory prediction that leverages a vision-positioning technique. Our approach denoises noisy sensor observations in an unsupervised manner and precisely maps sensor-based trajectories of out-of-sight objects into visual trajectories. This method has demonstrated state-of-the-art performance in out-of-sight noisy sensor trajectory denoising and prediction on the Vi-Fi and JRDB datasets. By enhancing trajectory prediction accuracy and addressing the challenges of out-of-sight objects, our work significantly contributes to improving the safety and reliability of autonomous driving in complex environments. Our work represents the first initiative towards Out-Of-Sight Trajectory prediction (OOSTraj), setting a new benchmark for future research. The code is available at \\url{https://github.com/Hai-chao-Zhang/OOSTraj}.","url_abs":"https://arxiv.org/abs/2404.02227v1","url_pdf":"https://arxiv.org/pdf/2404.02227v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"oostraj-out-of-sight-trajectory-prediction","repo_url":"https://github.com/hai-chao-zhang/oostraj","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"autonomous-driving","task_name":"Autonomous Driving"},{"task_slug":"decision-making","task_name":"Decision Making"},{"task_slug":"denoising","task_name":"Denoising"},{"task_slug":"out-of-sight-trajectory-prediction","task_name":"Out-of-Sight Trajectory Prediction"},{"task_slug":"prediction","task_name":"Prediction"},{"task_slug":"trajectory-prediction","task_name":"Trajectory Prediction"}],"methods":[{"method_slug":"oostraj","method_name":"OOSTraj"}],"datasets_introduced":[],"methods_introduced":[{"slug":"oostraj","name":"OOSTraj","full_name":"Out-of-Sight Trajectory Prediction"}],"results":[{"leaderboard":"/sota/out-of-sight-trajectory-prediction-on-vi-fi","task":"Out-of-Sight Trajectory Prediction","dataset":"Vi-Fi Multi-modal Dataset","model":"OOSTraj","rank_in_archive_order":1,"of":6,"metrics":{"MSE-D":"13.42","MSE-P":"13.83","SUM":"27.24"},"uses_additional_data":false},{"leaderboard":"/sota/out-of-sight-trajectory-prediction-on-vi-fi","task":"Out-of-Sight Trajectory Prediction","dataset":"Vi-Fi Multi-modal Dataset","model":"Transformer","rank_in_archive_order":2,"of":6,"metrics":{"MSE-D":"14.26","MSE-P":"14.08","SUM":"28.33"},"uses_additional_data":false},{"leaderboard":"/sota/out-of-sight-trajectory-prediction-on-vi-fi","task":"Out-of-Sight Trajectory Prediction","dataset":"Vi-Fi Multi-modal Dataset","model":"RNN","rank_in_archive_order":3,"of":6,"metrics":{"MSE-D":"15.92","MSE-P":"15.69","SUM":"31.61"},"uses_additional_data":false},{"leaderboard":"/sota/out-of-sight-trajectory-prediction-on-vi-fi","task":"Out-of-Sight Trajectory Prediction","dataset":"Vi-Fi Multi-modal Dataset","model":"GRU","rank_in_archive_order":4,"of":6,"metrics":{"MSE-D":"28.69","MSE-P":"28.65","SUM":"57.34"},"uses_additional_data":false},{"leaderboard":"/sota/out-of-sight-trajectory-prediction-on-vi-fi","task":"Out-of-Sight Trajectory Prediction","dataset":"Vi-Fi Multi-modal Dataset","model":"LSTM","rank_in_archive_order":5,"of":6,"metrics":{"MSE-D":"58.31","MSE-P":"57.7","SUM":"116.01"},"uses_additional_data":false},{"leaderboard":"/sota/out-of-sight-trajectory-prediction-on-vi-fi","task":"Out-of-Sight Trajectory Prediction","dataset":"Vi-Fi Multi-modal Dataset","model":"ViTag","rank_in_archive_order":6,"of":6,"metrics":{"MSE-D":"100.53","MSE-P":"100.37","SUM":"200.9"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2404.02227","atlas_url":"https://app.syntology.ai/?focus=2404.02227","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"2404.02227"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"2404.02227\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"2404.02227"},"call":"get_concepts_for_paper(arxiv_id=\"2404.02227\")"}],"by_repo":[{"repo":"hai-chao-zhang/oostraj","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"0116f8523a2d8e8fa1f401bb89da99f9d8c7fe5c6f724378956605165a9b4c26","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}