{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/panoptic-nuscenes-a-large-scale-benchmark-for","title":"Panoptic nuScenes: A Large-Scale Benchmark for LiDAR Panoptic Segmentation and Tracking","arxiv_id":"2109.03805","date":"2021-09-08","proceeding":null,"authors":["Whye Kit Fong","Rohit Mohan","Juana Valeria Hurtado","Lubing Zhou","Holger Caesar","Oscar Beijbom","Abhinav Valada"],"abstract":"Panoptic scene understanding and tracking of dynamic agents are essential for robots and automated vehicles to navigate in urban environments. As LiDARs provide accurate illumination-independent geometric depictions of the scene, performing these tasks using LiDAR point clouds provides reliable predictions. However, existing datasets lack diversity in the type of urban scenes and have a limited number of dynamic object instances which hinders both learning of these tasks as well as credible benchmarking of the developed methods. In this paper, we introduce the large-scale Panoptic nuScenes benchmark dataset that extends our popular nuScenes dataset with point-wise groundtruth annotations for semantic segmentation, panoptic segmentation, and panoptic tracking tasks. To facilitate comparison, we provide several strong baselines for each of these tasks on our proposed dataset. Moreover, we analyze the drawbacks of the existing metrics for panoptic tracking and propose the novel instance-centric PAT metric that addresses the concerns. We present exhaustive experiments that demonstrate the utility of Panoptic nuScenes compared to existing datasets and make the online evaluation server available at nuScenes.org. We believe that this extension will accelerate the research of novel methods for scene understanding of dynamic urban environments.","url_abs":"https://arxiv.org/abs/2109.03805v3","url_pdf":"https://arxiv.org/pdf/2109.03805v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"panoptic-nuscenes-a-large-scale-benchmark-for","repo_url":"https://github.com/nutonomy/nuscenes-devkit","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"NOASSERTION"}}],"tasks":[{"task_slug":"benchmarking","task_name":"Benchmarking"},{"task_slug":"diversity","task_name":"Diversity"},{"task_slug":"navigate","task_name":"Navigate"},{"task_slug":"panoptic-segmentation","task_name":"Panoptic Segmentation"},{"task_slug":null,"task_name":"Panoptic Tracking"},{"task_slug":"scene-understanding","task_name":"Scene Understanding"},{"task_slug":"semantic-segmentation","task_name":"Semantic Segmentation"}],"methods":[],"datasets_introduced":[{"slug":"panoptic-nuscenes","name":"Panoptic nuScenes","full_name":""}],"methods_introduced":[],"results":[{"leaderboard":"/sota/panoptic-segmentation-on-panoptic-nuscenes-1","task":"Panoptic Segmentation","dataset":"Panoptic nuScenes test","model":"(AF)2-S3Net + CenterPoint","rank_in_archive_order":1,"of":1,"metrics":{"PQ":"76.8","RQ":"85.4","SQ":"89.5","mIoU":"78.8"},"uses_additional_data":false},{"leaderboard":"/sota/panoptic-segmentation-on-panoptic-nuscenes","task":"Panoptic Segmentation","dataset":"Panoptic nuScenes val","model":"PolarSeg-Panoptic","rank_in_archive_order":1,"of":1,"metrics":{"PQ":"63.4","RQ":"75.3","SQ":"83.9","mIoU":"66.9"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2109.03805","atlas_url":"https://app.syntology.ai/?focus=2109.03805","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"2109.03805"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"2109.03805\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"2109.03805"},"call":"get_concepts_for_paper(arxiv_id=\"2109.03805\")"}],"by_repo":[{"repo":"nutonomy/nuscenes-devkit","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"7b8e14eec7ce17693afc009a355a7a77bbc0ed66a40f62bfa2f2e50731d50e40","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}