Browse State-of-the-Art › Scene Understanding
Scene Understanding
720 papers with code · 3 benchmarks · 43 datasets archive 2025-07-28
Scene understanding involves interpreting the visual information of a scene, including objects, their spatial relationships, and the overall layout. It goes beyond simple object recognition by considering the context and how objects relate to each other and the environment.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
3 leaderboard tables shown for this task, 3 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| Semantic Scene Understanding Challenge (passive actuation & ground-truth localisation) (3 rows) | ACRV Baseline | — | — | — | Compare |
| ADE20K val (1 row) | CPN(ResNet-101) | Context Prior for Scene Segmentation | code | — | Compare |
| Semantic Scene Understanding Challenge (active actuation & ground-truth localisation) (1 row) | ACRV Baseline | — | — | — | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
43 datasets whose archive record lists this task, ordered by the archive's paper count. 30 shown of 43 until expanded.
Subtasks archive 2025-07-28
6 subtasks in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 1,723 · with a code link: 720 · where Syntology ran a sample: 208 (174 with a run with no instrument failure, 34 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (208 of 1,723 tagged: 174 with a run with no instrument failure, 34 where every run was a failure of Syntology's instrument)
Page 1 of 18: papers 1 to 100 of 1,723, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
2 Nov 2015 74 repositories listed Syntology 22 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 1 honoured, 0 violated, 13 with no contract checked; 8 where Syntology's instrument failed) · 22 unverified (of 44 harvested samples) · 11 pointer-only (licence)We show that SegNet provides good performance with competitive inference time and more efficient inference memory-wise as compared to other architectures.
-
1 May 2014 38 repositories listed Syntology 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples)We present a new dataset with the goal of advancing the state-of-the-art in object recognition by placing the question of object recognition in the context of the broader question of scene understanding.
-
26 Jul 2018 25 repositories listed Syntology community repositories only · 25 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 2 honoured, 0 violated, 12 with no contract checked; 11 where Syntology's instrument failed) · 3 unverified (of 28 harvested samples) · 10 pointer-only (licence)In this paper, we study a new task called Unified Perceptual Parsing, which requires the machine vision systems to recognize as many visual concepts as possible from a given image.
-
9 Nov 2015 21 repositories listed Syntology 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 12 unverified (of 18 harvested samples)Semantic segmentation is an important tool for visual scene understanding and a meaningful measure of uncertainty is essential for decision making.
-
4 Jun 2018 15 repositories listed Syntology community repositories only · 23 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 4 honoured, 1 violated, 8 with no contract checked; 10 where Syntology's instrument failed) · 1 unverified (of 24 harvested samples) · 10 pointer-only (licence)Per-pixel ground-truth depth data is challenging to acquire at scale.
-
14 Jun 2017 14 repositories listed Syntology 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 2 pointer-only (licence)As a result they are huge in terms of parameters and number of operations; hence slow too.
-
9 Oct 2017 13 repositories listedA comprehensive set of experiments on the publicly available Cityscapes dataset demonstrates that our system achieves an accuracy that is similar to the state of the art, while being orders of magnitude faster to…
-
17 Dec 2017 9 repositories listedAlthough CNN has shown strong capability to extract semantics from raw pixels, its capacity to capture spatial relationships of pixels across rows and columns of an image is not fully explored.
-
1 Nov 2019 8 repositories listedWe leverage this scaling to train an agent for 2.
-
5 Dec 2020 7 repositories listedThis dataset demonstrates the post flooded damages of the affected areas.
-
1 Apr 2019 7 repositories listed Syntology official: harvested, nothing ran · 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 1 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 6 unverified (of 13 harvested samples)Scene understanding of high resolution aerial images is of great importance for the task of automated monitoring in various remote sensing applications.
-
10 Oct 2018 7 repositories listed Syntology official (archive's flag): 10 ran · 17 ran (of which 0 constructed an object rather than computing a result; 15 with no instrument failure: 0 honoured, 0 violated, 15 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 19 harvested samples) · 1 pointer-only (licence)These algorithms are not directly applicable to large-scale learning problems since they scale poorly with the dimensionality of the gradients and the number of tasks.
-
22 Feb 2022 6 repositories listedWith only text supervision and without any pixel-level annotations, GroupViT learns to group together semantic regions and successfully transfers to the task of semantic segmentation in a zero-shot manner, i. e.…
-
8 Jul 2019 6 repositories listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 8 harvested samples)3D object detection from LiDAR point cloud is a challenging problem in 3D scene understanding and has many practical applications.
-
27 Nov 2018 6 repositories listedCompared with real-time segmentation models such as BiSeNet, our model achieves higher accuracy at comparable speed on the Cityscapes Dataset, enabling the application in speed-demanding tasks such as street-scene…
-
27 Feb 2017 6 repositories listed Syntology 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)We introduce a method for training GANs with discrete data that uses the estimated difference measure from the discriminator to compute importance weights for generated samples, thus providing a policy gradient for…
-
20 Nov 2019 5 repositories listedWith the help of novel masks or scenes, we enhance the current datasets using synthesized shadow images.
-
2 Apr 2019 5 repositories listed Syntology official (archive's flag): 1 ran · 8 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples)Despite the relevance of semantic scene understanding for this application, there is a lack of a large dataset for this task which is based on an automotive LiDAR.
-
6 Aug 2016 5 repositories listedTo remedy this, we develop a method for adapting deep features to align with human similarity judgments, resulting in image representations that can potentially be used to extend the scope of psychological experiments.
-
4 Dec 2023 4 repositories listed Syntology official (archive's flag): 9 ran · 22 ran (of which 0 constructed an object rather than computing a result; 17 with no instrument failure: 0 honoured, 3 violated, 14 with no contract checked; 5 where Syntology's instrument failed) · 4 unverified (of 26 harvested samples) · 5 pointer-only (licence)Monocular depth estimation is a fundamental computer vision task.
-
24 Sep 2023 4 repositories listed Syntology community repositories only · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 7 unverified (of 12 harvested samples)As the application scenarios of mobile robots are getting more complex and challenging, scene understanding becomes increasingly crucial.
-
22 Jun 2021 4 repositories listedA popular solution to this problem is to use a single pooling operation to reduce the sequence length.
-
30 Mar 2021 4 repositories listed Syntology community repositories only · 9 ran (of which 7 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified (of 13 harvested samples) · 13 pointer-only (licence)Understanding the scene around the ego-vehicle is key to assisted and autonomous driving.
-
24 Mar 2021 4 repositories listedMoreover, we also propose a new head detector, HeadHunter, which is designed for small head detection in crowded scenes.
-
16 Apr 2020 4 repositories listed Syntology community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified (of 6 harvested samples)In this technical report, we present two novel datasets for image scene understanding.
-
3 Apr 2020 4 repositories listed Syntology 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples)Instance segmentation is an important task for scene understanding.
-
7 Jan 2020 4 repositories listedFew works have studied the disambiguating contribution of subsidiary relations made available via graph networks.
-
17 Nov 2019 4 repositories listedBeing natural, touchless, and fun-embracing, language-based inputs have been demonstrated effective for various tasks from image generation to literacy education for children.
-
13 Jul 2019 4 repositories listed Syntology official (archive's flag): 5 ran · 9 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 1 where Syntology's instrument failed) · 12 unverified (of 21 harvested samples) · 1 pointer-only (licence)Understanding the world in 3D is a critical component of urban autonomous driving.
-
2 May 2018 4 repositories listed Syntology community repositories only · 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples)It is valuable to fuse outputs from multiple sensors to boost overall performance.
-
3 Feb 2017 4 repositories listed Syntology official (archive's flag): 3 ran · 13 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 3 honoured, 3 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 14 harvested samples) · 4 pointer-only (licence)
-
26 Jan 2016 4 repositories listed
-
3 Jan 2025 3 repositories listed
-
24 Nov 2024 3 repositories listed
-
1 Nov 2024 3 repositories listed
-
16 May 2024 3 repositories listed Syntology official (archive's flag): 13 ran · 13 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 3 honoured, 1 violated, 5 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 14 harvested samples) · 10 pointer-only (licence)
-
12 Feb 2024 3 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (of 5 harvested samples) · 4 pointer-only (licence)
-
20 Jan 2024 3 repositories listed Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 1 violated, 4 with no contract checked; 5 where Syntology's instrument failed) · 3 unverified (of 13 harvested samples) · 6 pointer-only (licence)
-
28 Nov 2023 3 repositories listed Syntology official (archive's flag): 11 ran · 11 ran (of which 2 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 11 harvested samples) · 3 pointer-only (licence)
-
12 Sep 2023 3 repositories listed
-
30 Nov 2022 3 repositories listed
-
26 Jul 2022 3 repositories listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample)
-
7 Jul 2022 3 repositories listed
-
30 Mar 2022 3 repositories listed Syntology official (archive's flag): 2 ran · 5 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples)
-
14 Feb 2022 3 repositories listed Syntology official: not harvested · 0 ran · 1 unverified (of 1 harvested sample)
-
6 Jun 2021 3 repositories listed
-
17 Nov 2020 3 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
2 Oct 2020 3 repositories listed
-
2 Apr 2020 3 repositories listed Syntology 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
20 Sep 2019 3 repositories listed
-
24 Oct 2018 3 repositories listed
-
5 Sep 2018 3 repositories listed
-
27 Aug 2018 3 repositories listed
-
16 May 2018 3 repositories listed
-
1 Jun 2017 3 repositories listed
-
28 May 2017 3 repositories listed
-
6 Apr 2016 3 repositories listed
-
20 Mar 2025 2 repositories listed
-
20 Jan 2025 2 repositories listed
-
16 Jan 2025 2 repositories listed
-
5 Dec 2024 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
30 Sep 2024 2 repositories listed Syntology 9 ran (of which 1 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 1 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 6 unverified (of 15 harvested samples) · 15 pointer-only (licence)
-
18 Mar 2024 2 repositories listed
-
13 Dec 2023 2 repositories listed Syntology official (archive's flag): 6 ran · 11 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 6 where Syntology's instrument failed) · 0 unverified (of 11 harvested samples) · 5 pointer-only (licence)
-
4 Dec 2023 2 repositories listed
-
19 Sep 2023 2 repositories listed
-
17 Aug 2023 2 repositories listed
-
28 Jul 2023 2 repositories listed
-
11 May 2023 2 repositories listed
-
17 Apr 2023 2 repositories listed
-
14 Apr 2023 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)
-
13 Apr 2023 2 repositories listed Syntology official (archive's flag): 5 ran · 5 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples) · 6 pointer-only (licence)
-
16 Mar 2023 2 repositories listed Syntology official (archive's flag): 2 ran · 18 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 4 honoured, 0 violated, 4 with no contract checked; 10 where Syntology's instrument failed) · 6 unverified (of 24 harvested samples) · 21 pointer-only (licence)
-
30 Jan 2023 2 repositories listed Syntology official (archive's flag): 6 ran · 7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (of 11 harvested samples) · 2 pointer-only (licence)
-
15 Jan 2023 2 repositories listed Syntology official (archive's flag): 5 ran · 5 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)
-
1 Jan 2023 2 repositories listed
-
20 Sep 2022 2 repositories listed
-
10 Jul 2022 2 repositories listed
-
27 Jun 2022 2 repositories listed
-
3 Apr 2022 2 repositories listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples)
-
27 Feb 2022 2 repositories listed
-
28 Jan 2022 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 7 unverified (of 8 harvested samples) · 8 pointer-only (licence)
-
27 Dec 2021 2 repositories listed Syntology official (archive's flag): 11 ran · 14 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 4 where Syntology's instrument failed) · 2 unverified (of 16 harvested samples) · 4 pointer-only (licence)
-
4 Dec 2021 2 repositories listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples) · 1 pointer-only (licence)
-
22 Oct 2021 2 repositories listed
-
21 Oct 2021 2 repositories listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 8 harvested samples)
-
5 Oct 2021 2 repositories listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
28 Sep 2021 2 repositories listed Syntology official (archive's flag): 12 ran · 12 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 0 violated, 12 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified (of 16 harvested samples) · 2 pointer-only (licence)
-
27 Jul 2021 2 repositories listed
-
7 Apr 2021 2 repositories listed
-
27 Mar 2021 2 repositories listed
-
14 Mar 2021 2 repositories listed
-
11 Mar 2021 2 repositories listed
-
16 Feb 2021 2 repositories listed
-
21 Jan 2021 2 repositories listed
-
12 Jan 2021 2 repositories listed
-
16 Dec 2020 2 repositories listed
-
4 Nov 2020 2 repositories listed
-
30 Oct 2020 2 repositories listed
Syntology lines on 44 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections