Papers › High Temporal Consistency through Semantic Similarity Propagation in Semi-Supervised...

High Temporal Consistency through Semantic Similarity Propagation in Semi-Supervised Video Semantic Segmentation for Autonomous Flight

19 Mar 2025CVPR 2025 1arXiv:2503.15676archive 2025-07-28

Cédric Vincent, Taehyoung Kim, Henri Meeß

Semantic segmentation from RGB cameras is essential to the perception of autonomous flying vehicles. The stability of predictions through the captured videos is paramount to their reliability and, by extension, to the trustworthiness of the agents. In this paper, we propose a lightweight video semantic segmentation approach-suited to onboard real-time inference-achieving high temporal consistency on aerial data through Semantic Similarity Propagation across frames. SSP temporally propagates the predictions of an efficient image segmentation model with global registration alignment to compensate for camera movements. It combines the current estimation and the prior prediction with linear interpolation using weights computed from the features similarities of the two frames. Because data availability is a challenge in this domain, we propose a consistency-aware Knowledge Distillation training procedure for sparsely labeled datasets with few annotations. Using a large image segmentation model as a teacher to train the efficient SSP, we leverage the strong correlations between labeled and unlabeled frames in the same training videos to obtain high-quality supervision on all frames. KD-SSP obtains a significant temporal consistency increase over the base image segmentation model of 12.5% and 6.7% TC on UAVid and RuralScapes respectively, with higher accuracy and comparable inference speed. On these aerial datasets, KD-SSP provides a superior segmentation quality and inference speed trade-off than other video methods proposed for general applications and shows considerably higher consistency. The code will be made publicly available upon acceptance.

PaperPDFConference PDFCodeCode Syntology ranMethod as code

In Syntology View this paper on Syntology, its page in Syntology's graph. That page adds which of its functions are also present in other papers' code Syntology holds, with dates, and its dated run record as JSON and a README badge. It also lists the repositories linked to the paper, the abstract and the calls for agents.

Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, on Syntology's MCP service (how to connect):

Code

Syntology 39 code samples harvested from 1 repository linked to this paper: 25 ran (of which 15 constructed an object rather than computing a result; 20 with no instrument failure: 0 honoured, 0 violated, 20 with no contract checked; 5 where Syntology's instrument failed) · 14 unverified. Where Syntology's instrument failed: 2 where our contract draft was wrong; 3 where the contract check could not run; failures of Syntology's instrument, not of the code.

By repository: official repository: 39 samples from 1 repository, 25 ran (20 with no instrument failure; 5 where Syntology's instrument failed). The run record, sample by sample. “Ran” means executed on a synthesized input, not that the code is correct or reproduces the paper.

Levels written between 2026-09-22 and 2026-09-24 (UTC): the dates Syntology's graph wrote each sample's verification level, not when the code executed.

fraunhoferivi/ssp officialmentioned in papermentioned on GitHubpytorchSyntology: 39 samples, 25 ran (5 instrument-failed) · 14 unverified report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

39 samples harvested: 25 ran (of which 15 constructed an object rather than computing a result; 20 with no instrument failure: 0 honoured, 0 violated, 20 with no contract checked; 5 where Syntology's instrument failed) · 14 unverified. “Where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Syntology's record for this page has not changed since , the first build that kept a record date for it; when this build read Syntology's graph is in the build record. That date is not when the samples ran.

2ran · our draft was wrong
3ran; the contract check could not run
20ran
14unverified

Licence: 39 of the 39 samples are pointer only, meaning Syntology does not serve that copy's text. This page shows no code text for any sample; each one links to its file in the repository.

Harvested from fraunhoferivi/ssp. “Ran” means the sample executed on a synthesized input. It does not mean the output is correct, and nothing here reproduces the paper's results. A line beginning “fixture:” under a sample that ran gives the arguments Syntology's fixture called the sample with, each as name:type/rank/element kind (? where none was recorded), and the type of what the fixture's run returned, exactly as the harness recorded them; the arguments and the returned type were recorded by two separate runs of the same fixture. No output value is shown, and a returned type says nothing about whether the output was right. “Level recorded” gives the UTC date when Syntology's graph wrote the sample's verification level, not when the code executed; where the level was written before Syntology's graph kept that date, the row says “level recorded, date not recorded”. For 8 samples that ran, the graph records a signature this page does not show: for a class the fixture built without calling, the harness called the object with inputs it made up itself, so the recorded signature is the harness's probe, not the fixture's arguments. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself. “Our draft was wrong” and “the contract check could not run” are failures of Syntology's instrument, not of the code: the sample ran on Syntology's synthesized input, and then the drafted contract did not describe it, or the check itself raised an error (RAISES), lacked a dependency (DEP_MISSING) or ran out of time (TIMEOUT); hover the label for which. A metamorphic tier, where shown, is evidence of the output's shape, not that the sample implements the method.

Each sample ends with its code_sha256. A sample's code_sha256 is Syntology's identity for that exact code. It is printed in full (16 hexadecimal characters for every sample in this build), and get_code(code_sha256="…") takes it exactly as printed. An agent calls it on Syntology's MCP service (how to connect); click an identity to copy that call.

Repository labels, per sample. official repository: The archive marks this repository official for the paper. named in the paper: The archive records that the paper mentions this repository; it is not marked official. community (archive-listed): In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper. found in paper text by Syntology: Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted. community: Not in the archive's code links for this paper; a community repository Syntology harvested. Samples are grouped by repository: a repository marked official first, then by how directly the repository is tied to the paper, then in the archive's order; never by how many ran. Licence labels name the repository's licence as recorded at harvest. “Pointer only” means Syntology does not serve that copy's text, for one of six reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar); this paper's copy was not located, so its licence is not recorded; or this paper's copy is cleared, but the stored copy of the same code that Syntology serves is not. Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence label for the reason. File links open the file on GitHub at the default branch, which may have changed since the harvest.

A function or class name links to its page when the name occurs in the harvested code of at least 5 papers; the name is a string, not an identity.

fraunhoferivi/ssp official repository 39 samples, 25 ran (5 instrument-failed) · 14 unverified
AverageSimBlock models/video/models_consistency.py ran · metamorphic tier: deterministic licence not identified · pointer only · d044b5ce825d4a5c · report fixture: returned AverageSimBlock · level recorded 2026-09-22
ConstantSimBlock models/video/models_consistency.py ran · metamorphic tier: deterministic licence not identified · pointer only · 7f8e3f8b70d49c2f · report fixture: returned ConstantSimBlock · level recorded 2026-09-22
Conv2DMixingBlock models/video/models_consistency.py ran · metamorphic tier: deterministic fingerprinted licence not identified · pointer only · 5e791605cb7329d7 · report fixture: returned Conv2DMixingBlock · level recorded 2026-09-22
Conv2DMixingLayer models/video/models_consistency.py ran licence not identified · pointer only · 07e2216dbbe99e90 · report fixture: signature x:Tensor/4/float · returned Tensor · level recorded 2026-09-24
Conv3DMixingBlock models/video/models_consistency.py ran · metamorphic tier: deterministic fingerprinted licence not identified · pointer only · 058734a67a781ac6 · report fixture: returned Conv3DMixingBlock · level recorded 2026-09-22
Conv3DMixingLayer models/video/models_consistency.py ran · metamorphic tier: deterministic licence not identified · pointer only · c78187c6d5ad1b68 · report fixture: returned Conv3DMixingLayer · level recorded 2026-09-22
ConvSimBlock models/video/models_consistency.py ran licence not identified · pointer only · 6c47c44ac4a36fd1 · report fixture: signature last_featmap:Tensor/4/float, featmap:Tensor/4/float, size:tuple/1/int · returned Tensor · level recorded 2026-09-24
ConvSimBlockBase models/video/models_consistency.py ran licence not identified · pointer only · 73eebc021c081540 · report fixture: signature last_featmap:Tensor/4/float, featmap:Tensor/4/float, size:tuple/1/int · returned Tensor · level recorded 2026-09-24
ConvSimBlockv2 models/video/models_consistency.py ran · metamorphic tier: deterministic licence not identified · pointer only · 4c114e1ca34fdd56 · report fixture: returned ConvSimBlockv2 · level recorded 2026-09-22
CossimSimBlock models/video/models_consistency.py ran licence not identified · pointer only · 7043870d374949b0 · report fixture: signature last_featmap:Tensor/4/float, featmap:Tensor/4/float, size:tuple/1/int · returned Tensor · level recorded 2026-09-24
IdMixingBlock models/video/models_consistency.py ran · metamorphic tier: deterministic fingerprinted licence not identified · pointer only · a4394ad61f3a1594 · report fixture: returned IdMixingBlock · level recorded 2026-09-22
IdentityRegistrator models/video/models_consistency.py ran · metamorphic tier: deterministic fingerprinted licence not identified · pointer only · a270a720b90984f0 · report fixture: returned IdentityRegistrator · level recorded 2026-09-22
MetricMeter models/video/models_consistency.py ran licence not identified · pointer only · 5c6b14f527ed13b7 · report fixture: returned MetricMeter · level recorded 2026-09-22
Mix_FFN2D models/video/models_consistency.py ran · metamorphic tier: deterministic licence not identified · pointer only · 9e6f6502476feed9 · report fixture: returned Mix_FFN2D · level recorded 2026-09-22
Mix_FFN3D models/video/models_consistency.py ran · metamorphic tier: deterministic licence not identified · pointer only · 683a05a61bd8a4d6 · report fixture: returned Mix_FFN3D · level recorded 2026-09-22
ShiftedWindows_MSA_2D models/video/models_consistency.py ran · metamorphic tier: deterministic licence not identified · pointer only · ff7968971c45bd97 · report fixture: returned ShiftedWindows_MSA_2D · level recorded 2026-09-22
ShiftedWindows_MSA_3D models/video/models_consistency.py ran · metamorphic tier: deterministic licence not identified · pointer only · 95cad40f6f93b6d0 · report fixture: returned ShiftedWindows_MSA_3D · level recorded 2026-09-22
TempConstLoss models/video/models_consistency.py ran licence not identified · pointer only · a92fb745968521e5 · report fixture: signature out:Tensor/4/float, last_out:Tensor/4/float, flow_model:callable/0/?, frame:Tensor/4/float, last_frame:Tensor/4/float · returned Tensor · level recorded 2026-09-24
WindowAttention2D models/video/models_consistency.py ran · metamorphic tier: deterministic licence not identified · pointer only · 2cd93b72e9eab106 · report fixture: returned WindowAttention2D · level recorded 2026-09-22
WindowAttention3D in 10 papers models/video/models_consistency.py ran · metamorphic tier: deterministic licence not identified · pointer only · 718fd35d460d708b · report fixture: returned WindowAttention3D · level recorded 2026-09-22
class_meanIoU models/video/models_consistency.py ran; the contract check could not run (RAISES) · metamorphic tier: invariant licence not identified · pointer only · d347919e1bf4509d · report fixture: signature preds:Tensor/4/float, labels:Tensor/3/int, n_classes:int/0/int, ignore_index:int/0/int · returned Tensor · level recorded 2026-09-22
conditional_no_grad models/video/models_consistency.py ran · our draft was wrong licence not identified · pointer only · 4db7a39c999d283b · report fixture: signature condition:bool/0/bool · returned _GeneratorContextManager · level recorded 2026-09-22
flowwarp models/video/models_consistency.py ran · our draft was wrong fingerprinted licence not identified · pointer only · 446875b2982cc5dc · report fixture: signature x:Tensor/4/float, flo:Tensor/4/float · returned Tensor · level recorded 2026-09-22
meanIoU models/video/models_consistency.py ran; the contract check could not run (RAISES) · metamorphic tier: invariant licence not identified · pointer only · 4f1bb8f28de5476d · report fixture: signature preds:Tensor/4/float, labels:Tensor/3/int, n_classes:int/0/int, ignore_index:int/0/int · returned Tensor · level recorded 2026-09-22
soft_to_hard_labels models/video/models_consistency.py ran; the contract check could not run (RAISES) · metamorphic tier: invariant fingerprinted licence not identified · pointer only · 6c2f180f76144ba4 · report fixture: signature soft_labels:Tensor/2/float, ignore_index:int/0/int · returned Tensor · level recorded 2026-09-22
ConsistencyWrapper models/video/models_consistency.py unverified licence not identified · pointer only · 32d9a37f2197d508 · report
DiskFeatureRegistrator models/video/models_consistency.py unverified licence not identified · pointer only · 0ea451382191a4af · report
STT2DMixingBlock models/video/models_consistency.py unverified licence not identified · pointer only · fb5a9acbdef9723e · report
STT2DMixingLayer models/video/models_consistency.py unverified licence not identified · pointer only · 9a15b215d04d0d28 · report
STT3DConvSimBlock models/video/models_consistency.py unverified licence not identified · pointer only · 313598e87d65c0b7 · report
STT3DConvSimBlock2 models/video/models_consistency.py unverified licence not identified · pointer only · db29f802ea381aee · report
STT3DCosSimBlock models/video/models_consistency.py unverified licence not identified · pointer only · 27126ab3e795315a · report
STT3DMixingBlock models/video/models_consistency.py unverified licence not identified · pointer only · 7a10690af16c2868 · report
STT3DMixingLayer models/video/models_consistency.py unverified licence not identified · pointer only · 9c05757b057929a0 · report
get_matching_kpts models/video/models_consistency.py unverified licence not identified · pointer only · 2566c2e884ccf16f · report
parse_mixing_ops models/video/models_consistency.py unverified licence not identified · pointer only · fb03ee37c6f4f1a3 · report
parse_sim_ops models/video/models_consistency.py unverified licence not identified · pointer only · f4c0c6828919e5ca · report
warp in 27 papers models/video/models_consistency.py unverified licence not identified · pointer only · c03217842230837f · report
warp_batch models/video/models_consistency.py unverified licence not identified · pointer only · eed19af1a585edd7 · report

Method as code Syntology

What Syntology's graph records as this paper's claimed method, lifted into code: each assembly names its bricks (functions and classes), each with its own role and its own verification level. An assembly is not a check that the code implements the method correctly or reproduces the paper's results. Levels are each brick's own verification level in Syntology's graph (level 0: no recorded run), listed brick by brick and never combined into one level; “ran” means the brick executed on a synthesized input, not that its output is correct, and the instrument figure counts failures of Syntology's instrument, not of the code. Where a model read the code against the paper's claim, each assembly's label verdict is one model's judgement, kept in this page's JSON twin; it is not calibrated, so no card prints it.

1 assembly on this paper: 1 harvested, 0 generated.

harvested Assembly for Semantic Similarity Propagation (SSP) (graph method: Semantic Similarity Propagation (SSP)). 39 bricks; individually on a fixture: 25 ran (of which 15 constructed an object rather than computing a result; 20 with no instrument failure: 0 honoured, 0 violated, 20 with no contract checked; 5 where Syntology's instrument failed) · 14 unverified. The assembly has not been run end-to-end.

  1. ConsistencyWrapper entry · level 0 · unverified · 32d9a37f2197d508
  2. DiskFeatureRegistrator helper · level 0 · unverified · 0ea451382191a4af
  3. IdentityRegistrator helper · level 1 · ran · a270a720b90984f0
  4. MetricMeter helper · level 1 · ran · 5c6b14f527ed13b7
  5. TempConstLoss helper · level 1 · ran · a92fb745968521e5
  6. class_meanIoU helper · level 1 · ran; the contract check could not run (RAISES) · d347919e1bf4509d
  7. conditional_no_grad helper · level 1 · ran · our draft was wrong · 4db7a39c999d283b
  8. flowwarp helper · level 1 · ran · our draft was wrong · 446875b2982cc5dc
  9. meanIoU helper · level 1 · ran; the contract check could not run (RAISES) · 4f1bb8f28de5476d
  10. parse_mixing_ops helper · level 0 · unverified · fb03ee37c6f4f1a3
  11. parse_sim_ops helper · level 0 · unverified · f4c0c6828919e5ca
  12. soft_to_hard_labels helper · level 1 · ran; the contract check could not run (RAISES) · 6c2f180f76144ba4
  13. warp helper · level 0 · unverified · c03217842230837f
  14. warp_batch helper · level 0 · unverified · eed19af1a585edd7
  15. get_matching_kpts helper · level 0 · unverified · 2566c2e884ccf16f
  16. Conv2DMixingBlock helper · level 1 · ran · 5e791605cb7329d7
  17. Conv3DMixingBlock helper · level 1 · ran · 058734a67a781ac6
  18. IdMixingBlock helper · level 1 · ran · a4394ad61f3a1594
  19. STT2DMixingBlock helper · level 0 · unverified · fb5a9acbdef9723e
  20. STT3DMixingBlock model · level 0 · unverified · 7a10690af16c2868
  21. AverageSimBlock helper · level 1 · ran · d044b5ce825d4a5c
  22. ConstantSimBlock helper · level 1 · ran · 7f8e3f8b70d49c2f
  23. ConvSimBlock helper · level 1 · ran · 6c47c44ac4a36fd1
  24. ConvSimBlockBase helper · level 1 · ran · 73eebc021c081540
  25. ConvSimBlockv2 helper · level 1 · ran · 4c114e1ca34fdd56
  26. CossimSimBlock model · level 1 · ran · 7043870d374949b0
  27. STT3DConvSimBlock helper · level 0 · unverified · 313598e87d65c0b7
  28. STT3DConvSimBlock2 helper · level 0 · unverified · db29f802ea381aee
  29. STT3DCosSimBlock helper · level 0 · unverified · 27126ab3e795315a
  30. Conv2DMixingLayer helper · level 1 · ran · 07e2216dbbe99e90
  31. Conv3DMixingLayer helper · level 1 · ran · c78187c6d5ad1b68
  32. STT2DMixingLayer helper · level 0 · unverified · 9a15b215d04d0d28
  33. STT3DMixingLayer helper · level 0 · unverified · 9c05757b057929a0
  34. Mix_FFN2D helper · level 1 · ran · 9e6f6502476feed9
  35. ShiftedWindows_MSA_2D helper · level 1 · ran · ff7968971c45bd97
  36. Mix_FFN3D helper · level 1 · ran · 683a05a61bd8a4d6
  37. ShiftedWindows_MSA_3D helper · level 1 · ran · 95cad40f6f93b6d0
  38. WindowAttention2D helper · level 1 · ran · 2cd93b72e9eab106
  39. WindowAttention3D helper · level 1 · ran · 718fd35d460d708b

Each brick ends with its code_sha256, Syntology's identity for that exact code; click one to copy the get_code call that returns it. For agents, on Syntology's MCP service: assembly(arxiv_id="2503.15676") returns these assemblies with each brick's role and wiring (how to connect).

Tasks

Image SegmentationKnowledge DistillationSegmentationSemantic SegmentationSemantic SimilaritySemantic Textual SimilarityVideo Semantic Segmentation

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Methods

BASEKnowledge DistillationSPEED

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections