Papers › Rethinking Dilated Convolution for Real-time Semantic Segmentation

Rethinking Dilated Convolution for Real-time Semantic Segmentation

18 Nov 2021arXiv:2111.09957archive 2025-07-28

Roland Gao

The field-of-view is an important metric when designing a model for semantic segmentation. To obtain a large field-of-view, previous approaches generally choose to rapidly downsample the resolution, usually with average poolings or stride 2 convolutions. We take a different approach by using dilated convolutions with large dilation rates throughout the backbone, allowing the backbone to easily tune its field-of-view by adjusting its dilation rates, and show that it's competitive with existing approaches. To effectively use the dilated convolution, we show a simple upper bound on the dilation rate in order to not leave gaps in between the convolutional weights, and design an SE-ResNeXt inspired block structure that uses two parallel 3×3 convolutions with different dilation rates to preserve the local details. Manually tuning the dilation rates for every block can be difficult, so we also introduce a differentiable neural architecture search method that uses gradient descent to optimize the dilation rates. In addition, we propose a lightweight decoder that restores local information better than common alternatives. To demonstrate the effectiveness of our approach, our model RegSeg achieves competitive results on real-time Cityscapes and CamVid datasets. Using a T4 GPU with mixed precision, RegSeg achieves 78.3 mIOU on Cityscapes test set at 37 FPS, and 80.9 mIOU on CamVid test set at 112 FPS, both without ImageNet pretraining.

PaperPDFCode

Syntology This paper's arXiv id is not in Syntology's Atlas id list (549,449 ids, as this build read them; the read time is in the build record), so this page links to no Syntology page for it. The list is not the whole graph; Syntology's feed shows papers as they enter the graph.

Code

RolandGao/RegSeg officialmentioned on GitHubpytorchSyntology: not harvested report
Deci-AI/super-gradients mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Deep Residual Learning for Image Recognition (arXiv:1512.03385; that paper's own run record: 254 ran (of which 108 constructed an object rather than computing a result; 163 with no instrument failure: 3 honoured, 1 violated, 159 with no contract checked; 91 where Syntology's instrument failed) · 123 unverified), MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications (arXiv:1704.04861; that paper's own run record: 53 ran (of which 28 constructed an object rather than computing a result; 44 with no instrument failure: 4 honoured, 0 violated, 40 with no contract checked; 9 where Syntology's instrument failed) · 30 unverified), RepVGG: Making VGG-style ConvNets Great Again (arXiv:2101.03697; that paper's own run record: 13 ran (of which 7 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 5 where Syntology's instrument failed) · 3 unverified) and 1 more (every one in this page's JSON twin); nothing checks that they implement this paper's method. report
zh320/realtime-semantic-segmentation-pytorch mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to CGNet: A Light-weight Context Guided Network for Semantic Segmentation (arXiv:1811.08201; that paper's own run record: 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified), ESPNetv2: A Light-weight, Power Efficient, and General Purpose Convolutional Neural Network (arXiv:1811.11431; that paper's own run record: 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified), Lite-HRNet: A Lightweight High-Resolution Network (arXiv:2104.06403; that paper's own run record: 13 ran (of which 2 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 2 where Syntology's instrument failed) · 16 unverified) and 1 more (every one in this page's JSON twin); nothing checks that they implement this paper's method. report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

A paper named beside a repository with no sample linked to this paper is shown with that paper's own run record, not this paper's: “ran” means executed on a synthesized input, not that the code is correct, and “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Papers are listed in arXiv-id order, at most three per repository.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

DecoderNeural Architecture SearchReal-Time Semantic SegmentationSemantic Segmentation

1 archive task tag without a task page not shown.

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Real-Time Semantic Segmentation CamVid RegSeg(Cityscapes-Pretrained) Frame (fps) 70 #3 of 29 Archive leaderboard report
Real-Time Semantic Segmentation CamVid RegSeg(Cityscapes-Pretrained) Time (ms) 14 #3 of 29 Archive leaderboard report
Real-Time Semantic Segmentation CamVid RegSeg(Cityscapes-Pretrained) mIoU 80.9 #3 of 29 Archive leaderboard report
Real-Time Semantic Segmentation Cityscapes test RegSeg (no ImageNet pretraining) Frame (fps) 30 #5 of 39 Archive leaderboard report
Real-Time Semantic Segmentation Cityscapes test RegSeg (no ImageNet pretraining) Time (ms) 33 #5 of 39 Archive leaderboard report
Real-Time Semantic Segmentation Cityscapes test RegSeg (no ImageNet pretraining) mIoU 78.3% #5 of 39 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

1x1 ConvolutionBatch NormalizationConvolutionDilated ConvolutionGrouped ConvolutionReLUResNeXtResNeXt BlockResidual Connection

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections