Papers › The 2018 PIRM Challenge on Perceptual Image Super-resolution

The 2018 PIRM Challenge on Perceptual Image Super-resolution

20 Sep 2018arXiv:1809.07517archive 2025-07-28

Yochai Blau, Roey Mechrez, Radu Timofte, Tomer Michaeli, Lihi Zelnik-Manor

This paper reports on the 2018 PIRM challenge on perceptual super-resolution (SR), held in conjunction with the Perceptual Image Restoration and Manipulation (PIRM) workshop at ECCV 2018. In contrast to previous SR challenges, our evaluation methodology jointly quantifies accuracy and perceptual quality, therefore enabling perceptual-driven methods to compete alongside algorithms that target PSNR maximization. Twenty-one participating teams introduced algorithms which well-improved upon the existing state-of-the-art methods in perceptual SR, as confirmed by a human opinion study. We also analyze popular image quality measures and draw conclusions regarding which of them correlates best with human opinion scores. We conclude with an analysis of the current trends in perceptual SR, as reflected from the leading submissions.

PaperPDFCode

In Syntology View this paper on Syntology, its page in Syntology's graph. That page lists the repositories linked to the paper, the abstract and the calls for agents.

Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, on Syntology's MCP service (how to connect):

Code

alterzero/DBPN-Pytorch mentioned on GitHubpytorchMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Deep Back-Projection Networks For Super-Resolution (arXiv:1803.02735; that paper's own run record: 14 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 1 violated, 11 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report
alterzero/RBPN-PyTorch mentioned on GitHubpytorchMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Recurrent Back-Projection Network for Video Super-Resolution (arXiv:1903.10128; that paper's own run record: 7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report
alterzero/STARnet mentioned on GitHubpytorchMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Space-Time-Aware Multi-Resolution Video Enhancement (arXiv:2003.13170; that paper's own run record: 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified); nothing checks that they implement this paper's method. report
idearibosome/tf-perceptual-eusr mentioned on GitHubtfApache-2.0Syntology: not harvested report
lizatish/My_CNN mentioned on GitHubpytorchSyntology: not harvested report
ryanxingql/image-quality-assessment-toolbox mentioned on GitHubpytorchSyntology: not harvested report
shnhrtkyk/satellite-super-resolution mentioned on GitHubpytorchSyntology: not harvested report
subeeshvasu/2018_subeesh_epsr_eccvw mentioned on GitHubpytorchMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Maintaining Natural Image Statistics with the Contextual Loss (arXiv:1803.04626; that paper's own run record: 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified); nothing checks that they implement this paper's method. report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

A paper named beside a repository with no sample linked to this paper is shown with that paper's own run record, not this paper's: “ran” means executed on a synthesized input, not that the code is correct, and “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Papers are listed in arXiv-id order, at most three per repository.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Image RestorationImage Super-ResolutionSuper-ResolutionVideo Quality Assessment

Datasets

Introduced by this paper, per the archive.

PIRM

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Video Quality Assessment MSU SR-QA Dataset PI KLCC 0.39101 #33 of 60 Archive leaderboard report
Video Quality Assessment MSU SR-QA Dataset PI PLCC 0.53178 #33 of 60 Archive leaderboard report
Video Quality Assessment MSU SR-QA Dataset PI SROCC 0.52319 #33 of 60 Archive leaderboard report
Video Quality Assessment MSU SR-QA Dataset PI Type NR #33 of 60 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections