{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/dataset/msu-sr-qa-dataset","name":"MSU SR-QA Dataset","full_name":"MSU Super-Resolution Quality Assessment Dataset","description_markdown":"Our dataset was made of videos from MSU Video Upscalers Benchmark Dataset, MSU Video Super-Resolution Benchmark Dataset and MSU Super-Resolution for Video Compression Benchmark Dataset. Dataset consists of real videos (were filmed with 2 cameras), video games footages, movies, cartoons, dynamic ads. \r\n\r\nHow we brought our dataset closer to completeness?\r\n* The dataset covers a large number of use cases in the field of SR due to the large number of content types\r\n* The dataset contains videos with completely different resolutions, FPS values: 8, 24, 25, 30, 60, as well as high and low spatio-temporal complexity\r\n* Distorted videos were obtained using 46 SR methods, some of them were preprocessed with 5 codecs: aomenc, vvenc, x264, x265, uavs3es with different bitrates and qp values\r\n* The dataset was manually checked for redundancy\r\n\r\nVideos from benchmarks are FullHD video crops, since the subjective comparison was made on crops. Therefore, the resolution of all videos in the received dataset is low.","description_withheld":null,"homepage":"https://videoprocessing.ai/benchmarks/super-resolution-metrics.html#home","introduced_date":"2024-03-04","introduced_date_note":null,"introduced_by":null,"license":null,"modalities":[{"name":"Videos","url":"/datasets/modality/videos"}],"tasks":[{"name":"Super-Resolution","url":"/task/super-resolution","datasets_with_task":"/datasets/task/super-resolution"},{"name":"Image Super-Resolution","url":"/task/image-super-resolution","datasets_with_task":"/datasets/task/image-super-resolution"},{"name":"Image Quality Assessment","url":"/task/image-quality-assessment","datasets_with_task":"/datasets/task/image-quality-assessment"},{"name":"Video Super-Resolution","url":"/task/video-super-resolution","datasets_with_task":"/datasets/task/video-super-resolution"},{"name":"Video Quality Assessment","url":"/task/video-quality-assessment","datasets_with_task":"/datasets/task/video-quality-assessment"}],"languages":[],"variants":["MSU SR-QA Dataset"],"data_loaders":[],"num_papers_in_archive":26,"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28"},"benchmarks":[{"leaderboard":"/sota/video-quality-assessment-on-msu-sr-qa-dataset","task":"Video Quality Assessment","dataset_variant":"MSU SR-QA Dataset","rows":60,"metrics":["SROCC","PLCC","KLCC","Type"],"first_row_in_archive_order":{"model":"PieAPP","paper":"/paper/pieapp-perceptual-image-error-assessment","metrics":{"KLCC":"0.61945","PLCC":"0.75743","SROCC":"0.75215","Type":"FR"},"code_links":[{"title":"prashnani/PerceptualImageError","url":"https://github.com/prashnani/PerceptualImageError"}]},"note":"rows are the archive's own order at snapshot; nothing here re-ranks them"}],"papers":{"order":"date (newest first), then slug","population":"every paper with a leaderboard row on this dataset's benchmarks (the benchmark-backed subset): the archive's own papers-using-this-dataset list was never published, so this is not that list; num_papers_in_archive is the archive's own count","page":1,"pages_in_order":1,"rows_per_page":100,"shown":26,"of":26,"counts":{"papers_with_a_benchmark_row":26,"with_a_code_link":23,"where_syntology_ran_a_sample":10,"not_listed_spam_title":0,"listed":26,"listed_where_code_ran":10,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":8,"every_run_a_failure_of_syntologys_instrument":2,"listed_with_a_run_with_no_instrument_failure":8,"listed_every_run_a_failure_of_syntologys_instrument":2,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers with at least one leaderboard row on this dataset's benchmarks; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"items":[{"paper":"/paper/q-align-teaching-lmms-for-visual-scoring-via","slug":"q-align-teaching-lmms-for-visual-scoring-via","title":"Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levels","date":"2023-12-28","arxiv_id":"2312.17090","rows_on_this_dataset":3,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":2,"samples_ran":2,"samples_constructed":0,"samples_ran_checked":1,"samples_ran_instrument_failed":1,"samples_unverified":0,"pointer_only_for_licence":2,"official":{"repos":["q-future/q-align"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/q-align-teaching-lmms-for-visual-scoring-via#ran","syntology_url":"https://syntology.ai/paper/2312.17090","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2312.17090"}}}},{"paper":"/paper/topiq-a-top-down-approach-from-semantics-to","slug":"topiq-a-top-down-approach-from-semantics-to","title":"TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessment","date":"2023-08-06","arxiv_id":"2308.03060","rows_on_this_dataset":8,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":10,"samples_ran":4,"samples_constructed":0,"samples_ran_checked":4,"samples_ran_instrument_failed":0,"samples_unverified":6,"pointer_only_for_licence":10,"official":{"repos":["chaofengc/iqa-pytorch"],"state":"official (archive's flag): 4 ran","n_ran":4,"n_constructed":0,"n_ran_no_instrument_failure":4,"n_unverified":6,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/topiq-a-top-down-approach-from-semantics-to#ran","syntology_url":"https://syntology.ai/paper/2308.03060","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2308.03060"}}}},{"paper":"/paper/vila-learning-image-aesthetics-from-user","slug":"vila-learning-image-aesthetics-from-user","title":"VILA: Learning Image Aesthetics from User Comments with Vision-Language Pretraining","date":"2023-03-24","arxiv_id":"2303.14302","rows_on_this_dataset":1,"code_links":2,"syntology":null},{"paper":"/paper/shift-tolerant-perceptual-similarity-metric-1","slug":"shift-tolerant-perceptual-similarity-metric-1","title":"Shift-tolerant Perceptual Similarity Metric","date":"2022-07-27","arxiv_id":"2207.13686","rows_on_this_dataset":2,"code_links":2,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":21,"samples_ran":8,"samples_constructed":0,"samples_ran_checked":1,"samples_ran_instrument_failed":7,"samples_unverified":13,"pointer_only_for_licence":4,"official":{"repos":["abhijay9/shifttolerant-lpips"],"state":"official (archive's flag): 8 ran","n_ran":8,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":13,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/shift-tolerant-perceptual-similarity-metric-1#ran","syntology_url":"https://syntology.ai/paper/2207.13686","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2207.13686"}}}},{"paper":"/paper/exploring-clip-for-assessing-the-look-and","slug":"exploring-clip-for-assessing-the-look-and","title":"Exploring CLIP for Assessing the Look and Feel of Images","date":"2022-07-25","arxiv_id":"2207.12396","rows_on_this_dataset":4,"code_links":1,"syntology":null},{"paper":"/paper/maniqa-multi-dimension-attention-network-for","slug":"maniqa-multi-dimension-attention-network-for","title":"MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessment","date":"2022-04-19","arxiv_id":"2204.08958","rows_on_this_dataset":1,"code_links":2,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":9,"samples_ran":8,"samples_constructed":0,"samples_ran_checked":7,"samples_ran_instrument_failed":1,"samples_unverified":1,"pointer_only_for_licence":0,"official":{"repos":["iigroup/maniqa"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/maniqa-multi-dimension-attention-network-for#ran","syntology_url":"https://syntology.ai/paper/2204.08958","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2204.08958"}}}},{"paper":"/paper/erqa-edge-restoration-quality-assessment-for","slug":"erqa-edge-restoration-quality-assessment-for","title":"ERQA: Edge-Restoration Quality Assessment for Video Super-Resolution","date":"2021-10-19","arxiv_id":"2110.09992","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/locally-adaptive-structure-and-texture","slug":"locally-adaptive-structure-and-texture","title":"Locally Adaptive Structure and Texture Similarity for Image Quality Assessment","date":"2021-10-16","arxiv_id":"2110.08521","rows_on_this_dataset":1,"code_links":0,"syntology":null},{"paper":"/paper/no-reference-image-quality-assessment-via-1","slug":"no-reference-image-quality-assessment-via-1","title":"No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistency","date":"2021-08-16","arxiv_id":"2108.06858","rows_on_this_dataset":3,"code_links":1,"syntology":null},{"paper":"/paper/musiq-multi-scale-image-quality-transformer","slug":"musiq-multi-scale-image-quality-transformer","title":"MUSIQ: Multi-scale Image Quality Transformer","date":"2021-08-12","arxiv_id":"2108.05997","rows_on_this_dataset":4,"code_links":2,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":6,"samples_ran":5,"samples_constructed":1,"samples_ran_checked":4,"samples_ran_instrument_failed":1,"samples_unverified":1,"pointer_only_for_licence":6,"official":{"repos":["google-research/google-research"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/musiq-multi-scale-image-quality-transformer#ran","syntology_url":"https://syntology.ai/paper/2108.05997","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2108.05997"}}}},{"paper":"/paper/unified-quality-assessment-of-in-the-wild","slug":"unified-quality-assessment-of-in-the-wild","title":"Unified Quality Assessment of In-the-Wild Videos with Mixed Datasets Training","date":"2020-11-09","arxiv_id":"2011.04263","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/norm-in-norm-loss-with-faster-convergence-and","slug":"norm-in-norm-loss-with-faster-convergence-and","title":"Norm-in-Norm Loss with Faster Convergence and Better Performance for Image Quality Assessment","date":"2020-08-10","arxiv_id":"2008.03889","rows_on_this_dataset":1,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":3,"samples_ran":3,"samples_constructed":0,"samples_ran_checked":0,"samples_ran_instrument_failed":3,"samples_unverified":0,"pointer_only_for_licence":3,"official":{"repos":["lidq92/LinearityIQA"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/norm-in-norm-loss-with-faster-convergence-and#ran","syntology_url":"https://syntology.ai/paper/2008.03889","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2008.03889"}}}},{"paper":"/paper/blindly-assess-image-quality-in-the-wild","slug":"blindly-assess-image-quality-in-the-wild","title":"Blindly Assess Image Quality in the Wild Guided by a Self-Adaptive Hyper Network","date":"2020-06-01","arxiv_id":null,"rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/image-quality-assessment-unifying-structure","slug":"image-quality-assessment-unifying-structure","title":"Image Quality Assessment: Unifying Structure and Texture Similarity","date":"2020-04-16","arxiv_id":"2004.07728","rows_on_this_dataset":1,"code_links":2,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":2,"samples_ran":2,"samples_constructed":0,"samples_ran_checked":1,"samples_ran_instrument_failed":1,"samples_unverified":0,"pointer_only_for_licence":0,"official":{"repos":["dingkeyan93/DISTS"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/image-quality-assessment-unifying-structure#ran","syntology_url":"https://syntology.ai/paper/2004.07728","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2004.07728"}}}},{"paper":"/paper/from-patches-to-pictures-paq-2-piq-mapping","slug":"from-patches-to-pictures-paq-2-piq-mapping","title":"From Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture Quality","date":"2019-12-20","arxiv_id":"1912.10088","rows_on_this_dataset":1,"code_links":2,"syntology":null},{"paper":"/paper/quality-assessment-of-in-the-wild-videos","slug":"quality-assessment-of-in-the-wild-videos","title":"Quality Assessment of In-the-Wild Videos","date":"2019-08-01","arxiv_id":"1908.00375","rows_on_this_dataset":1,"code_links":2,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":3,"samples_ran":2,"samples_constructed":0,"samples_ran_checked":1,"samples_ran_instrument_failed":1,"samples_unverified":1,"pointer_only_for_licence":0,"official":{"repos":["lidq92/VSFA"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":1,"ran_from_kinds":["listed","official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/quality-assessment-of-in-the-wild-videos#ran","syntology_url":"https://syntology.ai/paper/1908.00375","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1908.00375"}}}},{"paper":"/paper/blind-image-quality-assessment-using-a-deep","slug":"blind-image-quality-assessment-using-a-deep","title":"Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Network","date":"2019-07-05","arxiv_id":"1907.02665","rows_on_this_dataset":1,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":10,"samples_ran":9,"samples_constructed":0,"samples_ran_checked":5,"samples_ran_instrument_failed":4,"samples_unverified":1,"pointer_only_for_licence":3,"official":{"repos":["zwx8981/DBCNN-PyTorch"],"state":"official (archive's flag): 9 ran","n_ran":9,"n_constructed":0,"n_ran_no_instrument_failure":5,"n_unverified":1,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/blind-image-quality-assessment-using-a-deep#ran","syntology_url":"https://syntology.ai/paper/1907.02665","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1907.02665"}}}},{"paper":"/paper/the-2018-pirm-challenge-on-perceptual-image","slug":"the-2018-pirm-challenge-on-perceptual-image","title":"The 2018 PIRM Challenge on Perceptual Image Super-resolution","date":"2018-09-20","arxiv_id":"1809.07517","rows_on_this_dataset":1,"code_links":8,"syntology":null},{"paper":"/paper/pieapp-perceptual-image-error-assessment","slug":"pieapp-perceptual-image-error-assessment","title":"PieAPP: Perceptual Image-Error Assessment through Pairwise Preference","date":"2018-06-06","arxiv_id":"1806.02067","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/the-unreasonable-effectiveness-of-deep","slug":"the-unreasonable-effectiveness-of-deep","title":"The Unreasonable Effectiveness of Deep Features as a Perceptual Metric","date":"2018-01-11","arxiv_id":"1801.03924","rows_on_this_dataset":2,"code_links":24,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":2,"samples_ran":2,"samples_constructed":0,"samples_ran_checked":0,"samples_ran_instrument_failed":2,"samples_unverified":0,"pointer_only_for_licence":0,"official":{"repos":["richzhang/PerceptualSimilarity"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/the-unreasonable-effectiveness-of-deep#ran","syntology_url":"https://syntology.ai/paper/1801.03924","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1801.03924"}}}},{"paper":"/paper/nima-neural-image-assessment","slug":"nima-neural-image-assessment","title":"NIMA: Neural Image Assessment","date":"2017-09-15","arxiv_id":"1709.05424","rows_on_this_dataset":1,"code_links":12,"syntology":null},{"paper":"/paper/learning-a-no-reference-quality-metric-for","slug":"learning-a-no-reference-quality-metric-for","title":"Learning a No-Reference Quality Metric for Single-Image Super-Resolution","date":"2016-12-18","arxiv_id":"1612.05890","rows_on_this_dataset":1,"code_links":2,"syntology":null},{"paper":"/paper/no-reference-image-quality-assessment-in-the","slug":"no-reference-image-quality-assessment-in-the","title":"No-Reference Image Quality Assessment in the Spatial Domain","date":"2012-08-17","arxiv_id":null,"rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/fsim-a-feature-similarity-index-for-image","slug":"fsim-a-feature-similarity-index-for-image","title":"FSIM: A Feature Similarity Index for Image Quality Assessment","date":"2011-01-31","arxiv_id":null,"rows_on_this_dataset":1,"code_links":0,"syntology":null},{"paper":"/paper/multiscale-structural-similarity-for-image","slug":"multiscale-structural-similarity-for-image","title":"Multiscale structural similarity for image quality assessment","date":"2004-05-04","arxiv_id":null,"rows_on_this_dataset":4,"code_links":2,"syntology":null},{"paper":"/paper/image-quality-assessment-from-error","slug":"image-quality-assessment-from-error","title":"Image quality assessment: from error visibility to structural similarity","date":"2004-04-13","arxiv_id":null,"rows_on_this_dataset":1,"code_links":0,"syntology":null}],"full_list":"papers_with_a_benchmark_row: every listed paper, in this order"},"papers_with_a_benchmark_row":[{"paper":"/paper/q-align-teaching-lmms-for-visual-scoring-via","slug":"q-align-teaching-lmms-for-visual-scoring-via","title":"Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levels","date":"2023-12-28","arxiv_id":"2312.17090","rows_on_this_dataset":3,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":2,"samples_ran":2,"samples_constructed":0,"samples_ran_checked":1,"samples_ran_instrument_failed":1,"samples_unverified":0,"pointer_only_for_licence":2,"official":{"repos":["q-future/q-align"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/q-align-teaching-lmms-for-visual-scoring-via#ran","syntology_url":"https://syntology.ai/paper/2312.17090","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2312.17090"}}}},{"paper":"/paper/topiq-a-top-down-approach-from-semantics-to","slug":"topiq-a-top-down-approach-from-semantics-to","title":"TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessment","date":"2023-08-06","arxiv_id":"2308.03060","rows_on_this_dataset":8,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":10,"samples_ran":4,"samples_constructed":0,"samples_ran_checked":4,"samples_ran_instrument_failed":0,"samples_unverified":6,"pointer_only_for_licence":10,"official":{"repos":["chaofengc/iqa-pytorch"],"state":"official (archive's flag): 4 ran","n_ran":4,"n_constructed":0,"n_ran_no_instrument_failure":4,"n_unverified":6,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/topiq-a-top-down-approach-from-semantics-to#ran","syntology_url":"https://syntology.ai/paper/2308.03060","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2308.03060"}}}},{"paper":"/paper/vila-learning-image-aesthetics-from-user","slug":"vila-learning-image-aesthetics-from-user","title":"VILA: Learning Image Aesthetics from User Comments with Vision-Language Pretraining","date":"2023-03-24","arxiv_id":"2303.14302","rows_on_this_dataset":1,"code_links":2,"syntology":null},{"paper":"/paper/shift-tolerant-perceptual-similarity-metric-1","slug":"shift-tolerant-perceptual-similarity-metric-1","title":"Shift-tolerant Perceptual Similarity Metric","date":"2022-07-27","arxiv_id":"2207.13686","rows_on_this_dataset":2,"code_links":2,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":21,"samples_ran":8,"samples_constructed":0,"samples_ran_checked":1,"samples_ran_instrument_failed":7,"samples_unverified":13,"pointer_only_for_licence":4,"official":{"repos":["abhijay9/shifttolerant-lpips"],"state":"official (archive's flag): 8 ran","n_ran":8,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":13,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/shift-tolerant-perceptual-similarity-metric-1#ran","syntology_url":"https://syntology.ai/paper/2207.13686","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2207.13686"}}}},{"paper":"/paper/exploring-clip-for-assessing-the-look-and","slug":"exploring-clip-for-assessing-the-look-and","title":"Exploring CLIP for Assessing the Look and Feel of Images","date":"2022-07-25","arxiv_id":"2207.12396","rows_on_this_dataset":4,"code_links":1,"syntology":null},{"paper":"/paper/maniqa-multi-dimension-attention-network-for","slug":"maniqa-multi-dimension-attention-network-for","title":"MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessment","date":"2022-04-19","arxiv_id":"2204.08958","rows_on_this_dataset":1,"code_links":2,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":9,"samples_ran":8,"samples_constructed":0,"samples_ran_checked":7,"samples_ran_instrument_failed":1,"samples_unverified":1,"pointer_only_for_licence":0,"official":{"repos":["iigroup/maniqa"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/maniqa-multi-dimension-attention-network-for#ran","syntology_url":"https://syntology.ai/paper/2204.08958","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2204.08958"}}}},{"paper":"/paper/erqa-edge-restoration-quality-assessment-for","slug":"erqa-edge-restoration-quality-assessment-for","title":"ERQA: Edge-Restoration Quality Assessment for Video Super-Resolution","date":"2021-10-19","arxiv_id":"2110.09992","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/locally-adaptive-structure-and-texture","slug":"locally-adaptive-structure-and-texture","title":"Locally Adaptive Structure and Texture Similarity for Image Quality Assessment","date":"2021-10-16","arxiv_id":"2110.08521","rows_on_this_dataset":1,"code_links":0,"syntology":null},{"paper":"/paper/no-reference-image-quality-assessment-via-1","slug":"no-reference-image-quality-assessment-via-1","title":"No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistency","date":"2021-08-16","arxiv_id":"2108.06858","rows_on_this_dataset":3,"code_links":1,"syntology":null},{"paper":"/paper/musiq-multi-scale-image-quality-transformer","slug":"musiq-multi-scale-image-quality-transformer","title":"MUSIQ: Multi-scale Image Quality Transformer","date":"2021-08-12","arxiv_id":"2108.05997","rows_on_this_dataset":4,"code_links":2,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":6,"samples_ran":5,"samples_constructed":1,"samples_ran_checked":4,"samples_ran_instrument_failed":1,"samples_unverified":1,"pointer_only_for_licence":6,"official":{"repos":["google-research/google-research"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/musiq-multi-scale-image-quality-transformer#ran","syntology_url":"https://syntology.ai/paper/2108.05997","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2108.05997"}}}},{"paper":"/paper/unified-quality-assessment-of-in-the-wild","slug":"unified-quality-assessment-of-in-the-wild","title":"Unified Quality Assessment of In-the-Wild Videos with Mixed Datasets Training","date":"2020-11-09","arxiv_id":"2011.04263","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/norm-in-norm-loss-with-faster-convergence-and","slug":"norm-in-norm-loss-with-faster-convergence-and","title":"Norm-in-Norm Loss with Faster Convergence and Better Performance for Image Quality Assessment","date":"2020-08-10","arxiv_id":"2008.03889","rows_on_this_dataset":1,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":3,"samples_ran":3,"samples_constructed":0,"samples_ran_checked":0,"samples_ran_instrument_failed":3,"samples_unverified":0,"pointer_only_for_licence":3,"official":{"repos":["lidq92/LinearityIQA"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/norm-in-norm-loss-with-faster-convergence-and#ran","syntology_url":"https://syntology.ai/paper/2008.03889","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2008.03889"}}}},{"paper":"/paper/blindly-assess-image-quality-in-the-wild","slug":"blindly-assess-image-quality-in-the-wild","title":"Blindly Assess Image Quality in the Wild Guided by a Self-Adaptive Hyper Network","date":"2020-06-01","arxiv_id":null,"rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/image-quality-assessment-unifying-structure","slug":"image-quality-assessment-unifying-structure","title":"Image Quality Assessment: Unifying Structure and Texture Similarity","date":"2020-04-16","arxiv_id":"2004.07728","rows_on_this_dataset":1,"code_links":2,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":2,"samples_ran":2,"samples_constructed":0,"samples_ran_checked":1,"samples_ran_instrument_failed":1,"samples_unverified":0,"pointer_only_for_licence":0,"official":{"repos":["dingkeyan93/DISTS"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed","official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/image-quality-assessment-unifying-structure#ran","syntology_url":"https://syntology.ai/paper/2004.07728","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2004.07728"}}}},{"paper":"/paper/from-patches-to-pictures-paq-2-piq-mapping","slug":"from-patches-to-pictures-paq-2-piq-mapping","title":"From Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture Quality","date":"2019-12-20","arxiv_id":"1912.10088","rows_on_this_dataset":1,"code_links":2,"syntology":null},{"paper":"/paper/quality-assessment-of-in-the-wild-videos","slug":"quality-assessment-of-in-the-wild-videos","title":"Quality Assessment of In-the-Wild Videos","date":"2019-08-01","arxiv_id":"1908.00375","rows_on_this_dataset":1,"code_links":2,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":3,"samples_ran":2,"samples_constructed":0,"samples_ran_checked":1,"samples_ran_instrument_failed":1,"samples_unverified":1,"pointer_only_for_licence":0,"official":{"repos":["lidq92/VSFA"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":1,"ran_from_kinds":["listed","official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/quality-assessment-of-in-the-wild-videos#ran","syntology_url":"https://syntology.ai/paper/1908.00375","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1908.00375"}}}},{"paper":"/paper/blind-image-quality-assessment-using-a-deep","slug":"blind-image-quality-assessment-using-a-deep","title":"Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Network","date":"2019-07-05","arxiv_id":"1907.02665","rows_on_this_dataset":1,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":10,"samples_ran":9,"samples_constructed":0,"samples_ran_checked":5,"samples_ran_instrument_failed":4,"samples_unverified":1,"pointer_only_for_licence":3,"official":{"repos":["zwx8981/DBCNN-PyTorch"],"state":"official (archive's flag): 9 ran","n_ran":9,"n_constructed":0,"n_ran_no_instrument_failure":5,"n_unverified":1,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/blind-image-quality-assessment-using-a-deep#ran","syntology_url":"https://syntology.ai/paper/1907.02665","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1907.02665"}}}},{"paper":"/paper/the-2018-pirm-challenge-on-perceptual-image","slug":"the-2018-pirm-challenge-on-perceptual-image","title":"The 2018 PIRM Challenge on Perceptual Image Super-resolution","date":"2018-09-20","arxiv_id":"1809.07517","rows_on_this_dataset":1,"code_links":8,"syntology":null},{"paper":"/paper/pieapp-perceptual-image-error-assessment","slug":"pieapp-perceptual-image-error-assessment","title":"PieAPP: Perceptual Image-Error Assessment through Pairwise Preference","date":"2018-06-06","arxiv_id":"1806.02067","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/the-unreasonable-effectiveness-of-deep","slug":"the-unreasonable-effectiveness-of-deep","title":"The Unreasonable Effectiveness of Deep Features as a Perceptual Metric","date":"2018-01-11","arxiv_id":"1801.03924","rows_on_this_dataset":2,"code_links":24,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":2,"samples_ran":2,"samples_constructed":0,"samples_ran_checked":0,"samples_ran_instrument_failed":2,"samples_unverified":0,"pointer_only_for_licence":0,"official":{"repos":["richzhang/PerceptualSimilarity"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/the-unreasonable-effectiveness-of-deep#ran","syntology_url":"https://syntology.ai/paper/1801.03924","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1801.03924"}}}},{"paper":"/paper/nima-neural-image-assessment","slug":"nima-neural-image-assessment","title":"NIMA: Neural Image Assessment","date":"2017-09-15","arxiv_id":"1709.05424","rows_on_this_dataset":1,"code_links":12,"syntology":null},{"paper":"/paper/learning-a-no-reference-quality-metric-for","slug":"learning-a-no-reference-quality-metric-for","title":"Learning a No-Reference Quality Metric for Single-Image Super-Resolution","date":"2016-12-18","arxiv_id":"1612.05890","rows_on_this_dataset":1,"code_links":2,"syntology":null},{"paper":"/paper/no-reference-image-quality-assessment-in-the","slug":"no-reference-image-quality-assessment-in-the","title":"No-Reference Image Quality Assessment in the Spatial Domain","date":"2012-08-17","arxiv_id":null,"rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/fsim-a-feature-similarity-index-for-image","slug":"fsim-a-feature-similarity-index-for-image","title":"FSIM: A Feature Similarity Index for Image Quality Assessment","date":"2011-01-31","arxiv_id":null,"rows_on_this_dataset":1,"code_links":0,"syntology":null},{"paper":"/paper/multiscale-structural-similarity-for-image","slug":"multiscale-structural-similarity-for-image","title":"Multiscale structural similarity for image quality assessment","date":"2004-05-04","arxiv_id":null,"rows_on_this_dataset":4,"code_links":2,"syntology":null},{"paper":"/paper/image-quality-assessment-from-error","slug":"image-quality-assessment-from-error","title":"Image quality assessment: from error visibility to structural similarity","date":"2004-04-13","arxiv_id":null,"rows_on_this_dataset":1,"code_links":0,"syntology":null}],"papers_where_code_ran":10,"papers_where_code_ran_first_page":"/dataset/msu-sr-qa-dataset/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not run it on this dataset or check it against this dataset's benchmarks.","pages":[{"order":"ran","page":1,"of":1,"url":"/dataset/msu-sr-qa-dataset/papers/ran/1","json":"/dataset/msu-sr-qa-dataset/papers/ran/1.json","rows":10}],"row_route":"each paper's syntology object carries sample_list (this site's paper page, #ran), syntology_url (syntology.ai's page for the paper, only when that route probed live) and mcp (the agent call that lists the paper's harvested samples; not a verdict on the paper)","developers":"https://syntology.ai/developers","syntology_totals":{"read_at":"2026-10-05T00:36:11+00:00","papers_with_samples":10,"samples_harvested":68,"samples_ran":45,"samples_constructed":1,"samples_ran_checked":24,"samples_ran_instrument_failed":21,"samples_unverified":23,"pointer_only_for_licence":28,"papers_with_no_sample_that_ran":0,"papers_with_a_sample_that_ran":10,"papers_with_a_run_with_no_instrument_failure":8,"papers_where_every_run_was_an_instrument_failure":2,"note":"the per-paper counts of every listed paper (all pages), summed; not a rate"},"key_notes":{"samples_ran_checked":"legacy name, kept unchanged so existing readers do not break: it counts the samples that ran with no instrument failure (honoured, violated, and ran with no contract checked); it does not mean a contract was checked, and the pages print it as 'K with no instrument failure', not 'K checked'","samples_constructed":"a sub-count of the samples that ran, never subtracted from them and never a failure: an executed sample whose run returned an instance of its own class (fixture_out_type equals the entry name): the run built an object and did not compute a result (Syntology's RAN record, counts.constructed)"},"since_archive_judged":{"papers":0,"papers_placed":0,"judged_by":{"model":"a model","models_as_recorded":[],"from":"lb_rows_run_verified.jsonl: each record's `model` field (the extractor's call that wrote decisions[])"},"note":"a model's judgement from the paper's own tables that they report on this leaderboard, not a result: no value from a paper that was not placed is printed or carried here; papers counts each paper once over these leaderboards","backfill":"8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read)","backfill_complete":false,"leaderboards":[]},"papers_note":"The archive never published its papers-using-dataset list; these are papers with a leaderboard row on this dataset's benchmarks.","record_sha256":"ee599d1477ea5bc998e9462078eaa99710064a1d60aec06279050476649bccb8","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}