{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/learning-jpeg-compression-artifacts-for-image","title":"Learning JPEG Compression Artifacts for Image Manipulation Detection and Localization","arxiv_id":"2108.12947","date":"2021-08-30","proceeding":null,"authors":["Myung-Joon Kwon","Seung-Hun Nam","In-Jae Yu","Heung-Kyu Lee","Changick Kim"],"abstract":"Detecting and localizing image manipulation are necessary to counter malicious use of image editing techniques. Accordingly, it is essential to distinguish between authentic and tampered regions by analyzing intrinsic statistics in an image. We focus on JPEG compression artifacts left during image acquisition and editing. We propose a convolutional neural network (CNN) that uses discrete cosine transform (DCT) coefficients, where compression artifacts remain, to localize image manipulation. Standard CNNs cannot learn the distribution of DCT coefficients because the convolution throws away the spatial coordinates, which are essential for DCT coefficients. We illustrate how to design and train a neural network that can learn the distribution of DCT coefficients. Furthermore, we introduce Compression Artifact Tracing Network (CAT-Net) that jointly uses image acquisition artifacts and compression artifacts. It significantly outperforms traditional and deep neural network-based methods in detecting and localizing tampered regions.","url_abs":"https://arxiv.org/abs/2108.12947v2","url_pdf":"https://arxiv.org/pdf/2108.12947v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"learning-jpeg-compression-artifacts-for-image","repo_url":"https://github.com/mjkwon2021/cat-net","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"image-manipulation","task_name":"Image Manipulation"},{"task_slug":"image-manipulation-detection","task_name":"Image Manipulation Detection"},{"task_slug":"image-manipulation-localization","task_name":"Image Manipulation Localization"}],"methods":[{"method_slug":"convolution","method_name":"Convolution"},{"method_slug":"discrete-cosine-transform","method_name":"Discrete Cosine Transform"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/image-manipulation-detection-on-coverage","task":"Image Manipulation Detection","dataset":"COVERAGE","model":"CAT-Net v2","rank_in_archive_order":4,"of":8,"metrics":{"AUC":".680","Balanced Accuracy":".635"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-detection-on-casia-v1","task":"Image Manipulation Detection","dataset":"Casia V1+","model":"CAT-Net v2","rank_in_archive_order":3,"of":9,"metrics":{"AUC":".942","Balanced Accuracy":".838"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-detection-on-cocoglide","task":"Image Manipulation Detection","dataset":"CocoGlide","model":"CAT-Net v2","rank_in_archive_order":4,"of":8,"metrics":{"AUC":".667","Balanced Accuracy":".580"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-detection-on-columbia","task":"Image Manipulation Detection","dataset":"Columbia","model":"CAT-Net v2","rank_in_archive_order":4,"of":8,"metrics":{"AUC":".977","Balanced Accuracy":".803"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-detection-on-dso-1","task":"Image Manipulation Detection","dataset":"DSO-1","model":"CAT-Net v2","rank_in_archive_order":4,"of":9,"metrics":{"AUC":".747","Balanced Accuracy":".525"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-localization-on-casiav1","task":"Image Manipulation Localization","dataset":"CASIAv1(Protoclo-CAT)","model":"CAT-Net","rank_in_archive_order":3,"of":8,"metrics":{"Pixel Binary F1":"0.808"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-localization-on-coverage","task":"Image Manipulation Localization","dataset":"COVERAGE","model":"CAT-Net v2","rank_in_archive_order":9,"of":11,"metrics":{"Average Pixel F1(Fixed threshold)":".381"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-localization-on-coverage-1","task":"Image Manipulation Localization","dataset":"COVERAGE(Protocol-CAT)","model":"CAT-Net","rank_in_archive_order":5,"of":8,"metrics":{"Pixel Binary F1":"0.427"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-localization-on-casia-v1","task":"Image Manipulation Localization","dataset":"Casia V1+","model":"CAT-Net v2","rank_in_archive_order":6,"of":11,"metrics":{"Average Pixel F1(Fixed threshold)":".752"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-localization-on-cocoglide","task":"Image Manipulation Localization","dataset":"CocoGlide","model":"CAT-Net v2","rank_in_archive_order":10,"of":11,"metrics":{"Average Pixel F1(Fixed threshold)":".434"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-localization-on-columbia","task":"Image Manipulation Localization","dataset":"Columbia","model":"CAT-Net v2","rank_in_archive_order":6,"of":11,"metrics":{"Average Pixel F1(Fixed threshold)":".859"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-localization-on-columbia-1","task":"Image Manipulation Localization","dataset":"Columbia(Protocol-CAT)","model":"CAT-Net","rank_in_archive_order":3,"of":8,"metrics":{"Pixel Binary F1":"0.915"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-localization-on-dso-1","task":"Image Manipulation Localization","dataset":"DSO-1","model":"CAT-Net v2","rank_in_archive_order":7,"of":11,"metrics":{"Average Pixel F1(Fixed threshold)":".584"},"uses_additional_data":false},{"leaderboard":"/sota/image-manipulation-localization-on-nist16","task":"Image Manipulation Localization","dataset":"NIST16(Protocol-CAT)","model":"CAT-Net","rank_in_archive_order":6,"of":8,"metrics":{"Pixel Binary F1":"0.252"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2108.12947","atlas_url":"https://app.syntology.ai/?focus=2108.12947","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"2108.12947"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"2108.12947\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"2108.12947"},"call":"get_concepts_for_paper(arxiv_id=\"2108.12947\")"}],"by_repo":[{"repo":"mjkwon2021/cat-net","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"2ab98e80f1a77ba0286e562c8cb7442c92a521937590ab9809df5c1d91d0326a","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}