{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/scam-transferring-humans-between-images-with","title":"SCAM! Transferring humans between images with Semantic Cross Attention Modulation","arxiv_id":"2210.04883","date":"2022-10-10","proceeding":null,"authors":["Nicolas Dufour","David Picard","Vicky Kalogeiton"],"abstract":"A large body of recent work targets semantically conditioned image generation. Most such methods focus on the narrower task of pose transfer and ignore the more challenging task of subject transfer that consists in not only transferring the pose but also the appearance and background. In this work, we introduce SCAM (Semantic Cross Attention Modulation), a system that encodes rich and diverse information in each semantic region of the image (including foreground and background), thus achieving precise generation with emphasis on fine details. This is enabled by the Semantic Attention Transformer Encoder that extracts multiple latent vectors for each semantic region, and the corresponding generator that exploits these multiple latents by using semantic cross attention modulation. It is trained only using a reconstruction setup, while subject transfer is performed at test time. Our analysis shows that our proposed architecture is successful at encoding the diversity of appearance in each semantic region. Extensive experiments on the iDesigner and CelebAMask-HD datasets show that SCAM outperforms SEAN and SPADE; moreover, it sets the new state of the art on subject transfer.","url_abs":"https://arxiv.org/abs/2210.04883v1","url_pdf":"https://arxiv.org/pdf/2210.04883v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"scam-transferring-humans-between-images-with","repo_url":"https://github.com/nicolas-dufour/SCAM","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"diversity","task_name":"Diversity"},{"task_slug":"image-generation","task_name":"Image Generation"},{"task_slug":"pose-transfer","task_name":"Pose Transfer"},{"task_slug":"reconstruction","task_name":"Reconstruction"},{"task_slug":"subject-transfer","task_name":"Subject Transfer"}],"methods":[{"method_slug":"absolute-position-encodings","method_name":"Absolute Position Encodings"},{"method_slug":"adam","method_name":"Adam"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"bpe","method_name":"BPE"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"label-smoothing","method_name":"Label Smoothing"},{"method_slug":"layer-normalization","method_name":"Layer Normalization"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"position-wise-feed-forward-layer","method_name":"Position-Wise Feed-Forward Layer"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"sca","method_name":"SCA"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"test","method_name":"Test"},{"method_slug":"transformer","method_name":"Transformer"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/pose-transfer-on-ade20k","task":"Pose Transfer","dataset":"ADE20K","model":"SCAM","rank_in_archive_order":1,"of":1,"metrics":{"FID":"27.5"},"uses_additional_data":false},{"leaderboard":"/sota/pose-transfer-on-celebamask-hq","task":"Pose Transfer","dataset":"CelebAMask-HQ","model":"SCAM","rank_in_archive_order":1,"of":1,"metrics":{"S-FID":"19.8"},"uses_additional_data":false},{"leaderboard":"/sota/pose-transfer-on-idesigner","task":"Pose Transfer","dataset":"iDesigner","model":"SCAM","rank_in_archive_order":1,"of":1,"metrics":{"S-FID":"26.9"},"uses_additional_data":false},{"leaderboard":"/sota/reconstruction-on-ade20k","task":"Reconstruction","dataset":"ADE20K","model":"SCAM","rank_in_archive_order":1,"of":1,"metrics":{"PSNR":"20"},"uses_additional_data":false},{"leaderboard":"/sota/reconstruction-on-celebamask-hq","task":"Reconstruction","dataset":"CelebAMask-HQ","model":"SCAM","rank_in_archive_order":1,"of":1,"metrics":{"PSNR":"21.9","R-FID":"15.5"},"uses_additional_data":false},{"leaderboard":"/sota/reconstruction-on-idesigner","task":"Reconstruction","dataset":"iDesigner","model":"SCAM","rank_in_archive_order":1,"of":1,"metrics":{"PSNR":"21.4","R-FID":"13.2"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2210.04883","atlas_url":"https://app.syntology.ai/?focus=2210.04883","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"2210.04883"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"2210.04883\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"2210.04883"},"call":"get_concepts_for_paper(arxiv_id=\"2210.04883\")"}],"by_repo":[{"repo":"nicolas-dufour/SCAM","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"53f02829ea6460ae5d0987d2a94faf54761f55d2efe3d6f3126c05de0fa0dee6","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}