{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/joint-action-unit-localisation-and-intensity","title":"Joint Action Unit localisation and intensity estimation through heatmap regression","arxiv_id":"1805.03487","date":"2018-05-09","proceeding":null,"authors":["Enrique Sanchez-Lozano","Georgios Tzimiropoulos","Michel Valstar"],"abstract":"This paper proposes a supervised learning approach to jointly perform facial\nAction Unit (AU) localisation and intensity estimation. Contrary to previous\nworks that try to learn an unsupervised representation of the Action Unit\nregions, we propose to directly and jointly estimate all AU intensities through\nheatmap regression, along with the location in the face where they cause\nvisible changes. Our approach aims to learn a pixel-wise regression function\nreturning a score per AU, which indicates an AU intensity at a given spatial\nlocation. Heatmap regression then generates an image, or channel, per AU, in\nwhich each pixel indicates the corresponding AU intensity. To generate the\nground-truth heatmaps for a target AU, the facial landmarks are first\nestimated, and a 2D Gaussian is drawn around the points where the AU is known\nto cause changes. The amplitude and size of the Gaussian is determined by the\nintensity of the AU. We show that using a single Hourglass network suffices to\nattain new state of the art results, demonstrating the effectiveness of such a\nsimple approach. The use of heatmap regression allows learning of a shared\nrepresentation between AUs without the need to rely on latent representations,\nas these are implicitly learned from the data. We validate the proposed\napproach on the BP4D dataset, showing a modest improvement on recent, complex,\ntechniques, as well as robustness against misalignment errors. Code for testing\nand models will be available to download from\nhttps://github.com/ESanchezLozano/Action-Units-Heatmaps.","url_abs":"http://arxiv.org/abs/1805.03487v2","url_pdf":"http://arxiv.org/pdf/1805.03487v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"joint-action-unit-localisation-and-intensity","repo_url":"https://github.com/ESanchezLozano/Action-Units-Heatmaps","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":{"status":"ok"}}],"tasks":[{"task_slug":"regression-1","task_name":"regression"}],"methods":[{"method_slug":"heatmap","method_name":"Heatmap"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1805.03487","atlas_url":"https://app.syntology.ai/?focus=1805.03487","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1805.03487"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1805.03487\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1805.03487"},"call":"get_concepts_for_paper(arxiv_id=\"1805.03487\")"}],"by_repo":[{"repo":"ESanchezLozano/Action-Units-Heatmaps","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"cbdf3051889205ae60b2c92c7abaf7b38971ccb460501404afc37409763d214c","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}