{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/end2you-the-imperial-toolkit-for-multimodal","title":"End2You -- The Imperial Toolkit for Multimodal Profiling by End-to-End Learning","arxiv_id":"1802.01115","date":"2018-02-04","proceeding":null,"authors":["Panagiotis Tzirakis","Stefanos Zafeiriou","Bjorn W. Schuller"],"abstract":"We introduce End2You -- the Imperial College London toolkit for multimodal\nprofiling by end-to-end deep learning. End2You is an open-source toolkit\nimplemented in Python and is based on Tensorflow. It provides capabilities to\ntrain and evaluate models in an end-to-end manner, i.e., using raw input. It\nsupports input from raw audio, visual, physiological or other types of\ninformation or combination of those, and the output can be of an arbitrary\nrepresentation, for either classification or regression tasks. To our\nknowledge, this is the first toolkit that provides generic end-to-end learning\nfor profiling capabilities in either unimodal or multimodal cases. To test our\ntoolkit, we utilise the RECOLA database as was used in the AVEC 2016 challenge.\nExperimental results indicate that End2You can provide comparable results to\nstate-of-the-art methods despite no need of expert-alike feature\nrepresentations, but self-learning these from the data \"end to end\".","url_abs":"http://arxiv.org/abs/1802.01115v1","url_pdf":"http://arxiv.org/pdf/1802.01115v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"end2you-the-imperial-toolkit-for-multimodal","repo_url":"https://github.com/end2you/end2you","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"tf","reach":{"status":"unanswered"}}],"tasks":[{"task_slug":"self-learning","task_name":"Self-Learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1802.01115","atlas_url":"https://app.syntology.ai/?focus=1802.01115","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1802.01115"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1802.01115\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1802.01115"},"call":"get_concepts_for_paper(arxiv_id=\"1802.01115\")"}],"by_repo":[{"repo":"end2you/end2you","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"3062d277e924929d04a3212231fb532a48effd0cd920456a8757fff69eebe2be","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}