{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/unifying-molecular-and-textual","title":"Unifying Molecular and Textual Representations via Multi-task Language Modelling","arxiv_id":"2301.12586","date":"2023-01-29","proceeding":null,"authors":["Dimitrios Christofidellis","Giorgio Giannone","Jannis Born","Ole Winther","Teodoro Laino","Matteo Manica"],"abstract":"The recent advances in neural language models have also been successfully applied to the field of chemistry, offering generative solutions for classical problems in molecular design and synthesis planning. These new methods have the potential to fuel a new era of data-driven automation in scientific discovery. However, specialized models are still typically required for each task, leading to the need for problem-specific fine-tuning and neglecting task interrelations. The main obstacle in this field is the lack of a unified representation between natural language and chemical representations, complicating and limiting human-machine interaction. Here, we propose the first multi-domain, multi-task language model that can solve a wide range of tasks in both the chemical and natural language domains. Our model can handle chemical and natural language concurrently, without requiring expensive pre-training on single domains or task-specific models. Interestingly, sharing weights across domains remarkably improves our model when benchmarked against state-of-the-art baselines on single-domain and cross-domain tasks. In particular, sharing information across domains and tasks gives rise to large improvements in cross-domain tasks, the magnitude of which increase with scale, as measured by more than a dozen of relevant metrics. Our work suggests that such models can robustly and efficiently accelerate discovery in physical sciences by superseding problem-specific fine-tuning and enhancing human-model interactions.","url_abs":"https://arxiv.org/abs/2301.12586v2","url_pdf":"https://arxiv.org/pdf/2301.12586v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"unifying-molecular-and-textual","repo_url":"https://github.com/gt4sd/multitask_text_and_chemistry_t5","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}}],"tasks":[{"task_slug":"language-modelling","task_name":"Language Modelling"},{"task_slug":"molecule-captioning","task_name":"Molecule Captioning"},{"task_slug":"multi-task-learning","task_name":"Multi-Task Learning"},{"task_slug":"text-based-de-novo-molecule-generation","task_name":"Text-based de novo Molecule Generation"},{"task_slug":"scientific-discovery","task_name":"scientific discovery"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/molecule-captioning-on-chebi-20","task":"Molecule Captioning","dataset":"ChEBI-20","model":"Text+Chem T5-augm-Base","rank_in_archive_order":6,"of":33,"metrics":{"BLEU-2":"62.5","BLEU-4":"54.2","METEOR":"64.8","ROUGE-1":"68.2","ROUGE-2":"54.3","ROUGE-L":"62.2"},"uses_additional_data":false},{"leaderboard":"/sota/molecule-captioning-on-chebi-20","task":"Molecule Captioning","dataset":"ChEBI-20","model":"Text+Chem T5-Base","rank_in_archive_order":19,"of":33,"metrics":{"BLEU-2":"58","BLEU-4":"49","METEOR":"60.4","ROUGE-1":"64.7","ROUGE-2":"49.8","ROUGE-L":"58.6"},"uses_additional_data":false},{"leaderboard":"/sota/molecule-captioning-on-chebi-20","task":"Molecule Captioning","dataset":"ChEBI-20","model":"Text+Chem T5-augm-Small","rank_in_archive_order":23,"of":33,"metrics":{"BLEU-2":"56.0","BLEU-4":"47.0","METEOR":"58.8","ROUGE-1":"63.8","ROUGE-2":"48.8","ROUGE-L":"58"},"uses_additional_data":false},{"leaderboard":"/sota/molecule-captioning-on-chebi-20","task":"Molecule Captioning","dataset":"ChEBI-20","model":"Text+Chem T5-Small","rank_in_archive_order":24,"of":33,"metrics":{"BLEU-2":"55.3","BLEU-4":"46.2","METEOR":"58.3","ROUGE-1":"63.3","ROUGE-2":"48.1","ROUGE-L":"57.4"},"uses_additional_data":false},{"leaderboard":"/sota/text-based-de-novo-molecule-generation-on","task":"Text-based de novo Molecule Generation","dataset":"ChEBI-20","model":"Text+Chem T5-augm base","rank_in_archive_order":7,"of":20,"metrics":{"BLEU":"85.3","Exact Match":"32.2","Frechet ChemNet Distance (FCD)":".05","Levenshtein":"16.87","MACCS FTS":"90.1","Morgan FTS":"75.7","Parameter Count":"220000000","RDK FTS":"81.6","Validity":"94.3"},"uses_additional_data":false},{"leaderboard":"/sota/text-based-de-novo-molecule-generation-on","task":"Text-based de novo Molecule Generation","dataset":"ChEBI-20","model":"Text+Chem T5-augm small","rank_in_archive_order":11,"of":20,"metrics":{"BLEU":"81.5","Exact Match":"19.1","Frechet ChemNet Distance (FCD)":"0.06","Levenshtein":"21.78","MACCS FTS":"86.4","Morgan FTS":"67.2","Parameter Count":"60000000","RDK FTS":"74.4","Validity":"95.1"},"uses_additional_data":false},{"leaderboard":"/sota/text-based-de-novo-molecule-generation-on","task":"Text-based de novo Molecule Generation","dataset":"ChEBI-20","model":"Text+Chem T5 base","rank_in_archive_order":18,"of":20,"metrics":{"BLEU":"75","Exact Match":"21.2","Frechet ChemNet Distance (FCD)":"0.061","Levenshtein":"27.39","MACCS FTS":"87.4","Morgan FTS":"69.7","Parameter Count":"220000000","RDK FTS":"76.7","Validity":"79.2"},"uses_additional_data":false},{"leaderboard":"/sota/text-based-de-novo-molecule-generation-on","task":"Text-based de novo Molecule Generation","dataset":"ChEBI-20","model":"Text+Chem T5 small","rank_in_archive_order":19,"of":20,"metrics":{"BLEU":"73.9","Exact Match":"15.7","Frechet ChemNet Distance (FCD)":"0.066","Levenshtein":"28.54","MACCS FTS":"85.9","Morgan FTS":"66","Parameter Count":"60000000","RDK FTS":"73.6","Validity":"77.6"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2301.12586","atlas_url":"https://app.syntology.ai/?focus=2301.12586","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"2301.12586"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"2301.12586\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"2301.12586"},"call":"get_concepts_for_paper(arxiv_id=\"2301.12586\")"}],"by_repo":[{"repo":"gt4sd/multitask_text_and_chemistry_t5","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"2846881edf77a71d8657349be04faec635bc1ea141568a8922c58fec6cfc9673","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}