{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/biosentvec-creating-sentence-embeddings-for","title":"BioSentVec: creating sentence embeddings for biomedical texts","arxiv_id":"1810.09302","date":"2018-10-22","proceeding":null,"authors":["Qingyu Chen","Yifan Peng","Zhiyong Lu"],"abstract":"Sentence embeddings have become an essential part of today's natural language processing (NLP) systems, especially together advanced deep learning methods. Although pre-trained sentence encoders are available in the general domain, none exists for biomedical texts to date. In this work, we introduce BioSentVec: the first open set of sentence embeddings trained with over 30 million documents from both scholarly articles in PubMed and clinical notes in the MIMIC-III Clinical Database. We evaluate BioSentVec embeddings in two sentence pair similarity tasks in different text genres. Our benchmarking results demonstrate that the BioSentVec embeddings can better capture sentence semantics compared to the other competitive alternatives and achieve state-of-the-art performance in both tasks. We expect BioSentVec to facilitate the research and development in biomedical text mining and to complement the existing resources in biomedical word embeddings. BioSentVec is publicly available at https://github.com/ncbi-nlp/BioSentVec","url_abs":"https://arxiv.org/abs/1810.09302v6","url_pdf":"https://arxiv.org/pdf/1810.09302v6.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"biosentvec-creating-sentence-embeddings-for","repo_url":"https://github.com/ncbi-nlp/BioSentVec","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"biosentvec-creating-sentence-embeddings-for","repo_url":"https://github.com/ncbi-nlp/BioWordVec","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"biosentvec-creating-sentence-embeddings-for","repo_url":"https://github.com/ESBigeard/paper_graph","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok"}},{"paper_slug":"biosentvec-creating-sentence-embeddings-for","repo_url":"https://github.com/ncbi-nlp/BLUE_Benchmark","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"NOASSERTION"}}],"tasks":[{"task_slug":"articles","task_name":"Articles"},{"task_slug":"benchmarking","task_name":"Benchmarking"},{"task_slug":"sentence","task_name":"Sentence"},{"task_slug":"sentence-embeddings","task_name":"Sentence Embeddings"},{"task_slug":"sentence-embeddings-for-biomedical-texts","task_name":"Sentence Embeddings For Biomedical Texts"},{"task_slug":"word-embeddings","task_name":"Word Embeddings"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/sentence-embeddings-for-biomedical-texts-on","task":"Sentence Embeddings For Biomedical Texts","dataset":"BIOSSES","model":"BioSentVec (PubMed)","rank_in_archive_order":4,"of":14,"metrics":{"Pearson Correlation":"0.817"},"uses_additional_data":true},{"leaderboard":"/sota/sentence-embeddings-for-biomedical-texts-on","task":"Sentence Embeddings For Biomedical Texts","dataset":"BIOSSES","model":"BioSentVec (PubMed + MIMIC-III)","rank_in_archive_order":7,"of":14,"metrics":{"Pearson Correlation":"0.795"},"uses_additional_data":true},{"leaderboard":"/sota/sentence-embeddings-for-biomedical-texts-on","task":"Sentence Embeddings For Biomedical Texts","dataset":"BIOSSES","model":"BioSentVec (MIMIC-III)","rank_in_archive_order":12,"of":14,"metrics":{"Pearson Correlation":"0.350"},"uses_additional_data":true},{"leaderboard":"/sota/sentence-embeddings-for-biomedical-texts-on","task":"Sentence Embeddings For Biomedical Texts","dataset":"BIOSSES","model":"Universal Sentence Encoder","rank_in_archive_order":13,"of":14,"metrics":{"Pearson Correlation":"0.345"},"uses_additional_data":false},{"leaderboard":"/sota/sentence-embeddings-for-biomedical-texts-on-2","task":"Sentence Embeddings For Biomedical Texts","dataset":"MedSTS","model":"BioSentVec (PubMed + MIMIC-III)","rank_in_archive_order":1,"of":4,"metrics":{"Pearson Correlation":"0.767"},"uses_additional_data":true},{"leaderboard":"/sota/sentence-embeddings-for-biomedical-texts-on-2","task":"Sentence Embeddings For Biomedical Texts","dataset":"MedSTS","model":"BioSentVec (MIMIC-III)","rank_in_archive_order":2,"of":4,"metrics":{"Pearson Correlation":"0.759"},"uses_additional_data":true},{"leaderboard":"/sota/sentence-embeddings-for-biomedical-texts-on-2","task":"Sentence Embeddings For Biomedical Texts","dataset":"MedSTS","model":"BioSentVec (PubMed)","rank_in_archive_order":3,"of":4,"metrics":{"Pearson Correlation":"0.750"},"uses_additional_data":true},{"leaderboard":"/sota/sentence-embeddings-for-biomedical-texts-on-2","task":"Sentence Embeddings For Biomedical Texts","dataset":"MedSTS","model":"Universal Sentence Encoder","rank_in_archive_order":4,"of":4,"metrics":{"Pearson Correlation":"0.714"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/1810.09302","atlas_url":"https://app.syntology.ai/?focus=1810.09302","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1810.09302"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1810.09302\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1810.09302"},"call":"get_concepts_for_paper(arxiv_id=\"1810.09302\")"}],"by_repo":[{"repo":"ncbi-nlp/BioSentVec","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"ncbi-nlp/BioWordVec","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"ESBigeard/paper_graph","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"ncbi-nlp/BLUE_Benchmark","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"25352def640840fac3ab5bef330ca1d4dd7c6affa677938eb1a307a116ba312d","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}