{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/internlm-xcomposer-a-vision-language-large","title":"InternLM-XComposer: A Vision-Language Large Model for Advanced Text-image Comprehension and Composition","arxiv_id":"2309.15112","date":"2023-09-26","proceeding":null,"authors":["Pan Zhang","Xiaoyi Dong","Bin Wang","Yuhang Cao","Chao Xu","Linke Ouyang","Zhiyuan Zhao","Haodong Duan","Songyang Zhang","Shuangrui Ding","Wenwei Zhang","Hang Yan","Xinyue Zhang","Wei Li","Jingwen Li","Kai Chen","Conghui He","Xingcheng Zhang","Yu Qiao","Dahua Lin","Jiaqi Wang"],"abstract":"We propose InternLM-XComposer, a vision-language large model that enables advanced image-text comprehension and composition. The innovative nature of our model is highlighted by three appealing properties: 1) Interleaved Text-Image Composition: InternLM-XComposer can effortlessly generate coherent and contextual articles that seamlessly integrate images, providing a more engaging and immersive reading experience. Simply provide a writing instruction, and our system will generate the corresponding manuscript. It can intelligently identify the areas in the text where images would enhance the content and automatically insert the most appropriate visual candidates. 2) Comprehension with Rich Multilingual Knowledge: The text-image comprehension is empowered by training on an extensive multi-modal multilingual database with carefully crafted strategies, resulting in a deep understanding of visual content. 3) State-of-the-art Performance: Our model consistently achieves state-of-the-art results across various mainstream benchmarks for vision-language foundational models, including MME Benchmark, MMBench, MMBench-CN, Seed-Bench, CCBench (Chinese Cultural Benchmark), QBench and Tiny LVLM. Owing to the absence of established metrics for quantitatively assessing text-image composition, we have devised a robust evaluation procedure that comprises both human and GPT4-Vision (GPT4-V) to ensure reliability. Notably, our InternLM-XComposer achieves competitive text-image composition scores compared to public solutions, including GPT4-V and GPT3.5. Collectively, InternLM-XComposer seamlessly blends advanced text-image comprehension and composition, revolutionizing vision-language interaction and offering new insights and opportunities. The InternLM-XComposer model series are publicly available at https://github.com/InternLM/InternLM-XComposer.","url_abs":"https://arxiv.org/abs/2309.15112v5","url_pdf":"https://arxiv.org/pdf/2309.15112v5.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"internlm-xcomposer-a-vision-language-large","repo_url":"https://github.com/internlm/internlm-xcomposer","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"internlm-xcomposer-a-vision-language-large","repo_url":"https://github.com/MS-P3/code3/tree/main/internlm","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"internlm-xcomposer-a-vision-language-large","repo_url":"https://github.com/MindSpore-scientific-2/code-14/tree/main/internlm","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null}],"tasks":[{"task_slug":"articles","task_name":"Articles"},{"task_slug":"image-comprehension","task_name":"Image Comprehension"},{"task_slug":"mme","task_name":"MME"},{"task_slug":"reading-comprehension","task_name":"Reading Comprehension"},{"task_slug":"visual-question-answering","task_name":"Visual Question Answering (VQA)"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/visual-question-answering-vqa-on-core-mm","task":"Visual Question Answering (VQA)","dataset":"InfiMM-Eval","model":"InternLM-XComposer-VL","rank_in_archive_order":9,"of":14,"metrics":{"Abductive":"35.97","Analogical":"18.61","Deductive":"26.77","Overall score":"26.84","Params":"9B"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2309.15112","atlas_url":"https://app.syntology.ai/?focus=2309.15112","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"2309.15112"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"2309.15112\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"2309.15112"},"call":"get_concepts_for_paper(arxiv_id=\"2309.15112\")"}],"by_repo":[{"repo":"internlm/internlm-xcomposer","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0,"harvested_for_other_papers":1,"harvested_for":["2402.14767"],"harvested_for_calls":[{"arxiv_id":"2402.14767","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"2402.14767"},"call":"get_harvested_code_for_paper(arxiv_id=\"2402.14767\")"}]},{"repo":"MS-P3/code3","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0,"harvested_for_other_papers":1,"harvested_for":["2404.07413"],"harvested_for_calls":[{"arxiv_id":"2404.07413","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"2404.07413"},"call":"get_harvested_code_for_paper(arxiv_id=\"2404.07413\")"}]},{"repo":"MindSpore-scientific-2/code-14","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_harvested_for_is":"harvested_for: the arXiv ids (as Syntology's graph holds them) of every paper whose samples Syntology's graph links to this repository, in arXiv-id order, complete; the page names the first 3 and says how many more. A link only: it does not say the papers are the same work, that one copied the other, or that the code implements this paper's method; harvested_for_calls gives the get_harvested_code_for_paper call for each arXiv-shaped id among them","by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"98bea3f2a5e6e6b09355edc750feff21b5cbae33e23965b93b8fc3db5cbacb08","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}