{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/qwen2-technical-report","title":"Qwen2 Technical Report","arxiv_id":"2407.10671","date":"2024-07-15","proceeding":null,"authors":["An Yang","Baosong Yang","Binyuan Hui","Bo Zheng","Bowen Yu","Chang Zhou","Chengpeng Li","Chengyuan Li","Dayiheng Liu","Fei Huang","Guanting Dong","Haoran Wei","Huan Lin","Jialong Tang","Jialin Wang","Jian Yang","Jianhong Tu","Jianwei Zhang","Jianxin Ma","Jianxin Yang","Jin Xu","Jingren Zhou","Jinze Bai","Jinzheng He","Junyang Lin","Kai Dang","Keming Lu","Keqin Chen","Kexin Yang","Mei Li","Mingfeng Xue","Na Ni","Pei Zhang","Peng Wang","Ru Peng","Rui Men","Ruize Gao","Runji Lin","Shijie Wang","Shuai Bai","Sinan Tan","Tianhang Zhu","TianHao Li","Tianyu Liu","Wenbin Ge","Xiaodong Deng","Xiaohuan Zhou","Xingzhang Ren","Xinyu Zhang","Xipin Wei","Xuancheng Ren","Xuejing Liu","Yang Fan","Yang Yao","Yichang Zhang","Yu Wan","Yunfei Chu","Yuqiong Liu","Zeyu Cui","Zhenru Zhang","Zhifang Guo","Zhihao Fan"],"abstract":"This report introduces the Qwen2 series, the latest addition to our large language models and large multimodal models. We release a comprehensive suite of foundational and instruction-tuned language models, encompassing a parameter range from 0.5 to 72 billion, featuring dense models and a Mixture-of-Experts model. Qwen2 surpasses most prior open-weight models, including its predecessor Qwen1.5, and exhibits competitive performance relative to proprietary models across diverse benchmarks on language understanding, generation, multilingual proficiency, coding, mathematics, and reasoning. The flagship model, Qwen2-72B, showcases remarkable performance: 84.2 on MMLU, 37.9 on GPQA, 64.6 on HumanEval, 89.5 on GSM8K, and 82.4 on BBH as a base language model. The instruction-tuned variant, Qwen2-72B-Instruct, attains 9.1 on MT-Bench, 48.1 on Arena-Hard, and 35.7 on LiveCodeBench. Moreover, Qwen2 demonstrates robust multilingual capabilities, proficient in approximately 30 languages, spanning English, Chinese, Spanish, French, German, Arabic, Russian, Korean, Japanese, Thai, Vietnamese, and more, underscoring its versatility and global reach. To foster community innovation and accessibility, we have made the Qwen2 model weights openly available on Hugging Face and ModelScope, and the supplementary materials including example code on GitHub. These platforms also include resources for quantization, fine-tuning, and deployment, facilitating a wide range of applications and research endeavors.","url_abs":"https://arxiv.org/abs/2407.10671v4","url_pdf":"https://arxiv.org/pdf/2407.10671v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"qwen2-technical-report","repo_url":"https://github.com/qwenlm/qwen2","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}},{"paper_slug":"qwen2-technical-report","repo_url":"https://github.com/qwenlm/qwen1.5","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}},{"paper_slug":"qwen2-technical-report","repo_url":"https://github.com/vicentvankor/sun-shine","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok"}},{"paper_slug":"qwen2-technical-report","repo_url":"https://github.com/ziye2chen/LLMs-for-Mathematical-Analysis","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok"}},{"paper_slug":"qwen2-technical-report","repo_url":"https://github.com/yangyucheng000/University/tree/main/model-1/qwen2","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"qwen2-technical-report","repo_url":"https://github.com/yangyucheng000/University/tree/main/model-3/qwen2_moe","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null}],"tasks":[{"task_slug":"arithmetic-reasoning","task_name":"Arithmetic Reasoning"},{"task_slug":"gsm8k","task_name":"GSM8K"},{"task_slug":"humaneval","task_name":"HumanEval"},{"task_slug":"language-modelling","task_name":"Language Modelling"},{"task_slug":"mmlu","task_name":"MMLU"},{"task_slug":"math-word-problem-solving","task_name":"Math Word Problem Solving"},{"task_slug":"mixture-of-experts","task_name":"Mixture-of-Experts"},{"task_slug":"quantization","task_name":"Quantization"}],"methods":[{"method_slug":"base","method_name":"BASE"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/arithmetic-reasoning-on-gsm8k","task":"Arithmetic Reasoning","dataset":"GSM8K","model":"Qwen2-Math-72B-Instruct\n(greedy)","rank_in_archive_order":3,"of":164,"metrics":{"Accuracy":"96.7","Parameters (Billion)":"72"},"uses_additional_data":true},{"leaderboard":"/sota/math-word-problem-solving-on-math","task":"Math Word Problem Solving","dataset":"MATH","model":"Qwen2-Math-72B-Instruct(greedy)","rank_in_archive_order":7,"of":135,"metrics":{"Accuracy":"84.0","Parameters (Billions)":"72"},"uses_additional_data":true}],"syntology":{"syntology_url":"https://syntology.ai/paper/2407.10671","atlas_url":"https://app.syntology.ai/?focus=2407.10671","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"2407.10671"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"2407.10671\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"2407.10671"},"call":"get_concepts_for_paper(arxiv_id=\"2407.10671\")"}],"by_repo":[{"repo":"qwenlm/qwen2","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"qwenlm/qwen1.5","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"vicentvankor/sun-shine","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"ziye2chen/LLMs-for-Mathematical-Analysis","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"yangyucheng000/University","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0,"harvested_for_other_papers":1,"harvested_for":["2409.12191"],"harvested_for_calls":[{"arxiv_id":"2409.12191","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"2409.12191"},"call":"get_harvested_code_for_paper(arxiv_id=\"2409.12191\")"}]}],"by_repo_harvested_for_is":"harvested_for: the arXiv ids (as Syntology's graph holds them) of every paper whose samples Syntology's graph links to this repository, in arXiv-id order, complete; the page names the first 3 and says how many more. A link only: it does not say the papers are the same work, that one copied the other, or that the code implements this paper's method; harvested_for_calls gives the get_harvested_code_for_paper call for each arXiv-shaped id among them","by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"6afa407e44850e33750b4ed45c9df461313d1e5036ce22abf9c9d5ce9167667f","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}