{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/frenchmedmcqa-a-french-multiple-choice-1","title":"FrenchMedMCQA: A French Multiple-Choice Question Answering Dataset for Medical domain","arxiv_id":"2304.04280","date":"2023-04-09","proceeding":"LOUHI 2022 10","authors":["Yanis Labrak","Adrien Bazoge","Richard Dufour","Mickael Rouvier","Emmanuel Morin","Béatrice Daille","Pierre-Antoine Gourraud"],"abstract":"This paper introduces FrenchMedMCQA, the first publicly available Multiple-Choice Question Answering (MCQA) dataset in French for medical domain. It is composed of 3,105 questions taken from real exams of the French medical specialization diploma in pharmacy, mixing single and multiple answers. Each instance of the dataset contains an identifier, a question, five possible answers and their manual correction(s). We also propose first baseline models to automatically process this MCQA task in order to report on the current performances and to highlight the difficulty of the task. A detailed analysis of the results showed that it is necessary to have representations adapted to the medical domain or to the MCQA task: in our case, English specialized models yielded better results than generic French ones, even though FrenchMedMCQA is in French. Corpus, models and tools are available online.","url_abs":"https://arxiv.org/abs/2304.04280v1","url_pdf":"https://arxiv.org/pdf/2304.04280v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"frenchmedmcqa-a-french-multiple-choice-1","repo_url":"https://github.com/qanastek/FrenchMedMCQA","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":null}],"tasks":[{"task_slug":"multiple-choice-qa","task_name":"Multiple Choice Question Answering (MCQA)"},{"task_slug":"multiple-choice","task_name":"Multiple-choice"},{"task_slug":"question-answering","task_name":"Question Answering"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/multiple-choice-question-answering-mcqa-on-22","task":"Multiple Choice Question Answering (MCQA)","dataset":"FrenchMedMCQA","model":"CamemBERT","rank_in_archive_order":1,"of":2,"metrics":{"Exact Match Accuracy":"16.55","Hamming Score":"36.24"},"uses_additional_data":false},{"leaderboard":"/sota/multiple-choice-question-answering-mcqa-on-22","task":"Multiple Choice Question Answering (MCQA)","dataset":"FrenchMedMCQA","model":"DrBERT","rank_in_archive_order":2,"of":2,"metrics":{"Exact Match Accuracy":"15.32","Hamming Score":"37.37"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2304.04280","atlas_url":"https://app.syntology.ai/?focus=2304.04280","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"2304.04280"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"2304.04280\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"2304.04280"},"call":"get_concepts_for_paper(arxiv_id=\"2304.04280\")"}],"by_repo":[{"repo":"qanastek/FrenchMedMCQA","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"95408109c0624a07a4c355fbec9c343171ae87ed9b0f334bec2e6d6d2b380d01","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}