{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/new-datasets-for-automatic-detection-of","title":"New Datasets for Automatic Detection of Textual Entailment and of Contradictions between Sentences in French","arxiv_id":null,"date":"2024-05-23","proceeding":"Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024) 2024 5","authors":["Maximos Skandalis","Richard Moot","Christian Retoré","Simon Robillard"],"abstract":"This paper introduces DACCORD, an original dataset in French for automatic detection of contradictions between sentences. It also presents new, manually translated versions of two datasets, namely the well known dataset RTE3 and the recent dataset GQNLI, from English to French, for the task of natural language inference / recognising textual entailment, which is a sentence-pair classification task. These datasets help increase the admittedly limited number of datasets in French available for these tasks. DACCORD consists of 1034 pairs of sentences and is the first dataset exclusively dedicated to this task and covering among others the topic of the Russian invasion in Ukraine. RTE3-FR contains 800 examples for each of its validation and test subsets, while GQNLI-FR is composed of 300 pairs of sentences and focuses specifically on the use of generalised quantifiers. Our experiments on these datasets show that they are more challenging than the two already existing datasets for the mainstream NLI task in French (XNLI, FraCaS). For languages other than English, most deep learning models for NLI tasks currently have only XNLI available as a training set. Additional datasets, such as ours for French, could permit different training and evaluation strategies, producing more robust results and reducing the inevitable biases present in any single dataset.","url_abs":"https://aclanthology.org/2024.lrec-main.1065","url_pdf":"https://aclanthology.org/2024.lrec-main.1065.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"new-datasets-for-automatic-detection-of","repo_url":"https://github.com/mskandalis/rte3-french","is_official":1,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"none","reach":null},{"paper_slug":"new-datasets-for-automatic-detection-of","repo_url":"https://github.com/mskandalis/daccord-dataset-contradictions","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"none","reach":null},{"paper_slug":"new-datasets-for-automatic-detection-of","repo_url":"https://github.com/mskandalis/gqnli-french","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"none","reach":null},{"paper_slug":"new-datasets-for-automatic-detection-of","repo_url":"https://huggingface.co/datasets/maximoss/daccord-contradictions","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"none","reach":null},{"paper_slug":"new-datasets-for-automatic-detection-of","repo_url":"https://huggingface.co/datasets/maximoss/gqnli-fr","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"none","reach":null},{"paper_slug":"new-datasets-for-automatic-detection-of","repo_url":"https://huggingface.co/datasets/maximoss/lingnli-multi-mt","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"none","reach":null},{"paper_slug":"new-datasets-for-automatic-detection-of","repo_url":"https://huggingface.co/datasets/maximoss/rte3-french","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"none","reach":null},{"paper_slug":"new-datasets-for-automatic-detection-of","repo_url":"https://huggingface.co/datasets/maximoss/rte3-multi","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"none","reach":null},{"paper_slug":"new-datasets-for-automatic-detection-of","repo_url":"https://huggingface.co/datasets/maximoss/sick-fr-mt","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"none","reach":null},{"paper_slug":"new-datasets-for-automatic-detection-of","repo_url":"https://huggingface.co/datasets/maximoss/sick_el-gr_mt","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"none","reach":null}],"tasks":[{"task_slug":"natural-language-inference","task_name":"Natural Language Inference"},{"task_slug":"rte","task_name":"RTE"},{"task_slug":"sentence","task_name":"Sentence"},{"task_slug":"sentence-pair-classification","task_name":"Sentence-Pair Classification"},{"task_slug":"text-pair-classification","task_name":"Text Pair Classification"}],"methods":[],"datasets_introduced":[{"slug":"gqnli-fr","name":"GQNLI-FR","full_name":""},{"slug":"rte3-fr","name":"RTE3-FR","full_name":""}],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers","held":null,"reason":"no_arxiv_id","checked_against":null,"by_repo":[{"repo":"mskandalis/rte3-french","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"mskandalis/daccord-dataset-contradictions","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"mskandalis/gqnli-french","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"huggingface.co/datasets/maximoss/daccord-contradictions","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"huggingface.co/datasets/maximoss/gqnli-fr","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"huggingface.co/datasets/maximoss/lingnli-multi-mt","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"huggingface.co/datasets/maximoss/rte3-french","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"huggingface.co/datasets/maximoss/rte3-multi","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"huggingface.co/datasets/maximoss/sick-fr-mt","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"huggingface.co/datasets/maximoss/sick_el-gr_mt","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"298b18b9cbf3b3c85ba110e7659054722d0464cb1c097123b98fc8968321f545","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}