{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/handwritten-text-recognition-from-1","title":"Handwritten Text Recognition from Crowdsourced Annotations","arxiv_id":"2306.10878","date":"2023-06-19","proceeding":"International Workshop on Historical Document Imaging and Processing 2023 6","authors":["Solène Tarride","Tristan Faine","Mélodie Boillet","Harold Mouchère","Christopher Kermorvant"],"abstract":"In this paper, we explore different ways of training a model for handwritten text recognition when multiple imperfect or noisy transcriptions are available. We consider various training configurations, such as selecting a single transcription, retaining all transcriptions, or computing an aggregated transcription from all available annotations. In addition, we evaluate the impact of quality-based data selection, where samples with low agreement are removed from the training set. Our experiments are carried out on municipal registers of the city of Belfort (France) written between 1790 and 1946. % results The results show that computing a consensus transcription or training on multiple transcriptions are good alternatives. However, selecting training samples based on the degree of agreement between annotators introduces a bias in the training data and does not improve the results. Our dataset is publicly available on Zenodo: https://zenodo.org/record/8041668.","url_abs":"https://arxiv.org/abs/2306.10878v1","url_pdf":"https://arxiv.org/pdf/2306.10878v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"handwritten-text-recognition","task_name":"Handwritten Text Recognition"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/handwritten-text-recognition-on-belfort","task":"Handwritten Text Recognition","dataset":"Belfort","model":"PyLaia (all transcriptions + agreement-based split)","rank_in_archive_order":1,"of":4,"metrics":{"CER (%)":"4.34","WER (%)":"15.14"},"uses_additional_data":false},{"leaderboard":"/sota/handwritten-text-recognition-on-belfort","task":"Handwritten Text Recognition","dataset":"Belfort","model":"PyLaia (rover consensus + agreement-based split)","rank_in_archive_order":2,"of":4,"metrics":{"CER (%)":"4.95","WER (%)":"17.08"},"uses_additional_data":false},{"leaderboard":"/sota/handwritten-text-recognition-on-belfort","task":"Handwritten Text Recognition","dataset":"Belfort","model":"PyLaia (human transcriptions + agreement-based split)","rank_in_archive_order":3,"of":4,"metrics":{"CER (%)":"5.57","WER (%)":"19.12"},"uses_additional_data":false},{"leaderboard":"/sota/handwritten-text-recognition-on-belfort","task":"Handwritten Text Recognition","dataset":"Belfort","model":"PyLaia (human transcriptions + random split)","rank_in_archive_order":4,"of":4,"metrics":{"CER (%)":"10.54","WER (%)":"28.11"},"uses_additional_data":false}],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers","held":null,"reason":"arxiv_id_not_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"by_repo":[],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":"the archive holds no code link for this paper","arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"8f28de608a2ba7f7c3125ff5cdbbb57d8712c10b008a51dd9b7038ffe6e28806","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}