{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/dataset/ade-corpus","name":"Adverse Drug Events (ADE) Corpus","full_name":null,"description_markdown":"Development of a benchmark corpus to support the automatic extraction of drug-related adverse effects from medical case reports.\r\n\r\nA significant amount of information about drug-related safety issues such as adverse effects are published in medical case reports that can only be explored by human readers due to their unstructured nature. The work presented here aims at generating a systematically annotated corpus that can support the development and validation of methods for the automatic extraction of drug-related adverse effects from medical case reports. The documents are systematically double annotated in various rounds to ensure consistent annotations. The annotated documents are finally harmonized to generate representative consensus annotations. In order to demonstrate an example use case scenario, the corpus was employed to train and validate models for the classification of informative against the non-informative sentences. A Maximum Entropy classifier trained with simple features and evaluated by 10-fold cross-validation resulted in the F₁ score of 0.70 indicating a potential useful application of the corpus.","description_withheld":null,"homepage":"https://pubmed.ncbi.nlm.nih.gov/22554702/","introduced_date":"2012-01-01","introduced_date_note":null,"introduced_by":null,"license":null,"modalities":[],"tasks":[{"name":"Text Classification","url":"/task/text-classification","datasets_with_task":"/datasets/task/text-classification"},{"name":"Named Entity Recognition (NER)","url":"/task/named-entity-recognition-ner","datasets_with_task":"/datasets/task/named-entity-recognition-ner"},{"name":"Relation Extraction","url":"/task/relation-extraction","datasets_with_task":"/datasets/task/relation-extraction"},{"name":"NER","url":"/task/cg","datasets_with_task":"/datasets/task/cg"},{"name":"Clinical Concept Extraction","url":"/task/clinical-concept-extraction","datasets_with_task":"/datasets/task/clinical-concept-extraction"}],"languages":[{"name":"English","url":"/datasets/language/english"}],"variants":["Adverse Drug Events (ADE) Corpus"],"data_loaders":[],"num_papers_in_archive":14,"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28"},"benchmarks":[{"leaderboard":"/sota/relation-extraction-on-ade-corpus","task":"Relation Extraction","dataset_variant":"Adverse Drug Events (ADE) Corpus","rows":15,"metrics":["RE+ Macro F1","RE Macro F1","NER Macro F1"],"first_row_in_archive_order":{"model":"ITER","paper":"/paper/iter-iterative-transformer-based-entity","metrics":{"NER Macro F1":"92.63 ± 0.89","RE+ Macro F1":"85.6 ± 1.42"},"code_links":[{"title":"fleonce/iter","url":"https://github.com/fleonce/iter"}]},"note":"rows are the archive's own order at snapshot; nothing here re-ranks them"},{"leaderboard":"/sota/named-entity-recognition-on-adverse-drug","task":"Named Entity Recognition (NER)","dataset_variant":"Adverse Drug Events (ADE) Corpus","rows":1,"metrics":["NER Macro F1"],"first_row_in_archive_order":{"model":"Spark NLP","paper":"/paper/mining-adverse-drug-reactions-from","metrics":{"NER Macro F1":"91.75"},"code_links":[]},"note":"rows are the archive's own order at snapshot; nothing here re-ranks them"},{"leaderboard":"/sota/text-classification-on-adverse-drug-events","task":"Text Classification","dataset_variant":"Adverse Drug Events (ADE) Corpus","rows":1,"metrics":["F1 - macro"],"first_row_in_archive_order":{"model":"Spark NLP","paper":"/paper/mining-adverse-drug-reactions-from","metrics":{"F1 - macro":"85.96"},"code_links":[]},"note":"rows are the archive's own order at snapshot; nothing here re-ranks them"}],"papers":{"order":"date (newest first), then slug","population":"every paper with a leaderboard row on this dataset's benchmarks (the benchmark-backed subset): the archive's own papers-using-this-dataset list was never published, so this is not that list; num_papers_in_archive is the archive's own count","page":1,"pages_in_order":1,"rows_per_page":100,"shown":14,"of":14,"counts":{"papers_with_a_benchmark_row":14,"with_a_code_link":11,"where_syntology_ran_a_sample":1,"not_listed_spam_title":0,"listed":14,"listed_where_code_ran":1,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":1,"every_run_a_failure_of_syntologys_instrument":0,"listed_with_a_run_with_no_instrument_failure":1,"listed_every_run_a_failure_of_syntologys_instrument":0,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers with at least one leaderboard row on this dataset's benchmarks; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"items":[{"paper":"/paper/iter-iterative-transformer-based-entity","slug":"iter-iterative-transformer-based-entity","title":"ITER: Iterative Transformer-based Entity Recognition and Relation Extraction","date":"2024-11-11","arxiv_id":null,"rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/an-information-extraction-study-take-in-mind","slug":"an-information-extraction-study-take-in-mind","title":"An Information Extraction Study: Take In Mind the Tokenization!","date":"2023-03-27","arxiv_id":"2303.15100","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/mining-adverse-drug-reactions-from","slug":"mining-adverse-drug-reactions-from","title":"Mining Adverse Drug Reactions from Unstructured Mediums at Scale","date":"2022-01-05","arxiv_id":"2201.01405","rows_on_this_dataset":2,"code_links":0,"syntology":null},{"paper":"/paper/rebel-relation-extraction-by-end-to-end","slug":"rebel-relation-extraction-by-end-to-end","title":"REBEL: Relation Extraction By End-to-end Language generation","date":"2021-10-29","arxiv_id":null,"rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/joint-entity-and-relation-extraction-from","slug":"joint-entity-and-relation-extraction-from","title":"Joint Entity and Relation Extraction from Scientific Documents: Role of Linguistic Information and Entity Types","date":"2021-09-30","arxiv_id":null,"rows_on_this_dataset":2,"code_links":1,"syntology":null},{"paper":"/paper/imposing-relation-structure-in-language-model","slug":"imposing-relation-structure-in-language-model","title":"Imposing Relation Structure in Language-Model Embeddings Using Contrastive Learning","date":"2021-09-02","arxiv_id":"2109.00840","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/a-partition-filter-network-for-joint-entity","slug":"a-partition-filter-network-for-joint-entity","title":"A Partition Filter Network for Joint Entity and Relation Extraction","date":"2021-08-27","arxiv_id":"2108.12202","rows_on_this_dataset":1,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":7,"samples_ran":5,"samples_constructed":3,"samples_ran_checked":4,"samples_ran_instrument_failed":1,"samples_unverified":2,"pointer_only_for_licence":0,"official":{"repos":["Coopercoppers/PFN"],"state":"official (archive's flag): 5 ran","n_ran":5,"n_constructed":3,"n_ran_no_instrument_failure":4,"n_unverified":2,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/a-partition-filter-network-for-joint-entity#ran","syntology_url":"https://syntology.ai/paper/2108.12202","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2108.12202"}}}},{"paper":"/paper/two-are-better-than-one-joint-entity-and","slug":"two-are-better-than-one-joint-entity-and","title":"Two are Better than One: Joint Entity and Relation Extraction with Table-Sequence Encoders","date":"2020-10-08","arxiv_id":"2010.03851","rows_on_this_dataset":1,"code_links":2,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":3,"samples_ran":0,"samples_constructed":0,"samples_ran_checked":0,"samples_ran_instrument_failed":0,"samples_unverified":3,"pointer_only_for_licence":3,"official":{"repos":["LorrinWWW/two-are-better-than-one"],"state":"official: harvested, nothing ran","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":3,"ran_from_kinds":[]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/two-are-better-than-one-joint-entity-and#ran","syntology_url":"https://syntology.ai/paper/2010.03851","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2010.03851"}}}},{"paper":"/paper/modeling-dense-cross-modal-interactions-for","slug":"modeling-dense-cross-modal-interactions-for","title":"Modeling Dense Cross-Modal Interactions for Joint Entity-Relation Extraction","date":"2020-07-01","arxiv_id":null,"rows_on_this_dataset":1,"code_links":0,"syntology":null},{"paper":"/paper/deeper-task-specificity-improves-joint-entity","slug":"deeper-task-specificity-improves-joint-entity","title":"Deeper Task-Specificity Improves Joint Entity and Relation Extraction","date":"2020-02-15","arxiv_id":"2002.06424","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/span-based-joint-entity-and-relation","slug":"span-based-joint-entity-and-relation","title":"Span-based Joint Entity and Relation Extraction with Transformer Pre-training","date":"2019-09-17","arxiv_id":"1909.07755","rows_on_this_dataset":2,"code_links":3,"syntology":null},{"paper":"/paper/neural-metric-learning-for-fast-end-to-end","slug":"neural-metric-learning-for-fast-end-to-end","title":"Neural Metric Learning for Fast End-to-End Relation Extraction","date":"2019-05-17","arxiv_id":"1905.07458","rows_on_this_dataset":1,"code_links":0,"syntology":null},{"paper":"/paper/adversarial-training-for-multi-context-joint","slug":"adversarial-training-for-multi-context-joint","title":"Adversarial training for multi-context joint entity and relation extraction","date":"2018-08-21","arxiv_id":"1808.06876","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/joint-entity-recognition-and-relation","slug":"joint-entity-recognition-and-relation","title":"Joint entity recognition and relation extraction as a multi-head selection problem","date":"2018-04-20","arxiv_id":"1804.07847","rows_on_this_dataset":1,"code_links":6,"syntology":null}],"full_list":"papers_with_a_benchmark_row: every listed paper, in this order"},"papers_with_a_benchmark_row":[{"paper":"/paper/iter-iterative-transformer-based-entity","slug":"iter-iterative-transformer-based-entity","title":"ITER: Iterative Transformer-based Entity Recognition and Relation Extraction","date":"2024-11-11","arxiv_id":null,"rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/an-information-extraction-study-take-in-mind","slug":"an-information-extraction-study-take-in-mind","title":"An Information Extraction Study: Take In Mind the Tokenization!","date":"2023-03-27","arxiv_id":"2303.15100","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/mining-adverse-drug-reactions-from","slug":"mining-adverse-drug-reactions-from","title":"Mining Adverse Drug Reactions from Unstructured Mediums at Scale","date":"2022-01-05","arxiv_id":"2201.01405","rows_on_this_dataset":2,"code_links":0,"syntology":null},{"paper":"/paper/rebel-relation-extraction-by-end-to-end","slug":"rebel-relation-extraction-by-end-to-end","title":"REBEL: Relation Extraction By End-to-end Language generation","date":"2021-10-29","arxiv_id":null,"rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/joint-entity-and-relation-extraction-from","slug":"joint-entity-and-relation-extraction-from","title":"Joint Entity and Relation Extraction from Scientific Documents: Role of Linguistic Information and Entity Types","date":"2021-09-30","arxiv_id":null,"rows_on_this_dataset":2,"code_links":1,"syntology":null},{"paper":"/paper/imposing-relation-structure-in-language-model","slug":"imposing-relation-structure-in-language-model","title":"Imposing Relation Structure in Language-Model Embeddings Using Contrastive Learning","date":"2021-09-02","arxiv_id":"2109.00840","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/a-partition-filter-network-for-joint-entity","slug":"a-partition-filter-network-for-joint-entity","title":"A Partition Filter Network for Joint Entity and Relation Extraction","date":"2021-08-27","arxiv_id":"2108.12202","rows_on_this_dataset":1,"code_links":1,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":7,"samples_ran":5,"samples_constructed":3,"samples_ran_checked":4,"samples_ran_instrument_failed":1,"samples_unverified":2,"pointer_only_for_licence":0,"official":{"repos":["Coopercoppers/PFN"],"state":"official (archive's flag): 5 ran","n_ran":5,"n_constructed":3,"n_ran_no_instrument_failure":4,"n_unverified":2,"ran_from_kinds":["official"]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/a-partition-filter-network-for-joint-entity#ran","syntology_url":"https://syntology.ai/paper/2108.12202","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2108.12202"}}}},{"paper":"/paper/two-are-better-than-one-joint-entity-and","slug":"two-are-better-than-one-joint-entity-and","title":"Two are Better than One: Joint Entity and Relation Extraction with Table-Sequence Encoders","date":"2020-10-08","arxiv_id":"2010.03851","rows_on_this_dataset":1,"code_links":2,"syntology":{"read_at":"2026-10-05T00:36:11+00:00","samples_harvested":3,"samples_ran":0,"samples_constructed":0,"samples_ran_checked":0,"samples_ran_instrument_failed":0,"samples_unverified":3,"pointer_only_for_licence":3,"official":{"repos":["LorrinWWW/two-are-better-than-one"],"state":"official: harvested, nothing ran","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":3,"ran_from_kinds":[]},"claim":"Per-sample execution on synthesized fixtures; not a correctness claim.","sample_list":"/paper/two-are-better-than-one-joint-entity-and#ran","syntology_url":"https://syntology.ai/paper/2010.03851","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2010.03851"}}}},{"paper":"/paper/modeling-dense-cross-modal-interactions-for","slug":"modeling-dense-cross-modal-interactions-for","title":"Modeling Dense Cross-Modal Interactions for Joint Entity-Relation Extraction","date":"2020-07-01","arxiv_id":null,"rows_on_this_dataset":1,"code_links":0,"syntology":null},{"paper":"/paper/deeper-task-specificity-improves-joint-entity","slug":"deeper-task-specificity-improves-joint-entity","title":"Deeper Task-Specificity Improves Joint Entity and Relation Extraction","date":"2020-02-15","arxiv_id":"2002.06424","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/span-based-joint-entity-and-relation","slug":"span-based-joint-entity-and-relation","title":"Span-based Joint Entity and Relation Extraction with Transformer Pre-training","date":"2019-09-17","arxiv_id":"1909.07755","rows_on_this_dataset":2,"code_links":3,"syntology":null},{"paper":"/paper/neural-metric-learning-for-fast-end-to-end","slug":"neural-metric-learning-for-fast-end-to-end","title":"Neural Metric Learning for Fast End-to-End Relation Extraction","date":"2019-05-17","arxiv_id":"1905.07458","rows_on_this_dataset":1,"code_links":0,"syntology":null},{"paper":"/paper/adversarial-training-for-multi-context-joint","slug":"adversarial-training-for-multi-context-joint","title":"Adversarial training for multi-context joint entity and relation extraction","date":"2018-08-21","arxiv_id":"1808.06876","rows_on_this_dataset":1,"code_links":1,"syntology":null},{"paper":"/paper/joint-entity-recognition-and-relation","slug":"joint-entity-recognition-and-relation","title":"Joint entity recognition and relation extraction as a multi-head selection problem","date":"2018-04-20","arxiv_id":"1804.07847","rows_on_this_dataset":1,"code_links":6,"syntology":null}],"papers_where_code_ran":1,"papers_where_code_ran_first_page":"/dataset/ade-corpus/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not run it on this dataset or check it against this dataset's benchmarks.","pages":[{"order":"ran","page":1,"of":1,"url":"/dataset/ade-corpus/papers/ran/1","json":"/dataset/ade-corpus/papers/ran/1.json","rows":1}],"row_route":"each paper's syntology object carries sample_list (this site's paper page, #ran), syntology_url (syntology.ai's page for the paper, only when that route probed live) and mcp (the agent call that lists the paper's harvested samples; not a verdict on the paper)","developers":"https://syntology.ai/developers","syntology_totals":{"read_at":"2026-10-05T00:36:11+00:00","papers_with_samples":2,"samples_harvested":10,"samples_ran":5,"samples_constructed":3,"samples_ran_checked":4,"samples_ran_instrument_failed":1,"samples_unverified":5,"pointer_only_for_licence":3,"papers_with_no_sample_that_ran":1,"papers_with_a_sample_that_ran":1,"papers_with_a_run_with_no_instrument_failure":1,"papers_where_every_run_was_an_instrument_failure":0,"note":"the per-paper counts of every listed paper (all pages), summed; not a rate"},"key_notes":{"samples_ran_checked":"legacy name, kept unchanged so existing readers do not break: it counts the samples that ran with no instrument failure (honoured, violated, and ran with no contract checked); it does not mean a contract was checked, and the pages print it as 'K with no instrument failure', not 'K checked'","samples_constructed":"a sub-count of the samples that ran, never subtracted from them and never a failure: an executed sample whose run returned an instance of its own class (fixture_out_type equals the entry name): the run built an object and did not compute a result (Syntology's RAN record, counts.constructed)"},"since_archive_judged":{"papers":0,"papers_placed":0,"judged_by":{"model":"a model","models_as_recorded":[],"from":"lb_rows_run_verified.jsonl: each record's `model` field (the extractor's call that wrote decisions[])"},"note":"a model's judgement from the paper's own tables that they report on this leaderboard, not a result: no value from a paper that was not placed is printed or carried here; papers counts each paper once over these leaderboards","backfill":"8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read)","backfill_complete":false,"leaderboards":[]},"papers_note":"The archive never published its papers-using-dataset list; these are papers with a leaderboard row on this dataset's benchmarks.","record_sha256":"af1042ac7bb1efee1008d250cb8074a97f29c40ca72a66d5478f880a96bcce7b","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}