{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/dataset/dataset-release","name":"Notebook Inaccessibility","full_name":null,"description_markdown":"This dataset artifact contains the intermediate datasets from pipeline executions necessary to reproduce the results of the paper.\r\nWe share this artifact in hopes of providing a starting point for other researchers to extend the analysis on notebooks, discover more about their accessibility, and offer solutions to make data science more accessible. The scripts needed to generate these datasets and analyse them are shared in the [Github Repository](https://github.com/make4all/notebooka11y) for this work.\r\n\r\nThe dataset contains large files of approximately 60 GB so please exercise caution when extracting the data from compressed files.\r\n\r\n\r\nThe dataset contains files which could take a significant amount of run time of the scripts to generate/reproduce.\r\n\r\n### Dataset Contents\r\n\r\nWe briefly summarize the included files in our dataset. Please refer to the [documentation](https://github.com/make4all/notebooka11y/blob/main/pipeline/README.md) for specific information about the structure of the data in these files, the scripts to generate them, and runtimes for various parts of our data processing pipeline.\r\n\r\n1. `epoch_9_loss_0.04706_testAcc_0.96867_X_resnext101_docSeg.pth`: We share this model file, originally provided by [Jobin et al.](https://github.com/jobinkv/DocFigure), to enable the classification of figures found in our dataset. Please place this into the `model/` [directory](https://github.com/make4all/notebooka11y/tree/main/model).\r\n2. `model-results.csv`: This file contains results from the classification performed on the figures found in the notebooks in our dataset.\r\n> Performing this classification may take upto a day.\r\n3. `a11y-scan-dataset.zip`: This archive contains two files and results in datasets of approximately 60GB when extracted. Please ensure that you have sufficient disk space to uncompress this zip archive. The archive contains:\r\n    - `a11y/a11y-detailed-result.csv`: This dataset contains the accessibility scan results from the scans run on the 100k notebooks across themes.\r\n        > The detailed result file can be really large (> 60 GB) and can be time-consuming to construct.\r\n    - `a11y/a11y-aggregate-scan.csv`: This file is an aggregate of the detailed result that contains the number of each type of error found in each notebook.\r\n        > This file is also shared outside the compressed directory.\r\n4. `errors-different-counts-a11y-analyze-errors-summary.csv`: This file contains the counts of errors that occur in notebooks across different themes.\r\n5. `nb_processed_cell_html.csv`: This file contains metadata corresponding to each cell extracted from the html exports of our notebooks.\r\n6. `nb_first_interactive_cell.csv`: This file contains the necessary metadata to compute the first interactive element, as defined in our paper, in each notebook.\r\n7. `nb_processed.csv`: This file contains the necessary data after processing the notebooks extracting the number of images, imports, languages, and cell level information.\r\n8. `processed_function_calls.csv`: This file contains the information about the notebooks, the various imports and function calls used within the notebooks.","description_withheld":null,"homepage":"https://zenodo.org/record/8185050","introduced_date":"2023-07-25","introduced_date_note":null,"introduced_by":{"paper":"/paper/notably-inaccessible-data-driven","title":"Notably Inaccessible -- Data Driven Understanding of Data Science Notebook (In)Accessibility","first_author":null,"url":null},"license":{"name":"Creative Commons Attribution 4.0 International","url":"https://creativecommons.org/licenses/by/4.0/legalcode"},"modalities":[{"name":"Tables","url":"/datasets/modality/tables"}],"tasks":[],"languages":[{"name":"English","url":"/datasets/language/english"}],"variants":["Notebook Inaccessibility"],"data_loaders":[],"num_papers_in_archive":1,"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28"},"benchmarks":[],"papers":{"order":"date (newest first), then slug","population":"every paper with a leaderboard row on this dataset's benchmarks (the benchmark-backed subset): the archive's own papers-using-this-dataset list was never published, so this is not that list; num_papers_in_archive is the archive's own count","page":1,"pages_in_order":1,"rows_per_page":100,"shown":0,"of":0,"counts":{"papers_with_a_benchmark_row":0,"with_a_code_link":0,"where_syntology_ran_a_sample":0,"not_listed_spam_title":0,"listed":0,"listed_where_code_ran":0,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":0,"every_run_a_failure_of_syntologys_instrument":0,"listed_with_a_run_with_no_instrument_failure":0,"listed_every_run_a_failure_of_syntologys_instrument":0,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers with at least one leaderboard row on this dataset's benchmarks; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"items":[],"full_list":"papers_with_a_benchmark_row: every listed paper, in this order"},"papers_with_a_benchmark_row":[],"papers_where_code_ran":0,"papers_where_code_ran_first_page":null,"papers_where_code_ran_caption":"We ran code from the paper's repository; we did not run it on this dataset or check it against this dataset's benchmarks.","pages":[],"row_route":"each paper's syntology object carries sample_list (this site's paper page, #ran), syntology_url (syntology.ai's page for the paper, only when that route probed live) and mcp (the agent call that lists the paper's harvested samples; not a verdict on the paper)","developers":"https://syntology.ai/developers","syntology_totals":{"read_at":"2026-10-05T00:36:11+00:00","papers_with_samples":0,"samples_harvested":0,"samples_ran":0,"samples_constructed":0,"samples_ran_checked":0,"samples_ran_instrument_failed":0,"samples_unverified":0,"pointer_only_for_licence":0,"papers_with_no_sample_that_ran":0,"papers_with_a_sample_that_ran":0,"papers_with_a_run_with_no_instrument_failure":0,"papers_where_every_run_was_an_instrument_failure":0,"note":"the per-paper counts of every listed paper (all pages), summed; not a rate"},"key_notes":{"samples_ran_checked":"legacy name, kept unchanged so existing readers do not break: it counts the samples that ran with no instrument failure (honoured, violated, and ran with no contract checked); it does not mean a contract was checked, and the pages print it as 'K with no instrument failure', not 'K checked'","samples_constructed":"a sub-count of the samples that ran, never subtracted from them and never a failure: an executed sample whose run returned an instance of its own class (fixture_out_type equals the entry name): the run built an object and did not compute a result (Syntology's RAN record, counts.constructed)"},"since_archive_judged":{"papers":0,"papers_placed":0,"judged_by":{"model":"a model","models_as_recorded":[],"from":"lb_rows_run_verified.jsonl: each record's `model` field (the extractor's call that wrote decisions[])"},"note":"a model's judgement from the paper's own tables that they report on this leaderboard, not a result: no value from a paper that was not placed is printed or carried here; papers counts each paper once over these leaderboards","backfill":"8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read)","backfill_complete":false,"leaderboards":[]},"papers_note":"The archive never published its papers-using-dataset list; these are papers with a leaderboard row on this dataset's benchmarks.","record_sha256":"9c4a98a92e3eb13d8b2bd65df525da3515b211e3132f09ca979c5897ff9df094","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}