{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/dataset/banglabook","name":"BanglaBook","full_name":"Large-scale Bangla Dataset for Sentiment Analysis from Book Reviews","description_markdown":"This repository contains the code, data, and models of the paper titled \"BᴀɴɢʟᴀBᴏᴏᴋ: A Large-scale Bangla Dataset for Sentiment Analysis from Book Reviews\" published in the ***Findings of the Association for Computational Linguistics: ACL 2023***.\r\n\r\n[![arXiv](https://img.shields.io/badge/arXiv-2305.06595-b31b1b.svg?logo=arxiv)](https://arxiv.org/abs/2305.06595)\r\n[![anthology](https://img.shields.io/badge/ACL%20Anthology-2023.findings--acl.80-EE161F.svg)](https://aclanthology.org/2023.findings-acl.80/)\r\n[![GoogleScholar](https://img.shields.io/badge/Google%20Scholar-4285F4?style=flat&logo=Google+Scholar&logoColor=white&color=gray&labelColor=4285F4)](https://tinyurl.com/gscholarbanglabook)\r\n[![ResearchGate](https://img.shields.io/badge/ResearchGate-00CCBB?style=flat&logo=ResearchGate&logoColor=white&color=gray&labelColor=00CCBB)](https://www.researchgate.net/publication/370688086_BanglaBook_A_Large-scale_Bangla_Dataset_for_Sentiment_Analysis_from_Book_Reviews)\r\n[![GitHub](https://img.shields.io/badge/GitHub-black?style=flat&logo=GitHub&logoColor=white&color=gray&labelColor=black)](https://github.com/mohsinulkabir14/BanglaBook)\r\n[![HuggingFace](https://img.shields.io/badge/Hugging%20Face-yellow?style=flat&logo=HuggingFace&logoColor=black&color=gray&labelColor=yellow)](https://huggingface.co/datasets/Starscream-11813/BanglaBook)\r\n\r\n[![PDF](https://img.shields.io/badge/Paper%20PDF-EF3939?style=flat&logo=adobeacrobatreader&logoColor=white&color=gray&labelColor=ec1c24)](https://aclanthology.org/2023.findings-acl.80.pdf)\r\n[![Slides](https://img.shields.io/badge/Slides%20PDF-EF3939?style=flat&logo=Microsoft+PowerPoint&logoColor=white&color=gray&labelColor=B7472A)](https://drive.google.com/file/d/1-UkYs_Rx11S7qKOfR-6rnO2VDp3W78vQ/view?usp=sharing)\r\n[![Video](https://img.shields.io/badge/Video%20Presentation-4285F4?style=flat&logo=data:image/svg%2bxml;base64,PHN2ZyB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciIHZpZXdCb3g9IjAgMCA1NzYgNTEyIj48IS0tIUZvbnQgQXdlc29tZSBGcmVlIDYuNS4yIGJ5IEBmb250YXdlc29tZSAtIGh0dHBzOi8vZm9udGF3ZXNvbWUuY29tIExpY2Vuc2UgLSBodHRwczovL2ZvbnRhd2Vzb21lLmNvbS9saWNlbnNlL2ZyZWUgQ29weXJpZ2h0IDIwMjQgRm9udGljb25zLCBJbmMuLS0+PHBhdGggZmlsbD0iI2ZmZmZmZiIgZD0iTTAgMTI4QzAgOTIuNyAyOC43IDY0IDY0IDY0SDMyMGMzNS4zIDAgNjQgMjguNyA2NCA2NFYzODRjMCAzNS4zLTI4LjcgNjQtNjQgNjRINjRjLTM1LjMgMC02NC0yOC43LTY0LTY0VjEyOHpNNTU5LjEgOTkuOGMxMC40IDUuNiAxNi45IDE2LjQgMTYuOSAyOC4yVjM4NGMwIDExLjgtNi41IDIyLjYtMTYuOSAyOC4ycy0yMyA1LTMyLjktMS42bC05Ni02NEw0MTYgMzM3LjFWMzIwIDE5MiAxNzQuOWwxNC4yLTkuNSA5Ni02NGM5LjgtNi41IDIyLjQtNy4yIDMyLjktMS42eiIvPjwvc3ZnPg==&logoColor=white&color=gray&labelColor=B197FC)](https://aclanthology.org/2023.findings-acl.80.mp4)\r\n\r\n**License:** Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International\r\n\r\n[![license](https://arxiv.org/icons/licenses/by-nc-sa-4.0.png)](http://creativecommons.org/licenses/by-nc-sa/4.0/)\r\n\r\n## Data Format\r\nEach row consists of a book review sample. The table below describes what each column signifies.\r\n\r\nColumn Title | Description\r\n------------ | -------------\r\n`id` | The unique identification number of the sample\r\n`Book_Name` | The title of the book that has been evaluated by the review\r\n`Writer_Name` | The name of the book's author\r\n`Category` | The genre to which the book belongs\r\n`Rating` | A numerical value $r$ such that $1\\leq r \\leq 5$<br>A score reflecting the reviewer's subjective assessment of the book's quality\r\n`Review` | The review text written by the reviewer\r\n`Site` | The name of the online bookshop\r\n`sentiment` | The conveyed sentiment and class label of the review<br>For a review sample $i$ with rating $r_i$, the sentiment label $S_i$ is,<br>$S_i =\\begin{cases}Negative, & \\text{if $r_i \\leq 2$}\\\\\\Neutral, & \\text{if $r_i = 3$}\\\\\\Positive, & \\text{if $r_i \\geq 4$}\\end{cases}$\r\n`label` | The numerical representation of the sentiment label<br>For a review sample $i$ with sentiment label $S_i$, the numerical label is,<br>$label_i =\\begin{cases}0, & \\text{if $S_i = Negative$}\\\\\\1, & \\text{if $S_i = Neutral$}\\\\\\2, & \\text{if $S_i = Positive$}\\end{cases}$\r\n\r\n## Data Construction\r\n### Data Collection Process\r\nFor the data collection and preparation process of the BᴀɴɢʟᴀBᴏᴏᴋ dataset, we first compile a list of URLs for authors from online bookstores. From there, we procure URLs for the books. We meticulously scrape information such as book titles, author names, book categories, review texts, reviewer names, review dates, and ratings by utilizing these book URLs. \r\n<img src=\"https://github.com/mohsinulkabir14/BanglaBook/raw/main/images/banglabookgithub1.png\" alt=\"drawing\" style=\"width:1000px;\"/>\r\n### Labeling, Translation, and Validation of the Curated Samples\r\nIf a review does not have a rating, we deem it unannotated. Reviews with a rating of 1 or 2 are classified as negative, a rating of 3 is considered neutral, and a rating of 4 or 5 is classified as positive. After discarding the unannotated reviews, we curate a final dataset of 158,065 annotated reviews. Of these, 89,371 are written entirely in Bangla. The remaining 68,694 reviews were written in Romanized Bangla, English, or a mix of languages. They are translated into Bangla with Google Translator and a custom Python program using the `googletrans` library. The translations are subsequently subjected to manual review and scrutiny to confirm their accuracy.\r\n<img src=\"https://github.com/mohsinulkabir14/BanglaBook/raw/main/images/banglabookgithub2.png\" alt=\"drawing\" style=\"width:1000px;\"/>\r\n## Results\r\n<img src=\"https://github.com/mohsinulkabir14/BanglaBook/raw/main/images/banglabookgithub3.png\" alt=\"drawing\" style=\"width:1000px;\"/>\r\n## Citation\r\nIf you find this work useful, please cite our paper:\r\n```bib\r\n@inproceedings{kabir-etal-2023-banglabook,\r\n    title = \"{B}angla{B}ook: A Large-scale {B}angla Dataset for Sentiment Analysis from Book Reviews\",\r\n    author = \"Kabir, Mohsinul  and\r\n      Bin Mahfuz, Obayed  and\r\n      Raiyan, Syed Rifat  and\r\n      Mahmud, Hasan  and\r\n      Hasan, Md Kamrul\",\r\n    booktitle = \"Findings of the Association for Computational Linguistics: ACL 2023\",\r\n    month = jul,\r\n    year = \"2023\",\r\n    address = \"Toronto, Canada\",\r\n    publisher = \"Association for Computational Linguistics\",\r\n    url = \"https://aclanthology.org/2023.findings-acl.80\",\r\n    pages = \"1237--1247\",\r\n    abstract = \"The analysis of consumer sentiment, as expressed through reviews, can provide a wealth of insight regarding the quality of a product. While the study of sentiment analysis has been widely explored in many popular languages, relatively less attention has been given to the Bangla language, mostly due to a lack of relevant data and cross-domain adaptability. To address this limitation, we present BanglaBook, a large-scale dataset of Bangla book reviews consisting of 158,065 samples classified into three broad categories: positive, negative, and neutral. We provide a detailed statistical analysis of the dataset and employ a range of machine learning models to establish baselines including SVM, LSTM, and Bangla-BERT. Our findings demonstrate a substantial performance advantage of pre-trained models over models that rely on manually crafted features, emphasizing the necessity for additional training resources in this domain. Additionally, we conduct an in-depth error analysis by examining sentiment unigrams, which may provide insight into common classification errors in under-resourced languages like Bangla. Our codes and data are publicly available at https://github.com/mohsinulkabir14/BanglaBook.\",\r\n}\r\n```","description_withheld":null,"homepage":"https://github.com/mohsinulkabir14/BanglaBook","introduced_date":"2023-05-11","introduced_date_note":null,"introduced_by":{"paper":"/paper/banglabook-a-large-scale-bangla-dataset-for","title":"BanglaBook: A Large-scale Bangla Dataset for Sentiment Analysis from Book Reviews","first_author":"Mohsinul Kabir","url":null},"license":{"name":"Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International","url":"http://creativecommons.org/licenses/by-nc-sa/4.0/"},"modalities":[{"name":"Texts","url":"/datasets/modality/texts"}],"tasks":[{"name":"Text Classification","url":"/task/text-classification","datasets_with_task":"/datasets/task/text-classification"},{"name":"Sentiment Analysis","url":"/task/sentiment-analysis","datasets_with_task":"/datasets/task/sentiment-analysis"},{"name":"Sentiment Classification","url":"/task/sentiment-classification","datasets_with_task":"/datasets/task/sentiment-classification"}],"languages":[{"name":"Bengali","url":"/datasets/language/bengali"}],"variants":["BanglaBook"],"data_loaders":[{"repo":"https://github.com/huggingface/datasets","url":"https://huggingface.co/datasets/Starscream-11813/BanglaBook","frameworks":["tf","pytorch","jax"]}],"num_papers_in_archive":1,"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28"},"benchmarks":[{"leaderboard":"/sota/sentiment-analysis-on-banglabook","task":"Sentiment Analysis","dataset_variant":"BanglaBook","rows":13,"metrics":["Weighted Average F1-score"],"first_row_in_archive_order":{"model":"Bangla-BERT (large)","paper":"/paper/banglabook-a-large-scale-bangla-dataset-for","metrics":{"Weighted Average F1-score":"0.9331"},"code_links":[{"title":"mohsinulkabir14/banglabook","url":"https://github.com/mohsinulkabir14/banglabook"}]},"note":"rows are the archive's own order at snapshot; nothing here re-ranks them"}],"papers":{"order":"date (newest first), then slug","population":"every paper with a leaderboard row on this dataset's benchmarks (the benchmark-backed subset): the archive's own papers-using-this-dataset list was never published, so this is not that list; num_papers_in_archive is the archive's own count","page":1,"pages_in_order":1,"rows_per_page":100,"shown":1,"of":1,"counts":{"papers_with_a_benchmark_row":1,"with_a_code_link":1,"where_syntology_ran_a_sample":0,"not_listed_spam_title":0,"listed":1,"listed_where_code_ran":0,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":0,"every_run_a_failure_of_syntologys_instrument":0,"listed_with_a_run_with_no_instrument_failure":0,"listed_every_run_a_failure_of_syntologys_instrument":0,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers with at least one leaderboard row on this dataset's benchmarks; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"items":[{"paper":"/paper/banglabook-a-large-scale-bangla-dataset-for","slug":"banglabook-a-large-scale-bangla-dataset-for","title":"BanglaBook: A Large-scale Bangla Dataset for Sentiment Analysis from Book Reviews","date":"2023-05-11","arxiv_id":"2305.06595","rows_on_this_dataset":13,"code_links":1,"syntology":null}],"full_list":"papers_with_a_benchmark_row: every listed paper, in this order"},"papers_with_a_benchmark_row":[{"paper":"/paper/banglabook-a-large-scale-bangla-dataset-for","slug":"banglabook-a-large-scale-bangla-dataset-for","title":"BanglaBook: A Large-scale Bangla Dataset for Sentiment Analysis from Book Reviews","date":"2023-05-11","arxiv_id":"2305.06595","rows_on_this_dataset":13,"code_links":1,"syntology":null}],"papers_where_code_ran":0,"papers_where_code_ran_first_page":null,"papers_where_code_ran_caption":"We ran code from the paper's repository; we did not run it on this dataset or check it against this dataset's benchmarks.","pages":[],"row_route":"each paper's syntology object carries sample_list (this site's paper page, #ran), syntology_url (syntology.ai's page for the paper, only when that route probed live) and mcp (the agent call that lists the paper's harvested samples; not a verdict on the paper)","developers":"https://syntology.ai/developers","syntology_totals":{"read_at":"2026-10-05T00:36:11+00:00","papers_with_samples":0,"samples_harvested":0,"samples_ran":0,"samples_constructed":0,"samples_ran_checked":0,"samples_ran_instrument_failed":0,"samples_unverified":0,"pointer_only_for_licence":0,"papers_with_no_sample_that_ran":0,"papers_with_a_sample_that_ran":0,"papers_with_a_run_with_no_instrument_failure":0,"papers_where_every_run_was_an_instrument_failure":0,"note":"the per-paper counts of every listed paper (all pages), summed; not a rate"},"key_notes":{"samples_ran_checked":"legacy name, kept unchanged so existing readers do not break: it counts the samples that ran with no instrument failure (honoured, violated, and ran with no contract checked); it does not mean a contract was checked, and the pages print it as 'K with no instrument failure', not 'K checked'","samples_constructed":"a sub-count of the samples that ran, never subtracted from them and never a failure: an executed sample whose run returned an instance of its own class (fixture_out_type equals the entry name): the run built an object and did not compute a result (Syntology's RAN record, counts.constructed)"},"since_archive_judged":{"papers":0,"papers_placed":0,"judged_by":{"model":"a model","models_as_recorded":[],"from":"lb_rows_run_verified.jsonl: each record's `model` field (the extractor's call that wrote decisions[])"},"note":"a model's judgement from the paper's own tables that they report on this leaderboard, not a result: no value from a paper that was not placed is printed or carried here; papers counts each paper once over these leaderboards","backfill":"8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read)","backfill_complete":false,"leaderboards":[]},"papers_note":"The archive never published its papers-using-dataset list; these are papers with a leaderboard row on this dataset's benchmarks.","record_sha256":"270ecf98b6941c4802883e49e8a68a12f5a3f9f0567544bb994e9b22f5268412","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}