{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/dataset/finsen","name":"FinSen","full_name":null,"description_markdown":"## Enhancing Financial Market Predictions: Causality-Driven Feature Selection\r\n\r\nThis paper introduces FinSen dataset that revolutionizes financial market analysis by integrating economic and financial news articles from 197 countries with stock market data. The dataset’s extensive coverage spans 15 years from 2007 to 2023 with temporal information, offering a rich, global perspective 160,000 records on financial market news. Our study leverages causally validated sentiment scores and LSTM models to enhance market forecast accuracy and reliability.\r\n\r\n\r\n# Our FinSen Dataset\r\n[![arXiv](https://img.shields.io/badge/stat.ML-arXiv%3A2006.08437-B31B1B.svg)](https://arxiv.org/abs/2408.01005)\r\n[![Pytorch 1.5](https://img.shields.io/badge/pytorch-1.5.1-blue.svg)](https://pytorch.org/)\r\n[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://github.com/EagleAdelaide/FinSen_Dataset/LICENSE)\r\n\r\nThis repository contains the dataset for [*Enhancing Financial Market Predictions:\r\nCausality-Driven Feature Selection*](https://arxiv.org/abs/2408.01005), which has been accepted in ADMA 2024.\r\n\r\nIf the dataset or the paper has been useful in your research, please add a citation to our work:\r\n\r\n```\r\n@article{liang2024enhancing,\r\n  title={Enhancing Financial Market Predictions: Causality-Driven Feature Selection},\r\n  author={Liang, Wenhao and Li, Zhengyang and Chen, Weitong},\r\n  journal={arXiv e-prints},\r\n  pages={arXiv--2408},\r\n  year={2024}\r\n}\r\n```\r\n\r\n### Datasets\r\n\r\n**[FinSen]** can be downloaded manually from the repository as csv file. Sentiment and its score are generated by FinBert model from the Hugging Face Transformers library under the identifier \"ProsusAI/finbert\".  (Araci, Dogu. \"Finbert: Financial sentiment analysis with pre-trained language models.\" arXiv preprint arXiv:1908.10063 (2019).)\r\n\r\n**We only provide US for research purpose usage, please contact w.liang@adelaide.edu.au for other countries (total 197 included) if necessary.**\r\n\r\nWe also provide other NLP datasets for text classification tasks here, please cite them correspondingly once you used them in your research if any.\r\n\r\n1. 20Newsgroups. Joachims, T., et al.: A probabilistic analysis of the rocchio algorithm with tfidf for\r\ntext categorization. In: ICML. vol. 97, pp. 143–151. Citeseer (1997)\r\n2. AG News. Zhang, X., Zhao, J., LeCun, Y.: Character-level convolutional networks for text\r\nclassification. Advances in neural information processing systems 28 (2015)\r\n3. Financial PhraseBank. Malo, P., Sinha, A., Korhonen, P., Wallenius, J., Takala, P.: Good debt or bad debt:\r\nDetecting semantic orientations in economic texts. Journal of the Association for\r\nInformation Science and Technology 65(4), 782–796 (2014)\r\n\r\n### Dataloader for FinSen\r\n\r\nWe provide the preprocessing file finsen.py for our FinSen dataset under dataloaders directory for more convienient usage.\r\n\r\n### Models - Text Classification\r\n\r\n1. DAN-3. \r\n\r\n2. Gobal Pooling CNN.\r\n\r\n### Models - Regression Prediction\r\n\r\n1. LSTM\r\n\r\n### Using Sentiment Score from FinSen Predict Result on S&P500\r\n\r\n### Dependencies\r\n\r\nThe code is based on PyTorch under code frame of https://github.com/torrvision/focal_calibration, please cite their work if you found it is useful.\r\n\r\n:smiley: ☺ Happy Research !","description_withheld":null,"homepage":"","introduced_date":null,"introduced_date_note":null,"introduced_by":null,"license":{"name":"MIT","url":null},"modalities":[],"tasks":[{"name":"Text Classification","url":"/task/text-classification","datasets_with_task":"/datasets/task/text-classification"},{"name":"Stock Market Prediction","url":"/task/stock-market-prediction","datasets_with_task":"/datasets/task/stock-market-prediction"},{"name":"Time Series Regression","url":"/task/time-series-regression","datasets_with_task":"/datasets/task/time-series-regression"}],"languages":[],"variants":[],"data_loaders":[{"repo":"https://github.com/EagleAdelaide/FinSen_Dataset","url":"https://github.com/EagleAdelaide/FinSen_Dataset","frameworks":["pytorch"]}],"num_papers_in_archive":1,"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28"},"benchmarks":[{"leaderboard":"/sota/time-series-regression-on-finsen","task":"Time Series Regression","dataset_variant":"FinSen","rows":1,"metrics":["Mean MSE"],"first_row_in_archive_order":{"model":"LSTM","paper":"/paper/enhancing-financial-market-predictions","metrics":{"Mean MSE":"0.01"},"code_links":[{"title":"EagleAdelaide/FinSen_Dataset","url":"https://github.com/EagleAdelaide/FinSen_Dataset"}]},"note":"rows are the archive's own order at snapshot; nothing here re-ranks them"}],"papers":{"order":"date (newest first), then slug","population":"every paper with a leaderboard row on this dataset's benchmarks (the benchmark-backed subset): the archive's own papers-using-this-dataset list was never published, so this is not that list; num_papers_in_archive is the archive's own count","page":1,"pages_in_order":1,"rows_per_page":100,"shown":1,"of":1,"counts":{"papers_with_a_benchmark_row":1,"with_a_code_link":1,"where_syntology_ran_a_sample":0,"not_listed_spam_title":0,"listed":1,"listed_where_code_ran":0,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":0,"every_run_a_failure_of_syntologys_instrument":0,"listed_with_a_run_with_no_instrument_failure":0,"listed_every_run_a_failure_of_syntologys_instrument":0,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers with at least one leaderboard row on this dataset's benchmarks; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"items":[{"paper":"/paper/enhancing-financial-market-predictions","slug":"enhancing-financial-market-predictions","title":"Enhancing Financial Market Predictions: Causality-Driven Feature Selection","date":"2024-08-02","arxiv_id":"2408.01005","rows_on_this_dataset":1,"code_links":1,"syntology":null}],"full_list":"papers_with_a_benchmark_row: every listed paper, in this order"},"papers_with_a_benchmark_row":[{"paper":"/paper/enhancing-financial-market-predictions","slug":"enhancing-financial-market-predictions","title":"Enhancing Financial Market Predictions: Causality-Driven Feature Selection","date":"2024-08-02","arxiv_id":"2408.01005","rows_on_this_dataset":1,"code_links":1,"syntology":null}],"papers_where_code_ran":0,"papers_where_code_ran_first_page":null,"papers_where_code_ran_caption":"We ran code from the paper's repository; we did not run it on this dataset or check it against this dataset's benchmarks.","pages":[],"row_route":"each paper's syntology object carries sample_list (this site's paper page, #ran), syntology_url (syntology.ai's page for the paper, only when that route probed live) and mcp (the agent call that lists the paper's harvested samples; not a verdict on the paper)","developers":"https://syntology.ai/developers","syntology_totals":{"read_at":"2026-10-05T00:36:11+00:00","papers_with_samples":0,"samples_harvested":0,"samples_ran":0,"samples_constructed":0,"samples_ran_checked":0,"samples_ran_instrument_failed":0,"samples_unverified":0,"pointer_only_for_licence":0,"papers_with_no_sample_that_ran":0,"papers_with_a_sample_that_ran":0,"papers_with_a_run_with_no_instrument_failure":0,"papers_where_every_run_was_an_instrument_failure":0,"note":"the per-paper counts of every listed paper (all pages), summed; not a rate"},"key_notes":{"samples_ran_checked":"legacy name, kept unchanged so existing readers do not break: it counts the samples that ran with no instrument failure (honoured, violated, and ran with no contract checked); it does not mean a contract was checked, and the pages print it as 'K with no instrument failure', not 'K checked'","samples_constructed":"a sub-count of the samples that ran, never subtracted from them and never a failure: an executed sample whose run returned an instance of its own class (fixture_out_type equals the entry name): the run built an object and did not compute a result (Syntology's RAN record, counts.constructed)"},"since_archive_judged":{"papers":0,"papers_placed":0,"judged_by":{"model":"a model","models_as_recorded":[],"from":"lb_rows_run_verified.jsonl: each record's `model` field (the extractor's call that wrote decisions[])"},"note":"a model's judgement from the paper's own tables that they report on this leaderboard, not a result: no value from a paper that was not placed is printed or carried here; papers counts each paper once over these leaderboards","backfill":"8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read)","backfill_complete":false,"leaderboards":[]},"papers_note":"The archive never published its papers-using-dataset list; these are papers with a leaderboard row on this dataset's benchmarks.","record_sha256":"a4b45c0079ae9f7dae3b84c554837d5c535c5eab3811076333d6294272f668d8","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}