Papers › "Liar, Liar Pants on Fire": A New Benchmark Dataset for Fake News Detection

"Liar, Liar Pants on Fire": A New Benchmark Dataset for Fake News Detection

1 May 2017ACL 2017 7arXiv:1705.00648archive 2025-07-28

William Yang Wang

Automatic fake news detection is a challenging problem in deception detection, and it has tremendous real-world political and social impacts. However, statistical approaches to combating fake news has been dramatically limited by the lack of labeled benchmark datasets. In this paper, we present liar: a new, publicly available dataset for fake news detection. We collected a decade-long, 12.8K manually labeled short statements in various contexts from PolitiFact.com, which provides detailed analysis report and links to source documents for each case. This dataset can be used for fact-checking research as well. Notably, this new dataset is an order of magnitude larger than previously largest public fake news datasets of similar type. Empirically, we investigate automatic fake news detection based on surface-level linguistic patterns. We have designed a novel, hybrid convolutional neural network to integrate meta-data with text. We show that this hybrid approach can improve a text-only deep learning model.

PaperPDFCode

In Syntology View this paper on Syntology, its page in Syntology's graph. That page lists the repositories linked to the paper, the abstract and the calls for agents.

Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, on Syntology's MCP service (how to connect):

Code

ExploringLies/lies-have-short-legs mentioned on GitHubSyntology: not harvested report
JelenaBanjac/AppliedDataAnalysis mentioned on GitHubSyntology: not harvested report
JelenaBanjac/lies-have-short-legs mentioned on GitHubSyntology: not harvested report
SindhuMadi/FakeNewsDetection mentioned on GitHubSyntology: not harvested report
bedarkarpriyanka/NLP-Project-Fake-News-Detection mentioned on GitHubtfSyntology: not harvested report
kiranrawat/Detecting-Fake-News-On-Social-Media mentioned on GitHubSyntology: not harvested report
mansoor9743/Fake-News-Detection mentioned on GitHubtfSyntology: not harvested report
mikanikos/ADA_Project mentioned on GitHubSyntology: not harvested report
siddarthhari95/NLP-Fake-News_detection mentioned on GitHubtfSyntology: not harvested report
ekagra-ranjan/fake-news-detection-LIAR-pytorch pytorchSyntology: not harvested report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Deception DetectionFact CheckingFake News Detection

Datasets

Introduced by this paper, per the archive.

LIAR

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Fake News Detection LIAR Hybrid CNNs (Text + All) Test Accuracy 0.274 #1 of 4 Archive leaderboard report
Fake News Detection LIAR Hybrid CNNs (Text + All) Validation Accuracy 0.247 #1 of 4 Archive leaderboard report
Fake News Detection LIAR CNNs Test Accuracy 0.27 #2 of 4 Archive leaderboard report
Fake News Detection LIAR CNNs Validation Accuracy 0.26 #2 of 4 Archive leaderboard report
Fake News Detection LIAR Hybrid CNNs (Text + Speaker) Test Accuracy 0.248 #3 of 4 Archive leaderboard report
Fake News Detection LIAR Hybrid CNNs (Text + Speaker) Validation Accuracy 0.277 #3 of 4 Archive leaderboard report
Fake News Detection LIAR Bi-LSTMs Test Accuracy 0.233 #4 of 4 Archive leaderboard report
Fake News Detection LIAR Bi-LSTMs Validation Accuracy 0.223 #4 of 4 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections