Papers › Bringing Structure into Summaries: a Faceted Summarization Dataset for Long Scientific...

Bringing Structure into Summaries: a Faceted Summarization Dataset for Long Scientific Documents

31 May 2021ACL 2021 5arXiv:2106.00130archive 2025-07-28

Rui Meng, Khushboo Thaker, Lei Zhang, Yue Dong, Xingdi Yuan, Tong Wang, Daqing He

Faceted summarization provides briefings of a document from different perspectives. Readers can quickly comprehend the main points of a long document with the help of a structured outline. However, little research has been conducted on this subject, partially due to the lack of large-scale faceted summarization datasets. In this study, we present FacetSum, a faceted summarization benchmark built on Emerald journal articles, covering a diverse range of domains. Different from traditional document-summary pairs, FacetSum provides multiple summaries, each targeted at specific sections of a long document, including the purpose, method, findings, and value. Analyses and empirical results on our dataset reveal the importance of bringing structure into summaries. We believe FacetSum will spur further advances in summarization research and foster the development of NLP systems that can leverage the structured information in both long texts and summaries.

PaperPDFConference PDFCode

In Syntology View this paper on Syntology, its page in Syntology's graph. That page lists the repositories linked to the paper, the abstract and the calls for agents.

Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, on Syntology's MCP service (how to connect):

Code

hfthair/emerald_crawler officialmentioned in paperSyntology: not harvested report
bnitsan/papertweet mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to TLDR: Extreme Summarization of Scientific Documents (arXiv:2004.15011; that paper's own run record: 17 ran (of which 1 constructed an object rather than computing a result; 10 with no instrument failure: 4 honoured, 0 violated, 6 with no contract checked; 7 where Syntology's instrument failed) · 2 unverified); nothing checks that they implement this paper's method. report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

A paper named beside a repository with no sample linked to this paper is shown with that paper's own run record, not this paper's: “ran” means executed on a synthesized input, not that the code is correct, and “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Papers are listed in arXiv-id order, at most three per repository.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

ArticlesUnsupervised Extractive Summarization

Datasets

Introduced by this paper, per the archive.

FacetSum

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Unsupervised Extractive Summarization FacetSum HipoRank ROUGE-L 42.89 #1 of 5 Archive leaderboard report
Unsupervised Extractive Summarization FacetSum LexRank ROUGE-L 42.18 #2 of 5 Archive leaderboard report
Unsupervised Extractive Summarization FacetSum TextRank ROUGE-L 41.87 #3 of 5 Archive leaderboard report
Unsupervised Extractive Summarization FacetSum SumBasic ROUGE-L 38.71 #4 of 5 Archive leaderboard report
Unsupervised Extractive Summarization FacetSum LSA ROUGE-L 35.98 #5 of 5 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections