{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/salient-information-prompting-to-steer","title":"Salient Information Prompting to Steer Content in Prompt-based Abstractive Summarization","arxiv_id":"2410.02741","date":"2024-10-03","proceeding":null,"authors":["Lei Xu","Mohammed Asad Karim","Saket Dingliwal","Aparna Elangovan"],"abstract":"Large language models (LLMs) can generate fluent summaries across domains using prompting techniques, reducing the need to train models for summarization applications. However, crafting effective prompts that guide LLMs to generate summaries with the appropriate level of detail and writing style remains a challenge. In this paper, we explore the use of salient information extracted from the source document to enhance summarization prompts. We show that adding keyphrases in prompts can improve ROUGE F1 and recall, making the generated summaries more similar to the reference and more complete. The number of keyphrases can control the precision-recall trade-off. Furthermore, our analysis reveals that incorporating phrase-level salient information is superior to word- or sentence-level. However, the impact on hallucination is not universally positive across LLMs. To conduct this analysis, we introduce Keyphrase Signal Extractor (SigExt), a lightweight model that can be finetuned to extract salient keyphrases. By using SigExt, we achieve consistent ROUGE improvements across datasets and open-weight and proprietary LLMs without any LLM customization. Our findings provide insights into leveraging salient information in building prompt-based summarization systems. We release our code at \\url{https://github.com/amazon-science/SigExt}","url_abs":"https://arxiv.org/abs/2410.02741v2","url_pdf":"https://arxiv.org/pdf/2410.02741v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"salient-information-prompting-to-steer","repo_url":"https://github.com/amazon-science/SigExt","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"abstractive-text-summarization","task_name":"Abstractive Text Summarization"},{"task_slug":"hallucination","task_name":"Hallucination"},{"task_slug":"sentence","task_name":"Sentence"},{"task_slug":"text-summarization","task_name":"Text Summarization"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/abstractive-text-summarization-on-cnn-daily-2","task":"Abstractive Text Summarization","dataset":"CNN/Daily Mail","model":"Claude Instant + SigExt","rank_in_archive_order":4,"of":4,"metrics":{"ROUGE-1":"42","ROUGE-L":"26.6"},"uses_additional_data":false},{"leaderboard":"/sota/text-summarization-on-meetingbank","task":"Text Summarization","dataset":"MeetingBank","model":"Claude Instant + SigExt","rank_in_archive_order":2,"of":2,"metrics":{"ROUGE-L":"31.9","Rouge-1":"42.3"},"uses_additional_data":false},{"leaderboard":"/sota/text-summarization-on-samsum-corpus","task":"Text Summarization","dataset":"SAMSum","model":"Mistral 7B + SigExt","rank_in_archive_order":10,"of":12,"metrics":{"ROUGE-1":"44.1","ROUGE-L":"33.9"},"uses_additional_data":false},{"leaderboard":"/sota/text-summarization-on-arxiv-summarization","task":"Text Summarization","dataset":"arXiv Summarization Dataset","model":"Claude Instant + SigExt","rank_in_archive_order":4,"of":4,"metrics":{"ROUGE-1":"45.2","ROUGE-L":"23.5"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/2410.02741","atlas_url":"https://app.syntology.ai/?focus=2410.02741","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"2410.02741"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"2410.02741\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"2410.02741"},"call":"get_concepts_for_paper(arxiv_id=\"2410.02741\")"}],"by_repo":[{"repo":"amazon-science/SigExt","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"18fcff8a7fba12ee69263d298021c2cb50017984a2ba49e0834db76ed850068d","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}