Browse State-of-the-Art › Video Summarization
Video Summarization
89 papers with code · 6 benchmarks · 16 datasets archive 2025-07-28
Video Summarization aims to generate a short synopsis that summarizes the video content by selecting its most informative and important parts. The produced summary is usually composed of a set of representative video frames (a.k.a. video key-frames), or video fragments (a.k.a. video key-fragments) that have been stitched in chronological order to form a shorter video. The former type of a video summary is known as video storyboard, and the latter type is known as video skim.
Source: Video Summarization Using Deep Neural Networks: A Survey
Image credit: iJRASET
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
6 leaderboard tables shown for this task, 6 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
Syntology 2 newer papers were judged to report on this task's benchmarks so far (Claude Sonnet 4.5, reading their tables: a model's judgement, not a result; 0 placed): SumMe (1 judged, 0 placed), TvSum (1 judged, 0 placed), Mr. HiSum (1 judged, 0 placed). Drawn from 8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read).
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
16 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
2 subtasks in the archive's task tree.
Parent tasks archive 2025-07-28
Papers archive 2025-07-28
archive papers tagged: 280 · with a code link: 89 · where Syntology ran a sample: 14 (13 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (14 of 280 tagged: 13 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument)
Page 1 of 3: papers 1 to 100 of 280, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
29 Dec 2017 6 repositories listed Syntology community repositories only · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)Video summarization aims to facilitate large-scale video browsing by producing short, concise summaries that are diverse and representative of original videos.
-
5 Dec 2018 5 repositories listed Syntology official (archive's flag): 11 ran · 13 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 0 violated, 12 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified (of 15 harvested samples)In this work we propose a novel method for supervised, keyshots based video summarization by applying a conceptually simple and computationally efficient soft, self-attention mechanism.
-
26 Apr 2021 4 repositories listedTraditional video summarization methods generate fixed video representations regardless of user interest.
-
23 Apr 2021 3 repositories listedThe proposed architecture utilizes an attention mechanism before fusing motion features and features representing the (static) visual content, i. e., derived from an image classification model.
-
10 Oct 2019 3 repositories listedVideo is one of the robust sources of information and the consumption of online and offline videos has reached an unprecedented level in the last few years.
-
7 Jun 2023 2 repositories listedTo address these challenges and provide a comprehensive dataset for this new direction, we have meticulously curated the MMSum dataset.
-
13 Mar 2023 2 repositories listedThe goal of multimodal summarization is to extract the most important information from different modalities to form output summaries.
-
3 Jun 2022 2 repositories listed Syntology official (archive's flag): 2 ran · 3 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 2 pointer-only (licence)Video-Language Pretraining (VLP), which aims to learn transferable representation to advance a wide range of video-text downstream tasks, has recently received increasing attention.
-
7 Jan 2022 2 repositories listedConsidering that the annotation of large-scale datasets is time-consuming, we propose a multimodal self-supervised learning framework to obtain semantic representations of videos, which benefits the video summarization…
-
27 Dec 2021 2 repositories listedVideo summarization aims to automatically generate a summary (storyboard or video skim) of a video, which can facilitate large-scale video retrieval and browsing.
-
31 Jan 2020 2 repositories listedThis paper addresses the task of query-focused video summarization, which takes user's query and a long video as inputs and aims to generate a query-focused video summary.
-
27 Mar 2019 2 repositories listed Syntology 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)Video summarization is a technique to create a short skim of the original video while preserving the main stories/content.
-
29 Nov 2018 2 repositories listedIn our algorithm, at each iteration, the maximum information from the structure of the data is captured by one selected sample, and the captured information is neglected in the next iterations by projection on the…
-
28 Sep 2016 2 repositories listedFor this, we design a deep neural network that maps videos as well as descriptions to a common semantic space and jointly trained it with associated pairs of videos and descriptions.
-
6 May 2025 1 repository listedIn this work, we introduce the task of script-driven video summarization, which aims to produce a summary of the full-length video by selecting the parts that are most relevant to a user-provided script outlining the…
-
6 Mar 2025 1 repository listedWe present Vinci, a vision-language system designed to provide real-time, comprehensive AI assistance on portable devices.
-
26 Feb 2025 1 repository listedIn this work, we present a novel unsupervised scheme named SegSum, designed for video summarization through the creation of video skims.
-
12 Feb 2025 1 repository listedTransforming recorded videos into concise and accurate textual summaries is a growing challenge in multimodal learning.
-
18 Dec 2024 1 repository listedCurrent approaches to video understanding with LLMs often rely on pretrained video encoders to extract spatiotemporal features and text encoders to capture semantic meaning.
-
12 Dec 2024 1 repository listed Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 5 where Syntology's instrument failed) · 1 unverified (of 11 harvested samples)The demand for producing short-form videos for sharing on social media platforms has experienced significant growth in recent times.
-
17 Oct 2024 1 repository listedThis paper introduces an approach for query-focused video summarization, aiming to align video summaries closely with user queries.
-
4 Oct 2024 1 repository listedThese models achieved state-of-the-art correlation scores on important benchmark datasets.
-
22 Sep 2024 1 repository listed Syntology official (archive's flag): 1 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 2 pointer-only (licence)The VST module is trained by instruction fine-tuning, where two optimizing strategies are offered.
-
24 Jun 2024 1 repository listedWith the surge in the amount of video data, video summarization techniques, including visual-modal(VM) and textual-modal(TM) summarization, are attracting more and more attention.
-
5 Jun 2024 1 repository listedIn this paper we introduce a new dataset for 360-degree video summarization: the transformation of 360-degree video content to concise 2D-video summaries that can be consumed via traditional devices, such as TV sets and…
-
31 May 2024 1 repository listedVideo is an increasingly prominent and information-dense medium, yet it poses substantial challenges for language models.
-
22 May 2024 1 repository listed Syntology official (archive's flag): 15 ran · 15 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 2 honoured, 0 violated, 3 with no contract checked; 10 where Syntology's instrument failed) · 2 unverified (of 17 harvested samples)Video Temporal Grounding (VTG) strives to accurately pinpoint event timestamps in a specific video using linguistic queries, significantly impacting downstream tasks like video browsing and editing.
-
20 May 2024 1 repository listed Syntology official (archive's flag): 7 ran · 7 ran (of which 7 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 7 samples that ran constructed an object rather than computing a result (of 8 harvested samples)Video summarization aims to generate a concise representation of a video, capturing its essential content and key moments while reducing its overall length.
-
16 May 2024 1 repository listedThe findings of the conducted quantitative and qualitative evaluations demonstrate the ability of our framework to spot the most and least influential fragments and visual objects of the video for the summarizer, and to…
-
14 Apr 2024 1 repository listedWe propose a graph-based representation learning framework for video summarization.
-
6 Apr 2024 1 repository listed
-
6 Apr 2024 1 repository listed
-
2 Apr 2024 1 repository listed
-
31 Mar 2024 1 repository listed
-
10 Jan 2024 1 repository listed
-
16 Dec 2023 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified (of 7 harvested samples) · 7 pointer-only (licence)
-
5 Dec 2023 1 repository listed
-
4 Dec 2023 1 repository listed Syntology official: no sample here; runs from other or unrecorded repositories · 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples)
-
1 Dec 2023 1 repository listed
-
7 Nov 2023 1 repository listed
-
8 Oct 2023 1 repository listed
-
11 Sep 2023 1 repository listed
-
11 Sep 2023 1 repository listed
-
31 Jul 2023 1 repository listed Syntology official (archive's flag): 11 ran · 11 ran (of which 2 constructed an object rather than computing a result; 9 with no instrument failure: 2 honoured, 0 violated, 7 with no contract checked; 2 where Syntology's instrument failed) · 5 unverified (of 16 harvested samples) · 5 pointer-only (licence)
-
11 Jul 2023 1 repository listed
-
8 May 2023 1 repository listed
-
29 Mar 2023 1 repository listed Syntology official (archive's flag): 10 ran · 10 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 0 violated, 6 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified (of 12 harvested samples) · 3 pointer-only (licence)
-
28 Mar 2023 1 repository listed
-
21 Mar 2023 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
15 Feb 2023 1 repository listed
-
28 Dec 2022 1 repository listed
-
18 Nov 2022 1 repository listed
-
29 Jun 2022 1 repository listed
-
27 Apr 2022 1 repository listed
-
18 Apr 2022 1 repository listed
-
22 Jan 2022 1 repository listed
-
1 Dec 2021 1 repository listed
-
30 Sep 2021 1 repository listed
-
6 Sep 2021 1 repository listed
-
3 Sep 2021 1 repository listed
-
8 Aug 2021 1 repository listed
-
1 Jul 2021 1 repository listed
-
9 Jun 2021 1 repository listed
-
5 Jun 2021 1 repository listed
-
3 Jun 2021 1 repository listed
-
26 May 2021 1 repository listed
-
27 Apr 2021 1 repository listed
-
27 Mar 2021 1 repository listed
-
17 Mar 2021 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result (of 1 harvested sample) · 1 pointer-only (licence)
-
4 Mar 2021 1 repository listed
-
14 Dec 2020 1 repository listed
-
1 Dec 2020 1 repository listed
-
23 Nov 2020 1 repository listed
-
16 Nov 2020 1 repository listed
-
9 Oct 2020 1 repository listed
-
17 Sep 2020 1 repository listed
-
19 May 2020 1 repository listed
-
7 Apr 2020 1 repository listed
-
24 Dec 2019 1 repository listed
-
8 Dec 2019 1 repository listed
-
21 Oct 2019 1 repository listed
-
1 Dec 2018 1 repository listed
-
24 Nov 2018 1 repository listed
-
24 Sep 2018 1 repository listed
-
8 May 2018 1 repository listed
-
1 Jul 2017 1 repository listed
-
1 May 2017 1 repository listed
-
21 Dec 2016 1 repository listed
-
26 May 2016 1 repository listed
-
TRIM: A Self-Supervised Video Summarization Framework Maximizing Temporal Relative Information and Representativeness25 Jun 2025 0 repositories listed
-
MF2Summ: Multimodal Fusion for Video Summarization with Temporal Alignment12 Jun 2025 0 repositories listed
-
Prompts to Summaries: Zero-Shot Language-Guided Video Summarization12 Jun 2025 0 repositories listed
-
Enhancing Video Memorability Prediction with Text-Motion Cross-modal Contrastive Loss and Its Application in Video Summarization10 Jun 2025 0 repositories listed
-
TriPSS: A Tri-Modal Keyframe Extraction Framework Using Perceptual, Structural, and Semantic Representations3 Jun 2025 0 repositories listed
-
Unsupervised Transcript-assisted Video Summarization and Highlight Detection29 May 2025 0 repositories listed
-
REGen: Multimodal Retrieval-Embedded Generation for Long-to-Short Video Editing24 May 2025 0 repositories listed
-
Video Summarization with Large Language Models15 Apr 2025 0 repositories listed
-
Automatic Detection of Intro and Credits in Video using CLIP and Multihead Attention13 Apr 2025 0 repositories listed
-
FaVChat: Unlocking Fine-Grained Facail Video Understanding with Multimodal Large Language Models12 Mar 2025 0 repositories listed
-
A Novel Trustworthy Video Summarization Algorithm Through a Mixture of LoRA Experts8 Mar 2025 0 repositories listed
Syntology lines on 14 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections