{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/task/video-description","name":"Video Description","slug":"video-description","description_markdown":"The goal of automatic **Video Description** is to tell a story about events happening in a video. While early Video Description methods produced captions for short clips that were manually segmented to contain a single event of interest, more recently dense video captioning has been proposed to both segment distinct events in time and describe them in a series of coherent sentences. This problem is a generalization of dense image region captioning and has many practical applications, such as generating textual summaries for the visually impaired, or detecting and describing important events in surveillance footage.\r\n\r\n\r\n<span class=\"description-source\">Source: [Joint Event Detection and Description in Continuous Video Streams ](https://arxiv.org/abs/1802.10250)</span>","categories":[{"name":"Computer Vision","url":"/area/computer-vision"}],"source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","slug_source":"archive_url"},"counts":{"papers_tagged":104,"papers_with_code":34,"benchmarks":0,"benchmark_tables_in_archive":0,"benchmark_tables_shown":0,"benchmark_tables_withheld_as_spam":0,"benchmark_definition":"a leaderboard table with at least one row; benchmark_tables_shown also counts the zero-row tables; benchmark_tables_in_archive adds the tables withheld as spam","datasets":9,"subtasks":0,"parent_tasks":1},"benchmarks":[],"datasets":[{"url":"/dataset/flickr30k","name":"Flickr30k","full_name":"Flickr30k","num_papers_in_archive":880},{"url":"/dataset/tacos-multi-level-corpus","name":"TACoS Multi-Level Corpus","full_name":"","num_papers_in_archive":45},{"url":"/dataset/youcook","name":"YouCook","full_name":"","num_papers_in_archive":45},{"url":"/dataset/activitynet-entities-1","name":"ActivityNet Entities","full_name":null,"num_papers_in_archive":18},{"url":"/dataset/videocc3m","name":"VideoCC3M","full_name":"Video-Conceptual-Captions","num_papers_in_archive":10},{"url":"/dataset/edub-seg","name":"EDUB-Seg","full_name":"Egocentric Dataset of the University of Barcelona – Segmentation","num_papers_in_archive":4},{"url":"/dataset/m-vad-names","name":"M-VAD Names","full_name":"M-VAD Names Dataset","num_papers_in_archive":3},{"url":"/dataset/devan","name":"DeVAn","full_name":"Dense Video Annotation for Video-Language Models","num_papers_in_archive":1},{"url":"/dataset/vidas","name":"ViDAS","full_name":"","num_papers_in_archive":1}],"subtasks":[],"parent_tasks":[{"url":"/task/video","name":"Video"}],"papers":{"order":"repositories listed in the archive (most first), then date (newest first), then slug; the archive holds no stars","population":"every paper the archive tags with this task (distinct papers; spam titles not listed). 'of' counts the papers listed; until 2026-09-25 it counted only the papers with a code link, and that number is of_with_code","page":1,"pages_in_order":2,"rows_per_page":100,"shown":100,"of":104,"of_with_code":34,"tagged_in_all":104,"counts":{"archive_papers_tagged":104,"with_a_code_link":34,"where_syntology_ran_a_sample":11,"not_listed_spam_title":0,"listed":104,"listed_where_code_ran":11,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":8,"every_run_a_failure_of_syntologys_instrument":3,"listed_with_a_run_with_no_instrument_failure":8,"listed_every_run_a_failure_of_syntologys_instrument":3,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"items":[{"url":"/paper/describing-videos-by-exploiting-temporal","slug":"describing-videos-by-exploiting-temporal","title":"Describing Videos by Exploiting Temporal Structure","date":"2015-02-27","arxiv_id":"1502.08029","repositories_listed":5,"syntology":{"n":2,"n_ran":2,"n_constructed":0,"n_ran_checked":2,"n_instrument":0,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":2,"n_pointer_only":0,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/describing-videos-by-exploiting-temporal#ran","syntology_url":"https://syntology.ai/paper/1502.08029","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1502.08029"}},"official":{"repos":["yaoli/arctic-capgen-vid"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"url":"/paper/vatex-a-large-scale-high-quality-multilingual","slug":"vatex-a-large-scale-high-quality-multilingual","title":"VATEX: A Large-Scale, High-Quality Multilingual Dataset for Video-and-Language Research","date":"2019-04-06","arxiv_id":"1904.03493","repositories_listed":4,"syntology":null},{"url":"/paper/audio-visual-scene-aware-dialog-avsd","slug":"audio-visual-scene-aware-dialog-avsd","title":"Audio Visual Scene-Aware Dialog (AVSD) Challenge at DSTC7","date":"2018-06-01","arxiv_id":"1806.00525","repositories_listed":4,"syntology":null},{"url":"/paper/improving-lstm-based-video-description-with","slug":"improving-lstm-based-video-description-with","title":"Improving LSTM-based Video Description with Linguistic Knowledge Mined from Text","date":"2016-04-06","arxiv_id":"1604.01729","repositories_listed":3,"syntology":null},{"url":"/paper/grounded-video-description","slug":"grounded-video-description","title":"Grounded Video Description","date":"2018-12-17","arxiv_id":"1812.06587","repositories_listed":2,"syntology":null},{"url":"/paper/end-to-end-audio-visual-scene-aware-dialog","slug":"end-to-end-audio-visual-scene-aware-dialog","title":"End-to-End Audio Visual Scene-Aware Dialog using Multimodal Attention-Based Video Features","date":"2018-06-21","arxiv_id":"1806.08409","repositories_listed":2,"syntology":{"n":3,"n_ran":1,"n_constructed":0,"n_ran_checked":1,"n_instrument":0,"n_unverified":2,"n_honours":0,"n_violates":0,"n_no_contract":1,"n_pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified","sample_list":"/paper/end-to-end-audio-visual-scene-aware-dialog#ran","syntology_url":"https://syntology.ai/paper/1806.08409","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1806.08409"}},"official":null}},{"url":"/paper/tarsier2-advancing-large-vision-language","slug":"tarsier2-advancing-large-vision-language","title":"Tarsier2: Advancing Large Vision-Language Models from Detailed Video Description to Comprehensive Video Understanding","date":"2025-01-14","arxiv_id":"2501.07888","repositories_listed":1,"syntology":{"n":4,"n_ran":4,"n_constructed":0,"n_ran_checked":0,"n_instrument":4,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":4,"phrase":"4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/tarsier2-advancing-large-vision-language#ran","syntology_url":"https://syntology.ai/paper/2501.07888","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2501.07888"}},"official":{"repos":["bytedance/tarsier"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official","unlocated"]}}},{"url":"/paper/implicit-location-caption-alignment-via","slug":"implicit-location-caption-alignment-via","title":"Implicit Location-Caption Alignment via Complementary Masking for Weakly-Supervised Dense Video Captioning","date":"2024-12-17","arxiv_id":"2412.12791","repositories_listed":1,"syntology":{"n":12,"n_ran":6,"n_constructed":0,"n_ran_checked":1,"n_instrument":5,"n_unverified":6,"n_honours":0,"n_violates":0,"n_no_contract":1,"n_pointer_only":0,"phrase":"6 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 5 where Syntology's instrument failed) · 6 unverified","sample_list":"/paper/implicit-location-caption-alignment-via#ran","syntology_url":"https://syntology.ai/paper/2412.12791","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2412.12791"}},"official":{"repos":["ShipingGe/ILCACM"],"state":"official (archive's flag): 6 ran","n_ran":6,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":6,"ran_from_kinds":["official"]}}},{"url":"/paper/storyteller-improving-long-video-description","slug":"storyteller-improving-long-video-description","title":"StoryTeller: Improving Long Video Description through Global Audio-Visual Character Identification","date":"2024-11-11","arxiv_id":"2411.07076","repositories_listed":1,"syntology":null},{"url":"/paper/sustechgan-image-generation-for-object","slug":"sustechgan-image-generation-for-object","title":"SUSTechGAN: Image Generation for Object Detection in Adverse Conditions of Autonomous Driving","date":"2024-07-18","arxiv_id":"2408.01430","repositories_listed":1,"syntology":null},{"url":"/paper/tarsier-recipes-for-training-and-evaluating-1","slug":"tarsier-recipes-for-training-and-evaluating-1","title":"Tarsier: Recipes for Training and Evaluating Large Video Description Models","date":"2024-06-30","arxiv_id":"2407.00634","repositories_listed":1,"syntology":{"n":2,"n_ran":2,"n_constructed":0,"n_ran_checked":0,"n_instrument":2,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/tarsier-recipes-for-training-and-evaluating-1#ran","syntology_url":"https://syntology.ai/paper/2407.00634","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2407.00634"}},"official":{"repos":["bytedance/tarsier"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]}}},{"url":"/paper/hawk-learning-to-understand-open-world-video","slug":"hawk-learning-to-understand-open-world-video","title":"Hawk: Learning to Understand Open-World Video Anomalies","date":"2024-05-27","arxiv_id":"2405.16886","repositories_listed":1,"syntology":{"n":9,"n_ran":7,"n_constructed":0,"n_ran_checked":1,"n_instrument":6,"n_unverified":2,"n_honours":0,"n_violates":1,"n_no_contract":0,"n_pointer_only":9,"phrase":"7 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 6 where Syntology's instrument failed) · 2 unverified","sample_list":"/paper/hawk-learning-to-understand-open-world-video#ran","syntology_url":"https://syntology.ai/paper/2405.16886","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2405.16886"}},"official":{"repos":["jqtangust/hawk"],"state":"official (archive's flag): 7 ran","n_ran":7,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":2,"ran_from_kinds":["official"]}}},{"url":"/paper/trafficvlm-a-controllable-visual-language","slug":"trafficvlm-a-controllable-visual-language","title":"TrafficVLM: A Controllable Visual Language Model for Traffic Video Captioning","date":"2024-04-14","arxiv_id":"2404.09275","repositories_listed":1,"syntology":{"n":1,"n_ran":1,"n_constructed":0,"n_ran_checked":0,"n_instrument":1,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/trafficvlm-a-controllable-visual-language#ran","syntology_url":"https://syntology.ai/paper/2404.09275","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2404.09275"}},"official":{"repos":["quangminhdinh/trafficvlm"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]}}},{"url":"/paper/jmi-at-semeval-2024-task-3-two-step-approach","slug":"jmi-at-semeval-2024-task-3-two-step-approach","title":"JMI at SemEval 2024 Task 3: Two-step approach for multimodal ECAC using in-context learning with GPT and instruction-tuned Llama models","date":"2024-03-05","arxiv_id":"2403.04798","repositories_listed":1,"syntology":{"n":12,"n_ran":5,"n_constructed":0,"n_ran_checked":3,"n_instrument":2,"n_unverified":7,"n_honours":0,"n_violates":0,"n_no_contract":3,"n_pointer_only":12,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 7 unverified","sample_list":"/paper/jmi-at-semeval-2024-task-3-two-step-approach#ran","syntology_url":"https://syntology.ai/paper/2403.04798","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2403.04798"}},"official":{"repos":["cmooncs/semeval-2024_multimodal_ecpe"],"state":"official (archive's flag): 5 ran","n_ran":5,"n_constructed":0,"n_ran_no_instrument_failure":3,"n_unverified":7,"ran_from_kinds":["official"]}}},{"url":"/paper/panda-70m-captioning-70m-videos-with-multiple","slug":"panda-70m-captioning-70m-videos-with-multiple","title":"Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teachers","date":"2024-02-29","arxiv_id":"2402.19479","repositories_listed":1,"syntology":null},{"url":"/paper/funqa-towards-surprising-video-comprehension","slug":"funqa-towards-surprising-video-comprehension","title":"FunQA: Towards Surprising Video Comprehension","date":"2023-06-26","arxiv_id":"2306.14899","repositories_listed":1,"syntology":{"n":3,"n_ran":3,"n_constructed":0,"n_ran_checked":3,"n_instrument":0,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":3,"n_pointer_only":0,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/funqa-towards-surprising-video-comprehension#ran","syntology_url":"https://syntology.ai/paper/2306.14899","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2306.14899"}},"official":{"repos":["jingkang50/funqa"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":3,"n_unverified":0,"ran_from_kinds":["official"]}}},{"url":"/paper/msvd-indonesian-a-benchmark-for-multimodal","slug":"msvd-indonesian-a-benchmark-for-multimodal","title":"MSVD-Indonesian: A Benchmark for Multimodal Video-Text Tasks in Indonesian","date":"2023-06-20","arxiv_id":"2306.11341","repositories_listed":1,"syntology":null},{"url":"/paper/edit-as-you-wish-video-description-editing","slug":"edit-as-you-wish-video-description-editing","title":"Edit As You Wish: Video Caption Editing with Multi-grained User Control","date":"2023-05-15","arxiv_id":"2305.08389","repositories_listed":1,"syntology":null},{"url":"/paper/fine-grained-audible-video-description","slug":"fine-grained-audible-video-description","title":"Fine-grained Audible Video Description","date":"2023-03-27","arxiv_id":"2303.15616","repositories_listed":1,"syntology":{"n":12,"n_ran":7,"n_constructed":0,"n_ran_checked":6,"n_instrument":1,"n_unverified":5,"n_honours":0,"n_violates":0,"n_no_contract":6,"n_pointer_only":1,"phrase":"7 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 5 unverified","sample_list":"/paper/fine-grained-audible-video-description#ran","syntology_url":"https://syntology.ai/paper/2303.15616","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2303.15616"}},"official":{"repos":["opennlplab/favdbench"],"state":"official (archive's flag): 7 ran","n_ran":7,"n_constructed":0,"n_ran_no_instrument_failure":6,"n_unverified":5,"ran_from_kinds":["official"]}}},{"url":"/paper/thinking-hallucination-for-video-captioning","slug":"thinking-hallucination-for-video-captioning","title":"Thinking Hallucination for Video Captioning","date":"2022-09-28","arxiv_id":"2209.13853","repositories_listed":1,"syntology":null},{"url":"/paper/what-s-in-a-caption-dataset-specific","slug":"what-s-in-a-caption-dataset-specific","title":"What's in a Caption? Dataset-Specific Linguistic Diversity and Its Effect on Visual Description Models and Metrics","date":"2022-05-12","arxiv_id":"2205.06253","repositories_listed":1,"syntology":null},{"url":"/paper/learn-to-understand-negation-in-video","slug":"learn-to-understand-negation-in-video","title":"Learn to Understand Negation in Video Retrieval","date":"2022-04-30","arxiv_id":"2205.00132","repositories_listed":1,"syntology":null},{"url":"/paper/identity-aware-multi-sentence-video","slug":"identity-aware-multi-sentence-video","title":"Identity-Aware Multi-Sentence Video Description","date":"2020-08-22","arxiv_id":"2008.09791","repositories_listed":1,"syntology":null},{"url":"/paper/describing-unseen-videos-via-multi","slug":"describing-unseen-videos-via-multi","title":"Describing Unseen Videos via Multi-Modal Cooperative Dialog Agents","date":"2020-08-18","arxiv_id":"2008.07935","repositories_listed":1,"syntology":null},{"url":"/paper/delving-deeper-into-the-decoder-for-video","slug":"delving-deeper-into-the-decoder-for-video","title":"Delving Deeper into the Decoder for Video Captioning","date":"2020-01-16","arxiv_id":"2001.05614","repositories_listed":1,"syntology":{"n":2,"n_ran":0,"n_constructed":0,"n_ran_checked":0,"n_instrument":0,"n_unverified":2,"n_honours":0,"n_violates":0,"n_no_contract":0,"n_pointer_only":0,"phrase":"0 ran · 2 unverified","sample_list":"/paper/delving-deeper-into-the-decoder-for-video#ran","syntology_url":"https://syntology.ai/paper/2001.05614","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2001.05614"}},"official":{"repos":["WingsBrokenAngel/delving-deeper-into-the-decoder-for-video-captioning"],"state":"official: harvested, nothing ran","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":2,"ran_from_kinds":[]}}},{"url":"/paper/vizseq-a-visual-analysis-toolkit-for-text","slug":"vizseq-a-visual-analysis-toolkit-for-text","title":"VizSeq: A Visual Analysis Toolkit for Text Generation Tasks","date":"2019-09-12","arxiv_id":"1909.05424","repositories_listed":1,"syntology":null},{"url":"/paper/adversarial-inference-for-multi-sentence","slug":"adversarial-inference-for-multi-sentence","title":"Adversarial Inference for Multi-Sentence Video Description","date":"2018-12-13","arxiv_id":"1812.05634","repositories_listed":1,"syntology":null},{"url":"/paper/predicting-visual-features-from-text-for","slug":"predicting-visual-features-from-text-for","title":"Predicting Visual Features from Text for Image and Video Caption Retrieval","date":"2017-09-05","arxiv_id":"1709.01362","repositories_listed":1,"syntology":null},{"url":"/paper/egocentric-video-description-based-on","slug":"egocentric-video-description-based-on","title":"Egocentric Video Description based on Temporally-Linked Sequences","date":"2017-04-07","arxiv_id":"1704.02163","repositories_listed":1,"syntology":null},{"url":"/paper/memory-augmented-attention-modelling-for","slug":"memory-augmented-attention-modelling-for","title":"Memory-augmented Attention Modelling for Videos","date":"2016-11-07","arxiv_id":"1611.02261","repositories_listed":1,"syntology":null},{"url":"/paper/a-mid-level-video-representation-based-on","slug":"a-mid-level-video-representation-based-on","title":"A Mid-level Video Representation based on Binary Descriptors: A Case Study for Pornography Detection","date":"2016-05-12","arxiv_id":"1605.03804","repositories_listed":1,"syntology":null},{"url":"/paper/video-description-using-bidirectional","slug":"video-description-using-bidirectional","title":"Video Description using Bidirectional Recurrent Neural Networks","date":"2016-04-12","arxiv_id":"1604.03390","repositories_listed":1,"syntology":null},{"url":"/paper/tgif-a-new-dataset-and-benchmark-on-animated","slug":"tgif-a-new-dataset-and-benchmark-on-animated","title":"TGIF: A New Dataset and Benchmark on Animated GIF Description","date":"2016-04-10","arxiv_id":"1604.02748","repositories_listed":1,"syntology":null},{"url":"/paper/using-descriptive-video-services-to-create-a","slug":"using-descriptive-video-services-to-create-a","title":"Using Descriptive Video Services to Create a Large Data Source for Video Annotation Research","date":"2015-03-03","arxiv_id":"1503.01070","repositories_listed":1,"syntology":null},{"url":null,"slug":"dante-ad-dual-vision-attention-network-for","title":"DANTE-AD: Dual-Vision Attention Network for Long-Term Audio Description","date":"2025-03-31","arxiv_id":"2503.24096","repositories_listed":0,"syntology":null},{"url":"/paper/hoigen-1m-a-large-scale-dataset-for-human","slug":"hoigen-1m-a-large-scale-dataset-for-human","title":"HOIGen-1M: A Large-scale Dataset for Human-Object Interaction Video Generation","date":"2025-03-31","arxiv_id":"2503.23715","repositories_listed":0,"syntology":{"n":1,"n_ran":1,"n_constructed":0,"n_ran_checked":1,"n_instrument":0,"n_unverified":0,"n_honours":0,"n_violates":0,"n_no_contract":1,"n_pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","sample_list":"/paper/hoigen-1m-a-large-scale-dataset-for-human#ran","syntology_url":"https://syntology.ai/paper/2503.23715","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"2503.23715"}},"official":null}},{"url":null,"slug":"cross-modal-learning-for-music-to-music-video","title":"Cross-Modal Learning for Music-to-Music-Video Description Generation","date":"2025-03-14","arxiv_id":"2503.11190","repositories_listed":0,"syntology":null},{"url":null,"slug":"videoa11y-method-and-dataset-for-accessible","title":"VideoA11y: Method and Dataset for Accessible Video Description","date":"2025-02-27","arxiv_id":"2502.20480","repositories_listed":0,"syntology":null},{"url":null,"slug":"avd2-accident-video-diffusion-for-accident","title":"AVD2: Accident Video Diffusion for Accident Video Description","date":"2025-02-20","arxiv_id":"2502.14801","repositories_listed":0,"syntology":null},{"url":null,"slug":"enhancing-video-understanding-deep-neural","title":"Enhancing Video Understanding: Deep Neural Networks for Spatiotemporal Analysis","date":"2025-02-11","arxiv_id":"2502.07277","repositories_listed":0,"syntology":null},{"url":null,"slug":"towards-zero-shot-explainable-video","title":"Towards Zero-Shot & Explainable Video Description by Reasoning over Graphs of Events in Space and Time","date":"2025-01-14","arxiv_id":"2501.08460","repositories_listed":0,"syntology":null},{"url":"/paper/pv-vtt-a-privacy-centric-dataset-for-mission","slug":"pv-vtt-a-privacy-centric-dataset-for-mission","title":"PV-VTT: A Privacy-Centric Dataset for Mission-Specific Anomaly Detection and Natural Language Interpretation","date":"2024-10-30","arxiv_id":"2410.22623","repositories_listed":0,"syntology":null},{"url":null,"slug":"can-lvlms-describe-videos-like-humans-a-five","title":"FIOVA: A Multi-Annotator Benchmark for Human-Aligned Video Captioning","date":"2024-10-20","arxiv_id":"2410.15270","repositories_listed":0,"syntology":null},{"url":null,"slug":"videoclip-xl-advancing-long-description","title":"VideoCLIP-XL: Advancing Long Description Understanding for Video CLIP Models","date":"2024-10-01","arxiv_id":"2410.00741","repositories_listed":0,"syntology":null},{"url":null,"slug":"technical-report-competition-solution-for-2","title":"Technical Report: Competition Solution For Modelscope-Sora","date":"2024-09-24","arxiv_id":"2410.07194","repositories_listed":0,"syntology":null},{"url":null,"slug":"kubrick-multimodal-agent-collaborations-for","title":"Kubrick: Multimodal Agent Collaborations for Synthetic Video Generation","date":"2024-08-19","arxiv_id":"2408.10453","repositories_listed":0,"syntology":null},{"url":null,"slug":"https-arxiv-org-abs-2407-00634","title":"https://arxiv.org/abs/2407.00634","date":"2024-07-02","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"llavidal-benchmarking-large-language-vision","title":"LLAVIDAL: A Large LAnguage VIsion Model for Daily Activities of Living","date":"2024-06-13","arxiv_id":"2406.09390","repositories_listed":0,"syntology":null},{"url":null,"slug":"a-labelled-dataset-for-sentiment-analysis-of","title":"A Labelled Dataset for Sentiment Analysis of Videos on YouTube, TikTok, and Other Sources about the 2024 Outbreak of Measles","date":"2024-06-11","arxiv_id":"2406.07693","repositories_listed":0,"syntology":null},{"url":null,"slug":"x-vars-introducing-explainability-in-football","title":"X-VARS: Introducing Explainability in Football Refereeing with Multi-Modal Large Language Model","date":"2024-04-07","arxiv_id":"2404.06332","repositories_listed":0,"syntology":null},{"url":null,"slug":"multi-modal-news-understanding-with","title":"Multi-modal News Understanding with Professionally Labelled Videos (ReutersViLNews)","date":"2024-01-23","arxiv_id":"2401.12419","repositories_listed":0,"syntology":null},{"url":null,"slug":"actionhub-a-large-scale-action-video","title":"ActionHub: A Large-scale Action Video Description Dataset for Zero-shot Action Recognition","date":"2024-01-22","arxiv_id":"2401.11654","repositories_listed":0,"syntology":null},{"url":null,"slug":"attention-based-encoder-decoder-model-for","title":"Attention Based Encoder Decoder Model for Video Captioning in Nepali (2023)","date":"2023-12-12","arxiv_id":"2312.07418","repositories_listed":0,"syntology":null},{"url":null,"slug":"multi-sentence-description-of-complex","title":"Multi Sentence Description of Complex Manipulation Action Videos","date":"2023-11-13","arxiv_id":"2311.07285","repositories_listed":0,"syntology":null},{"url":null,"slug":"clearvid-curriculum-learning-for-video","title":"CLearViD: Curriculum Learning for Video Description","date":"2023-11-08","arxiv_id":"2311.04480","repositories_listed":0,"syntology":null},{"url":null,"slug":"analyzing-political-figures-in-real-time","title":"Analyzing Political Figures in Real-Time: Leveraging YouTube Metadata for Sentiment Analysis","date":"2023-09-28","arxiv_id":"2309.16234","repositories_listed":0,"syntology":null},{"url":null,"slug":"synchronized-audio-visual-frames-with","title":"Synchronized Audio-Visual Frames with Fractional Positional Encoding for Transformers in Video-to-Text Translation","date":"2021-12-28","arxiv_id":"2112.14088","repositories_listed":0,"syntology":null},{"url":null,"slug":"relational-graph-learning-for-grounded-video","title":"Relational Graph Learning for Grounded Video Description Generation","date":"2021-12-02","arxiv_id":"2112.00967","repositories_listed":0,"syntology":null},{"url":"/paper/an-efficient-keyframes-selection-based","slug":"an-efficient-keyframes-selection-based","title":"An Efficient Keyframes Selection Based Framework for Video Captioning","date":"2021-12-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"narrationbot-and-infobot-a-hybrid-system-for","title":"NarrationBot and InfoBot: A Hybrid System for Automated Video Description","date":"2021-11-07","arxiv_id":"2111.03994","repositories_listed":0,"syntology":null},{"url":null,"slug":"visual-aware-attention-dual-stream-decoder","title":"Visual-aware Attention Dual-stream Decoder for Video Captioning","date":"2021-10-16","arxiv_id":"2110.08578","repositories_listed":0,"syntology":null},{"url":null,"slug":"boosting-video-captioning-with-dynamic-loss","title":"Boosting Video Captioning with Dynamic Loss Network","date":"2021-07-25","arxiv_id":"2107.11707","repositories_listed":0,"syntology":null},{"url":null,"slug":"efficient-data-driven-encoding-of-scene","title":"Efficient data-driven encoding of scene motion using Eccentricity","date":"2021-03-03","arxiv_id":"2103.02743","repositories_listed":0,"syntology":null},{"url":null,"slug":"the-role-of-the-input-in-natural-language","title":"The Role of the Input in Natural Language Video Description","date":"2021-02-09","arxiv_id":"2102.05067","repositories_listed":0,"syntology":null},{"url":null,"slug":"understanding-health-misinformation","title":"Unbox the Blackbox: Predict and Interpret YouTube Viewership Using Deep Learning","date":"2020-12-21","arxiv_id":"2101.01076","repositories_listed":0,"syntology":null},{"url":null,"slug":"msvd-turkish-a-comprehensive-multimodal","title":"MSVD-Turkish: A Comprehensive Multimodal Dataset for Integrated Vision and Language Research in Turkish","date":"2020-12-13","arxiv_id":"2012.07098","repositories_listed":0,"syntology":null},{"url":null,"slug":"a-comprehensive-review-on-recent-methods-and","title":"A Comprehensive Review on Recent Methods and Challenges of Video Description","date":"2020-11-30","arxiv_id":"2011.14752","repositories_listed":0,"syntology":null},{"url":null,"slug":"active-learning-for-video-description-with","title":"Active Learning for Video Description With Cluster-Regularized Ensemble Ranking","date":"2020-07-27","arxiv_id":"2007.13913","repositories_listed":0,"syntology":null},{"url":null,"slug":"multi-layer-content-interaction-through","title":"Multi-Layer Content Interaction Through Quaternion Product For Visual Question Answering","date":"2020-01-03","arxiv_id":"2001.05840","repositories_listed":0,"syntology":null},{"url":null,"slug":"captioning-near-future-activity-sequences","title":"Prediction and Description of Near-Future Activities in Video","date":"2019-08-02","arxiv_id":"1908.00943","repositories_listed":0,"syntology":null},{"url":null,"slug":"an-end-to-end-baseline-for-video-captioning","title":"End-to-End Video Captioning","date":"2019-04-04","arxiv_id":"1904.02628","repositories_listed":0,"syntology":null},{"url":null,"slug":"a-dataset-for-telling-the-stories-of-social","title":"A Dataset for Telling the Stories of Social Media Videos","date":"2018-10-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"incorporating-background-knowledge-into-video","title":"Incorporating Background Knowledge into Video Description Generation","date":"2018-10-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"attentive-sequence-to-sequence-translation","title":"Attentive Sequence to Sequence Translation for Localizing Clips of Interest by Natural Language Descriptions","date":"2018-08-27","arxiv_id":"1808.08803","repositories_listed":0,"syntology":null},{"url":null,"slug":"bridge-video-and-text-with-cascade-syntactic","title":"Bridge Video and Text with Cascade Syntactic Structure","date":"2018-08-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"multimodal-neural-machine-translation-for-low","title":"Multimodal Neural Machine Translation for Low-resource Language Pairs using Synthetic Data","date":"2018-07-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"interpretable-video-captioning-via-trajectory","title":"Interpretable Video Captioning via Trajectory Structured Localization","date":"2018-06-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"video-description-a-survey-of-methods","title":"Video Description: A Survey of Methods, Datasets and Evaluation Metrics","date":"2018-06-01","arxiv_id":"1806.00186","repositories_listed":0,"syntology":null},{"url":null,"slug":"incorporating-semantic-attention-in-video","title":"Incorporating Semantic Attention in Video Description Generation","date":"2018-05-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"integrating-both-visual-and-audio-cues-for","title":"Integrating both Visual and Audio Cues for Enhanced Video Caption","date":"2017-11-22","arxiv_id":"1711.08097","repositories_listed":0,"syntology":null},{"url":null,"slug":"attend-and-interact-higher-order-object","title":"Attend and Interact: Higher-Order Object Interactions for Video Understanding","date":"2017-11-16","arxiv_id":"1711.06330","repositories_listed":0,"syntology":null},{"url":null,"slug":"incorporating-global-visual-features-into-1","title":"Incorporating Global Visual Features into Attention-based Neural Machine Translation.","date":"2017-09-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"task-driven-dynamic-fusion-reducing-ambiguity","title":"Task-Driven Dynamic Fusion: Reducing Ambiguity in Video Description","date":"2017-07-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"attention-based-multimodal-fusion-for-video","title":"Attention-Based Multimodal Fusion for Video Description","date":"2017-01-11","arxiv_id":"1701.03126","repositories_listed":0,"syntology":null},{"url":null,"slug":"generating-video-description-using-sequence","title":"Generating Video Description using Sequence-to-sequence Model with Temporal Attention","date":"2016-12-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"hierarchical-boundary-aware-neural-encoder","title":"Hierarchical Boundary-Aware Neural Encoder for Video Captioning","date":"2016-11-28","arxiv_id":"1611.09312","repositories_listed":0,"syntology":null},{"url":null,"slug":"neural-headline-generation-on-abstract","title":"Neural Headline Generation on Abstract Meaning Representation","date":"2016-11-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"natural-language-descriptions-of-human","title":"Natural Language Descriptions of Human Activities Scenes: Corpus Generation and Analysis","date":"2016-08-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"shef-multimodal-grounding-machine-translation","title":"SHEF-Multimodal: Grounding Machine Translation on Images","date":"2016-08-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"videomcc-a-new-benchmark-for-video","title":"VideoMCC: a New Benchmark for Video Comprehension","date":"2016-06-23","arxiv_id":"1606.07373","repositories_listed":0,"syntology":null},{"url":null,"slug":"bidirectional-long-short-term-memory-for","title":"Bidirectional Long-Short Term Memory for Video Description","date":"2016-06-15","arxiv_id":"1606.04631","repositories_listed":0,"syntology":null},{"url":"/paper/msr-vtt-a-large-video-description-dataset-for","slug":"msr-vtt-a-large-video-description-dataset-for","title":"MSR-VTT: A Large Video Description Dataset for Bridging Video and Language","date":"2016-06-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"noisy-parallel-approximate-decoding-for","title":"Noisy Parallel Approximate Decoding for Conditional Recurrent Language Model","date":"2016-05-12","arxiv_id":"1605.03835","repositories_listed":0,"syntology":null},{"url":null,"slug":"vectors-of-locally-aggregated-centers-for","title":"Vectors of Locally Aggregated Centers for Compact Video Representation","date":"2015-09-13","arxiv_id":"1509.03844","repositories_listed":0,"syntology":null},{"url":null,"slug":"a-multi-scale-multiple-instance-video","title":"A Multi-scale Multiple Instance Video Description Network","date":"2015-05-21","arxiv_id":"1505.05914","repositories_listed":0,"syntology":null},{"url":null,"slug":"probabilistic-soft-logic-for-semantic-textual","title":"Probabilistic Soft Logic for Semantic Textual Similarity","date":"2014-06-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":"/paper/coherent-multi-sentence-video-description","slug":"coherent-multi-sentence-video-description","title":"Coherent Multi-Sentence Video Description with Variable Level of Detail","date":"2014-03-24","arxiv_id":"1403.6173","repositories_listed":0,"syntology":null},{"url":null,"slug":"semantic-neighborhoods-as-hypergraphs","title":"Semantic Neighborhoods as Hypergraphs","date":"2013-08-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":"/paper/a-thousand-frames-in-just-a-few-words-lingual","slug":"a-thousand-frames-in-just-a-few-words-lingual","title":"A Thousand Frames in Just a Few Words: Lingual Description of Videos through Latent Topics and Sparse Object Stitching","date":"2013-06-01","arxiv_id":null,"repositories_listed":0,"syntology":null},{"url":null,"slug":"better-exploiting-motion-for-better-action","title":"Better Exploiting Motion for Better Action Recognition","date":"2013-06-01","arxiv_id":null,"repositories_listed":0,"syntology":null}],"syntology_records":12,"syntology_note":"a paper without a record is not a recorded non-run: it may lack an arXiv id or simply be absent from the graph layer"},"key_notes":{"n_ran_checked":"legacy name, kept unchanged so existing readers do not break: it counts the samples that ran with no instrument failure (honoured, violated, and ran with no contract checked); it does not mean a contract was checked, and the pages print it as 'K with no instrument failure', not 'K checked'","n_constructed":"a sub-count of the samples that ran, never subtracted from them and never a failure: an executed sample whose run returned an instance of its own class (fixture_out_type equals the entry name): the run built an object and did not compute a result (Syntology's RAN record, counts.constructed)"},"since_archive_judged":{"papers":0,"papers_placed":0,"judged_by":{"model":"a model","models_as_recorded":[],"from":"lb_rows_run_verified.jsonl: each record's `model` field (the extractor's call that wrote decisions[])"},"note":"a model's judgement from the paper's own tables that they report on this leaderboard, not a result: no value from a paper that was not placed is printed or carried here; papers counts each paper once over these leaderboards","backfill":"8,886 of 18,637 newer papers checked so far (733 more had nothing to place; 41 could not be read)","backfill_complete":false,"leaderboards":[]},"papers_where_code_ran":11,"papers_where_code_ran_first_page":"/task/video-description/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not run it on this task or check it against the task's benchmarks.","pages":[{"order":"archive","page":2,"of":2,"url":"/task/video-description/papers/2","json":"/task/video-description/papers/2.json","rows":4},{"order":"ran","page":1,"of":1,"url":"/task/video-description/papers/ran/1","json":"/task/video-description/papers/ran/1.json","rows":11}],"description_links":{"kept":0,"unwrapped_to_text":0,"bare_urls_linked":0,"relative_images_dropped":0,"rule":"internal links are kept only when the target slug exists in the catalog"},"syntology":{"read_at":"2026-10-05T00:36:11+00:00","claim":"Per-sample execution status on synthesized fixtures ('ran N of M samples'); not a correctness claim and not a ranking signal.","status_vocabulary":{"ran_honours":"ran, honoured the contract we drafted","ran_violates":"ran, violated the contract we drafted","ran_draft_wrong":"ran; our contract draft was wrong, not the code","ran_fixture":"ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT)","ran":"ran on a synthesized input","unverified":"unverified (harvested, no recorded run)"},"row_route":"each syntology object on a benchmark's first row and on a paper carries sample_list (this site's paper page, #ran), syntology_url (syntology.ai's page for the paper, only when that route probed live) and mcp (the agent call that lists the paper's harvested samples; not a verdict on the paper)","developers":"https://syntology.ai/developers"},"not_shown":{"libraries":"the archive has no per-task library table","trend_sparklines":"the Trend column of the benchmarks table was a rendered image; it is not in the archive","social_and_latest_sorts":"stars and social signals are not in the archive"},"record_sha256":"d710d5712ed39ae5b1a1ee84cf2c711f3d6081dd7ba1a2281536848dcc0e8d5d","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}