Browse State-of-the-Art › Vulnerability Detection
Vulnerability Detection
72 papers with code · 2 benchmarks · 7 datasets archive 2025-07-28
Vulnerability detection plays a crucial role in safeguarding against these threats by identifying weaknesses and potential entry points that malicious actors could exploit. Through advanced scanning techniques and penetration testing, vulnerability detection tools meticulously analyze web applications and websites for vulnerabilities such as SQL injection, cross-site scripting (XSS), and insecure authentication mechanisms.
By proactively identifying and addressing vulnerabilities, organizations can strengthen their online security posture and mitigate the risk of data breaches, financial loss, and reputational damage. Additionally, vulnerability detection empowers businesses to stay compliant with industry regulations and standards, demonstrating their commitment to safeguarding sensitive information and maintaining the trust of their customers. With the evolving threat landscape and increasingly sophisticated attack vectors, investing in robust vulnerability detection measures is paramount for staying one step ahead of cyber threats and ensuring the resilience of web-based platforms and services.
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
2 leaderboard tables shown for this task, 2 with rows (a “benchmark” on this site is a table with at least one row, as on /sota), ordered by row count. “Best model” is the first row in the archive's own order at snapshot; nothing is re-ranked here and metric direction is not recorded in the archive. PwC's Trend sparklines are not in the archive, so that column is omitted.
| Dataset | Best model (first row in archive order) | Paper | Code | Syntology | Compare |
|---|---|---|---|---|---|
| VulScribeR (6 rows) | Reveal Model - Tested on Reveal (Training on Devign + VulScribeR 20K + Extra Cleans) | VulScribeR: Exploring RAG-based Vulnerability Augmentation with LLMs | code | — | Compare |
| Vulnerability Java Dataset (2 rows) | WizardCoder | Finetuning Large Language Models for Vulnerability Detection | code | — | Compare |
Syntology column: samples harvested from the paper's repositories and executed on synthesized fixtures; “ran” is not a correctness claim and does not order the table. Each line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the instrument figure counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the row's paper, the line starts with that repository's state (“official” is the archive's flag, not a verdict on who wrote the code; “community repositories only” when every sample that ran came from a community repository, “official: no sample here; runs from other or unrecorded repositories” when some came from a repository the paper names or has in its text, or from none recorded); hover it for the repositories the samples that ran came from. A dash means no Syntology record for that paper, not a recorded non-run. Each “ran” line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
7 datasets whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 216 · with a code link: 72 · where Syntology ran a sample: 8 (7 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (8 of 216 tagged: 7 with a run with no instrument failure, 1 where every run was a failure of Syntology's instrument)
Page 1 of 3: papers 1 to 100 of 216, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
8 Jun 2024 5 repositories listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 4 pointer-only (licence)Large Language Models (LLMs) are being deployed across various domains today.
-
5 Jan 2018 5 repositories listed Syntology official: not harvested · 0 ran · 1 unverified (of 1 harvested sample)Since deep learning is motivated to deal with problems that are very different from the problem of vulnerability detection, we need some guiding principles for applying deep learning to vulnerability detection.
-
18 Jul 2018 4 repositories listed Syntology official: harvested, nothing ran · 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 1 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 8 harvested samples) · 1 pointer-only (licence)Our experiments with 4 software products demonstrate the usefulness of the framework: we detect 15 vulnerabilities that are not reported in the National Vulnerability Database.
-
28 Jun 2023 3 repositories listedUsing six ML4VD techniques and two datasets, we find (a) that state-of-the-art models severely overfit to unrelated features for predicting the vulnerabilities in the testing data, (b) that the performance gained by…
-
13 Nov 2018 3 repositories listed Syntology 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 1 pointer-only (licence)We report the results from a quantitative and qualitative analysis that show how SAFE provides a noticeable performance improvement with respect to previous solutions.
-
19 Nov 2022 2 repositories listedIn recent years, research in software security has concentrated on identifying vulnerabilities in smart contracts to prevent significant losses of crypto assets on blockchains.
-
16 Dec 2020 2 repositories listedWe thus train the model to learn execution semantics from the functions' micro-traces, without any manual labeling effort.
-
11 Jul 2018 2 repositories listedThe labeled dataset is available at: https://osf.io/d45bw/.
-
9 Jun 2025 1 repository listedLarge language models (LLMs) demonstrate considerable proficiency in numerous coding-related tasks; however, their capabilities in detecting software vulnerabilities remain limited.
-
27 May 2025 1 repository listedAs Large Language Models (LLMs) evolve in understanding and generating code, accurately evaluating their reliability in analyzing source code vulnerabilities becomes increasingly vital.
-
21 May 2025 1 repository listedLarge Language Model (LLM) agents can automate cybersecurity tasks and can adapt to the evolving cybersecurity landscape without re-engineering.
-
15 May 2025 1 repository listedSoftware vulnerabilities such as buffer overflows and SQL injections are a major source of security breaches.
-
15 May 2025 1 repository listedIn this paper, we first propose CoV-Eval, a multi-task benchmark covering various tasks such as code completion, vulnerability repair, vulnerability detection and classification, for comprehensive evaluation of LLM code…
-
8 May 2025 1 repository listedOur results show a 97.
-
2 May 2025 1 repository listedFinding training examples to teach LLMs to solve these tasks can be challenging.
-
16 Apr 2025 1 repository listedStatic analysis plays a crucial role in software vulnerability detection, yet faces a persistent precision-scalability tradeoff.
-
7 Apr 2025 1 repository listedThrough RLAIF, R2Vul enables LLMs to produce structured, security-aware reasoning that is actionable and reliable while explicitly learning to distinguish valid assessments from misleading ones.
-
3 Apr 2025 1 repository listedAs AI advances, broader consensus is needed to determine research priorities.
-
22 Mar 2025 1 repository listedAutomating software vulnerability detection (SVD) remains a critical challenge in an era of increasingly complex and interdependent software systems.
-
12 Mar 2025 1 repository listedLLMs perform exceptionally well in the CASTLE dataset when identifying vulnerabilities in small code snippets.
-
24 Feb 2025 1 repository listedIn this paper, we propose a multi-teacher based bytecode vulnerability detection method, namely Multi-Teacher Vulnerability Hunter (MTVHunter), which delivers effective denoising and missing semantic to bytecode under…
-
7 Jan 2025 1 repository listedPre-training a language model and then fine-tuning it has shown to be an efficient and effective technique for a wide range of code intelligence tasks, such as code generation, code summarization, and vulnerability…
-
24 Dec 2024 1 repository listedHowever, the effectiveness of LLMs in detecting code vulnerabilities is largely under-explored.
-
7 Dec 2024 1 repository listedWe conduct several experiments to assess the performance of the proposed method against the state-of-the-art.
-
20 Nov 2024 1 repository listedCryptographic protocols play a fundamental role in securing modern digital infrastructure, but they are often deployed without prior formal verification.
-
30 Oct 2024 1 repository listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)Binary analysis is a core component of many critical security tasks, including reverse engineering, malware analysis, and vulnerability detection.
-
4 Oct 2024 1 repository listedRecently, deep learning (DL) approaches to vulnerability detection have gained significant traction.
-
7 Aug 2024 1 repository listedMore specifically, we explore three strategies to augment both single and multi-statement vulnerabilities, with LLMs, namely Mutation, Injection, and Extension.
-
27 Jul 2024 1 repository listedRecently, deep learning has demonstrated promising results in enhancing the accuracy of vulnerability detection and identifying vulnerabilities in software.
-
11 Jul 2024 1 repository listedThe benchmark consists of a list of revisions in different repositories, each associated with the list of known vulnerabilities present at that revision.
-
10 Jul 2024 1 repository listed
-
4 Jul 2024 1 repository listed
-
3 Jul 2024 1 repository listed
-
12 Jun 2024 1 repository listed
-
VulDetectBench: Evaluating the Deep Capability of Vulnerability Detection with Large Language Models11 Jun 2024 1 repository listed
-
10 Jun 2024 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)
-
6 Jun 2024 1 repository listed
-
9 May 2024 1 repository listed
-
8 May 2024 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 1 pointer-only (licence)
-
24 Apr 2024 1 repository listed
-
15 Apr 2024 1 repository listed
-
27 Mar 2024 1 repository listed Syntology official (archive's flag): 6 ran · 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (of 10 harvested samples)
-
21 Mar 2024 1 repository listed
-
30 Jan 2024 1 repository listed
-
21 Nov 2023 1 repository listed
-
2 Oct 2023 1 repository listed
-
21 Aug 2023 1 repository listed
-
7 Aug 2023 1 repository listed
-
12 Jun 2023 1 repository listed
-
2 Jun 2023 1 repository listed
-
26 May 2023 1 repository listed
-
8 May 2023 1 repository listed
-
17 Apr 2023 1 repository listed
-
1 Apr 2023 1 repository listed
-
26 Mar 2023 1 repository listed
-
15 Dec 2022 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
20 Sep 2022 1 repository listed
-
19 Sep 2022 1 repository listed
-
28 Aug 2022 1 repository listed
-
20 Jun 2022 1 repository listed
-
25 May 2022 1 repository listed
-
22 Mar 2022 1 repository listed
-
4 Nov 2021 1 repository listed
-
18 Oct 2021 1 repository listed
-
14 Oct 2021 1 repository listed
-
24 Jul 2021 1 repository listed
-
17 Jun 2021 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 2 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
16 Feb 2021 1 repository listed
-
15 Jan 2021 1 repository listed
-
7 Jan 2021 1 repository listed
-
30 Dec 2020 1 repository listed
-
22 Oct 2019 1 repository listed
-
CORE: Benchmarking LLMs Code Reasoning Capabilities through Static Analysis Tasks3 Jul 2025 0 repositories listed
-
SV-LLM: An Agentic Approach for SoC Security Verification using Large Language Models25 Jun 2025 0 repositories listed
-
Smart-LLaMA-DPO: Reinforced Large Language Model for Explainable Smart Contract Vulnerability Detection23 Jun 2025 0 repositories listed
-
Identifying Helpful Context for LLM-based Vulnerability Repair: A Preliminary Study13 Jun 2025 0 repositories listed
-
Today's Cat Is Tomorrow's Dog: Accounting for Time-Based Changes in the Labels of ML Vulnerability Detection Approaches13 Jun 2025 0 repositories listed
-
Ai-Driven Vulnerability Analysis in Smart Contracts: Trends, Challenges and Future Directions7 Jun 2025 0 repositories listed
-
SafeGenBench: A Benchmark Framework for Security Vulnerability Detection in LLM-Generated Code6 Jun 2025 0 repositories listed
-
A Multi-Dataset Evaluation of Models for Automated Vulnerability Repair5 Jun 2025 0 repositories listed
-
Explainer-guided Targeted Adversarial Attacks against Binary Code Similarity Detection Models5 Jun 2025 0 repositories listed
-
LPASS: Linear Probes as Stepping Stones for vulnerability detection using compressed LLMs30 May 2025 0 repositories listed
-
BugWhisperer: Fine-Tuning LLMs for SoC Hardware Vulnerability Detection28 May 2025 0 repositories listed
-
An Initial Exploration of Fine-tuning Small Language Models for Smart Contract Reentrancy Vulnerability Detection25 May 2025 0 repositories listed
-
Adaptive Plan-Execute Framework for Smart Contract Security Auditing21 May 2025 0 repositories listed
-
Leveraging Large Language Models for Command Injection Vulnerability Analysis in Python: An Empirical Study on Popular Open-Source Projects21 May 2025 0 repositories listed
-
Let the Trial Begin: A Mock-Court Approach to Vulnerability Detection using LLM-Based Agents16 May 2025 0 repositories listed
-
Enhancing the Cloud Security through Topic Modelling1 May 2025 0 repositories listed
-
LLMpatronous: Harnessing the Power of LLMs For Vulnerability Detection25 Apr 2025 0 repositories listed
-
23 Apr 2025 0 repositories listed
-
A Study on Mixup-Inspired Augmentation Methods for Software Vulnerability Detection22 Apr 2025 0 repositories listed
-
C2RUST-BENCH: A Minimized, Representative Dataset for C-to-Rust Transpilation Evaluation21 Apr 2025 0 repositories listed
-
AI-Based Vulnerability Analysis of NFT Smart Contracts18 Apr 2025 0 repositories listed
-
Trace Gadgets: Minimizing Code Context for Machine Learning-Based Vulnerability Prediction18 Apr 2025 0 repositories listed
-
Using ML filters to help automated vulnerability repairs: when it helps and when it doesn't9 Apr 2025 0 repositories listed
-
Reasoning Under Threat: Symbolic and Neural Techniques for Cybersecurity Verification27 Mar 2025 0 repositories listed
-
Enhancing Software Vulnerability Detection Using Code Property Graphs and Convolutional Neural Networks23 Mar 2025 0 repositories listed
-
Computing Modes of Instability of Parameterized Nonlinear Systems for Vulnerability Assessment16 Mar 2025 0 repositories listed
-
Vulnerability Detection: From Formal Verification to Large Language Models and Hybrid Approaches: A Comprehensive Overview13 Mar 2025 0 repositories listed
-
Evaluating LLaMA 3.2 for Software Vulnerability Detection10 Mar 2025 0 repositories listed
Syntology lines on 10 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections