Browse State-of-the-Art › Bug fixing
Bug fixing
31 papers with code · 0 benchmarks · 1 dataset archive 2025-07-28
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
1 dataset whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 62 · with a code link: 31 · where Syntology ran a sample: 8 (8 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (8 of 62 tagged: 8 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument)
Page 1 of 1: papers 1 to 62 of 62, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
15 Mar 2023 11 repositories listed Syntology community repositories only · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 2 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 1 pointer-only (licence)We report the development of GPT-4, a large-scale, multimodal model which can accept image and text inputs and produce text outputs.
-
10 Oct 2023 8 repositories listed Syntology 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 5 harvested samples)We find real-world software engineering to be a rich, sustainable, and challenging testbed for evaluating the next generation of language models.
-
8 Apr 2024 5 repositories listed Syntology official (archive's flag): 1 ran · 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 4 harvested samples) · 1 pointer-only (licence)Recent progress in Large Language Models (LLMs) has significantly impacted the development process, where developers can use LLM-based programming assistants to achieve automated coding.
-
16 Apr 2021 3 repositories listedTo sum up, this paper shows that transfer learning works well for repairing security vulnerabilities in C compared to learning on a small dataset.
-
6 May 2024 2 repositories listedWe investigate how interface design affects the performance of language model agents.
-
4 Jul 2025 1 repository listedAs Large Language Models (LLMs) demonstrate increasingly sophisticated code processing capabilities, evaluating their performance on engineering-level code remains challenging.
-
22 May 2025 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 0 unverified (of 5 harvested samples) · 5 pointer-only (licence)We therefore introduce SWE-Dev, the first large-scale dataset (with 14, 000 training and 500 test samples) designed to evaluate and train autonomous coding systems on real-world feature development tasks.
-
9 Mar 2025 1 repository listedAutomated Program Repair (APR) is a task to automatically generate patches for the buggy code.
-
10 Feb 2025 1 repository listedWe define the task of repository-level code search as retrieving the set of files from the current state of a code repository that are most relevant to addressing a user's question or bug.
-
19 Jan 2025 1 repository listedResults show that our method reduces the energy consumption between 23-50 % on average for code generation tasks without significantly affecting accuracy.
-
1 Dec 2024 1 repository listed Syntology official (archive's flag): 12 ran · 12 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 1 violated, 5 with no contract checked; 6 where Syntology's instrument failed) · 2 unverified (of 14 harvested samples)Effective code retrieval plays a crucial role in advancing code generation, bug fixing, and software maintenance, particularly as software systems increase in complexity.
-
5 Nov 2024 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 4 where Syntology's instrument failed) · 5 unverified (of 13 harvested samples) · 13 pointer-only (licence)In this paper, we assess the ability of LLMs to reason about post-synthesis metrics of Verilog designs.
-
2 Oct 2024 1 repository listed Syntology official (archive's flag): 8 ran · 8 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 9 harvested samples)While large language models have made significant strides in code generation, the pass rate of the generated code is bottlenecked on subtle errors, often requiring human intervention to pass tests, especially for…
-
21 Aug 2024 1 repository listedAutomated unit test generators, particularly search-based software testing tools like EvoSuite, are capable of generating tests with high coverage.
-
23 Jul 2024 1 repository listedThis paper introduces Patched Round-Trip Correctness (Patched RTC), a novel evaluation technique for Large Language Models (LLMs) applied to diverse software development tasks, particularly focusing on "outer loop"…
-
3 Jun 2024 1 repository listedGitHub issue resolving recently has attracted significant attention from academia and industry.
-
25 Apr 2024 1 repository listedWe empirically analyze code clones in nine popular DL frameworks, i. e., TensorFlow, Paddle, PyTorch, Aesara, Ray, MXNet, Keras, Jax and BentoML, to investigate (1) the characteristics of the long-term code cloning…
-
26 Jul 2023 1 repository listedBased on our results, fixing ML bugs are more costly and ML components are more error-prone, compared to non-ML bugs and non-ML components respectively.
-
8 Feb 2023 1 repository listedThen, we pre-train 32 transformers using both (i) generic pre-training objectives usually adopted in SE; and (ii) pre-training objectives tailored to specific code-related tasks subject of our experimentation, namely…
-
11 Nov 2022 1 repository listedAutomatically fixing software bugs is a challenging task.
-
2 Nov 2022 1 repository listedIn this study, we develop a Markov decision process (MDP) model for an online bug triage task.
-
10 Aug 2022 1 repository listedPretrained language models have been shown to be effective in many software-related generation tasks; however, they are not well-suited for editing tasks as they are not designed to reason about edits.
-
15 Jun 2022 1 repository listed Syntology official (archive's flag): 11 ran · 11 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified (of 14 harvested samples) · 2 pointer-only (licence)To address this issue, we introduce FixEval, a benchmark comprising of buggy code submissions to competitive programming problems and their corresponding fixes.
-
12 Apr 2022 1 repository listedWe further incorporate the schedule of developers in our formulation to have a more comprehensive model for this multifaceted problem.
-
12 Feb 2022 1 repository listedRecent studies show that current source code authorship attribution methods can be compromised by attackers exploiting adversarial examples and coding style manipulation.
-
26 Apr 2021 1 repository listedIn software engineering practice, fixing a bug promptly reduces the associated costs.
-
16 Feb 2021 1 repository listedHowever, existing datasets to train models for vulnerability identification suffer from multiple limitations such as limited bug context, limited size, and synthetic and unrealistic source code.
-
23 Oct 2020 1 repository listedThere is an emerging interest in the application of natural language processing models to source code processing tasks.
-
23 Oct 2020 1 repository listedIn this work, we develop dynamic embeddings, a recurrent mechanism that adjusts the learned semantics of the variable when it obtains more information about the variable's role in the program.
-
15 Oct 2020 1 repository listedIn this work, we conduct a thorough empirical study of the capabilities of Transformers to utilize syntactic information in different tasks.
-
22 Jul 2019 1 repository listed
-
The Foundation Cracks: A Comprehensive Study on Bugs and Testing Practices in LLM Libraries14 Jun 2025 0 repositories listed
-
LongCodeBench: Evaluating Coding LLMs at 1M Context Windows12 May 2025 0 repositories listed
-
VeriDebug: A Unified LLM for Verilog Debugging via Contrastive Embedding and Guided Correction27 Apr 2025 0 repositories listed
-
On Simulation-Guided LLM-based Code Generation for Safe Autonomous Driving Software2 Apr 2025 0 repositories listed
-
Benchmarking AI Models in Software Engineering: A Review, Search Tool, and Enhancement Protocol7 Mar 2025 0 repositories listed
-
Empirical evaluation of LLMs in predicting fixes of Configuration bugs in Smart Home System16 Feb 2025 0 repositories listed
-
An Empirical Study on LLM-based Agents for Automated Bug Fixing15 Nov 2024 0 repositories listed
-
A Comprehensive Survey of AI-Driven Advancements and Techniques in Automated Program Repair and Code Generation12 Nov 2024 0 repositories listed
-
PDC & DM-SFT: A Road for LLM SQL Bug-Fix Enhancing11 Nov 2024 0 repositories listed
-
Characterising Open Source Co-opetition in Company-hosted Open Source Software Projects: The Cases of PyTorch, TensorFlow, and Transformers23 Oct 2024 0 repositories listed
-
Debug Smarter, Not Harder: AI Agents for Error Resolution in Computational Notebooks18 Oct 2024 0 repositories listed
-
MarsCode Agent: AI-native Automated Bug Fixing2 Sep 2024 0 repositories listed
-
Code Comparison Tuning for Code Large Language Models28 Mar 2024 0 repositories listed
-
Untangling Knots: Leveraging LLM for Error Resolution in Computational Notebooks26 Mar 2024 0 repositories listed
-
A Study of Vulnerability Repair in JavaScript Programs with Large Language Models19 Mar 2024 0 repositories listed
-
Copilot Evaluation Harness: Evaluating LLM-Guided Software Programming22 Feb 2024 0 repositories listed
-
SecureFalcon: Are We There Yet in Automated Software Vulnerability Detection with LLMs?13 Jul 2023 0 repositories listed
-
11 Jul 2023 0 repositories listed
-
RAPGen: An Approach for Fixing Code Inefficiencies in Zero-Shot29 Jun 2023 0 repositories listed
-
GrACE: Generation using Associated Code Edits23 May 2023 0 repositories listed
-
Detect-Localize-Repair: A Unified Framework for Learning to Debug with CodeT527 Nov 2022 0 repositories listed
-
Bug Fix Time Optimization Using Matrix Factorization and Iterative Gale-Shaply Algorithms14 Jul 2022 0 repositories listed
-
Leveraging Causal Inference for Explainable Automatic Program Repair26 May 2022 0 repositories listed
-
Enabling Automatic Repair of Source Code Vulnerabilities Using Data-Driven Methods7 Feb 2022 0 repositories listed
-
Fix-Filter-Fix: Intuitively Connect Any Models for Effective Bug Fixing1 Nov 2021 0 repositories listed
-
GRAPHIX: A Pre-trained Graph Edit Model for Automated Program Repair29 Sep 2021 0 repositories listed
-
Tea: Program Repair Using Neural Network Based on Program Information Attention Matrix17 Jul 2021 0 repositories listed
-
EnHMM: On the Use of Ensemble HMMs and Stack Traces to Predict the Reassignment of Bug Report Fields15 Mar 2021 0 repositories listed
-
On Learning Meaningful Code Changes via Neural Machine Translation25 Jan 2019 0 repositories listed
-
An Empirical Investigation into Learning Bug-Fixing Patches in the Wild via Neural Machine Translation7 Sep 2018 0 repositories listed
Syntology lines on 9 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections