Browse State-of-the-Art › software testing
software testing
39 papers with code · 0 benchmarks · 1 dataset archive 2025-07-28
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
1 dataset whose archive record lists this task, ordered by the archive's paper count.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 135 · with a code link: 39 · where Syntology ran a sample: 5 (5 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (5 of 135 tagged: 5 with a run with no instrument failure, 0 where every run was a failure of Syntology's instrument)
Page 1 of 2: papers 1 to 100 of 135, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
24 Mar 2024 3 repositories listed Syntology official (archive's flag): 12 ran · 12 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 4 where Syntology's instrument failed) · 5 unverified (of 17 harvested samples)Compared to MuTAP, a mutation- and LLM-based test generator, CoverUp achieves an overall line+branch coverage of 89% (vs. 77%).
-
28 Jul 2018 3 repositories listed Syntology 8 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (of 12 harvested samples)We then discuss the application of CGF to the following goals: finding numerical errors in trained neural networks, generating disagreements between neural networks and quantized versions of those networks, and…
-
17 Jun 2025 2 repositories listedThis paper reviews recent research on AI augmentation in software test automation, from no automation to full automation.
-
13 Feb 2022 2 repositories listedThis paper investigates the parameter space of machine learning (ML) algorithms in aggravating or mitigating fairness bugs.
-
5 Jun 2020 2 repositories listed Syntology 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 3 harvested samples) · 3 pointer-only (licence)We propose D-RISE, a method for generating visual explanations for the predictions of object detectors.
-
26 Apr 2025 1 repository listedIn-context learning (ICL) has emerged as a powerful capability of large language models (LLMs), enabling them to perform new tasks based on a few provided examples without explicit fine-tuning.
-
30 Mar 2025 1 repository listedGUI agents, powered by large foundation models, can interact with digital interfaces, enabling various applications in web automation, mobile navigation, and software testing.
-
3 Feb 2025 1 repository listedData augmentation has become a standard practice in software engineering to address limited or imbalanced data sets, particularly in specialized domains like test classification and bug detection where data can be…
-
15 Oct 2024 1 repository listedHowever, it is important to ensure that identified failures are spread throughout the entire failure-inducing area of a search domain and not clustered in a sub-region.
-
21 Aug 2024 1 repository listedAutomated unit test generators, particularly search-based software testing tools like EvoSuite, are capable of generating tests with high coverage.
-
18 Jun 2024 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified (of 6 harvested samples)We find that LLMs generally perform surprisingly well at generating relevant test cases, with Code Agents designed for code repair exceeding the performance of systems designed specifically for test generation.
-
16 Apr 2024 1 repository listedTo address this problem, we propose TrickCatcher, an LLM-powered approach to generating test cases for uncovering bugs in plausible programs.
-
22 Mar 2024 1 repository listedBehavior-driven development (BDD) is an Agile testing methodology fostering collaboration among developers, QA analysts, and stakeholders.
-
20 Mar 2024 1 repository listedWe study two types of settings: one where there is iid noise in the observation, and a more challenging setting where there is also the presence of exogenous noise, which is non-iid noise that is temporally correlated…
-
20 Feb 2024 1 repository listedSubsequently, QuanTest formulates the problem of generating test inputs that maximize the quantum entanglement adequacy and capture incorrect behaviors of the QNN system as a joint optimization problem and solves it in…
-
1 Feb 2024 1 repository listedTo our best knowledge, this is the first work that covers the intersection of three areas, including LLMs, fuzzing test, and fuzzing test generated based on LLMs.
-
31 Jan 2024 1 repository listedThe results show that LLMs can successfully generate realistic test data generators in a wide range of domains at all three levels of integrability.
-
13 Jan 2024 1 repository listedAutomated test case generation has proven to be useful to reduce the usually high expenses of software testing.
-
23 Dec 2023 1 repository listedSynthetic data has numerous applications, including but not limited to software testing at scale, privacy-preserving data sharing to enable smoother collaboration between stakeholders, and data augmentation for…
-
4 Oct 2023 1 repository listedTo this end, we propose an automated approach which exploits both structural and semantic properties of source code methods and test cases to recommend the most relevant and useful unit tests to the developers.
-
11 Apr 2023 1 repository listedOur experimental study shows that (1) lexical, syntactic and structural properties of source code are encoded in the lower, intermediate, and higher layers, respectively, while the semantic property spans across the…
-
6 Mar 2023 1 repository listedTo understand and debug convolutional neural networks (CNNs) we propose techniques for testing the channels of CNNs.
-
2 Mar 2023 1 repository listedWe introduce Reasoning-Based Software Testing (RBST), a new way of thinking at the testing problem as a causal reasoning task.
-
14 Feb 2023 1 repository listedOngoing progress in computational intelligence (CI) has led to an increased desire to apply CI techniques for the purpose of improving software engineering processes, particularly software testing.
-
3 Feb 2023 1 repository listedThis paper presents SEER, a learning-based approach that in the absence of test assertions or other types of oracle, can determine whether a unit test passes or fails on a given method under test (MUT).
-
18 Jan 2023 1 repository listedHowever, typically, the variables of a dataset depend on one another, and these dependencies are not considered in data generation leading to the creation of implausible records.
-
25 Aug 2022 1 repository listedIn this paper, we empirically investigate the applications of carefully selected DRL algorithms on two important software testing tasks: test case prioritization in the context of Continuous Integration (CI) and game…
-
25 Jul 2022 1 repository listedThe execution of the feasible tests revealed that there is a large amount of deviations for the scores and classes.
-
8 Jul 2022 1 repository listedSPLADE efficiency can be controlled via a regularization factor, but solely controlling this regularization has been shown to not be efficient enough.
-
1 May 2022 1 repository listedWe hope to open a discussion on the best methodologies to handle social bias testing in language models.
-
16 Sep 2021 1 repository listed
-
5 May 2021 1 repository listed
-
3 Sep 2020 1 repository listed
-
4 Jan 2020 1 repository listed
-
19 Aug 2019 1 repository listed
-
6 Jun 2019 1 repository listed
-
12 Dec 2018 1 repository listed
-
31 Oct 2017 1 repository listed
-
27 Oct 2016 1 repository listed
-
Guaranteed Guess: A Language Modeling Approach for CISC-to-RISC Transpilation with Testing Guarantees17 Jun 2025 0 repositories listed
-
The Impact of Software Testing with Quantum Optimization Meets Machine Learning2 Jun 2025 0 repositories listed
-
EvoGPT: Enhancing Test Suite Robustness via LLM-Based Generation and Genetic Optimization18 May 2025 0 repositories listed
-
On the Need for a Statistical Foundation in Scenario-Based Testing of Autonomous Vehicles4 May 2025 0 repositories listed
-
Automated Unit Test Case Generation: A Systematic Literature Review29 Apr 2025 0 repositories listed
-
Harden and Catch for Just-in-Time Assured LLM-Based Software Testing: Open Research Challenges23 Apr 2025 0 repositories listed
-
Expectations vs Reality -- A Secondary Study on AI Adoption in Software Testing7 Apr 2025 0 repositories listed
-
From Code Generation to Software Testing: AI Copilot with Context-Based RAG2 Apr 2025 0 repositories listed
-
Integrating Artificial Intelligence with Human Expertise: An In-depth Analysis of ChatGPT's Capabilities in Generating Metamorphic Relations28 Mar 2025 0 repositories listed
-
Vulnerability Detection: From Formal Verification to Large Language Models and Hybrid Approaches: A Comprehensive Overview13 Mar 2025 0 repositories listed
-
Rule-Guided Reinforcement Learning Policy Evaluation and Improvement12 Mar 2025 0 repositories listed
-
ToolFuzz -- Automated Agent Tool Testing6 Mar 2025 0 repositories listed
-
WIP: Assessing the Effectiveness of ChatGPT in Preparatory Testing Activities5 Mar 2025 0 repositories listed
-
Towards Reliable LLM-Driven Fuzz Testing: Vision and Road Ahead2 Mar 2025 0 repositories listed
-
CLOVER: A Test Case Generation Benchmark with Coverage, Long-Context, and Verification12 Feb 2025 0 repositories listed
-
Identifying Flaky Tests in Quantum Code: A Machine Learning Approach6 Feb 2025 0 repositories listed
-
A Systematic Approach for Assessing Large Language Models' Test Case Generation Capability5 Feb 2025 0 repositories listed
-
Toward Neurosymbolic Program Comprehension3 Feb 2025 0 repositories listed
-
Many-Objective Neuroevolution for Testing Games14 Jan 2025 0 repositories listed
-
An efficient approach to represent enterprise web application structure using Large Language Model in the service of Intelligent Quality Engineering12 Jan 2025 0 repositories listed
-
The Potential of LLMs in Automating Software Testing: From Generation to Reporting31 Dec 2024 0 repositories listed
-
Design choices made by LLM-based test generators prevent them from finding bugs18 Dec 2024 0 repositories listed
-
Reinforcement Learning from Automatic Feedback for High-Quality Unit Test Generation18 Dec 2024 0 repositories listed
-
CPP-UT-Bench: Can LLMs Write Complex Unit Tests in C++?3 Dec 2024 0 repositories listed
-
Software testing for project report.20 Nov 2024 0 repositories listed
-
VALTEST: Automated Validation of Language Model Generated Test Cases13 Nov 2024 0 repositories listed
-
TAEGAN: Generating Synthetic Tabular Data For Data Augmentation2 Oct 2024 0 repositories listed
-
On the Effectiveness of LLMs for Manual Test Verifications19 Sep 2024 0 repositories listed
-
Computer Vision Intelligence Test Modeling and Generation: A Case Study on Smart OCR14 Sep 2024 0 repositories listed
-
Exploring the Integration of Large Language Models in Industrial Test Maintenance Processes10 Sep 2024 0 repositories listed
-
The Future of Software Testing: AI-Powered Test Case Generation and Validation9 Sep 2024 0 repositories listed
-
The Role of Artificial Intelligence and Machine Learning in Software Testing4 Sep 2024 0 repositories listed
-
Testing and Evaluation of Large Language Models: Correctness, Non-Toxicity, and Fairness31 Aug 2024 0 repositories listed
-
A System for Automated Unit Test Generation Using Large Language Models and Assessment of Generated Test Suites14 Aug 2024 0 repositories listed
-
MAO: A Framework for Process Model Generation with Multi-Agent Orchestration4 Aug 2024 0 repositories listed
-
FuzzTheREST: An Intelligent Automated Black-box RESTful API Fuzzer19 Jul 2024 0 repositories listed
-
Data Augmentation by Fuzzing for Neural Test Generation12 Jun 2024 0 repositories listed
-
BugBlitz-AI: An Intelligent QA Assistant17 May 2024 0 repositories listed
-
Artificial intelligence for context-aware visual change detection in software test automation1 May 2024 0 repositories listed
-
Fuzzy Inference System for Test Case Prioritization in Software Testing25 Apr 2024 0 repositories listed
-
Tasks People Prompt: A Taxonomy of LLM Downstream Tasks in Software Verification and Falsification Approaches14 Apr 2024 0 repositories listed
-
Machine Learning Robustness: A Primer1 Apr 2024 0 repositories listed
-
RITFIS: Robust input testing framework for LLMs-based intelligent software21 Feb 2024 0 repositories listed
-
UniTSyn: A Large-Scale Dataset Capable of Enhancing the Prowess of Large Language Models for Program Testing4 Feb 2024 0 repositories listed
-
Code-Aware Prompting: A study of Coverage Guided Test Generation in Regression Setting using LLM31 Jan 2024 0 repositories listed
-
Mutation-based Consistency Testing for Evaluating the Code Understanding Capability of LLMs11 Jan 2024 0 repositories listed
-
A Case Study on Test Case Construction with Large Language Models: Unveiling Practical Insights and Challenges19 Dec 2023 0 repositories listed
-
An empirical study of testing machine learning in the wild19 Dec 2023 0 repositories listed
-
Can ChatGPT advance software testing intelligence? An experience report on metamorphic testing30 Oct 2023 0 repositories listed
-
Reinforcement Learning from Automatic Feedback for High-Quality Unit Test Generation3 Oct 2023 0 repositories listed
-
TestLab: An Intelligent Automated Software Testing Framework6 Jun 2023 0 repositories listed
-
Rethinking Diversity in Deep Neural Network Testing25 May 2023 0 repositories listed
-
Validating Multimedia Content Moderation Software via Semantic Fusion23 May 2023 0 repositories listed
-
Comparing Software Developers with ChatGPT: An Empirical Investigation19 May 2023 0 repositories listed
-
Information-Theoretic Testing and Debugging of Fairness Defects in Deep Neural Networks9 Apr 2023 0 repositories listed
-
Constrained Adversarial Learning for Automated Software Testing: a literature review14 Mar 2023 0 repositories listed
-
Object-Oriented Test Case Generation Using Teaching Learning-Based Optimization (TLBO) Algorithm14 Oct 2022 0 repositories listed
-
DiverGet: A Search-Based Software Testing Approach for Deep Neural Network Quantization Assessment13 Jul 2022 0 repositories listed
-
Guiding the retraining of convolutional neural networks against adversarial inputs8 Jul 2022 0 repositories listed
-
Test2Vec: An Execution Trace Embedding for Test Case Prioritization28 Jun 2022 0 repositories listed
Syntology lines on 5 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections