English
Related papers

Related papers: Unit Test Case Generation with Transformers and Fo…

200 papers

Automated unit test generation is a well-known methodology aiming to reduce the developers' effort of writing tests manually. Prior research focused mainly on statically typed programming languages like Java. In practice, however,…

Software Engineering · Computer Science 2022-02-11 Stephan Lukasczyk , Gordon Fraser

Though many machine learning (ML)-based unit testing generation approaches have been proposed and indeed achieved remarkable performance, they still have several limitations in effectiveness and practical usage. More precisely, existing…

Software Engineering · Computer Science 2024-06-25 Chao Ni , Xiaoya Wang , Liushan Chen , Dehai Zhao , Zhengong Cai , Shaohua Wang , Xiaohu Yang

Automated unit test generation has been widely studied, with Large Language Models (LLMs) recently showing significant potential. Moreover, in the context of unit test generation, these tools prioritize high code coverage, often at the…

Software Engineering · Computer Science 2024-10-18 Zhe Zhang , Xingyu Liu , Yuanzhang Lin , Xiang Gao , Hailong Sun , Yuan Yuan

We introduce a novel approach for inferring natural preconditions from code. Our technique produces preconditions of high quality in terms of both correctness (modulo a test generator) and naturalness. Prior works generate preconditions…

Software Engineering · Computer Science 2024-08-20 Elizabeth Dinella , Shuvendu Lahiri , Mayur Naik

This paper explores the effectiveness of modular randomized testing for object oriented programs in Java. Modular testing involves testing individual components of a program in isolation. Often times, for effective test generation, a series…

Software Engineering · Computer Science 2026-05-06 Elizabeth Dinella

The level and quality of automation dramatically affects software testing activities, determines costs and effectiveness of the testing process, and largely impacts on the quality of the final product. While costs and benefits of automating…

Software Engineering · Computer Science 2021-03-02 Matteo Brunetto , Giovanni Denaro , Leonardo Mariani , Mauro Pezzè

Context: Software development projects increasingly adopt unit testing as a way to identify and correct program faults early in the construction process. Code that is unit tested should therefore have fewer failures associated with it.…

Software Engineering · Computer Science 2023-12-05 Efstathia Chioteli , Ioannis Batas , Diomidis Spinellis

Various mature automated test generation tools exist for statically typed programming languages such as Java. Automatically generating unit tests for dynamically typed programming languages such as Python, however, is substantially more…

Software Engineering · Computer Science 2022-07-19 Stephan Lukasczyk , Florian Kroiß , Gordon Fraser

Automatic unit test (UT) generation is essential for software quality assurance, but existing approaches--including symbolic execution, search-based approaches, and recent LLM-based generators--struggle to produce human-quality tests with…

Software Engineering · Computer Science 2026-02-04 Ziyue Hua , Tianyu Chen , Yeyun Gong , Shuai Lu , Peng Cheng , Qinglin Zhu , Yibo He , Yingjie Fu , Wenpin Jiao , Wei Yang , Tao Xie

Unit testing is a critical part of software development process, ensuring the correctness of basic programming units in a program (e.g., a method). Search-based software testing (SBST) is an automated approach to generating test cases. SBST…

Software Engineering · Computer Science 2023-01-10 Zhichao Zhou , Yuming Zhou , Chunrong Fang , Zhenyu Chen , Yutian Tang

Generating tests automatically is a key and ongoing area of focus in software engineering research. The emergence of Large Language Models (LLMs) has opened up new opportunities, given their ability to perform a wide spectrum of tasks.…

Software Engineering · Computer Science 2025-01-20 Azat Abdullin , Pouria Derakhshanfar , Annibale Panichella

In the scenario-based evaluation of machine learning models, a key problem is how to construct test datasets that represent various scenarios. The methodology proposed in this paper is to construct a benchmark and attach metadata to each…

Software Engineering · Computer Science 2024-06-19 Debalina Ghosh Paul , Hong Zhu , Ian Bayley

Large language models (LLMs) have shown strong potential for automated test generation, yet most approaches to generating Java unit tests still rely on mocking frameworks to handle dependencies. Mockless test generation could exercise more…

Software Engineering · Computer Science 2026-05-27 Qinghua Xu , Guancheng Wang , Lionel Briand , Zhaoqiang Guo , Kui Liu

Automated test techniques usually generate unit tests with higher code coverage than manual tests. However, the readability of automated tests is crucial for code comprehension and maintenance. The readability of unit tests involves many…

Software Engineering · Computer Science 2024-08-20 Zhichao Zhou , Yutian Tang , Yun Lin , Jingzhu He

Automated test generation is essential for software quality assurance, with coverage rate serving as a key metric to ensure thorough testing. Recent advancements in Large Language Models (LLMs) have shown promise in improving test…

Software Engineering · Computer Science 2026-02-26 WeiZhe Xu , Mengyu Liu , Fanxin Kong

Recognizing fallacies is crucial for ensuring the quality and validity of arguments across various domains. However, computational fallacy recognition faces challenges due to the diverse genres, domains, and types of fallacies found in…

Computation and Language · Computer Science 2024-08-16 Tariq Alhindi , Smaranda Muresan , Preslav Nakov

Programming based approaches to reasoning tasks have substantially expanded the types of questions models can answer about visual scenes. Yet on benchmark visual reasoning data, when models answer correctly, they produce incorrect programs…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Artemis Panagopoulou , Honglu Zhou , Silvio Savarese , Caiming Xiong , Chris Callison-Burch , Mark Yatskar , Juan Carlos Niebles

Testing is an important technique to improve the quality of Ethereum smart contract programs. However, current work on testing smart contract only focus on static problems of smart contract programs. A data flow oriented test case…

Software Engineering · Computer Science 2020-03-03 Pengcheng Zhang , Jianan Yu , Shunhui Ji

Their highly adaptive nature and the combinatorial explosion of possible configurations makes testing context-oriented programs hard. We propose a methodology to automate the generation of test scenarios for developers of feature-based…

Software Engineering · Computer Science 2021-09-27 Pierre Martou , Kim Mens , Benoît Duhoux , Axel Legay

With the development of code generation techniques, selecting the correct code solution from multiple candidate solutions has become a crucial task. This study proposes AutoTest, a novel technique that combines automated test case…

Software Engineering · Computer Science 2024-08-23 Zhihua Duan , Jialin Wang