English
Related papers

Related papers: Generating Project-Specific Test Cases with Requir…

200 papers

Unit tests play a key role in ensuring the correctness of software. However, manually creating unit tests is a laborious task, motivating the need for automation. Large Language Models (LLMs) have recently been applied to this problem,…

Software Engineering · Computer Science 2023-12-12 Max Schäfer , Sarah Nadi , Aryaz Eghbali , Frank Tip

Context: User intent modeling is a crucial process in Natural Language Processing that aims to identify the underlying purpose behind a user's request, enabling personalized responses. With a vast array of approaches introduced in the…

Existing LLM-based automatic test generation methods mainly produce input and expected output pairs to categorize the intended behavior of correct programs. Although straightforward, these methods have limited diversity in generated tests…

Software Engineering · Computer Science 2025-11-04 Yujian Liu , Jiabao Ji , Yang Zhang , Wenbo Guo , Tommi Jaakkola , Shiyu Chang

In the life-cycle of software development, testing plays a crucial role in quality assurance. Proper testing not only increases code coverage and prevents regressions but it can also ensure that any potential vulnerabilities in the software…

Software Engineering · Computer Science 2025-06-16 Gábor Antal , Dénes Bán , Martin Isztin , Rudolf Ferenc , Péter Hegedűs

Unit testing is essential for software quality assurance, yet writing and maintaining tests remains time-consuming and error-prone. To address this challenge, researchers have proposed various techniques for automating unit test generation,…

Software Engineering · Computer Science 2025-10-14 Dianshu Liao , Xin Yin , Shidong Pan , Chao Ni , Zhenchang Xing , Xiaoyu Sun

Large language models have demonstrated exceptional capabilities in understanding and generation. However, in real-world scenarios, users' natural language expressions are often inherently fuzzy, ambiguous, and uncertain, leading to…

Human-Computer Interaction · Computer Science 2026-01-30 Zongyu Chang , Feihong Lu , Ziqin Zhu , Qian Li , Cheng Ji , Tao Yang , Zhuo Chen , Hao Peng , Yang Liu , Ruifeng Xu , Yangqiu Song , Jianxin Li , Shangguang Wang

Test-driven development (TDD) is a widely-employed software development practice that mandates writing test cases based on requirements before writing the actual code. While writing test cases is the centerpiece of TDD, it is…

Software Engineering · Computer Science 2025-03-03 Wannita Takerngsaksiri , Rujikorn Charakorn , Chakkrit Tantithamthavorn , Yuan-Fang Li

Generating queries corresponding to natural language questions is a long standing problem. Traditional methods lack language flexibility, while newer sequence-to-sequence models require large amount of data. Schema-agnostic…

Machine Learning · Computer Science 2020-12-16 Amol Kelkar , Nachiketa Rajpurohit , Utkarsh Mittal , Peter Relan

Generating code from natural-language requirements has become a primary route for LLM-assisted software development. Although LLMs can successfully complete small programming tasks, generating an entire complex project remains unreliable…

Software Engineering · Computer Science 2026-05-26 Jian Fang , Yingfei Xiong

Intent detection is an essential component of task oriented dialogue systems. Over the years, extensive research has been conducted resulting in many state of the art models directed towards resolving user's intents in dialogue. A variety…

Computation and Language · Computer Science 2018-12-10 Pratik Jayarao , Aman Srivastava

Generating tests automatically is a key and ongoing area of focus in software engineering research. The emergence of Large Language Models (LLMs) has opened up new opportunities, given their ability to perform a wide spectrum of tasks.…

Software Engineering · Computer Science 2025-01-20 Azat Abdullin , Pouria Derakhshanfar , Annibale Panichella

Mock assertions provide developers with a powerful means to validate program behaviors that are unobservable to test assertions. Despite their significance, they are rarely considered by automated test generation techniques. Effective…

Software Engineering · Computer Science 2025-03-26 Hengcheng Zhu , Valerio Terragni , Lili Wei , Shing-Chi Cheung , Jiarong Wu , Yepang Liu

Unit testing is crucial for software development and maintenance. Effective unit testing ensures and improves software quality, but writing unit tests is time-consuming and labor-intensive. Recent studies have proposed deep learning (DL)…

Software Engineering · Computer Science 2025-02-21 Junwei Zhang , Xing Hu , Shan Gao , Xin Xia , David Lo , Shanping Li

Test cases are essential for validating the reliability and quality of software applications. Recent studies have demonstrated the capability of Large Language Models (LLMs) to generate useful test cases for given source code. However, the…

Software Engineering · Computer Science 2025-01-03 Shuzheng Gao , Chaozheng Wang , Cuiyun Gao , Xiaoqian Jiao , Chun Yong Chong , Shan Gao , Michael Lyu

Unit test generation has become a promising and important Large Language Model (LLM) use case. However, existing evaluation benchmarks for LLM unit test generation focus on function- or class-level code (single-file) rather than more…

Software Engineering · Computer Science 2026-04-08 Yibo Wang , Congying Xia , Wenting Zhao , Jiangshu Du , Chunyu Miao , Zhongfen Deng , Philip S. Yu , Chen Xing

Code completion, a highly valuable topic in the software development domain, has been increasingly promoted for use by recent advances in large language models (LLMs). To date, visible LLM-based code completion frameworks such as GitHub…

Software Engineering · Computer Science 2023-05-09 Zongjie Li , Chaozheng Wang , Zhibo Liu , Haoxuan Wang , Dong Chen , Shuai Wang , Cuiyun Gao

The development of modern NLP applications often relies on various benchmark datasets containing plenty of manually labeled tests to evaluate performance. While constructing datasets often costs many resources, the performance on the…

Software Engineering · Computer Science 2023-08-01 Pin Ji , Yang Feng , Weitao Huang , Jia Liu , Zhihong Zhao

Unit testing represents the foundational basis of the software testing pyramid, beneath integration and end-to-end testing. Automated software testing researchers have proposed a variety of techniques to assist developers in this…

Software Engineering · Computer Science 2022-03-25 Michele Tufano , Dawn Drain , Alexey Svyatkovskiy , Neel Sundaresan

Intent detection with semantically similar fine-grained intents is a challenging task. To address it, we reformulate intent detection as a question-answering retrieval task by treating utterances and intent names as questions and answers.…

Computation and Language · Computer Science 2023-03-22 Asaf Yehudai , Matan Vetzler , Yosi Mass , Koren Lazar , Doron Cohen , Boaz Carmeli

With the rapid growth of the developer community, the amount of posts on online technical forums has been growing rapidly, which poses difficulties for users to filter useful posts and find important information. Tags provide a concise…

Software Engineering · Computer Science 2024-04-11 Xingfang Wu , Eric Laufer , Heng Li , Foutse Khomh , Santhosh Srinivasan , Jayden Luo