English
Related papers

Related papers: Unit Test Generation using Generative AI : A Compa…

200 papers

In recent times, large language models (LLMs) have made significant strides in generating computer code, blurring the lines between code created by humans and code produced by artificial intelligence (AI). As these technologies evolve…

Machine Learning · Computer Science 2024-07-04 Marc Oedingen , Raphael C. Engelhardt , Robin Denz , Maximilian Hammer , Wolfgang Konen

Code generation with Large Language Models (LLMs) has been extensively studied and achieved remarkable progress. As a complementary aspect to code generation, test case generation is of crucial importance in ensuring the quality and…

Software Engineering · Computer Science 2024-04-23 Kefan Li , Yuan Yuan

Code generation stands as a powerful technique in modern software development, improving development efficiency, reducing errors, and fostering standardization and consistency. Recently, ChatGPT has exhibited immense potential in automatic…

Software Engineering · Computer Science 2023-12-22 Youjia Li , Jianjun Shi , Zheng Zhang

Although Large Language Models (LLMs) have demonstrated remarkable code-generation ability, they still struggle with complex tasks. In real-world software development, humans usually tackle complex tasks through collaborative teamwork, a…

Software Engineering · Computer Science 2024-05-14 Yihong Dong , Xue Jiang , Zhi Jin , Ge Li

Large Language Models (LLMs) have become a popular choice for many Natural Language Processing (NLP) tasks due to their versatility and ability to produce high-quality results. Specifically, they are increasingly used for automatic code…

Artificial Intelligence · Computer Science 2024-08-30 Jessica López Espejel , Mahaman Sanoussi Yahaya Alassan , Merieme Bouhandi , Walid Dahhane , El Hassane Ettifouri

Large Language Models (LLMs) are frequently discussed in academia and the general public as support tools for virtually any use case that relies on the production of text, including software engineering. Currently there is much debate, but…

Software Engineering · Computer Science 2024-05-22 Ranim Khojah , Mazen Mohamad , Philipp Leitner , Francisco Gomes de Oliveira Neto

ChatGPT has become a global sensation. As ChatGPT and other Large Language Models (LLMs) emerge, concerns of misusing them in various ways increase, such as disseminating fake news, plagiarism, manipulating public opinion, cheating, and…

Machine Learning · Computer Science 2023-04-06 Alessandro Pegoraro , Kavita Kumari , Hossein Fereidooni , Ahmad-Reza Sadeghi

This study investigates the application effectiveness of the Large Language Model (LLMs) ChatGLM in the automated generation of high school information technology exam questions. Through meticulously designed prompt engineering strategies,…

Computers and Society · Computer Science 2024-08-22 Yanxin Chen , Ling He

Interest in Large Language Models (LLMs) has increased drastically since the emergence of ChatGPT and the outstanding positive societal response to the ease with which it performs tasks in Natural Language Processing (NLP). The triumph of…

Computation and Language · Computer Science 2023-04-06 Oluwatosin Ogundare , Gustavo Quiros Araya

Programming reliability algorithms is crucial for risk assessment in geotechnical engineering. This study explores the possibility of automating and accelerating this task using Generative AI based on Large Language Models (LLMs).…

Applications · Statistics 2025-06-25 Atma Sharma , Jie Zhang , Meng Lu , Shuangyi Wu , Baoxiang Li

The increasing demand for digital literacy and artificial intelligence (AI) fluency in the workforce has highlighted the need for scalable, efficient programming instruction. This study evaluates the effectiveness of integrating generative…

Computers and Society · Computer Science 2025-05-28 Ian McCulloh , Pedro Rodriguez , Srivaths Kumar , Manu Gupta , Viplove Raj Sharma , Benjamin Johnson , Anthony N. Johnson

Recent research has explored the creation of questions from code submitted by students. These Questions about Learners' Code (QLCs) are created through program analysis, exploring execution paths, and then creating code comprehension…

Computers and Society · Computer Science 2024-04-19 Teemu Lehtinen , Charles Koutcheme , Arto Hellas

Programming students have a widespread access to powerful Generative AI tools like ChatGPT. While this can help understand the learning material and assist with exercises, educators are voicing more and more concerns about an overreliance…

Human-Computer Interaction · Computer Science 2025-02-24 Christian Rahe , Walid Maalej

Developers often build software on top of third-party libraries (Libs) to improve productivity, but these libraries may contain vulnerabilities that enable supply chain attacks. Existing tools detect vulnerable dependencies, yet developers…

Cryptography and Security · Computer Science 2026-03-31 Ying Zhang , Wenjia Song , Zhengjie Ji , Danfeng , Yao , Na Meng

This paper discusses the feasibility of using Large Language Models LLM for code generation with a particular application in designing an RISC. The paper also reviews the associated steps such as parsing, tokenization, encoding, attention…

Machine Learning · Computer Science 2024-01-22 Shadeeb Hossain , Aayush Gohil , Yizhou Wang

Large Language Models (LLMs) can generate plausible test code. Intuitively they generate this by imitating tests seen in their training data, rather than reasoning about execution semantics. However, such reasoning is important when…

Software Engineering · Computer Science 2025-03-12 Philipp Straubinger , Marvin Kreis , Stephan Lukasczyk , Gordon Fraser

Since ChatGPT has emerged as a major AIGC model, providing high-quality responses across a wide range of applications (including software development and maintenance), it has attracted much interest from many individuals. ChatGPT has great…

Computation and Language · Computer Science 2023-10-24 Arslan Akram

Unit testing is essential for ensuring software reliability and correctness. Classic Search-Based Software Testing (SBST) methods and concolic execution-based approaches for generating unit tests often fail to achieve high coverage due to…

Software Engineering · Computer Science 2025-09-30 Bei Chu , Yang Feng , Kui Liu , Hange Shi , Zifan Nan , Zhaoqiang Guo , Baowen Xu

Unit tests play a vital role in uncovering potential faults in software. While tools like EvoSuite focus on maximizing code coverage, recent advances in large language models (LLMs) have shifted attention toward LLM-based test generation.…

Software Engineering · Computer Science 2026-04-17 Guancheng Wang , Qinghua Xu , Lionel Briand , Kui Liu

We investigate the usefulness of generative Large Language Models (LLMs) in generating training data for cross-encoder re-rankers in a novel direction: generating synthetic documents instead of synthetic queries. We introduce a new dataset,…

Information Retrieval · Computer Science 2023-05-04 Arian Askari , Mohammad Aliannejadi , Evangelos Kanoulas , Suzan Verberne