中文
相关论文

相关论文: ACE: Self-Evolving LLM Coding Framework via Advers…

200 篇论文

Large language models (LLMs) have already revolutionized code generation, after being pretrained on publicly available code data. However, while various methods have been proposed to augment LLMs with retrieved knowledge and enhance the…

计算与语言 · 计算机科学 2023-06-06 Shuyang Jiang , Yuhao Wang , Yu Wang

Large Language Models (LLMs) are increasingly used for automated unit test generation. However, it remains unclear whether these tests reflect genuine reasoning about program behavior or simply reproduce superficial patterns learned during…

软件工程 · 计算机科学 2026-03-25 Sabaat Haroon , Mohammad Taha Khan , Muhammad Ali Gulzar

Pre-trained code language models have achieved promising performance in code generation and improved the programming efficiency of human developers. However, their self-refinement capability is typically overlooked by the existing…

软件工程 · 计算机科学 2024-03-28 Yangruibo Ding , Marcus J. Min , Gail Kaiser , Baishakhi Ray

Unit testing is a core practice in programming, enabling systematic evaluation of programs produced by human developers or large language models (LLMs). Given the challenges in writing comprehensive unit tests, LLMs have been employed to…

软件工程 · 计算机科学 2026-03-17 Dongjun Lee , Changho Hwang , Kimin Lee

Evaluating the programming robustness of large language models (LLMs) is paramount for ensuring their reliability in AI-based software development. However, adversarial attacks exhibit fundamental limitations that compromise fair robustness…

软件工程 · 计算机科学 2026-02-17 Sen Fang , Weiyuan Ding , Mengshi Zhang , Zihao Chen , Bowen Xu

Reinforcement learning with verifiable rewards improves reasoning in large language models (LLMs), but many methods still rely on large human-labeled datasets. While self-play reduces this dependency, it often lacks explicit planning and…

人工智能 · 计算机科学 2026-03-18 Yulin Peng , Xinxin Zhu , Chenxing Wei , Nianbo Zeng , Leilei Wang , Ying Tiffany He , F. Richard Yu

Recent advancements in Large Language Models (LLMs) and Reinforcement Learning (RL) have shown significant promise in decision-making tasks. Nevertheless, for large-scale industrial decision problems, both approaches face distinct…

人工智能 · 计算机科学 2025-06-04 Xu Wan , Wenyue Xu , Chao Yang , Mingyang Sun

Recent advancements in Large Language Model (LLM) safety have primarily focused on mitigating attacks crafted in natural language or common ciphers (e.g. Base64), which are likely integrated into newer models' safety training. However, we…

计算与语言 · 计算机科学 2025-10-15 Divij Handa , Zehua Zhang , Amir Saeidi , Shrinidhi Kumbhar , Md Nayem Uddin , Aswin RRV , Chitta Baral

Code generation refers to automatically producing executable programs from user requirements. Recently, researchers have explored approaches to enhance the correctness of generated code with advanced large language models. Although…

软件工程 · 计算机科学 2026-04-20 Jia Li , Ruiqi Bai , Yangkang Luo , Yiran Zhang , Wentao Yang , Zeyu Sun , Tiankuo Zhao , Dongming Jin , Lei Li , Zhi Jin

Large Language Models (LLMs) exhibit impressive capabilities, but remain susceptible to a growing spectrum of safety risks, including jailbreaks, toxic content, hallucinations, and bias. Existing defenses often address only a single threat…

计算与语言 · 计算机科学 2025-11-18 Md Rafi Ur Rashid , Vishnu Asutosh Dasu , Ye Wang , Gang Tan , Shagufta Mehnaz

Large Language Models (LLMs), particularly Code LLMs, have demonstrated impressive performance in code generation. Current research primarily focuses on the correctness of generated code, while efficiency remains less explored. Recent works…

软件工程 · 计算机科学 2025-02-27 Tong Ye , Weigang Huang , Xuhong Zhang , Tengfei Ma , Peiyu Liu , Jianwei Yin , Wenhai Wang

Large Language Models (LLMs) demonstrate impressive ability in handling reasoning tasks. However, unlike humans who can instinctively adapt their problem-solving strategies to the complexity of task, most LLM-based methods adopt a…

计算与语言 · 计算机科学 2024-12-24 Jianpeng Zhou , Wanjun Zhong , Yanlin Wang , Jiahai Wang

Ensemble learning has been widely used in machine learning to improve model robustness, accuracy, and generalization, but has not yet been applied to code generation tasks with large language models (LLMs). We propose an ensemble approach…

软件工程 · 计算机科学 2025-07-22 Tarek Mahmud , Bin Duan , Corina Pasareanu , Guowei Yang

Foundation models -- large language models (LLMs) in particular -- have become ubiquitous, shaping daily life and driving breakthroughs across science, engineering, and technology. Harnessing their broad cross-domain knowledge,…

软件工程 · 计算机科学 2025-10-01 Haoyang Wu , Xinxin Zhang , Lailai Zhu

The astonishing performance of large language models (LLMs) and their remarkable achievements in production and daily life have led to their widespread application in collaborative tasks. However, current large models face challenges such…

计算与语言 · 计算机科学 2025-02-10 Xiaoyu Deng , Ye Zhang , Tianmin Guo , Yongzhe Zhang , Zhengjian Kang , Hang Yang

The design and implementation of unit tests is a complex task many programmers neglect. This research evaluates the potential of Large Language Models (LLMs) in automatically generating test cases, comparing them with manual tests. An…

软件工程 · 计算机科学 2025-05-16 Martín Rodríguez , Gustavo Rossi , Alejandro Fernandez

Grammar-based test case generation has proven effective for competitive programming problems, but generating valid and general grammars from natural language specifications remains a key challenge, especially under limited supervision.…

计算与语言 · 计算机科学 2025-06-16 Aditi , Hyunwoo Park , Sicheol Sung , Yo-Sub Han , Sang-Ki Ko

Self-Refinement refers to a model's ability to revise its own responses to produce improved outputs. This capability can also serve as a fundamental mechanism for Self-Improvement, for example, by reconstructing datasets with refined…

Large language models (LLMs) have recently shown strong coding abilities, enabling not only static code generation but also iterative code self-evolving through agentic frameworks. Recently, AlphaEvolve \cite{novikov2025alphaevolve}…

人工智能 · 计算机科学 2025-09-10 Cunxi Yu , Rongjian Liang , Chia-Tung Ho , Haoxing Ren

Recent advancements in Large Language Models (LLMs) have spurred interest in deploying LLM agents to undertake tasks in the world. LLMs are often deployed in agent systems: code that orchestrates LLM calls and provides them with tools. We…

人工智能 · 计算机科学 2025-05-20 Maxime Robeyns , Martin Szummer , Laurence Aitchison