English
Related papers

Related papers: SEVerA: Verified Synthesis of Self-Evolving Agents

200 papers

The Agentic Paradigm faces a significant Software Engineering Absence, yielding Agentic systems commonly lacking robustness, observability, and evolvability. To address these deficiencies, we propose a principled engineering framework…

Artificial Intelligence · Computer Science 2025-12-02 Jiazheng Sun , Ruimeng Yang , Xu Han , Jiayang Niu , Mingxuan Li , Te Yang , Yongyong Lu , Xin Peng

Open-weight coding agents should hold a fundamental advantage over closed-source systems: they can be specialized to private codebases, encoding repository-specific information directly in their weights. Yet the cost and complexity of…

Computation and Language · Computer Science 2026-02-04 Ethan Shen , Danny Tormoen , Saurabh Shah , Ali Farhadi , Tim Dettmers

Automated code generation has long been considered the holy grail of software engineering. The emergence of Large Language Models (LLMs) has catalyzed a revolutionary breakthrough in this area. However, existing methods that only rely on…

Software Engineering · Computer Science 2025-08-27 Xu Lu , Weisong Sun , Yiran Zhang , Ming Hu , Cong Tian , Zhi Jin , Yang Liu

Large Language Model-based agents have garnered significant attention and are becoming increasingly popular. Furthermore, planning ability is a crucial component of an LLM-based agent, which generally entails achieving a desired goal from…

Computation and Language · Computer Science 2025-02-07 Mengkang Hu , Pu Zhao , Can Xu , Qingfeng Sun , Jianguang Lou , Qingwei Lin , Ping Luo , Saravan Rajmohan

Large Language Models (LLMs) have made significant progress in handling complex programming tasks. However, current methods rely on manual model selection and fixed workflows, which limit their ability to adapt to changing task…

Software Engineering · Computer Science 2026-03-18 Yulin Peng , Haowen Hou , Xinxin Zhu , Ying Tiffany He , F. Richard Yu

Evaluating large language model (LLM)-based multi-agent systems remains a critical challenge, as these systems must exhibit reliable coordination, transparent decision-making, and verifiable performance across evolving tasks. Existing…

Artificial Intelligence · Computer Science 2026-01-21 YenTing Lee , Keerthi Koneru , Zahra Moslemi , Sheethal Kumar , Ramesh Radhakrishnan

Verifiers--functions assigning rewards to agent behavior--have been key to AI progress in math, code, and games. However, extending gains to domains without clear-cut success criteria remains a challenge: while humans can recognize desired…

Artificial Intelligence · Computer Science 2026-03-10 Moises Andrade , Joonhyuk Cha , Brandon Ho , Vriksha Srihari , Karmesh Yadav , Zsolt Kira

Recent advancements in large language models (LLMs) have significantly advanced the automation of software development tasks, including code synthesis, program repair, and test generation. More recently, researchers and industry…

Software Engineering · Computer Science 2024-10-30 Chunqiu Steven Xia , Yinlin Deng , Soren Dunn , Lingming Zhang

Modern Large Language Model (LLM)-based programming agents often rely on test execution feedback to refine their generated code. These tests are synthetically generated by LLMs. However, LLMs may produce invalid or hallucinated test cases,…

Software Engineering · Computer Science 2026-02-27 Hamed Taherkhani , Jiho Shin , Muhammad Ammar Tahir , Md Rakib Hossain Misu , Vineet Sunil Gattani , Hadi Hemmati

Recent advancements in automatic code generation using large language model (LLM) agent have brought us closer to the future of automated software development. However, existing single-agent approaches face limitations in generating and…

Software Engineering · Computer Science 2024-04-04 Yoichi Ishibashi , Yoshimasa Nishimura

Recently, using Large Language Models (LLMs) to generate optimization models from natural language descriptions has became increasingly popular. However, a major open question is how to validate that the generated models are correct and…

Artificial Intelligence · Computer Science 2026-04-07 Alexander Zadorojniy , Segev Wasserkrug , Eitan Farchi

The integration of large language models (LLMs) into autonomous agents has enabled complex tool use, yet in high-stakes domains, these systems must strictly adhere to regulatory standards beyond simple functional correctness. However,…

Computation and Language · Computer Science 2026-01-14 Da Song , Yuheng Huang , Boqi Chen , Tianshuo Cong , Randy Goebel , Lei Ma , Foutse Khomh

We present Prover Agent, a novel AI agent for automated theorem proving that integrates large language models (LLMs) with a formal proof assistant, Lean. Prover Agent coordinates an informal reasoning LLM, a formal prover model, and…

Artificial Intelligence · Computer Science 2026-02-18 Kaito Baba , Chaoran Liu , Shuhei Kurita , Akiyoshi Sannai

Large language models (LLMs) have recently achieved notable success in code-generation benchmarks such as HumanEval and LiveCodeBench. However, a detailed examination reveals that these evaluation suites often comprise only a limited number…

Computation and Language · Computer Science 2025-07-11 Zihan Ma , Taolin Zhang , Maosong Cao , Junnan Liu , Wenwei Zhang , Minnan Luo , Songyang Zhang , Kai Chen

Large Language Model (LLM) based agents are powerful yet fundamentally static after deployment, lacking the ability to autonomously expand capabilities, generate new tools, or evolve their reasoning. This work introduces a hierarchical…

Computation and Language · Computer Science 2026-01-21 Indrajit Kar , Sammy Zonunpuia , Zonunfeli Ralte

Agent-based models (ABMs) stand as an essential paradigm for proposing and validating hypothetical solutions or policies aimed at addressing challenges posed by complex systems and achieving various objectives. This process demands…

Computation and Language · Computer Science 2024-04-02 Tong Niu , Weihao Zhang , Rong Zhao

Recent advances in Reinforcement Learning with Verifiable Rewards (RLVR) have demonstrated significant potential in single-turn reasoning tasks. With the paradigm shift toward self-evolving agentic learning, models are increasingly expected…

Artificial Intelligence · Computer Science 2026-04-21 Xinshun Feng , Xinhao Song , Lijun Li , Gongshen Liu , Jing Shao

Formal verification offers a path to provably correct software, but writing verified code remains expensive enough that the technique is rarely used in production. Recent large language models can accelerate this work, and recent benchmarks…

Logic in Computer Science · Computer Science 2026-05-28 Leo Yao

Autonomous agents based on Large Language Models (LLMs) are increasingly being utilized in complex software systems. However, reliability remains a significant challenge due to unpredictable failures such as hallucinations, execution…

Software Engineering · Computer Science 2026-05-11 Cheonsu Jeong , Younggun Shin

Recent work explores agentic inference-time techniques to perform structured, multi-step reasoning. However, stateless inference often struggles on multi-step tasks due to the absence of persistent state. Moreover, task-specific fine-tuning…

Machine Learning · Computer Science 2025-10-09 Arshika Lalan , Rajat Ghosh , Aditya Kolsur , Debojyoti Dutta