English
Related papers

Related papers: On-Policy Self-Evolution via Failure Trajectories …

200 papers

As large models evolve from conversational assistants into autonomous agents, challenges increasingly arise from long-horizon decision making, tool use, and real environment interaction. Existing agenticinfrastructure remain fragmented…

Large Language Models (LLMs) excel at code generation but remain heavily reliant on large-scale annotated solutions and verification-based supervision, which constrains scalability and hinders sustained self-improvement. Recent…

Software Engineering · Computer Science 2026-05-22 Yixu Huang , Xinglei Yu , Zhongyu Wei

Current evaluation methods for autonomous driving prediction models rely heavily on simplistic metrics such as Average Displacement Error (ADE) and Final Displacement Error (FDE). While these metrics offer basic performance assessments,…

Robotics · Computer Science 2025-10-14 Feifei Liu , Haozhe Wang , Zejun Wei , Qirong Lu , Yiyang Wen , Xiaoyu Tang , Jingyan Jiang , Zhijian He

Large Language Models (LLMs) have demonstrated remarkable capabilities, enabling language agents to excel at single-turn tasks. However, their application to complex, multi-step, and long-horizon tasks remains challenging. While…

Machine Learning · Computer Science 2025-10-24 Jiazheng Li , Yawei Wang , David Yan , Yijun Tian , Zhichao Xu , Huan Song , Panpan Xu , Lin Lee Cheong

The rapid increase in remote sensing satellites has led to the emergence of distributed space-based observation systems. However, existing distributed remote sensing models often rely on centralized training, resulting in data leakage,…

Machine Learning · Computer Science 2025-04-08 Xiaohe Li , Haohua Wu , Jiahao Li , Zide Fan , Kaixin Zhang , Xinming Li , Yunping Ge , Xinyu Zhao

Large Language Model (LLM) agents, which integrate planning, memory, reflection, and tool-use modules, have shown promise in solving complex, multi-step tasks. Yet their sophisticated architectures amplify vulnerability to cascading…

Recent work on activation and latent steering has demonstrated that modifying internal representations can effectively guide large language models (LLMs) toward improved reasoning and efficiency without additional training. However, most…

Machine Learning · Computer Science 2026-01-07 Tuc Nguyen , Thai Le

LLM agents emit actions, not just text, and once taken, those actions often cannot be undone. Yet today's agent-safety evaluations run greedy or a few sampled rollouts and report a single safe/unsafe rate -- blind to the long-tail…

Cryptography and Security · Computer Science 2026-05-05 Shuyi Lin , Anshuman Suri , Alina Oprea , Cheng Tan

Ensuring correctness is crucial for code generation. Formal verification offers a definitive assurance of correctness, but demands substantial human effort in proof construction and hence raises a pressing need for automation. The primary…

Agentic LLM frameworks promise autonomous behavior via task decomposition, tool use, and iterative planning, but most deployed systems remain brittle. They lack runtime introspection, cannot diagnose their own failure modes, and do not…

Artificial Intelligence · Computer Science 2025-12-10 Christopher Cruz

Recent advancements in Large Language Models (LLMs) and Reinforcement Learning (RL) have shown significant promise in decision-making tasks. Nevertheless, for large-scale industrial decision problems, both approaches face distinct…

Artificial Intelligence · Computer Science 2025-06-04 Xu Wan , Wenyue Xu , Chao Yang , Mingyang Sun

AI agents are increasingly deployed in production, yet their security evaluations remain bottlenecked by manual red-teaming or static benchmarks that fail to model adaptive, multi-turn adversaries. We propose NAAMSE, an evolutionary…

Artificial Intelligence · Computer Science 2026-03-10 Kunal Pai , Parth Shah , Harshil Patel

Deploying autonomous vision systems on edge devices faces a critical challenge: resource constraints prevent real-time and predictable execution of comprehensive safety tests. Existing validation methods depend on static datasets or manual…

Machine Learning · Computer Science 2026-04-10 Faezeh Pasandideh , Achim Rettberg

Multimodal deep search requires an agent to solve open-world problems by chaining search, tool use, and visual reasoning over evolving textual and visual context. Two bottlenecks limit current systems. First, existing tool-use harnesses…

Computation and Language · Computer Science 2026-05-12 Shijue Huang , Hangyu Guo , Chenxin Li , Junting Lu , Xinyu Geng , Zhaochen Su , Zhenyu Li , Shuang Chen , Hongru Wang , Yi R. Fung

Agent skills extend LLM agents with reusable instructions, tool interfaces, and executable code, and users increasingly install third-party skills from marketplaces, repositories, and community channels. Because a skill exposes both…

Cryptography and Security · Computer Science 2026-05-13 Zhaojiacheng Zhou

The aim of multi-agent reinforcement learning systems is to provide interacting agents with the ability to collaboratively learn and adapt to the behavior of other agents. In many real-world applications, the agents can only acquire a…

Artificial Intelligence · Computer Science 2019-10-10 Mingyang Geng , Kele Xu , Yiying Li , Shuqi Liu , Bo Ding , Huaimin Wang

Self-evolving agents offer a promising path toward scalable autonomy. However, in this work, we show that in competitive environments, self-evolution can instead give rise to a serious and previously underexplored risk: the spontaneous…

Cryptography and Security · Computer Science 2026-03-16 Zonghao Ying , Haowen Dai , Tianyuan Zhang , Yisong Xiao , Quanchen Zou , Aishan Liu , Jian Yang , Yaodong Yang , Xianglong Liu

Intelligent agents progress by continually refining their capabilities through actively exploring environments. Yet robot policies often lack sufficient exploration capability due to action mode collapse. Existing methods that encourage…

Robotics · Computer Science 2025-09-24 Yang Jin , Jun Lv , Han Xue , Wendi Chen , Chuan Wen , Cewu Lu

Traditional self-adaptive systems automatically reconfigure existing components in response to changing requirements, but provide limited support for the generation of novel functionalities. The software generation capabilities of large…

Software Engineering · Computer Science 2026-04-21 Md Asif Iqbal Fahim , Oluwadamilola Adebayo , Alessio Ferrari

Imitation learning is a promising paradigm for training robot agents; however, standard approaches typically require substantial data acquisition -- via numerous demonstrations or random exploration -- to ensure reliable performance.…

Robotics · Computer Science 2026-02-12 Hanbit Oh , Masaki Murooka , Tomohiro Motoda , Ryoichi Nakajo , Yukiyasu Domae