English
Related papers

Related papers: EnvFactory: Scaling Tool-Use Agents via Executable…

200 papers

Current research in LLM-based simulation systems lacks comprehensive solutions for modeling real-world court proceedings, while existing legal language models struggle with dynamic courtroom interactions. We present AgentCourt, a…

Computation and Language · Computer Science 2025-06-17 Guhong Chen , Liyang Fan , Zihan Gong , Nan Xie , Zixuan Li , Ziqiang Liu , Chengming Li , Qiang Qu , Hamid Alinejad-Rokny , Shiwen Ni , Min Yang

Safe and efficient autonomous driving maneuvers in an interactive and complex environment can be considerably challenging due to the unpredictable actions of other surrounding agents that may be cooperative or adversarial in their…

Robotics · Computer Science 2019-01-28 Pin Wang , Ching-Yao Chan , Hanhan Li

The integration of Large Language Models (LLMs) into healthcare is constrained by knowledge limitations, hallucinations, and a disconnect from Evidence-Based Medicine (EBM). While Retrieval-Augmented Generation (RAG) offers a solution,…

Computation and Language · Computer Science 2026-02-03 Qiaoyu Zheng , Yuze Sun , Chaoyi Wu , Weike Zhao , Pengcheng Qiu , Yongguo Yu , Kun Sun , Jian Zhang , Yanfeng Wang , Ya Zhang , Weidi Xie

Reinforcement learning with verifiable rewards (RLVR) has demonstrated superior performance in enhancing the reasoning capability of large language models (LLMs). However, this accuracy-oriented learning paradigm often suffers from entropy…

Artificial Intelligence · Computer Science 2026-01-19 Hongye Cao , Zhixin Bai , Ziyue Peng , Boyan Wang , Tianpei Yang , Jing Huo , Yuyao Zhang , Yang Gao

Retrieval-Augmented Generation (RAG) mitigates hallucination in LLMs by incorporating external knowledge, but relies on chunk-based retrieval that lacks structural semantics. GraphRAG methods improve RAG by modeling knowledge as…

Computation and Language · Computer Science 2025-07-30 Haoran Luo , Haihong E , Guanting Chen , Qika Lin , Yikai Guo , Fangzhi Xu , Zemin Kuang , Meina Song , Xiaobao Wu , Yifan Zhu , Luu Anh Tuan

This paper addresses the challenges of training end-to-end autonomous driving agents using Reinforcement Learning (RL). RL agents are typically trained in a fixed set of scenarios and nominal behavior of surrounding road users in…

Robotics · Computer Science 2026-03-06 Ahmed Abouelazm , Tim Weinstein , Tim Joseph , Philip Schörner , J. Marius Zöllner

Large Language Models (LLMs) enhance their problem-solving capability by utilizing external tools. However, in open-world scenarios with massive and evolving tool repositories, existing methods relying on static embedding retrieval or…

Computation and Language · Computer Science 2026-04-16 Shouzheng Huang , Meishan Zhang , Baotian Hu , Min Zhang

Large language model (LLM) agents are increasingly expected to operate in enterprise environments, where work is distributed across specialized roles, permission-controlled systems, and cross-departmental procedures. However, existing…

Recent advancements in foundation models (FMs) have unlocked new prospects in autonomous driving, yet the experimental settings of these studies are preliminary, over-simplified, and fail to capture the complexity of real-world driving…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Yidong Huang , Jacob Sansom , Ziqiao Ma , Felix Gervits , Joyce Chai

The development of autonomous agents for complex, long-horizon tasks is a central goal in AI. However, dominant training paradigms face a critical limitation: reinforcement learning (RL) methods that optimize solely for final task success…

Machine Learning · Computer Science 2025-07-31 Zijing Zhang , Ziyang Chen , Mingxiao Li , Zhaopeng Tu , Xiaolong Li

LLM-powered agents face a persistent challenge: learning from their execution experiences to improve future performance. While agents can successfully complete many tasks, they often repeat inefficient patterns, fail to recover from similar…

Artificial Intelligence · Computer Science 2026-03-12 Gaodan Fang , Vatche Isahagian , K. R. Jayaram , Ritesh Kumar , Vinod Muthusamy , Punleuk Oum , Gegi Thomas

We introduce ComputerRL, a framework for autonomous desktop intelligence that enables agents to operate complex digital workspaces skillfully. ComputerRL features the API-GUI paradigm, which unifies programmatic API calls and direct GUI…

Artificial Intelligence · Computer Science 2025-10-22 Hanyu Lai , Xiao Liu , Yanxiao Zhao , Han Xu , Hanchen Zhang , Bohao Jing , Yanyu Ren , Shuntian Yao , Yuxiao Dong , Jie Tang

Skills, i.e., structured workflow instructions distilled for large language models (LLMs), are becoming an increasingly important mechanism for improving agent performance on real-world downstream tasks. However, as the open-source skill…

Computation and Language · Computer Science 2026-05-29 Jiahao Ying , Boxian Ai , Wei Tang , Siyuan Liu , Yixin Cao

Replicating human-level intelligence in the execution of embodied tasks remains challenging due to the unconstrained nature of real-world environments. Novel use of large language models (LLMs) for task planning seeks to address the…

Large language models (LLMs) have demonstrated strong capabilities in language understanding and reasoning, yet they remain limited when tackling real-world tasks that require up-to-date knowledge, precise operations, or specialized tool…

Machine Learning · Computer Science 2025-09-17 Yabo Zhang , Yihan Zeng , Qingyun Li , Zhen Hu , Kavin Han , Wangmeng Zuo

In the interaction between agents and their environments, agents expand their capabilities by planning and executing actions. However, LLM-based agents face substantial challenges when deployed in novel environments or required to navigate…

Computation and Language · Computer Science 2025-06-03 Runnan Fang , Xiaobin Wang , Yuan Liang , Shuofei Qiao , Jialong Wu , Zekun Xi , Ningyu Zhang , Yong Jiang , Pengjun Xie , Fei Huang , Huajun Chen

Vision language models (VLMs) are increasingly deployed as controllers with access to external tools for complex reasoning and decision-making, yet their effectiveness remains limited by the scarcity of high-quality multimodal trajectories…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Tajamul Ashraf , Umair Nawaz , Abdelrahman M. Shaker , Rao Anwer , Philip Torr , Fahad Shahbaz Khan , Salman Khan

Large Language Models (LLMs) suffer from significant performance degradation when processing long contexts due to proactive interference, where irrelevant information in earlier parts of the context disrupts reasoning and memory recall.…

Computation and Language · Computer Science 2025-09-30 Mo Li , L. H. Xu , Qitai Tan , Long Ma , Ting Cao , Yunxin Liu

Search agents have emerged as a pivotal paradigm for solving open-ended, knowledge-intensive reasoning tasks. However, training these agents via Reinforcement Learning (RL) faces a critical dilemma: interacting with live commercial Web APIs…

Computation and Language · Computer Science 2026-01-22 Xichen Zhang , Ziyi He , Yinghao Zhu , Sitong Wu , Shaozuo Yu , Meng Chu , Wenhu Zhang , Haoru Tan , Jiaya Jia

Verifiers have been demonstrated to enhance LLM reasoning via test-time scaling (TTS). Yet, they face significant challenges in complex domains. Error propagation from incorrect intermediate reasoning can lead to false positives for…