English
Related papers

Related papers: CuES: A Curiosity-driven and Environment-grounded …

200 papers

Large Language Model (LLM)-based agents are increasingly applied to tasks requiring structured reasoning, tool use, and environmental adaptation, such as data manipulation, multistep planning, and computer-use automation. However, despite…

Artificial Intelligence · Computer Science 2025-11-26 Shashank Kirtania , Param Biyani , Priyanshu Gupta , Yasharth Bajpai , Roshni Iyer , Sumit Gulwani , Gustavo Soares

Agentic search enables LLMs to solve complex multi-hop questions through iterative reasoning and external search. Despite the effectiveness, these systems often suffer from a critical limitation in practice: agents fail to recognize their…

Artificial Intelligence · Computer Science 2026-05-29 Yunbo Tang , Chengyi Yang , Shiyu Liu , Zhishang Xiang , Zerui Chen , Qinggang Zhang , Jinsong Su

Large language model (LLM)-based agents that reason, plan, and act through tools, memory, and structured interaction are emerging as a promising paradigm for automating complex workflows. Recent systems such as OpenClaw and Claude Code…

Information Retrieval · Computer Science 2026-05-27 Yingli Zhou , Wang Shu , Yaodong Su , Wenchuan Du , Yixiang Fang , Xuemin Lin

This study introduces Conversation Routines (CR), a structured prompt engineering framework for developing task-oriented dialog systems using Large Language Models (LLMs). While LLMs demonstrate remarkable natural language understanding…

Computation and Language · Computer Science 2025-02-25 Giorgio Robino

This work presents and experimentally test the framework used by our context-aware, distributed team of small Unmanned Aerial Systems (SUAS) capable of operating in real-time, in an autonomous fashion, and under constrained communications.…

Large Language Models (LLMs) have recently shown great promise in planning and reasoning applications. These tasks demand robust systems, which arguably require a causal understanding of the environment. While LLMs can acquire and reflect…

Artificial Intelligence · Computer Science 2024-10-29 John Gkountouras , Matthias Lindemann , Phillip Lippe , Efstratios Gavves , Ivan Titov

Reinforcement learning (RL) has substantially improved the ability of large language model (LLM) agents to interact with environments and solve multi-turn tasks. However, effective agentic RL remains challenging: sparse outcome-only rewards…

In recent years, advances in deep learning have resulted in a plethora of successes in the use of reinforcement learning (RL) to solve complex sequential decision tasks with high-dimensional inputs. However, existing systems lack the…

Artificial Intelligence · Computer Science 2022-11-14 Pedro Sequeira , Jesse Hostetler , Melinda Gervasio

People rely heavily on context to enrich meaning beyond what is literally said, enabling concise but effective communication. To interact successfully and naturally with people, user-facing artificial intelligence systems will require…

Computation and Language · Computer Science 2023-11-23 Daniel Fried , Nicholas Tomlin , Jennifer Hu , Roma Patel , Aida Nematzadeh

Large language models are quickly becoming the foundation for intelligent agents that are capable of using tools. However, training such agents is challenging because it requires human creation and annotation of a diverse set of tasks,…

Artificial Intelligence · Computer Science 2025-06-03 Yifei Zhou , Sergey Levine , Jason Weston , Xian Li , Sainbayar Sukhbaatar

Large Language Model (LLM) agents are increasingly deployed in complex, multi-step workflows involving planning, tool use, reflection, and interaction with external knowledge systems. These workflows generate rapidly expanding contexts that…

Artificial Intelligence · Computer Science 2025-12-22 Kamer Ali Yuksel

Recent development of agents has renewed demand for long-context reasoning capacity of LLMs. However, training LLMs for this capacity requires costly long-document curation or heuristic context synthesis. We observe that agents produce…

Computation and Language · Computer Science 2026-05-22 Qisheng Su , Zhen Fang , Shiting Huang , Yu Zeng , Yiming Zhao , Kou Shi , Ziao Zhang , Lin Chen , Zehui Chen , Lijun Wu , Feng Zhao

Associative thinking--the ability to connect seemingly unrelated ideas--is a foundational element of human creativity and problem-solving. This paper explores whether reinforcement learning (RL) guided by associative thinking principles can…

Artificial Intelligence · Computer Science 2025-11-25 Mukul Singh , Ananya Singha , Aishni Parab , Pronita Mehrotra , Sumit Gulwani

Reinforcement learning with verifiable rewards (RLVR) has driven breakthroughs in domains such as math, tool-use, and software engineering, yet its extension to computer-use agents (CUAs) has been bottlenecked by the scarcity of scalable…

Artificial Intelligence · Computer Science 2026-05-26 Bowen Wang , Dunjie Lu , Junli Wang , Tianyi Bai , Shixuan Liu , Zhipeng Zhang , Haiquan Wang , Hao Hu , Tianbao Xie , Shuai Bai , Dayiheng Liu , Que Shen , Junyang Lin , Tao Yu

Current context augmentation methods, such as retrieval-augmented generation, are essential for solving knowledge-intensive reasoning tasks. However, they typically adhere to a rigid, brute-force strategy that executes retrieval at every…

Computation and Language · Computer Science 2026-01-15 Rubing Chen , Jian Wang , Wenjie Li , Xiao-Yong Wei , Qing Li

The ability of Large Language Models (LLMs) to use external tools unlocks powerful real-world interactions, making rigorous evaluation essential. However, current benchmarks primarily report final accuracy, revealing what models can do but…

Computation and Language · Computer Science 2026-01-29 Qihao Wang , Yue Hu , Mingzhe Lu , Jiayue Wu , Yanbing Liu , Yuanmin Tang

Large language models (LLMs) excel at natural language tasks but are limited by their static parametric knowledge, especially in knowledge-intensive task. Retrieval-augmented generation (RAG) mitigates this by integrating external…

Artificial Intelligence · Computer Science 2025-10-10 Yi Jiang , Lei Shen , Lujie Niu , Sendong Zhao , Wenbo Su , Bo Zheng

As general intelligent agents are poised for widespread deployment in diverse households, evaluation tailored to each unique unseen 3D environment has become a critical prerequisite. However, existing benchmarks suffer from severe data…

Artificial Intelligence · Computer Science 2026-02-06 Xinyi He , Ying Yang , Chuanjian Fu , Sihan Guo , Songchun Zhu , Lifeng Fan , Zhenliang Zhang , Yujia Peng

Reinforcement learning (RL) has become a prevalent paradigm for training tool calling agents, which typically requires online interactive environments. Existing approaches either rely on training data with ground truth annotations or…

Machine Learning · Computer Science 2026-05-08 Chenming Tang , Hsiu-Yuan Huang , Weijie Liu , Junqiang Zheng , Saiyong Yang , Yunfang Wu

Language Models and Vision Language Models have recently demonstrated unprecedented capabilities in terms of understanding human intentions, reasoning, scene understanding, and planning-like behaviour, in text form, among many others. In…