English
Related papers

Related papers: DeepPlanner: Scaling Planning Capability for Deep …

200 papers

Deep learning has enabled traditional reinforcement learning methods to deal with high-dimensional problems. However, one of the disadvantages of deep reinforcement learning methods is the limited exploration capacity of learning agents. In…

Machine Learning · Computer Science 2019-07-30 Thanh Nguyen , Ngoc Duy Nguyen , Saeid Nahavandi

Recent advancements in agentic test-time scaling allow models to gather environmental feedback before committing to final actions. A key limitation of existing methods is that they typically employ undifferentiated exploration strategies,…

Artificial Intelligence · Computer Science 2026-05-13 Xingyuan Hua , Sheng Yue , Ju Ren

This work enhances the ability of large language models (LLMs) to perform complex reasoning in 3D scenes. Recent work has addressed the 3D situated reasoning task by invoking tool usage through large language models. Large language models…

Artificial Intelligence · Computer Science 2025-08-22 Jiayi Song , Rui Wan , Lipeng Ma , Weidong Yang , Qingyuan Zhou , Yixuan Li , Ben Fei

Designing strategyproof mechanisms for multi-facility location that optimize social costs based on agent preferences had been challenging due to the extensive domain knowledge required and poor worst-case guarantees. Recently, deep learning…

Machine Learning · Computer Science 2025-03-14 Nguyen Thach , Fei Liu , Houyu Zhou , Hau Chan

Policy exploration is critical in reinforcement learning (RL), where existing approaches include greedy, Gaussian process, etc. However, these approaches utilize preset stochastic processes and are indiscriminately applied in all kinds of…

Machine Learning · Computer Science 2025-10-24 Qianyue Hao , Yiwen Song , Qingmin Liao , Jian Yuan , Yong Li

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a powerful approach to enhancing the reasoning capabilities of Large Language Models (LLMs), while its mechanisms are not yet well understood. In this work, we undertake a…

Deep research systems, agentic AI that solve complex, multi-step tasks by coordinating reasoning, search across the open web and user files, and tool use, are moving toward hierarchical deployments with a Planner, Coordinator, and…

Artificial Intelligence · Computer Science 2025-11-06 Wenjun Li , Zhi Chen , Jingru Lin , Hannan Cao , Wei Han , Sheng Liang , Zhi Zhang , Kuicai Dong , Dexun Li , Chen Zhang , Yong Liu

Growing attention to intelligent agents has put a spotlight on one of their central capabilities: planning. Early attempts to leverage large language models (LLMs) for planning relied on single-shot plan generation, followed by hybrid…

Artificial Intelligence · Computer Science 2026-05-22 Michael Katz , Harsha Kokel , Kavitha Srinivas , Shirin Sohrabi

As agentic AI becomes more widespread, agents with distinct and possibly conflicting goals will interact in complex ways. These multi-agent interactions pose a fundamental challenge, particularly in social dilemmas, where agents' individual…

Machine Learning · Computer Science 2025-12-02 Dereck Piche , Mohammed Muqeeth , Milad Aghajohari , Juan Duque , Michael Noukhovitch , Aaron Courville

Reinforcement learning (RL) has emerged as a powerful paradigm for enhancing the reasoning capabilities of large language models (LLMs). While RL has demonstrated substantial performance gains, it still faces key challenges, including low…

Machine Learning · Computer Science 2025-11-18 Yihang Yao , Guangtao Zeng , Raina Wu , Yang Zhang , Ding Zhao , Zhang-Wei Hong , Chuang Gan

Reasoning-enhanced large language models (LLMs) explicitly generate intermediate reasoning steps prior to generating final answers, helping the model excel in complex problem-solving. In this paper, we demonstrate that this emerging…

Machine Learning · Computer Science 2025-05-22 Tong Wu , Chong Xiang , Jiachen T. Wang , G. Edward Suh , Prateek Mittal

In this paper, we introduce Rank-R1, a novel LLM-based reranker that performs reasoning over both the user query and candidate documents before performing the ranking task. Existing document reranking methods based on large language models…

Information Retrieval · Computer Science 2025-03-11 Shengyao Zhuang , Xueguang Ma , Bevan Koopman , Jimmy Lin , Guido Zuccon

Humans intuitively solve complex problems by flexibly shifting among reasoning modes: they plan, execute, revise intermediate goals, resolve ambiguity through associative judgment, and apply formal procedures to well-specified subproblems.…

Large Language Models (LLMs) have demonstrated strong reasoning capabilities in solving complex problems. However, current approaches primarily enhance reasoning through the elaboration of thoughts while neglecting the diversity of…

Computation and Language · Computer Science 2025-04-25 Danqing Wang , Jianxin Ma , Fei Fang , Lei Li

Theorem proving serves as a major testbed for evaluating complex reasoning abilities in large language models (LLMs). However, traditional automated theorem proving (ATP) approaches rely heavily on formal proof systems that poorly align…

Computation and Language · Computer Science 2025-06-04 Ziyin Zhang , Jiahao Xu , Zhiwei He , Tian Liang , Qiuzhi Liu , Yansi Li , Linfeng Song , Zhenwen Liang , Zhuosheng Zhang , Rui Wang , Zhaopeng Tu , Haitao Mi , Dong Yu

Multi-agent systems of large language models (LLMs) show promise for complex reasoning, but their effectiveness is often limited by fixed collaboration protocols. These frameworks typically focus on macro-level orchestration while…

Artificial Intelligence · Computer Science 2025-12-10 Wei Yang , Jesse Thomason

Planning is a fundamental capability for large language models (LLMs) because such complex tasks require models to coordinate goals, constraints, resources, and long-term consequences into executable and verifiable solutions. Existing…

Artificial Intelligence · Computer Science 2026-05-21 Ziliang Zhao , Zenan Xu , Shuting Wang , Hongjin Qian , Yan Lei , Minda Hu , Zhao Wang , Shihan Dou , Zhicheng Dou , Pluto Zhou

In domains requiring intelligent agents to emulate plausible human-like behaviour, such as formative simulations, traditional techniques like behaviour trees encounter significant challenges. Large Language Models (LLMs), despite not always…

Artificial Intelligence · Computer Science 2025-01-20 Israel Puerta-Merino , Jordi Sabater-Mir

Large language models (LLMs) have evolved into agentic systems capable of autonomous tool use and multi-step reasoning for complex problem-solving. However, post-training approaches building upon general-purpose foundation models…

A key method for creating Artificial Intelligence (AI) agents is Reinforcement Learning (RL). However, constructing a standalone RL policy that maps perception to action directly encounters severe problems, chief among them being its lack…