English
Related papers

Related papers: Choices are More Important than Efforts: LLM Enabl…

200 papers

Large Language Model (LLM) agents have shown strong results on multi-turn tool-use tasks, yet they operate in isolation during training, failing to leverage experiences accumulated across episodes. Existing experience-augmented methods…

Machine Learning · Computer Science 2026-03-20 Prince Zizhuang Wang , Shuli Jiang

We introduce Random Latent Exploration (RLE), a simple yet effective exploration strategy in reinforcement learning (RL). On average, RLE outperforms noise-based methods, which perturb the agent's actions, and bonus-based exploration, which…

Machine Learning · Computer Science 2025-02-28 Srinath Mahankali , Zhang-Wei Hong , Ayush Sekhari , Alexander Rakhlin , Pulkit Agrawal

The inherent uncertainty in the environmental transition model of Reinforcement Learning (RL) necessitates a delicate balance between exploration and exploitation. This balance is crucial for optimizing computational resources to accurately…

Machine Learning · Computer Science 2025-05-21 Yongxin Deng , Xihe Qiu , Jue Chen , Xiaoyu Tan

Effective decision-making in Large Language Models (LLMs) is essential for handling intricate tasks. However, existing approaches prioritize performance but often overlook the balance between effectiveness and computational cost. To address…

Computation and Language · Computer Science 2025-06-03 Jiawei Gu , Shangsong Liang

The emergence of large language models (LLMs) has substantially influenced natural language processing, demonstrating exceptional results across various tasks. In this study, we employ ``Introspective Tips" to facilitate LLMs in…

Artificial Intelligence · Computer Science 2023-05-22 Liting Chen , Lu Wang , Hang Dong , Yali Du , Jie Yan , Fangkai Yang , Shuang Li , Pu Zhao , Si Qin , Saravan Rajmohan , Qingwei Lin , Dongmei Zhang

Effective exploration is crucial to discovering optimal strategies for multi-agent reinforcement learning (MARL) in complex coordination tasks. Existing methods mainly utilize intrinsic rewards to enable committed exploration or use…

Machine Learning · Computer Science 2024-03-04 Zeyang Liu , Lipeng Wan , Xinrui Yang , Zhuoran Chen , Xingyu Chen , Xuguang Lan

Reinforcement Learning (RL)-based recommender systems have demonstrated promising performance in meeting user expectations by learning to make accurate next-item recommendations from historical user-item interactions. However, existing…

Information Retrieval · Computer Science 2024-03-26 Jie Wang , Alexandros Karatzoglou , Ioannis Arapakis , Joemon M. Jose

Navigating and understanding complex and unknown environments autonomously demands more than just basic perception and movement from embodied agents. Truly effective exploration requires agents to possess higher-level cognitive abilities,…

Artificial Intelligence · Computer Science 2025-09-12 Abdel Hakim Drid , Vincenzo Suriani , Daniele Nardi , Abderrezzak Debilou

Ensembling large language models (LLMs) can effectively combine diverse strengths of different models, offering a promising approach to enhance performance across various tasks. However, existing methods typically rely on fixed weighting…

Machine Learning · Computer Science 2025-06-03 Yuqian Fu , Yuanheng Zhu , Jiajun Chai , Guojun Yin , Wei Lin , Qichao Zhang , Dongbin Zhao

Reinforcement Learning (RL) has become a key approach for enhancing the reasoning capabilities of large language models. However, prevalent RL approaches like proximal policy optimization and group relative policy optimization suffer from…

Machine Learning · Computer Science 2026-02-02 Jingtong Gao , Ling Pan , Yejing Wang , Rui Zhong , Chi Lu , Maolin Wang , Qingpeng Cai , Peng Jiang , Xiangyu Zhao

In autonomous exploration tasks, robots are required to explore and map unknown environments while efficiently planning in dynamic and uncertain conditions. Given the significant variability of environments, human operators often have…

Robotics · Computer Science 2025-03-11 Shuhao Liao , Xuxin Lv , Yuhong Cao , Jeric Lew , Wenjun Wu , Guillaume Sartoretti

Model ensemble is a useful approach in reinforcement learning (RL) for training effective agents. Despite wide success of RL, training effective agents remains difficult due to the multitude of factors requiring careful tuning, such as…

Machine Learning · Computer Science 2025-05-22 Yiwen Song , Qianyue Hao , Qingmin Liao , Jian Yuan , Yong Li

Large Language Model-based multi-agent systems (MAS) have shown remarkable progress in solving complex tasks through collaborative reasoning and inter-agent critique. However, existing approaches typically treat each task in isolation,…

Computation and Language · Computer Science 2025-05-30 Yilong Li , Chen Qian , Yu Xia , Ruijie Shi , Yufan Dang , Zihao Xie , Ziming You , Weize Chen , Cheng Yang , Weichuan Liu , Ye Tian , Xuantang Xiong , Lei Han , Zhiyuan Liu , Maosong Sun

Large Language Models (LLMs) were shown to struggle with long-term planning, which may be caused by the limited way in which they explore the space of possible solutions. We propose an architecture where a Reinforcement Learning (RL) Agent…

Machine Learning · Computer Science 2024-10-18 Yoav Alon , Cristina David

Empowerment has the potential to help agents learn large skillsets, but is not yet a scalable solution for training general-purpose agents. Recent empowerment methods learn diverse skillsets by maximizing the mutual information between…

Artificial Intelligence · Computer Science 2024-10-16 Andrew Levy , Alessandro Allievi , George Konidaris

Recently, various studies have leveraged Large Language Models (LLMs) to help decision-making and planning in environments, and try to align the LLMs' knowledge with the world conditions. Nonetheless, the capacity of LLMs to continuously…

Machine Learning · Computer Science 2023-10-16 Yicheng Feng , Yuxuan Wang , Jiazheng Liu , Sipeng Zheng , Zongqing Lu

Large Language Models (LLMs) have significantly advanced tool-augmented agents, enabling autonomous reasoning via API interactions. However, executing multi-step tasks within massive tool libraries remains challenging due to two critical…

Artificial Intelligence · Computer Science 2026-04-15 Rongzhe Wei , Ge Shi , Min Cheng , Na Zhang , Pan Li , Sarthak Ghosh , Vaibhav Gorde , Leman Akoglu

Multi-agent systems with smaller language models (SLMs) present a viable alternative to single agent systems powered by large language models (LLMs) for addressing complex problems. In this work, we study how these alternatives compare in…

Reinforcement learning has empowered large language models to act as intelligent agents, yet training them for long-horizon tasks remains challenging due to the scarcity of high-quality trajectories, especially under limited resources.…

Machine Learning · Computer Science 2026-01-29 Jinyang Wu , Shuo Yang , Changpeng Yang , Yuhao Shen , Shuai Zhang , Zhengqi Wen , Jianhua Tao

Large language models (LLMs) offer significant promise as a knowledge source for task learning. Prompt engineering has been shown to be effective for eliciting knowledge from an LLM, but alone it is insufficient for acquiring relevant,…

Artificial Intelligence · Computer Science 2024-02-21 James R. Kirk , Robert E. Wray , Peter Lindes , John E. Laird