English
Related papers

Related papers: Training LLM Agents for Spontaneous, Reward-Free S…

200 papers

Unsupervised reinforcement learning aims to acquire skills without prior goal representations, where an agent automatically explores an open-ended environment to represent goals and learn the goal-conditioned policy. However, this procedure…

Machine Learning · Computer Science 2021-10-27 Jinxin Liu , Hao Shen , Donglin Wang , Yachen Kang , Qiangxing Tian

Behavioral skills or policies for autonomous agents are conventionally learned from reward functions, via reinforcement learning, or from demonstrations, via imitation learning. However, both modes of task specification have their…

Self-Modeling is the process by which an agent, such as an animal or machine, learns to create a predictive model of its own dynamics. Once captured, this self-model can then allow the agent to plan and evaluate various potential behaviors…

Robotics · Computer Science 2022-09-07 Robert Kwiatkowski , Yuhang Hu , Boyuan Chen , Hod Lipson

Imitation learning allows agents to learn complex behaviors from demonstrations. However, learning a complex vision-based task may require an impractical number of demonstrations. Meta-imitation learning is a promising approach towards…

Reward shaping allows reinforcement learning (RL) agents to accelerate learning by receiving additional reward signals. However, these signals can be difficult to design manually, especially for complex RL tasks. We propose a simple and…

Artificial Intelligence · Computer Science 2018-06-11 Niels Justesen , Sebastian Risi

Q-shaping is an extension of Q-value initialization and serves as an alternative to reward shaping for incorporating domain knowledge to accelerate agent training, thereby improving sample efficiency by directly shaping Q-values. This…

Artificial Intelligence · Computer Science 2024-10-03 Xiefeng Wu

Learning to control an environment without hand-crafted rewards or expert data remains challenging and is at the frontier of reinforcement learning research. We present an unsupervised learning algorithm to train agents to achieve…

Machine Learning · Computer Science 2018-11-29 David Warde-Farley , Tom Van de Wiele , Tejas Kulkarni , Catalin Ionescu , Steven Hansen , Volodymyr Mnih

Embodied agents are expected to operate persistently in dynamic physical environments, continuously acquiring new capabilities over time. Existing approaches to improving agent performance often rely on modifying the agent itself -- through…

Robotics · Computer Science 2026-05-22 Xue Qin , Simin Luan , John See , Cong Yang , Zhijun Li

Reward functions are central in reinforcement learning (RL), guiding agents towards optimal decision-making. The complexity of RL tasks requires meticulously designed reward functions that effectively drive learning while avoiding…

Machine Learning · Computer Science 2025-03-31 Rati Devidze

The use of mobile robots is being popular over the world mainly for autonomous explorations in hazardous/ toxic or unknown environments. This exploration will be more effective and efficient if the explorations in unknown environment can be…

Robotics · Computer Science 2011-10-11 Dip Narayan Ray , Somajyoti Majumder , Sumit Mukhopadhyay

Large Language Models (LLMs) have achieved considerable performance across various agentic planning tasks. However, traditional agent planning approaches adopt a "flood irrigation" methodology that indiscriminately injects gold…

Computation and Language · Computer Science 2025-05-30 Shuofei Qiao , Zhisong Qiu , Baochang Ren , Xiaobin Wang , Xiangyuan Ru , Ningyu Zhang , Xiang Chen , Yong Jiang , Pengjun Xie , Fei Huang , Huajun Chen

When learning to behave in a stochastic environment where safety is critical, such as driving a vehicle in traffic, it is natural for human drivers to plan fallback strategies as a backup to use if ever there is an unexpected change in the…

Machine Learning · Computer Science 2022-04-12 Ugo Lecerf , Christelle Yemdji-Tchassi , Sébastien Aubert , Pietro Michiardi

Solving a reinforcement learning problem typically involves correctly prespecifying the reward signal from which the algorithm learns. Here, we approach the problem of reward signal design by using an evolutionary approach to perform a…

Multiagent Systems · Computer Science 2021-05-19 Rafal Muszynski , Katja Hofmann , Jun Wang

Agents of general intelligence deployed in real-world scenarios must adapt to ever-changing environmental conditions. While such adaptive agents may leverage engineered knowledge, they will require the capacity to construct and evaluate…

Artificial Intelligence · Computer Science 2016-06-20 Craig Sherstan , Adam White , Marlos C. Machado , Patrick M. Pilarski

External knowledge has played a crucial role in the recent development of computer use agents. We identify a critical knowledge-execution gap: retrieved knowledge often fails to translate into effective real-world task execution. Our…

Human-Computer Interaction · Computer Science 2025-11-04 Ziyun Zhang , Xinyi Liu , Xiaoyi Zhang , Jun Wang , Gang Chen , Yan Lu

Both entropy-minimizing and entropy-maximizing (curiosity) objectives for unsupervised reinforcement learning (RL) have been shown to be effective in different environments, depending on the environment's level of natural entropy. However,…

Machine Learning · Computer Science 2024-08-19 Adriana Hugessen , Roger Creus Castanyer , Faisal Mohamed , Glen Berseth

Recent progress in multimodal large language models has led to strong performance on reasoning tasks, but these improvements largely rely on high-quality annotated data or teacher-model distillation, both of which are costly and difficult…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Zhengxian Wu , Kai Shi , Chuanrui Zhang , Zirui Liao , Jun Yang , Ni Yang , Qiuying Peng , Luyuan Zhang , Hangrui Xu , Tianhuang Su , Zhenyu Yang , Haonan Lu , Haoqian Wang

We introduce a novel co-design method for autonomous moving agents' shape attributes and locomotion by combining deep reinforcement learning and evolution with user control. Our main inspiration comes from evolution, which has led to wide…

Artificial Intelligence · Computer Science 2022-05-24 Zhiquan Wang , Bedrich Benes , Ahmed H. Qureshi , Christos Mousas

We propose a new method for training an agent via an evolutionary strategy (ES), in which we iteratively improve a set of samples to imitate: Starting with a random set, in every iteration we replace a subset of the samples with samples…

Neural and Evolutionary Computing · Computer Science 2020-09-18 Roy Eliya , J. Michael Herrmann

Autonomous vehicles with a self-evolving ability are expected to cope with unknown scenarios in the real-world environment. Take advantage of trial and error mechanism, reinforcement learning is able to self evolve by learning the optimal…

Robotics · Computer Science 2024-08-23 Shuo Yang , Liwen Wang , Yanjun Huang , Hong Chen