English
Related papers

Related papers: CODE-SHARP: Continuous Open-ended Discovery and Ev…

200 papers

While recent progress in deep reinforcement learning has enabled robots to learn complex behaviors, tasks with long horizons and sparse rewards remain an ongoing challenge. In this work, we propose an effective reward shaping method through…

Machine Learning · Computer Science 2020-08-04 Xingyu Lu , Stas Tiomkin , Pieter Abbeel

Exploration in environments with sparse rewards has been a persistent problem in reinforcement learning (RL). Many tasks are natural to specify with a sparse reward, and manually shaping a reward function can result in suboptimal…

Machine Learning · Computer Science 2018-02-27 Ashvin Nair , Bob McGrew , Marcin Andrychowicz , Wojciech Zaremba , Pieter Abbeel

Models capable of "thinking with images" by dynamically grounding their reasoning in visual evidence represent a major leap in multimodal AI. However, replicating and advancing this ability is non-trivial, with current methods often trapped…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Zhaoyang Wei , Wenchao Ding , Yanchao Hao , Xi Chen

Learning from experience is critical for building capable large language model (LLM) agents, yet prevailing self-evolving paradigms remain inefficient: agents learn in isolation, repeatedly rediscover similar behaviors from limited…

Computation and Language · Computer Science 2026-04-21 Chenxi Wang , Zhuoyun Yu , Xin Xie , Wuguannan Yao , Runnan Fang , Shuofei Qiao , Kexin Cao , Guozhou Zheng , Xiang Qi , Peng Zhang , Shumin Deng

There is a growing desire to create computer systems that can communicate effectively to collaborate with humans on complex, open-ended activities. Assessing these systems presents significant challenges. We describe a framework for…

Reinforcement Learning with Human Feedback (RLHF) has proven effective in image generation field guided by reward models to align human preferences. Motivated by this, adapting RLHF for Image Super-Resolution (ISR) tasks has shown promise…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Yidi Liu , Zihao Fan , Jie Huang , Jie Xiao , Dong Li , Wenlong Zhang , Lei Bai , Xueyang Fu , Zheng-Jun Zha

Reward machines (RMs) are a recent formalism for representing the reward function of a reinforcement learning task through a finite-state machine whose edges encode subgoals of the task using high-level events. The structure of RMs enables…

Machine Learning · Computer Science 2023-06-06 Daniel Furelos-Blanco , Mark Law , Anders Jonsson , Krysia Broda , Alessandra Russo

Large Reasoning Models (LRMs) have demonstrated impressive capabilities but suffer from cognitive inefficiencies like "overthinking" simple problems and "underthinking" complex ones. While existing methods that use supervised fine-tuning…

Artificial Intelligence · Computer Science 2026-03-24 Tian Liang , Wenxiang Jiao , Zhiwei He , Jiahao Xu , Haitao Mi , Dong Yu

Reinforcement learning algorithms are defined by their learning update rules, which are typically hand-designed and fixed. We present an evolutionary framework for discovering reinforcement learning algorithms by searching directly over…

Machine Learning · Computer Science 2026-03-31 Alkis Sygkounas , Amy Loutfi , Andreas Persson

Large Reasoning Models (LRMs) have shown remarkable capabilities in solving complex problems through reinforcement learning (RL), particularly by generating long reasoning traces. However, these extended outputs often exhibit substantial…

Computation and Language · Computer Science 2025-05-22 Wei Liu , Ruochen Zhou , Yiyun Deng , Yuzhen Huang , Junteng Liu , Yuntian Deng , Yizhe Zhang , Junxian He

As artificial intelligence engineering paradigms shift from single-agent Prompt and Context Engineering toward multi-agent \textbf{Coordination Engineering}, the ability to codify and systematically improve how multiple agents collaborate…

Computation and Language · Computer Science 2026-05-18 Xinyu Zhang , Zhicheng Dou , Deyang Li , Jianjun Tao , Shuo Cheng , Ruifeng Shi , Fangchao Liu , Enrui Hu , Yangkai Ding , Hongbo Wang , Qi Ye , Xuefeng Jin , Zhangchun Zhao

Recent advancements in reasoning-focused language models such as OpenAI's O1 and DeepSeek-R1 have shown that scaling test-time computation-through chain-of-thought reasoning and iterative exploration-can yield substantial improvements on…

In inaccessible environments with uncertain task demands, robots often rely on general-purpose tools that lack predefined usage strategies. These tools are not tailored for particular operations, making their longevity highly sensitive to…

Robotics · Computer Science 2025-07-28 Po-Yen Wu , Cheng-Yu Kuo , Yuki Kadokawa , Takamitsu Matsubara

Current AI agents can flexibly invoke tools and execute complex tasks, yet their long-term advancement is hindered by the lack of systematic accumulation and transfer of skills. Without a unified mechanism for skill consolidation, agents…

Scalar reward models compress multi-dimensional human preferences into a single opaque score, creating an information bottleneck that often leads to brittleness and reward hacking in open-ended alignment. We argue that robust alignment for…

Computation and Language · Computer Science 2026-03-02 Ruipeng Jia , Yunyi Yang , Yuxin Wu , Yongbo Gai , Siyuan Tao , Mengyu Zhou , Jianhe Lin , Xiaoxi Jiang , Guanjun Jiang

We present HiDe, a novel hierarchical reinforcement learning architecture that successfully solves long horizon control tasks and generalizes to unseen test scenarios. Functional decomposition between planning and low-level control is…

Machine Learning · Computer Science 2021-10-08 Sammy Christen , Lukas Jendele , Emre Aksan , Otmar Hilliges

The use of skills (a.k.a., options) can greatly accelerate exploration in reinforcement learning, especially when only sparse reward signals are available. While option discovery methods have been proposed for individual agents, in…

Machine Learning · Computer Science 2023-09-22 Jiayu Chen , Marina Haliem , Tian Lan , Vaneet Aggarwal

When a person is not satisfied with how a robot performs a task, they can intervene to correct it. Reward learning methods enable the robot to adapt its reward function online based on such human input, but they rely on handcrafted…

Robotics · Computer Science 2021-01-13 Andreea Bobu , Marius Wiggert , Claire Tomlin , Anca D. Dragan

Large language models (LLMs) are moving beyond static uses and are now powering agents that learn continually during their interaction with external environments. For example, agents can learn reusable skills while navigating web pages or…

Computation and Language · Computer Science 2026-03-03 Simon Yu , Gang Li , Weiyan Shi , Peng Qi

Multi-Agent Reinforcement Learning (MARL) provides a powerful framework for learning coordination in multi-agent systems. However, applying MARL to robotics still remains challenging due to high-dimensional continuous joint action spaces,…

Robotics · Computer Science 2025-10-03 Seoyeon Choi , Kanghyun Ryu , Jonghoon Ock , Negar Mehr