English
Related papers

Related papers: DreamerV3-XP: Optimizing exploration through uncer…

200 papers

Numerous machine learning problems require an exploration basis - a mechanism to explore the action space. We define a novel geometric notion of exploration basis with low variance, called volumetric spanners, and give efficient algorithms…

Machine Learning · Computer Science 2014-05-27 Elad Hazan , Zohar Karnin , Raghu Mehka

Reinforcement Learning from Verifiable Rewards (RLVR) improves the reasoning abilities of Large Language Models (LLMs) but it struggles with unstable exploration. We propose FR3E (First Return, Entropy-Eliciting Explore), a structured…

Artificial Intelligence · Computer Science 2025-07-10 Tianyu Zheng , Tianshun Xing , Qingshui Gu , Taoran Liang , Xingwei Qu , Xin Zhou , Yizhi Li , Zhoufutu Wen , Chenghua Lin , Wenhao Huang , Qian Liu , Ge Zhang , Zejun Ma

Learned world models summarize an agent's experience to facilitate learning complex behaviors. While learning world models from high-dimensional sensory inputs is becoming feasible through deep learning, there are many potential ways for…

Machine Learning · Computer Science 2020-03-18 Danijar Hafner , Timothy Lillicrap , Jimmy Ba , Mohammad Norouzi

Numerous real-world control problems involve dynamics and objectives affected by unobservable hidden parameters, ranging from autonomous driving to robotic manipulation, which cause performance degradation during sim-to-real transfer. To…

Robotics · Computer Science 2025-02-19 Morgan Byrd , Jackson Crandell , Mili Das , Jessica Inman , Robert Wright , Sehoon Ha

This work pushes the boundaries of learning-based methods in autonomous robot exploration in terms of environmental scale and exploration efficiency. We present HEADER, an attention-based reinforcement learning approach with hierarchical…

Robotics · Computer Science 2025-10-20 Yuhong Cao , Yizhuo Wang , Jingsong Liang , Shuhao Liao , Yifeng Zhang , Peizhuo Li , Guillaume Sartoretti

We present MEM: Multi-view Exploration Maximization for tackling complex visual control tasks. To the best of our knowledge, MEM is the first approach that combines multi-view representation learning and intrinsic reward-driven exploration…

Machine Learning · Computer Science 2022-11-29 Mingqi Yuan , Xin Jin , Bo Li , Wenjun Zeng

Efficient exploration remains a challenging problem in reinforcement learning, especially for tasks where extrinsic rewards from environments are sparse or even totally disregarded. Significant advances based on intrinsic motivation show…

Machine Learning · Computer Science 2024-04-03 Chenjia Bai , Peng Liu , Kaiyu Liu , Lingxiao Wang , Yingnan Zhao , Lei Han

Top-performing Model-Based Reinforcement Learning (MBRL) agents, such as Dreamer, learn the world model by reconstructing the image observations. Hence, they often fail to discard task-irrelevant details and struggle to handle visual…

Machine Learning · Computer Science 2021-10-28 Fei Deng , Ingook Jang , Sungjin Ahn

Uncertainty is widely acknowledged as an engaging gameplay element but rarely used in exergames. In this research, we explore the role of uncertainty in exergames and introduce three uncertain elements (false-attacks, misses, and critical…

Human-Computer Interaction · Computer Science 2021-01-18 Wenge Xu , Hai-Ning Liang , Kangyou Yu , Nilufar Baghaei

In the realm of multi-agent reinforcement learning, intrinsic motivations have emerged as a pivotal tool for exploration. While the computation of many intrinsic rewards relies on estimating variational posteriors using neural network…

Machine Learning · Computer Science 2023-08-22 Chenghao Li , Tonghan Wang , Chongjie Zhang , Qianchuan Zhao

Vision-to-code tasks require models to reconstruct structured visual inputs, such as charts, tables, and SVGs, into executable or structured representations with high visual fidelity. While recent Large Vision Language Models (LVLMs)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Ziyu Liu , Shengyuan Ding , Xinyu Fang , Xuanlang Dai , Penghui Yang , Jianze Liang , Jiaqi Wang , Kai Chen , Dahua Lin , Yuhang Zang

With high-dimensional state spaces, visual reinforcement learning (RL) faces significant challenges in exploitation and exploration, resulting in low sample efficiency and training stability. As a time-efficient diffusion model, although…

Machine Learning · Computer Science 2024-10-30 Haoran Li , Zhennan Jiang , Yuhui Chen , Dongbin Zhao

3D object detection is an essential task for computer vision applications in autonomous vehicles and robotics. However, models often struggle to quantify detection reliability, leading to poor performance on unfamiliar scenes. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Nikita Durasov , Rafid Mahmood , Jiwoong Choi , Marc T. Law , James Lucas , Pascal Fua , Jose M. Alvarez

Experience replay is widely used to improve learning efficiency in reinforcement learning by leveraging past experiences. However, existing experience replay methods, whether based on uniform or prioritized sampling, often suffer from low…

Machine Learning · Computer Science 2025-05-20 Kaiyan Zhao , Yiming Wang , Yuyang Chen , Yan Li , Leong Hou U , Xiaoguang Niu

Recently, various pre-training methods have been introduced in vision-based Reinforcement Learning (RL). However, their generalization ability remains unclear due to evaluations being limited to in-distribution environments and non-unified…

Machine Learning · Computer Science 2024-06-11 Donghu Kim , Hojoon Lee , Kyungmin Lee , Dongyoon Hwang , Jaegul Choo

Human environments are often regulated by explicit and complex rulesets. Integrating Reinforcement Learning (RL) agents into such environments motivates the development of learning mechanisms that perform well in rule-dense and…

Machine Learning · Computer Science 2022-01-20 Francesco Sovrano , Alex Raymond , Amanda Prorok

Recent model-free reinforcement learning algorithms have proposed incorporating learned dynamics models as a source of additional data with the intention of reducing sample complexity. Such methods hold the promise of incorporating imagined…

Machine Learning · Computer Science 2018-03-02 Vladimir Feinberg , Alvin Wan , Ion Stoica , Michael I. Jordan , Joseph E. Gonzalez , Sergey Levine

Several algorithms have been proposed to sample non-uniformly the replay buffer of deep Reinforcement Learning (RL) agents to speed-up learning, but very few theoretical foundations of these sampling schemes have been provided. Among…

Machine Learning · Computer Science 2022-06-15 Thibault Lahire , Matthieu Geist , Emmanuel Rachelson

Fine-tuning text-to-image diffusion models to maximize rewards has proven effective for enhancing model performance. However, reward fine-tuning methods often suffer from slow convergence due to online sample generation. Therefore,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Daewon Chae , June Suk Choi , Jinkyu Kim , Kimin Lee

While Reinforcement Learning with Verifiable Rewards (RLVR) is effective for deterministically checkable tasks, many vision-language tasks are partially verifiable, demanding multi-criteria supervision (e.g., perceptual details, reasoning…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Ya-Qi Yu , Hao Wang , Fangyu Hong , Xiangyang Qu , Gaojie Wu , Qiaoyu Luo , Nuo Xu , Huixin Wang , Wuheng Xu , Yongxin Liao , Zihao Chen , Haonan Li , Ziming Li , Dezhi Peng , Minghui Liao , Jihao Wu , Haoyu Ren , Dandan Tu
‹ Prev 1 4 5 6 7 8 10 Next ›