English
Related papers

Related papers: DreamerV3-XP: Optimizing exploration through uncer…

200 papers

With the advancement of interactive video generation, diffusion models have increasingly demonstrated their potential as world models. However, existing approaches still struggle to simultaneously achieve memory-enabled long-term temporal…

We are witnessing an explosion of neural implicit representations in computer vision and graphics. Their applicability has recently expanded beyond tasks such as shape generation and image-based rendering to the fundamental problem of…

Computer Vision and Pattern Recognition · Computer Science 2022-05-26 Jiaming Sun , Xi Chen , Qianqian Wang , Zhengqi Li , Hadar Averbuch-Elor , Xiaowei Zhou , Noah Snavely

Hindsight Experience Replay (HER) is a multi-goal reinforcement learning algorithm for sparse reward functions. The algorithm treats every failure as a success for an alternative (virtual) goal that has been achieved in the episode. Virtual…

Machine Learning · Computer Science 2021-03-09 Binyamin Manela , Armin Biess

This paper presents enhancements to the projection pursuit tree classifier and visual diagnostic methods for assessing their impact in high dimensions. The original algorithm uses linear combinations of variables in a tree structure where…

Machine Learning · Statistics 2026-03-16 Natalia da Silva , Dianne Cook , Eun-Kyung Lee

Solving multi-goal reinforcement learning (RL) problems with sparse rewards is generally challenging. Existing approaches have utilized goal relabeling on collected experiences to alleviate issues raised from sparse rewards. However, these…

Machine Learning · Computer Science 2021-11-30 Rui Yang , Meng Fang , Lei Han , Yali Du , Feng Luo , Xiu Li

Feature Transformation is crucial for classic machine learning that aims to generate feature combinations to enhance the performance of downstream tasks from a data-centric perspective. Current methodologies, such as manual expert-driven…

Machine Learning · Computer Science 2025-03-27 Tianqi He , Xiaohan Huang , Yi Du , Qingqing Long , Ziyue Qiao , Min Wu , Yanjie Fu , Yuanchun Zhou , Meng Xiao

Generating 3D worlds from text is a highly anticipated goal in computer vision. Existing works are limited by the degree of exploration they allow inside of a scene, i.e., produce streched-out and noisy artifacts when moving beyond central…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Manuel-Andreas Schneider , Lukas Höllein , Matthias Nießner

We study repeated multi-player vector-valued games in which a player observes a payoff vector each round and evaluates outcomes through linear scalarizations of those vectors. Different from most prior works, the choice of scalarization is…

Computer Science and Game Theory · Computer Science 2026-05-12 Ehsan Asadollahi , Calvin Hawkins , Matthew Hale

One of the most critical challenges in deep reinforcement learning is to maintain the long-term exploration capability of the agent. To tackle this problem, it has been recently proposed to provide intrinsic rewards for the agent to…

Machine Learning · Computer Science 2022-06-02 Mingqi Yuan , Man-on Pun , Dong Wang

Visual place recognition (VPR) is an essential component of many autonomous and augmented/virtual reality systems. It enables the systems to robustly localize themselves in large-scale environments. Existing VPR methods demonstrate…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Yuhang Ming , Minyang Xu , Xingrui Yang , Weicai Ye , Weihan Wang , Yong Peng , Weichen Dai , Wanzeng Kong

We present BYOL-Explore, a conceptually simple yet general approach for curiosity-driven exploration in visually-complex environments. BYOL-Explore learns a world representation, the world dynamics, and an exploration policy all-together by…

Reinforcement learning has enabled agents to solve challenging tasks in unknown environments. However, manually crafting reward functions can be time consuming, expensive, and error prone to human error. Competing objectives have been…

Machine Learning · Computer Science 2021-02-11 Brendon Matusch , Jimmy Ba , Danijar Hafner

This paper describes an improvement in Deep Q-learning called Reverse Experience Replay (also RER) that solves the problem of sparse rewards and helps to deal with reward maximizing tasks by sampling transitions successively in reverse…

Machine Learning · Computer Science 2019-10-24 Egor Rotinov

3D open-world environments with adversarial opponents remain a core challenge for reinforcement learning due to their vast state spaces. Effective reasoning representations are essential in such settings. While existing self-supervised…

Artificial Intelligence · Computer Science 2026-05-26 Yuanfei Xu , Lin Liu , Wengang Zhou , Mingxiao Feng , Houqiang Li

Posterior sampling for reinforcement learning (PSRL) is an effective method for balancing exploration and exploitation in reinforcement learning. Randomised value functions (RVF) can be viewed as a promising approach to scaling PSRL.…

This paper investigates the automatic exploration problem under the unknown environment, which is the key point of applying the robotic system to some social tasks. The solution to this problem via stacking decision rules is impossible to…

Robotics · Computer Science 2020-07-24 Haoran Li , Qichao Zhang , Dongbin Zhao

Solving a reinforcement learning problem typically involves correctly prespecifying the reward signal from which the algorithm learns. Here, we approach the problem of reward signal design by using an evolutionary approach to perform a…

Multiagent Systems · Computer Science 2021-05-19 Rafal Muszynski , Katja Hofmann , Jun Wang

In this work, we consider the problem of autonomous exploration in search of targets while respecting a fixed energy budget. The robot is equipped with an incremental-resolution symbolic perception module wherein the perception of targets…

Robotics · Computer Science 2023-09-15 Disha Kamale , Sofie Haesaert , Cristian-Ioan Vasile

In this paper, we address the problem of autonomous exploration of unknown environments with an aerial robot equipped with a sensory set that produces large point clouds, such as LiDARs. The main goal is to gradually explore an area while…

Robotics · Computer Science 2021-09-21 Ana Batinovic , Antun Ivanovic , Tamara Petrovic , Stjepan Bogdan

Reinforcement learning (RL) systems typically optimize scalar reward functions that assume precise and reliable evaluation of outcomes. However, real-world objectives--especially those derived from human preferences--are often uncertain,…

Machine Learning · Computer Science 2026-04-30 Disha Singha