中文
相关论文

相关论文: Object-Aware Regularization for Addressing Causal …

200 篇论文

Offline Reinforcement Learning (RL) addresses the problem of sequential decision-making by learning optimal policy through pre-collected data, without interacting with the environment. As yet, it has remained somewhat impractical, because…

机器学习 · 计算机科学 2024-10-07 Maksim Bobrin , Nazar Buzun , Dmitrii Krylov , Dmitry V. Dylov

We propose Process-Aware Policy Optimization (PAPO), a method that integrates process-level evaluation into Group Relative Policy Optimization (GRPO) through decoupled advantage normalization, to address two limitations of existing reward…

Deep reinforcement learning agents frequently suffer from premature convergence, where early entropy collapse causes the policy to discard exploratory behaviors before discovering globally optimal strategies. We introduce Optimistic Policy…

机器学习 · 计算机科学 2026-03-10 Mai Pham , Vikrant Vaze , Peter Chin

Causal confusion is a phenomenon where an agent learns a policy that reflects imperfect spurious correlations in the data. Such a policy may falsely appear to be optimal during training if most of the training data contain such spurious…

机器学习 · 计算机科学 2023-12-29 Gunshi Gupta , Tim G. J. Rudner , Rowan Thomas McAllister , Adrien Gaidon , Yarin Gal

Learning complex manipulation tasks in realistic, obstructed environments is a challenging problem due to hard exploration in the presence of obstacles and high-dimensional visual observations. Prior work tackles the exploration problem by…

机器学习 · 计算机科学 2021-11-12 I-Chun Arthur Liu , Shagun Uppal , Gaurav S. Sukhatme , Joseph J. Lim , Peter Englert , Youngwoon Lee

We aim to enable robot to learn object manipulation by imitation. Given external observations of demonstrations on object manipulations, we believe that two underlying problems to address in learning by imitation is 1) segment a given…

机器人学 · 计算机科学 2017-11-21 Zhen Zeng , Benjamin Kuipers

Imitation learning holds tremendous promise in learning policies efficiently for complex decision making problems. Current state-of-the-art algorithms often use inverse reinforcement learning (IRL), where given a set of expert…

机器人学 · 计算机科学 2023-02-22 Siddhant Haldar , Vaibhav Mathur , Denis Yarats , Lerrel Pinto

Reinforcement learning (RL) agents have shown remarkable performances in various environments, where they can discover effective policies directly from sensory inputs. However, these agents often exploit spurious correlations in the…

Model overconfidence and poor calibration are common in machine learning and difficult to account for when applying standard empirical risk minimization. In this work, we propose a novel method to alleviate these problems that we call…

Current methods for end-to-end constructive neural combinatorial optimization usually train a policy using behavior cloning from expert solutions or policy gradient methods from reinforcement learning. While behavior cloning is…

机器学习 · 计算机科学 2024-11-05 Jonathan Pirnay , Dominik G. Grimm

We study ObjectGoal Navigation -- where a virtual robot situated in a new environment is asked to navigate to an object. Prior work has shown that imitation learning (IL) using behavior cloning (BC) on a dataset of human demonstrations…

机器学习 · 计算机科学 2023-03-28 Ram Ramrakhya , Dhruv Batra , Erik Wijmans , Abhishek Das

A core component of the recent success of self-supervised learning is cropping data augmentation, which selects sub-regions of an image to be used as positive views in the self-supervised loss. The underlying assumption is that randomly…

计算机视觉与模式识别 · 计算机科学 2023-04-10 Shlok Mishra , Anshul Shah , Ankan Bansal , Abhyuday Jagannatha , Janit Anjaria , Abhishek Sharma , David Jacobs , Dilip Krishnan

Imitation learning is the task of replicating expert policy from demonstrations, without access to a reward function. This task becomes particularly challenging when the expert exhibits a mixture of behaviors. Prior work has introduced…

机器学习 · 计算机科学 2022-05-10 Arash Vahabpour , Tianyi Wang , Qiujing Lu , Omead Pooladzandi , Vwani Roychowdhury

In this paper, we aim to utilize only offline trajectory data to train a policy for multi-objective RL. We extend the offline policy-regularized method, a widely-adopted approach for single-objective offline RL problems, into the…

机器学习 · 计算机科学 2024-01-05 Qian Lin , Chao Yu , Zongkai Liu , Zifan Wu

Reinforcement Learning (RL) in partially observable environments poses significant challenges due to the complexity of learning under uncertainty. While additional information, such as that available in simulations, can enhance training,…

机器学习 · 计算机科学 2026-03-16 Yueheng Li , Guangming Xie , Zongqing Lu

Despite recent advancements in computer vision research, object detection in aerial images still suffers from several challenges. One primary challenge to be mitigated is the presence of multiple types of variation in aerial images, for…

计算机视觉与模式识别 · 计算机科学 2025-05-30 Sungjune Park , Hyunjun Kim , Beomchan Park , Yong Man Ro

Imitation Learning from Observation (IfO) offers a powerful way to learn behaviors at large-scale: Unlike behavior cloning or offline reinforcement learning, IfO can leverage action-free demonstrations and thus circumvents the need for…

Accurately detecting active objects undergoing state changes is essential for comprehending human interactions and facilitating decision-making. The existing methods for active object detection (AOD) primarily rely on visual appearance of…

计算机视觉与模式识别 · 计算机科学 2024-05-22 Dejie Yang , Yang Liu

Recently, many researchers have attempted to improve deep learning-based object detection models, both in terms of accuracy and operational speeds. However, frequently, there is a trade-off between speed and accuracy of such models, which…

计算机视觉与模式识别 · 计算机科学 2020-12-03 Sannidhi P Kumar , Chandan Gautam , Suresh Sundaram

We present a predictor-corrector framework, called PicCoLO, that can transform a first-order model-free reinforcement or imitation learning algorithm into a new hybrid method that leverages predictive models to accelerate policy learning.…

机器学习 · 计算机科学 2019-05-28 Ching-An Cheng , Xinyan Yan , Nathan Ratliff , Byron Boots