English
Related papers

Related papers: Deep Policies for Width-Based Planning in Pixel Do…

200 papers

We introduce a new approach for comparing reinforcement learning policies, using Wasserstein distances (WDs) in a newly defined latent behavioral space. We show that by utilizing the dual formulation of the WD, we can learn score functions…

Machine Learning · Computer Science 2020-03-05 Aldo Pacchiano , Jack Parker-Holder , Yunhao Tang , Anna Choromanska , Krzysztof Choromanski , Michael I. Jordan

Multi-Instance Learning (MIL) has shown impressive performance for histopathology whole slide image (WSI) analysis using bags or pseudo-bags. It involves instance sampling, feature representation, and decision-making. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Tingting Zheng , Kui Jiang , Hongxun Yao

Machine learning models trained on imbalanced datasets often exhibit intersectional biases-systematic errors arising from the interaction of multiple attributes such as object class and environmental conditions. This paper presents a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Farjana Yesmin

Separating an image into reflectance and shading layers poses a challenge for learning approaches because no large corpus of precise and realistic ground truth decompositions exists. The Intrinsic Images in the Wild~(IIW) dataset provides a…

Computer Vision and Pattern Recognition · Computer Science 2017-06-13 Thomas Nestmeyer , Peter V. Gehler

We study the infinite-horizon average-reward reinforcement learning (RL) for continuous space Lipschitz MDPs in which an agent can play policies from a given set $\Phi$. The proposed algorithms efficiently explore the policy space by…

Machine Learning · Computer Science 2025-11-18 Avik Kar , Rahul Singh

In deep reinforcement learning, policy optimization methods need to deal with issues such as function approximation and the reuse of off-policy data. Standard policy gradient methods do not handle off-policy data well, leading to premature…

Machine Learning · Computer Science 2025-01-28 Qing Wang , Yingru Li , Jiechao Xiong , Tong Zhang

Path planning is an active area of research essential for many applications in robotics. Popular techniques include graph-based searches and sampling-based planners. These approaches are powerful but have limitations. This paper continues…

Robotics · Computer Science 2020-12-10 Marlin P. Strub , Jonathan D. Gammell

On-policy deep reinforcement learning algorithms have low data utilization and require significant experience for policy improvement. This paper proposes a proximal policy optimization algorithm with prioritized trajectory replay (PTR-PPO)…

Machine Learning · Computer Science 2021-12-09 Xingxing Liang , Yang Ma , Yanghe Feng , Zhong Liu

Data augmentation is an effective technique for improving the accuracy of modern image classifiers. However, current data augmentation implementations are manually designed. In this paper, we describe a simple procedure called AutoAugment…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Ekin D. Cubuk , Barret Zoph , Dandelion Mane , Vijay Vasudevan , Quoc V. Le

High-resolution images are prevalent in various applications, such as autonomous driving and computer-aided diagnosis. However, training neural networks on such images is computationally challenging and easily leads to out-of-memory errors…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Benjamin Bergner , Christoph Lippert , Aravindh Mahendran

We propose a new sample-efficient methodology, called Supervised Policy Update (SPU), for deep reinforcement learning. Starting with data generated by the current policy, SPU formulates and solves a constrained optimization problem in the…

Machine Learning · Computer Science 2018-12-27 Quan Vuong , Yiming Zhang , Keith W. Ross

We introduce a novel policy learning method that integrates analytical gradients from differentiable environments with the Proximal Policy Optimization (PPO) algorithm. To incorporate analytical gradients into the PPO framework, we…

Machine Learning · Computer Science 2023-12-15 Sanghyun Son , Laura Yu Zheng , Ryan Sullivan , Yi-Ling Qiao , Ming C. Lin

For almost 70 years, researchers have typically selected the width of neural networks' layers either manually or through automated hyperparameter tuning methods such as grid search and, more recently, neural architecture search. This paper…

Machine Learning · Computer Science 2026-02-17 Federico Errica , Henrik Christiansen , Viktor Zaverkin , Mathias Niepert , Francesco Alesiani

Recent breakthroughs in Artificial Intelligence have shown that the combination of tree-based planning with deep learning can lead to superior performance. We present Adaptive Entropy Tree Search (ANTS) - a novel algorithm combining…

Artificial Intelligence · Computer Science 2023-03-16 Piotr Kozakowski , Mikołaj Pacek , Piotr Miłoś

Deep Reinforcement Learning (DRL) has been successfully applied in several research domains such as robot navigation and automated video game playing. However, these methods require excessive computation and interaction with the…

Machine Learning · Computer Science 2020-04-07 Ayberk Aydın , Elif Surer

We propose a physics-informed neural network policy iteration (PINN-PI) framework for solving stochastic optimal control problems governed by second-order Hamilton--Jacobi--Bellman (HJB) equations. At each iteration, a neural network is…

Machine Learning · Computer Science 2025-08-05 Yeongjong Kim , Yeoneung Kim , Minseok Kim , Namkyeong Cho

The famous Policy Iteration algorithm alternates between policy improvement and policy evaluation. Implementations of this algorithm with several variants of the latter evaluation stage, e.g, $n$-step and trace-based returns, have been…

Artificial Intelligence · Computer Science 2018-08-01 Yonathan Efroni , Gal Dalal , Bruno Scherrer , Shie Mannor

Current robotic planning methods often rely on predicting multi-frame images with full pixel details. While this fine-grained approach can serve as a generic world model, it introduces two significant challenges for downstream policy…

We present the first deep learning model to successfully learn control policies directly from high-dimensional sensory input using reinforcement learning. The model is a convolutional neural network, trained with a variant of Q-learning,…

Machine Learning · Computer Science 2013-12-20 Volodymyr Mnih , Koray Kavukcuoglu , David Silver , Alex Graves , Ioannis Antonoglou , Daan Wierstra , Martin Riedmiller

In imitation learning, it is common to learn a behavior policy to match an unknown target policy via max-likelihood training on a collected set of target demonstrations. In this work, we consider using offline experience datasets -…

Machine Learning · Computer Science 2021-10-11 Ofir Nachum , Mengjiao Yang