English
Related papers

Related papers: Deep Policies for Width-Based Planning in Pixel Do…

200 papers

We present a new class of structured reinforcement learning policy-architectures, Implicit Two-Tower (ITT) policies, where the actions are chosen based on the attention scores of their learnable latent representations with those of the…

Machine Learning · Computer Science 2023-10-26 Yunfan Zhao , Qingkai Pan , Krzysztof Choromanski , Deepali Jain , Vikas Sindhwani

Guiding off-screen points of interest (POIs) is a practical way of providing additional information to users of small-screen devices, such as smart devices and head-mounted displays. Popular previous methods involve displaying a primitive…

Human-Computer Interaction · Computer Science 2022-06-10 Shoki Miyagawa

Spectral bias, the tendency of neural networks to learn low-frequency features first, is a well-known issue with many training algorithms for physics-informed neural networks (PINNs). To overcome this issue, we propose IFeF-PINN, an…

Machine Learning · Computer Science 2025-10-23 Yulun Wu , Miguel Aguiar , Karl H. Johansson , Matthieu Barreau

We present a new approach to the problems of evaluating and learning personalized decision policies from observational data of past contexts, decisions, and outcomes. Only the outcome of the enacted decision is available and the historical…

Machine Learning · Statistics 2019-06-04 Nathan Kallus

One promising approach towards effective robot decision making in complex, long-horizon tasks is to sequence together parameterized skills. We consider a setting where a robot is initially equipped with (1) a library of parameterized…

Reinforcement learning has received high research interest for developing planning approaches in automated driving. Most prior works consider the end-to-end planning task that yields direct control commands and rarely deploy their algorithm…

Robotics · Computer Science 2023-07-31 Marvin Klimke , Benjamin Völz , Michael Buchholz

The robustness of visual navigation policies trained through imitation often hinges on the augmentation of the training image-action pairs. Traditionally, this has been done by collecting data from multiple cameras, by using standard data…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Dhruv Sharma , Alihusein Kuwajerwala , Florian Shkurti

Data augmentation methods are indispensable heuristics to boost the performance of deep neural networks, especially in image recognition tasks. Recently, several studies have shown that augmentation strategies found by search algorithms…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Ryuichiro Hataya , Jan Zdenek , Kazuki Yoshizoe , Hideki Nakayama

The rising growth of deep neural networks (DNNs) and datasets in size motivates the need for efficient solutions for simultaneous model selection and training. Many methods for hyperparameter optimization (HPO) of iterative learners,…

Machine Learning · Computer Science 2023-02-28 Syrine Belakaria , Janardhan Rao Doppa , Nicolo Fusi , Rishit Sheth

Diffusion weighted imaging techniques permit us to infer microstructural detail in biological tissue in vivo and noninvasively. Modern sequences are based on advanced diffusion encoding schemes, allowing probing of more revealing measures…

Path planning is an important topic in robotics. Recently, value iteration based deep learning models have achieved good performance such as Value Iteration Network(VIN). However, previous methods suffer from slow convergence and low…

Robotics · Computer Science 2021-04-30 Buqing Nie , Yue Gao , Yidong Mei , Feng Gao

Self-play fine-tuning enables large language models to improve beyond supervised fine-tuning without additional human annotations by contrasting annotated responses with self-generated ones. Many existing methods rely on a fixed divergence…

Machine Learning · Computer Science 2026-04-24 Wenjie Liao , Like Wu , Liangjie Zhao , Shihui Xu , Shigeru Fujimura

The explosion in mobile data traffic together with the ever-increasing expectations for higher quality of service call for the development of AI algorithms for wireless network optimization. In this paper, we investigate how to learn…

Artificial Intelligence · Computer Science 2021-11-17 Miguel Suau , Alexandros Agapitos , David Lynch , Derek Farrell , Mingqi Zhou , Aleksandar Milenovic

A key task in Artificial Intelligence is learning effective policies for controlling agents in unknown environments to optimize performance measures. Off-policy learning methods, like Q-learning, allow learners to make optimal decisions…

Artificial Intelligence · Computer Science 2025-09-10 Mingxuan Li , Junzhe Zhang , Elias Bareinboim

Model-based reinforcement learning (RL) can be effectively supported at scale through the use of world models. However, in practice, scaling such approaches remains fundamentally limited. A commonly recognized challenge is model bias and…

Machine Learning · Computer Science 2026-05-27 Xiaoyuan Cheng , Wenxuan Yuan , Zhancun Mu , Yuanzhao Zhang , Yiming Yang , Hai Wang , Zhuo Sun , Che Liu

The ability to transfer a policy from one environment to another is a promising avenue for efficient robot learning in realistic settings where task supervision is not available. This can allow us to take advantage of environments well…

Robotics · Computer Science 2021-07-02 Grace Zhang , Linghan Zhong , Youngwoon Lee , Joseph J. Lim

Approximate linear programming (ALP) represents one of the major algorithmic families to solve large-scale Markov decision processes (MDP). In this work, we study a primal-dual formulation of the ALP, and develop a scalable, model-free…

Machine Learning · Computer Science 2018-04-30 Yichen Chen , Lihong Li , Mengdi Wang

We consider the problem of learning an $\varepsilon$-optimal policy in controlled dynamical systems with low-rank latent structure. For this problem, we present LoRa-PI (Low-Rank Policy Iteration), a model-free learning algorithm…

Machine Learning · Computer Science 2024-11-12 Stefan Stojanovic , Yassir Jedra , Alexandre Proutiere

Is it possible to make online decisions when personalized covariates are unavailable? We take a collaborative-filtering approach for decision-making based on collective preferences. By assuming low-dimensional latent features, we formulate…

Machine Learning · Statistics 2024-12-20 Congyuan Duan , Jingyang Li , Dong Xia

This work aims at solving the problems with intractable sparsity-inducing norms that are often encountered in various machine learning tasks, such as multi-task learning, subspace clustering, feature selection, robust principal component…

Machine Learning · Computer Science 2019-07-03 Feiping Nie , Zhanxuan Hu , Xiaoqian Wang , Rong Wang , Xuelong Li , Heng Huang