English
Related papers

Related papers: Accelerating Representation Learning with View-Con…

200 papers

In reinforcement learning algorithms, it is a common practice to account for only a single view of the environment to make the desired decisions; however, utilizing multiple views of the environment can help to promote the learning of…

Machine Learning · Computer Science 2019-05-13 Elaheh Barati , Xuewen Chen , Zichun Zhong

Recently, many reinforcement learning techniques were shown to have provable guarantees in the simple case of linear dynamics, especially in problems like linear quadratic regulators. However, in practice, many reinforcement learning…

Machine Learning · Computer Science 2020-06-30 Abraham Frandsen , Rong Ge

Learned representations of dynamical systems reduce dimensionality, potentially supporting downstream reinforcement learning (RL). However, no established methods predict a representation's suitability for control and evaluation is largely…

Machine Learning · Computer Science 2020-11-25 Kevin Haninger , Raul Vicente Garcia , Joerg Krueger

In visual Reinforcement Learning (RL), learning from pixel-based observations poses significant challenges on sample efficiency, primarily due to the complexity of extracting informative state representations from high-dimensional data.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Jiarui Sun , M. Ugur Akcal , Wei Zhang , Girish Chowdhary

Many control tasks exhibit similar dynamics that can be modeled as having common latent structure. Hidden-Parameter Markov Decision Processes (HiP-MDPs) explicitly model this structure to improve sample efficiency in multi-task settings.…

Machine Learning · Computer Science 2021-02-15 Amy Zhang , Shagun Sodhani , Khimya Khetarpal , Joelle Pineau

Unmanned aerial vehicles (UAVs) have been widely used in military warfare. In this paper, we formulate the autonomous motion control (AMC) problem as a Markov decision process (MDP) and propose an advanced deep reinforcement learning (DRL)…

Artificial Intelligence · Computer Science 2022-07-05 Zijian Hu , Xiaoguang Gao , Kaifang Wan , Qianglong Wang , Yiwei Zhai

Continuous state spaces and stochastic, switching dynamics characterize a number of rich, realworld domains, such as robot navigation across varying terrain. We describe a reinforcementlearning algorithm for learning in these domains and…

Machine Learning · Computer Science 2012-06-18 Emma Brunskill , Bethany Leffler , Lihong Li , Michael L. Littman , Nicholas Roy

Markov Decision Processes (MDPs), the mathematical framework underlying most algorithms in Reinforcement Learning (RL), are often used in a way that wrongfully assumes that the state of an agent's environment does not change during action…

Machine Learning · Computer Science 2019-12-13 Simon Ramstedt , Christopher Pal

Despite recent progress in reinforcement learning (RL) from raw pixel data, sample inefficiency continues to present a substantial obstacle. Prior works have attempted to address this challenge by creating self-supervised auxiliary tasks,…

Machine Learning · Computer Science 2024-05-27 Ruijie Zheng , Xiyao Wang , Yanchao Sun , Shuang Ma , Jieyu Zhao , Huazhe Xu , Hal Daumé , Furong Huang

To overcome the curses of dimensionality and modeling of Dynamic Programming (DP) methods to solve Markov Decision Process (MDP) problems, Reinforcement Learning (RL) methods are adopted in practice. Contrary to traditional RL algorithms…

Machine Learning · Computer Science 2021-08-24 Arghyadip Roy , Vivek Borkar , Abhay Karandikar , Prasanna Chaporkar

To achieve robustness in Re-Identification, standard methods leverage tracking information in a Video-To-Video fashion. However, these solutions face a large drop in performance for single image queries (e.g., Image-To-Video setting).…

Computer Vision and Pattern Recognition · Computer Science 2020-07-09 Angelo Porrello , Luca Bergamini , Simone Calderara

We propose an approach to self-supervised representation learning based on maximizing mutual information between features extracted from multiple views of a shared context. For example, one could produce multiple views of a local…

Machine Learning · Computer Science 2019-07-09 Philip Bachman , R Devon Hjelm , William Buchwalter

This paper develops an inherently parallelised, fast, approximate learning-based solution to the generic class of Capacitated Vehicle Routing Problems with Time Windows and Dynamic Routing (CVRP-TWDR). Considering vehicles in a fleet as…

Artificial Intelligence · Computer Science 2021-04-15 Nazneen N Sultana , Vinita Baniwal , Ansuma Basumatary , Piyush Mittal , Supratim Ghosh , Harshad Khadilkar

Visual model-based reinforcement learning (RL) has the potential to enable sample-efficient robot learning from visual observations. Yet the current approaches typically train a single model end-to-end for learning both visual…

Robotics · Computer Science 2023-05-30 Younggyo Seo , Danijar Hafner , Hao Liu , Fangchen Liu , Stephen James , Kimin Lee , Pieter Abbeel

We study the design of sample-efficient algorithms for reinforcement learning in the presence of rich, high-dimensional observations, formalized via the Block MDP problem. Existing algorithms suffer from either 1) computational…

Machine Learning · Computer Science 2023-04-13 Zakaria Mhammedi , Dylan J. Foster , Alexander Rakhlin

Visual representation is crucial for a visual tracking method's performances. Conventionally, visual representations adopted in visual tracking rely on hand-crafted computer vision descriptors. These descriptors were developed generically…

Computer Vision and Pattern Recognition · Computer Science 2016-04-15 Jason Kuen , Kian Ming Lim , Chin Poo Lee

We consider a reinforcement learning setting introduced in (Maillard et al., NIPS 2011) where the learner does not have explicit access to the states of the underlying Markov decision process (MDP). Instead, she has access to several models…

Machine Learning · Computer Science 2014-09-16 Ronald Ortner , Odalric-Ambrym Maillard , Daniil Ryabko

In reinforcement learning algorithms, leveraging multiple views of the environment can improve the learning of complicated policies. In multi-view environments, due to the fact that the views may frequently suffer from partial…

Machine Learning · Computer Science 2019-07-24 Elaheh Barati , Xuewen Chen

\emph{Objective and Impact Statement}. With the renaissance of deep learning, automatic diagnostic systems for computed tomography (CT) have achieved many successful applications. However, they are mostly attributed to careful expert…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Penghua Zhai , Huaiwei Cong , Gangming Zhao , Chaowei Fang , Jinpeng Li , Ting Cai , Huiguang He

We present a representation learning algorithm that learns a low-dimensional latent dynamical system from high-dimensional \textit{sequential} raw data, e.g., video. The framework builds upon recent advances in amortized inference methods…

Machine Learning · Computer Science 2020-01-29 Jung-Su Ha , Young-Jin Park , Hyeok-Joo Chae , Soon-Seo Park , Han-Lim Choi