English
Related papers

Related papers: Planning from Pixels in Atari with Learned Symboli…

200 papers

Visual coverage path planning with unmanned aerial vehicles (UAVs) requires agents to strategically coordinate UAV motion and camera control to maximize coverage, minimize redundancy, and maintain battery efficiency. Traditional…

Robotics · Computer Science 2025-07-15 Venkat Margapuri

In reinforcement learning, the advantage function is critical for policy improvement, but is often extracted from a learned Q-function. A natural question is: Why not learn the advantage function directly? In this work, we introduce…

Machine Learning · Computer Science 2024-09-04 Yunhao Tang , Rémi Munos , Mark Rowland , Michal Valko

Learning low-dimensional latent state space dynamics models has been a powerful paradigm for enabling vision-based planning and learning for control. We introduce a latent dynamics learning framework that is uniquely designed to induce…

Machine Learning · Computer Science 2021-04-28 Miguel Jaques , Michael Burke , Timothy Hospedales

Quality feature representation is key to instance image retrieval. To attain it, existing methods usually resort to a deep model pre-trained on benchmark datasets or even fine-tune the model with a task-dependent labelled auxiliary dataset.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 Zhongyan Zhang , Lei Wang , Yang Wang , Luping Zhou , Jianjia Zhang , Peng Wang , Fang Chen

Separating an image into reflectance and shading layers poses a challenge for learning approaches because no large corpus of precise and realistic ground truth decompositions exists. The Intrinsic Images in the Wild~(IIW) dataset provides a…

Computer Vision and Pattern Recognition · Computer Science 2017-06-13 Thomas Nestmeyer , Peter V. Gehler

Active learning for regression reduces labeling costs by selecting the most informative samples. Improved Greedy Sampling is a prominent method that balances feature-space diversity and output-space uncertainty using a static,…

Machine Learning · Statistics 2026-03-12 Simon D. Nguyen , Troy Russo , Kentaro Hoffman , Tyler H. McCormick

Vector-Quantized Variational Autoencoders (VQ-VAE)[1] provide an unsupervised model for learning discrete representations by combining vector quantization and autoencoders. In this paper, we study the use of VQ-VAE for representation…

Image and Video Processing · Electrical Eng. & Systems 2019-03-05 Hanwei Wu , Markus Flierl

In imitation learning, it is common to learn a behavior policy to match an unknown target policy via max-likelihood training on a collected set of target demonstrations. In this work, we consider using offline experience datasets -…

Machine Learning · Computer Science 2021-10-11 Ofir Nachum , Mengjiao Yang

We attack the problem of learning concepts automatically from noisy web image search results. Going beyond low level attributes, such as colour and texture, we explore weakly-labelled datasets for the learning of higher level concepts, such…

Computer Vision and Pattern Recognition · Computer Science 2013-12-17 Eren Golge , Pinar Duygulu

Learning image representations without human supervision is an important and active research field. Several recent approaches have successfully leveraged the idea of making such a representation invariant under different types of…

Computer Vision and Pattern Recognition · Computer Science 2021-11-01 Spyros Gidaris , Andrei Bursuc , Gilles Puy , Nikos Komodakis , Matthieu Cord , Patrick Pérez

Our aim is to learn to solve long-horizon decision-making problems in complex robotics domains given low-level skills and a handful of short-horizon demonstrations containing sequences of images. To this end, we focus on learning abstract…

Recent work in deep reinforcement learning has allowed algorithms to learn complex tasks such as Atari 2600 games just from the reward provided by the game, but these algorithms presently require millions of training steps in order to…

Machine Learning · Computer Science 2018-01-09 Benjamin Spector , Serge Belongie

We present an autoencoder that leverages learned representations to better measure similarities in data space. By combining a variational autoencoder with a generative adversarial network we can use learned feature representations in the…

Machine Learning · Computer Science 2016-02-12 Anders Boesen Lindbo Larsen , Søren Kaae Sønderby , Hugo Larochelle , Ole Winther

Learning models whose predictions are invariant under multiple environments is a promising approach for out-of-distribution generalization. Such models are trained to extract features $X_{\text{inv}}$ where the conditional distribution $Y…

Machine Learning · Computer Science 2024-07-29 Gina Wong , Joshua Gleason , Rama Chellappa , Yoav Wald , Anqi Liu

State-of-the-art Variational Auto-Encoders (VAEs) for learning disentangled latent representations give impressive results in discovering features like pitch, pause duration, and accent in speech data, leading to highly controllable…

Sound · Computer Science 2021-05-11 Shakti Kumar , Jithin Pradeep , Hussain Zaidi

Some of the most powerful reinforcement learning frameworks use planning for action selection. Interestingly, their planning horizon is either fixed or determined arbitrarily by the state visitation history. Here, we expand beyond the naive…

Machine Learning · Computer Science 2023-01-19 Aviv Rosenberg , Assaf Hallak , Shie Mannor , Gal Chechik , Gal Dalal

Options in reinforcement learning allow agents to hierarchically decompose a task into subtasks, having the potential to speed up learning and planning. However, autonomously learning effective sets of options is still a major challenge in…

Machine Learning · Computer Science 2018-02-27 Marlos C. Machado , Clemens Rosenbaum , Xiaoxiao Guo , Miao Liu , Gerald Tesauro , Murray Campbell

Visual imitation learning enables reinforcement learning agents to learn to behave from expert visual demonstrations such as videos or image sequences, without explicit, well-defined rewards. Previous research either adopted supervised…

Artificial Intelligence · Computer Science 2023-02-14 Minghuan Liu , Tairan He , Weinan Zhang , Shuicheng Yan , Zhongwen Xu

While Reinforcement Learning (RL) agents can successfully learn to handle complex tasks, effectively generalizing acquired skills to unfamiliar settings remains a challenge. One of the reasons behind this is the visual encoders used are…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Yuhan Zhang , Guoqing Ma , Guangfu Hao , Liangxuan Guo , Yang Chen , Shan Yu

Part-based image classification consists in representing categories by small sets of discriminative parts upon which a representation of the images is built. This paper addresses the question of how to automatically learn such parts from a…

Computer Vision and Pattern Recognition · Computer Science 2016-11-15 Ronan Sicre , Julien Rabin , Yannis Avrithis , Teddy Furon , Frederic Jurie