English
Related papers

Related papers: Measuring Visual Generalization in Continuous Cont…

200 papers

Deep learning (DL) algorithms have shown significant performance in various computer vision tasks. However, having limited labelled data lead to a network overfitting problem, where network performance is bad on unseen data as compared to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Teerath Kumar , Alessandra Mileo , Rob Brennan , Malika Bendechache

Deep artificial neural networks require a large corpus of training data in order to effectively learn, where collection of such training data is often expensive and laborious. Data augmentation overcomes this issue by artificially inflating…

Machine Learning · Computer Science 2017-08-22 Luke Taylor , Geoff Nitschke

Deep reinforcement learning (RL) agents trained in a limited set of environments tend to suffer overfitting and fail to generalize to unseen testing environments. To improve their generalizability, data augmentation approaches (e.g. cutout…

Machine Learning · Computer Science 2020-10-22 Kaixin Wang , Bingyi Kang , Jie Shao , Jiashi Feng

One of the most challenging aspects of real-world reinforcement learning (RL) is the multitude of unpredictable and ever-changing distractions that could divert an agent from what was tasked to do in its training environment. While an agent…

Machine Learning · Computer Science 2020-11-17 Cristian Bodnar , Karol Hausman , Gabriel Dulac-Arnold , Rico Jonschkowski

Because imitation learning relies on human demonstrations in hard-to-simulate settings, the inclusion of force control in this method has resulted in a shortage of training data, even with a simple change in speed. Although the field of…

Robotics · Computer Science 2025-05-07 Nozomu Masuya , Hiroshi Sato , Koki Yamane , Takuya Kusume , Sho Sakaino , Toshiaki Tsuji

We investigate using reinforcement learning agents as generative models of images (extending arXiv:1804.01118). A generative agent controls a simulated painting environment, and is trained with rewards provided by a discriminator network…

Computer Vision and Pattern Recognition · Computer Science 2019-10-03 John F. J. Mellor , Eunbyung Park , Yaroslav Ganin , Igor Babuschkin , Tejas Kulkarni , Dan Rosenbaum , Andy Ballard , Theophane Weber , Oriol Vinyals , S. M. Ali Eslami

Graphical perception studies typically measure visualization encoding effectiveness using the error of an "average observer", leading to canonical rankings of encodings for numerical attributes: e.g., position > area > angle > volume. Yet…

Human-Computer Interaction · Computer Science 2022-12-22 Russell Davis , Xiaoying Pu , Yiren Ding , Brian D. Hall , Karen Bonilla , Mi Feng , Matthew Kay , Lane Harrison

Deep learning approaches have become the standard solution to many problems in computer vision and robotics, but obtaining sufficient training data in high enough quality is challenging, as human labor is error prone, time consuming, and…

Machine Learning · Computer Science 2021-06-16 Jan Blumenkamp , Andreas Baude , Tim Laue

We consider the problem of generalization in reinforcement learning where visual aspects of the observations might differ, e.g. when there are different backgrounds or change in contrast, brightness, etc. We assume that our agent has access…

Machine Learning · Computer Science 2021-02-16 Bonnie Li , Vincent François-Lavet , Thang Doan , Joelle Pineau

A common practice in unsupervised representation learning is to use labeled data to evaluate the quality of the learned representations. This supervised evaluation is then used to guide critical aspects of the training process such as…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Colorado J Reed , Sean Metzger , Aravind Srinivas , Trevor Darrell , Kurt Keutzer

The ability to generalize is an important feature of any intelligent agent. Not only because it may allow the agent to cope with large amounts of data, but also because in some environments, an agent with no generalization capabilities…

Artificial Intelligence · Computer Science 2017-11-02 Alexey A. Melnikov , Adi Makmal , Vedran Dunjko , Hans J. Briegel

Learning from previously collected data via behavioral cloning or offline reinforcement learning (RL) is a powerful recipe for scaling generalist agents by avoiding the need for expensive online learning. Despite strong generalization in…

Various data augmentation techniques have been recently proposed in image-based deep reinforcement learning (DRL). Although they empirically demonstrate the effectiveness of data augmentation for improving sample efficiency or…

Machine Learning · Computer Science 2024-02-20 Jianshu Hu , Yunpeng Jiang , Paul Weng

Operating directly from raw high dimensional sensory inputs like images is still a challenge for robotic control. Recently, Reinforcement Learning methods have been proposed to solve specific tasks end-to-end, from pixels to torques.…

Machine Learning · Computer Science 2019-01-07 Carlos Florensa , Jonas Degrave , Nicolas Heess , Jost Tobias Springenberg , Martin Riedmiller

Deep Reinforcement Learning has shown great success in a variety of control tasks. However, it is unclear how close we are to the vision of putting Deep RL into practice to solve real world problems. In particular, common practice in the…

Machine Learning · Computer Science 2019-02-21 Chenyang Zhao , Olivier Sigaud , Freek Stulp , Timothy M. Hospedales

Learning a generalist control policy for dexterous manipulation typically relies on large-scale datasets. Given the high cost of real-world data collection, a practical alternative is to generate synthetic data through simulation. However,…

Robotics · Computer Science 2026-03-25 Ruixing Jin , Zicheng Zhu , Ruixiang Ouyang , Sheng Xu , Bo Yue , Zhizheng Wu , Guiliang Liu

Data augmentations have been widely studied to improve the accuracy and robustness of classifiers. However, the potential of image augmentation in improving GAN models for image synthesis has not been thoroughly investigated in previous…

Machine Learning · Computer Science 2020-06-05 Zhengli Zhao , Zizhao Zhang , Ting Chen , Sameer Singh , Han Zhang

In order to reduce overfitting, neural networks are typically trained with data augmentation, the practice of artificially generating additional training data via label-preserving transformations of existing training examples. While these…

Computer Vision and Pattern Recognition · Computer Science 2019-01-23 Cecilia Summers , Michael J. Dinneen

Robots have to face challenging perceptual settings, including changes in viewpoint, lighting, and background. Current simulated reinforcement learning (RL) benchmarks such as DM Control provide visual input without such complexity, which…

Robotics · Computer Science 2021-01-11 Austin Stone , Oscar Ramirez , Kurt Konolige , Rico Jonschkowski

Autonomous agents need large repertoires of skills to act reasonably on new tasks that they have not seen before. However, acquiring these skills using only a stream of high-dimensional, unstructured, and unlabeled observations is a tricky…

Machine Learning · Computer Science 2021-02-09 Andrii Zadaianchuk , Maximilian Seitzer , Georg Martius