English
Related papers

Related papers: Towards Control-Centric Representations in Reinfor…

200 papers

Supervised learning is widely used in training autonomous driving vehicle. However, it is trained with large amount of supervised labeled data. Reinforcement learning can be trained without abundant labeled data, but we cannot train it in…

Computer Vision and Pattern Recognition · Computer Science 2019-04-26 Nayun Xu , Bowen Tan , Bingyu Kong

Learned representations of dynamical systems reduce dimensionality, potentially supporting downstream reinforcement learning (RL). However, no established methods predict a representation's suitability for control and evaluation is largely…

Machine Learning · Computer Science 2020-11-25 Kevin Haninger , Raul Vicente Garcia , Joerg Krueger

Reinforcement learning offers the promise of automating the acquisition of complex behavioral skills. However, compared to commonly used and well-understood supervised learning methods, reinforcement learning algorithms can be brittle,…

Machine Learning · Computer Science 2020-01-01 Aviral Kumar , Xue Bin Peng , Sergey Levine

Deep learning has achieved remarkable successes in solving challenging reinforcement learning (RL) problems when dense reward function is provided. However, in sparse reward environment it still often suffers from the need to carefully…

Machine Learning · Computer Science 2019-02-19 Hao Liu , Alexander Trott , Richard Socher , Caiming Xiong

Model-free reinforcement learning based methods such as Proximal Policy Optimization, or Q-learning typically require thousands of interactions with the environment to approximate the optimum controller which may not always be feasible in…

Machine Learning · Computer Science 2019-05-16 Narendra Patwardhan , Zequn Wang

We apply reinforcement learning to video compressive sensing to adapt the compression ratio. Specifically, video snapshot compressive imaging (SCI), which captures high-speed video using a low-speed camera is considered in this work, in…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Sidi Lu , Xin Yuan , Aggelos K Katsaggelos , Weisong Shi

Meta-reinforcement learning enables artificial agents to learn from related training tasks and adapt to new tasks efficiently with minimal interaction data. However, most existing research is still limited to narrow task distributions that…

Machine Learning · Computer Science 2023-05-02 Mingyang Wang , Zhenshan Bing , Xiangtong Yao , Shuai Wang , Hang Su , Chenguang Yang , Kai Huang , Alois Knoll

Reinforcement learning for training end-to-end autonomous driving models in closed-loop simulations is gaining growing attention. However, most simulation environments differ significantly from real-world conditions, creating a substantial…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Chaojun Ni , Guosheng Zhao , Xiaofeng Wang , Zheng Zhu , Wenkang Qin , Xinze Chen , Guanghong Jia , Guan Huang , Wenjun Mei

Document summarisation can be formulated as a sequential decision-making problem, which can be solved by Reinforcement Learning (RL) algorithms. The predominant RL paradigm for summarisation learns a cross-input policy, which requires…

Computation and Language · Computer Science 2019-07-31 Yang Gao , Christian M. Meyer , Mohsen Mesgar , Iryna Gurevych

Learning-based lossless image compression employs pixel-based or subimage-based auto-regression for probability estimation, which achieves desirable performances. However, the existing works only consider context dependencies in one…

Image and Video Processing · Electrical Eng. & Systems 2025-03-17 Tiantian Li , Qunbing Xia , Yue Li , Ruixiao Guo , Gaobo Yang

Despite the remarkable success of Deep RL in learning control policies from raw pixels, the resulting models do not generalize. We demonstrate that a trained agent fails completely when facing small visual changes, and that…

Computer Vision and Pattern Recognition · Computer Science 2019-07-05 Shani Gamrian , Yoav Goldberg

Datasets with significant proportions of bias present threats for training a trustworthy model on NLU tasks. Despite yielding great progress, current debiasing methods impose excessive reliance on the knowledge of bias attributes.…

Computation and Language · Computer Science 2022-09-19 Ting Wu , Tao Gui

Autonomous robots require high degrees of cognitive and motoric intelligence to come into our everyday life. In non-structured environments and in the presence of uncertainties, such degrees of intelligence are not easy to obtain.…

Prediction is an appealing objective for self-supervised learning of behavioral skills, particularly for autonomous robots. However, effectively utilizing predictive models for control, especially with raw image inputs, poses a number of…

Robotics · Computer Science 2018-10-09 Frederik Ebert , Sudeep Dasari , Alex X. Lee , Sergey Levine , Chelsea Finn

A common strategy in transfer learning is few shot fine-tuning, but its success is highly dependent on the quality of samples selected as training examples. Active learning methods such as uncertainty sampling and diversity sampling can…

Computation and Language · Computer Science 2026-04-23 Wei Han , David Martinez , Anna Khanina , Lawrence Cavedon , Karin Verspoor

The utility of learning a dynamics/world model of the environment in reinforcement learning has been shown in a many ways. When using neural networks, however, these models suffer catastrophic forgetting when learned in a lifelong or…

Machine Learning · Computer Science 2019-06-12 Nicholas Ketz , Soheil Kolouri , Praveen Pilly

Reinforcement learning has long struggled with poor sample efficiency. One promising approach to mitigate this problem is leveraging group-invariant Markov Decision Processes ($G$-invariant MDPs). Existing works in this direction have…

Machine Learning · Computer Science 2026-05-25 Shuai Zhen , Yifan Zhang , Yuling Wang , Yanhua Yu

We present an online model-based reinforcement learning algorithm suitable for controlling complex robotic systems directly in the real world. Unlike prevailing sim-to-real pipelines that rely on extensive offline simulation and model-free…

Robotics · Computer Science 2026-05-07 Fang Nan , Hao Ma , Qinghua Guan , Josie Hughes , Michael Muehlebach , Marco Hutter

In recent years, policy learning methods using either reinforcement or imitation have made significant progress. However, both techniques still suffer from being computationally expensive and requiring large amounts of training data. This…

Robotics · Computer Science 2022-10-12 Jan Ole von Hartz , Eugenio Chisari , Tim Welschehold , Abhinav Valada

The ability to autonomously learn behaviors via direct interactions in uninstrumented environments can lead to generalist robots capable of enhancing productivity or providing care in unstructured settings like homes. Such uninstrumented…

Robotics · Computer Science 2021-11-15 Rutav Shah , Vikash Kumar