English
Related papers

Related papers: Unified State Representation Learning under Data A…

200 papers

In offline Imitation Learning (IL), one of the main challenges is the \textit{covariate shift} between the expert observations and the actual distribution encountered by the agent, because it is difficult to determine what action an agent…

Machine Learning · Computer Science 2024-06-19 Jie-Jing Shao , Hao-Sen Shi , Lan-Zhe Guo , Yu-Feng Li

Deep neural networks are capable of learning powerful representations to tackle complex vision tasks but expose undesirable properties like the over-fitting issue. To this end, regularization techniques like image augmentation are necessary…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Haohang Xu , Shuangrui Ding , Manqi Zhao , Dongsheng Jiang

Overfitting in RL has become one of the main obstacles to applications in reinforcement learning(RL). Existing methods do not provide explicit semantic constrain for the feature extractor, hindering the agent from learning a unified…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Haihan Gao , Rui Zhang , Qi Yi , Hantao Yao , Haochen Li , Jiaming Guo , Shaohui Peng , Yunkai Gao , QiCheng Wang , Xing Hu , Yuanbo Wen , Zihao Zhang , Zidong Du , Ling Li , Qi Guo , Yunji Chen

Deep learning has become the method of choice to tackle real-world problems in different domains, partly because of its ability to learn from data and achieve impressive performance on a wide range of applications. However, its success…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Xiaofeng Liu , Chaehwa Yoo , Fangxu Xing , Hyejin Oh , Georges El Fakhri , Je-Won Kang , Jonghye Woo

Reinforcement learning (RL) methods have been shown to be capable of learning intelligent behavior in rich domains. However, this has largely been done in simulated domains without adequate focus on the process of building the simulator. In…

Machine Learning · Computer Science 2019-10-24 Aditya Modi , Nan Jiang , Ambuj Tewari , Satinder Singh

Unsupervised domain adaptation (UDA) aims to address the domain-shift problem between a labeled source domain and an unlabeled target domain. Many efforts have been made to address the mismatch between the distributions of training and…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Pingyang Dai , Peixian Chen , Qiong Wu , Xiaopeng Hong , Qixiang Ye , Qi Tian , Rongrong Ji

Vision-based reinforcement learning (RL) is a promising approach to solve control tasks involving images as the main observation. State-of-the-art RL algorithms still struggle in terms of sample efficiency, especially when using image…

Machine Learning · Computer Science 2021-10-05 Elie Aljalbout , Maximilian Ulmer , Rudolph Triebel

We are concerned with learning models that generalize well to different \emph{unseen} domains. We consider a worst-case formulation over data distributions that are near the source domain in the feature space. Only using training data from…

Computer Vision and Pattern Recognition · Computer Science 2018-11-07 Riccardo Volpi , Hongseok Namkoong , Ozan Sener , John Duchi , Vittorio Murino , Silvio Savarese

Learning reinforcement learning (RL)-based recommenders from historical user-item interaction sequences is vital to generate high-reward recommendations and improve long-term cumulative benefits. However, existing RL recommendation methods…

Information Retrieval · Computer Science 2023-05-19 Zhaochun Ren , Na Huang , Yidan Wang , Pengjie Ren , Jun Ma , Jiahuan Lei , Xinlei Shi , Hengliang Luo , Joemon M Jose , Xin Xin

Computers can understand and then engage with people in an emotionally intelligent way thanks to speech-emotion recognition (SER). However, the performance of SER in cross-corpus and real-world live data feed scenarios can be significantly…

Sound · Computer Science 2024-12-30 Thejan Rajapakshe , Rajib Rana , Sara Khalifa , Bjorn W. Schuller

While agents trained by Reinforcement Learning (RL) can solve increasingly challenging tasks directly from visual observations, generalizing learned skills to novel environments remains very challenging. Extensive use of data augmentation…

Machine Learning · Computer Science 2021-12-10 Nicklas Hansen , Hao Su , Xiaolong Wang

Recently, data augmentation (DA) has emerged as a method for leveraging domain knowledge to inexpensively generate additional data in reinforcement learning (RL) tasks, often yielding substantial improvements in data efficiency. While prior…

Machine Learning · Computer Science 2024-03-19 Nicholas E. Corrado , Josiah P. Hanna

Unsupervised Domain Adaptation (UDA) and domain generalization (DG) are two research areas that aim to tackle the lack of generalization of Deep Neural Networks (DNNs) towards unseen domains. While UDA methods have access to unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Manuel Schwonberg , Fadoua El Bouazati , Nico M. Schmidt , Hanno Gottschalk

How to learn an effective reinforcement learning-based model for control tasks from high-level visual observations is a practical and challenging problem. A key to solving this problem is to learn low-dimensional state representations from…

Machine Learning · Computer Science 2022-12-27 Jianda Chen , Sinno Jialin Pan

The generalization gap in reinforcement learning (RL) has been a significant obstacle that prevents the RL agent from learning general skills and adapting to varying environments. Increasing the generalization capacity of the RL systems can…

Machine Learning · Computer Science 2021-12-06 Hanping Zhang , Yuhong Guo

Visual reinforcement learning (RL), which makes decisions directly from high-dimensional visual inputs, has demonstrated significant potential in various domains. However, deploying visual RL techniques in the real world remains challenging…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Guozheng Ma , Zhen Wang , Zhecheng Yuan , Xueqian Wang , Bo Yuan , Dacheng Tao

A crucial aspect in reliable machine learning is to design a deployable system in generalizing new related but unobserved environments. Domain generalization aims to alleviate such a prediction gap between the observed and unseen…

Machine Learning · Computer Science 2021-06-01 Changjian Shui , Boyu Wang , Christian Gagné

An agent that has well understood the environment should be able to apply its skills for any given goals, leading to the fundamental problem of learning the Universal Value Function Approximator (UVFA). A UVFA learns to predict the…

Machine Learning · Computer Science 2019-08-16 Zhiao Huang , Fangchen Liu , Hao Su

We consider the problem of generalization in reinforcement learning where visual aspects of the observations might differ, e.g. when there are different backgrounds or change in contrast, brightness, etc. We assume that our agent has access…

Machine Learning · Computer Science 2021-02-16 Bonnie Li , Vincent François-Lavet , Thang Doan , Joelle Pineau

Invariances to translation, rotation and other spatial transformations are a hallmark of the laws of motion, and have widespread use in the natural sciences to reduce the dimensionality of systems of equations. In supervised learning, such…

Machine Learning · Computer Science 2019-10-02 Shruti Mishra , Abbas Abdolmaleki , Arthur Guez , Piotr Trochim , Doina Precup