English
Related papers

Related papers: DEAR: Disentangled Environment and Agent Represent…

200 papers

Generalizing vision-based reinforcement learning (RL) agents to novel environments remains a difficult and open challenge. Current trends are to collect large-scale datasets or use data augmentation techniques to prevent overfitting and…

Machine Learning · Computer Science 2025-08-13 Sumeet Batra , Gaurav S. Sukhatme

In this paper, we propose a novel model-based multi-agent reinforcement learning approach named Value Decomposition Framework with Disentangled World Model to address the challenge of achieving a common goal of multiple agents interacting…

Machine Learning · Computer Science 2025-09-29 Zhizun Wang , David Meger

In this paper, we investigate the problem of learning disentangled representations. Given a pair of images sharing some attributes, we aim to create a low-dimensional representation which is split into two parts: a shared representation…

Machine Learning · Statistics 2019-12-10 Eduardo Hugo Sanchez , Mathieu Serrurier , Mathias Ortner

Image translation methods typically aim to manipulate a set of labeled attributes (given as supervision at training time e.g. domain label) while leaving the unlabeled attributes intact. Current methods achieve either: (i) disentanglement,…

Computer Vision and Pattern Recognition · Computer Science 2021-09-09 Aviv Gabbay , Yedid Hoshen

Transportation systems often rely on understanding the flow of vehicles or pedestrian. From traffic monitoring at the city scale, to commuters in train terminals, recent progress in sensing technology make it possible to use cameras to…

Computer Vision and Pattern Recognition · Computer Science 2020-09-11 George Adaimi , Sven Kreiss , Alexandre Alahi

In the domain of combat simulations, the training and deployment of deep reinforcement learning (RL) agents still face substantial challenges due to the dynamic and intricate nature of such environments. Unfortunately, as the complexity of…

Machine Learning · Computer Science 2024-08-27 Scotty Black , Christian Darken

Vision-based reinforcement learning (RL) is a promising approach to solve control tasks involving images as the main observation. State-of-the-art RL algorithms still struggle in terms of sample efficiency, especially when using image…

Machine Learning · Computer Science 2021-10-05 Elie Aljalbout , Maximilian Ulmer , Rudolph Triebel

A challenge in reinforcement learning (RL) is minimizing the cost of sampling associated with exploration. Distributed exploration reduces sampling complexity in multi-agent RL (MARL). We investigate the benefits to performance in MARL when…

Machine Learning · Computer Science 2022-05-03 Justin Lidard , Udari Madhushani , Naomi Ehrich Leonard

We design a simple reinforcement learning (RL) agent that implements an optimistic version of $Q$-learning and establish through regret analysis that this agent can operate with some level of competence in any environment. While we leverage…

Machine Learning · Computer Science 2021-07-13 Shi Dong , Benjamin Van Roy , Zhengyuan Zhou

Multi-view multi-label learning frequently suffers from simultaneous feature absence and incomplete annotations, due to challenges in data acquisition and cost-intensive supervision. To tackle the complex yet highly practical problem while…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Quanjiang Li , Zhiming Liu , Tianxiang Xu , Tingjin Luo , Chenping Hou

Disentanglement is a useful property in representation learning which increases the interpretability of generative models such as Variational autoencoders (VAE), Generative Adversarial Models, and their many variants. Typically in such…

Machine Learning · Computer Science 2022-05-31 Arun Pandey , Michael Fanuel , Joachim Schreurs , Johan A. K. Suykens

The performance of image-based Reinforcement Learning (RL) agents can vary depending on the position of the camera used to capture the images. Training on multiple cameras simultaneously, including a first-person egocentric camera, can…

Machine Learning · Computer Science 2024-06-24 Mhairi Dunion , Stefano V. Albrecht

There have been a fairly of research interests in exploring the disentanglement of appearance and shape from human images. Most existing endeavours pursuit this goal by either using training images with annotations or regulating the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-31 Hongtao Yang , Tong Zhang , Wenbing Huang , Xuming He , Fatih Porikli

The ability to recognize objects despite there being differences in appearance, known as Core Object Recognition, forms a critical part of human perception. While it is understood that the brain accomplishes Core Object Recognition through…

Machine Learning · Computer Science 2020-05-15 Harshvardhan Sikka

When searching for objects in cluttered environments, it is often necessary to perform complex interactions in order to move occluding objects out of the way and fully reveal the object of interest and make it graspable. Due to the…

Deep neural networks are susceptible to learn biased models with entangled feature representations, which may lead to subpar performances on various downstream tasks. This is particularly true for under-represented classes, where a lack of…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Sanghyeok Chu , Dongwan Kim , Bohyung Han

Reinforcement learning (RL) in non-stationary environments is challenging, as changing dynamics and rewards quickly make past experiences outdated. Traditional experience replay (ER) methods, especially those using TD-error prioritization,…

Machine Learning · Computer Science 2025-09-19 Tianyang Duan , Zongyuan Zhang , Songxiao Guo , Yuanye Zhao , Zheng Lin , Zihan Fang , Yi Liu , Dianxin Luan , Dong Huang , Heming Cui , Yong Cui

Manipulating objects is a hallmark of human intelligence, and an important task in domains such as robotics. In principle, Reinforcement Learning (RL) offers a general approach to learn object manipulation. In practice, however, domains…

Robotics · Computer Science 2024-04-02 Dan Haramati , Tal Daniel , Aviv Tamar

While Reinforcement Learning (RL) agents can successfully learn to handle complex tasks, effectively generalizing acquired skills to unfamiliar settings remains a challenge. One of the reasons behind this is the visual encoders used are…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Yuhan Zhang , Guoqing Ma , Guangfu Hao , Liangxuan Guo , Yang Chen , Shan Yu

Modeling group actions on latent representations enables controllable transformations of high-dimensional image data. Prior works applying group-theoretic priors or modeling transformations typically operate in the high-dimensional data…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Farhana Hossain Swarnali , Miaomiao Zhang , Tonmoy Hossain