English
Related papers

Related papers: Which Mutual-Information Representation Learning O…

200 papers

We consider a Reinforcement Learning setup where an agent interacts with an environment in observation-reward-action cycles without any (esp.\ MDP) assumptions on the environment. State aggregation and more generally feature reinforcement…

Artificial Intelligence · Computer Science 2014-07-15 Marcus Hutter

We investigate contrastive learning in the federated setting through the lens of SimCLR and multi-view mutual information maximization. In doing so, we uncover a connection between contrastive representation learning and user verification;…

Machine Learning · Computer Science 2024-05-06 Christos Louizos , Matthias Reisser , Denis Korzhenkov

Recent works have studied *state entropy maximization* in reinforcement learning, in which the agent's objective is to learn a policy inducing high entropy over states visitation (Hazan et al., 2019). They typically assume full…

Machine Learning · Computer Science 2024-06-05 Riccardo Zamboni , Duilio Cirino , Marcello Restelli , Mirco Mutti

Due to information asymmetry, finding optimal policies for Decentralized Partially Observable Markov Decision Processes (Dec-POMDPs) is hard with the complexity growing doubly exponentially in the horizon length. The challenge increases…

Machine Learning · Computer Science 2021-10-26 Hsu Kao , Vijay Subramanian

Representation learning constitutes a pivotal cornerstone in contemporary deep learning paradigms, offering a conduit to elucidate distinctive features within the latent space and interpret the deep models. Nevertheless, the inherent…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Siyuan Dai , Kai Ye , Kun Zhao , Ge Cui , Haoteng Tang , Liang Zhan

This review addresses the problem of learning abstract representations of the measurement data in the context of Deep Reinforcement Learning (DRL). While the data are often ambiguous, high-dimensional, and complex to interpret, many…

Machine Learning · Computer Science 2024-05-31 Nicolò Botteghi , Mannes Poel , Christoph Brune

To overcome the curses of dimensionality and modeling of Dynamic Programming (DP) methods to solve Markov Decision Process (MDP) problems, Reinforcement Learning (RL) methods are adopted in practice. Contrary to traditional RL algorithms…

Machine Learning · Computer Science 2021-08-24 Arghyadip Roy , Vivek Borkar , Abhay Karandikar , Prasanna Chaporkar

One of the most complex tasks of decision making and planning is to gather information. This task becomes even more complex when the state is high-dimensional and its belief cannot be expressed with a parametric distribution. Although the…

Artificial Intelligence · Computer Science 2022-09-26 Gilad Rotman , Vadim Indelman

Learning a compact representation of history is critical for planning and generalization in partially observable environments. While meta-reinforcement learning (RL) agents can attain near Bayes-optimal policies, they often fail to learn…

Artificial Intelligence · Computer Science 2025-10-28 Po-Chen Kuo , Han Hou , Will Dabney , Edgar Y. Walker

Selective rationalization improves neural network interpretability by identifying a small subset of input features -- the rationale -- that best explains or supports the prediction. A typical rationalization criterion, i.e. maximum mutual…

Machine Learning · Computer Science 2020-03-24 Shiyu Chang , Yang Zhang , Mo Yu , Tommi S. Jaakkola

We investigate a paradigm in multi-task reinforcement learning (MT-RL) in which an agent is placed in an environment and needs to learn to perform a series of tasks, within this space. Since the environment does not change, there is…

Artificial Intelligence · Computer Science 2016-03-08 Diana Borsa , Thore Graepel , John Shawe-Taylor

In this paper, we argue that mutual distillation between reinforcement learning policies serves as an implicit regularization, preventing them from overfitting to irrelevant features. We highlight two separate contributions: (i)…

Machine Learning · Computer Science 2025-09-25 Zhengpeng Xie , Jiahang Cao , Changwei Wang , Fan Yang , Marco Hutter , Qiang Zhang , Jianxiong Zhang , Renjing Xu

Training a deep neural network to maximize a target objective has become the standard recipe for successful machine learning over the last decade. These networks can be optimized with supervised learning, if the target objective is…

Machine Learning · Computer Science 2025-05-12 Bernhard Jaeger , Andreas Geiger

Reinforcement Learning (RL) has demonstrated a huge potential in learning optimal policies without any prior knowledge of the process to be controlled. Model Predictive Control (MPC) is a popular control technique which is able to deal with…

Systems and Control · Computer Science 2019-04-10 Mario Zanon , Sébastien Gros , Alberto Bemporad

In most real-world reinforcement learning applications, state information is only partially observable, which breaks the Markov decision process assumption and leads to inferior performance for algorithms that conflate observations with…

Machine Learning · Computer Science 2024-06-12 Hongming Zhang , Tongzheng Ren , Chenjun Xiao , Dale Schuurmans , Bo Dai

Cumulative entropy regularization introduces a regulatory signal to the reinforcement learning (RL) problem that encourages policies with high-entropy actions, which is equivalent to enforcing small deviations from a uniform reference…

Machine Learning · Computer Science 2019-09-16 Felix Leibfried , Jordi Grau-Moya

Relational representations in reinforcement learning allow for the use of structural information like the presence of objects and relationships between them in the description of value functions. Through this paper, we show that such…

Artificial Intelligence · Computer Science 2012-03-01 Shiwali Mohan , John E. Laird

Markov Decision Processes (MDPs) are the most common model for decision making under uncertainty in the Machine Learning community. An MDP captures non-determinism, probabilistic uncertainty, and an explicit model of action. A Reinforcement…

Artificial Intelligence · Computer Science 2025-06-10 Alena Makarova , Houssam Abbas

Empowerment is an information-theoretic method that can be used to intrinsically motivate learning agents. It attempts to maximize an agent's control over the environment by encouraging visiting states with a large number of reachable next…

Machine Learning · Computer Science 2020-01-09 Felix Leibfried , Sergio Pascual-Diaz , Jordi Grau-Moya

Reinforcement learning in cooperative multi-agent settings has recently advanced significantly in its scope, with applications in cooperative estimation for advertising, dynamic treatment regimes, distributed control, and federated…

Machine Learning · Computer Science 2021-03-30 Abhimanyu Dubey , Alex Pentland