English
Related papers

Related papers: Suboptimal and trait-like reinforcement learning s…

200 papers

Robotic systems must be able to quickly and robustly make decisions when operating in uncertain and dynamic environments. While Reinforcement Learning (RL) can be used to compute optimal policies with little prior knowledge about the…

Robotics · Computer Science 2016-09-13 Yunpeng Pan , Xinyan Yan , Evangelos Theodorou , Byron Boots

Model-based Reinforcement Learning (MBRL) aims to make agents more sample-efficient, adaptive, and explainable by learning an explicit model of the environment. While the capabilities of MBRL agents have significantly improved in recent…

Machine Learning · Computer Science 2024-04-09 Ran Wei , Nathan Lambert , Anthony McDonald , Alfredo Garcia , Roberto Calandra

F-measures are popular performance metrics, particularly for tasks with imbalanced data sets. Algorithms for learning to maximize F-measures follow two approaches: the empirical utility maximization (EUM) approach learns a classifier having…

Machine Learning · Computer Science 2012-06-22 Ye Nan , Kian Ming Chai , Wee Sun Lee , Hai Leong Chieu

Self-training is a useful strategy for semi-supervised learning, leveraging raw texts for enhancing model performances. Traditional self-training methods depend on heuristics such as model confidence for instance selection, the manual…

Computation and Language · Computer Science 2018-04-17 Chenhua Chen , Yue Zhang

Machine learning practitioners invest significant manual and computational resources in finding suitable learning rates for optimization algorithms. We provide a probabilistic motivation, in terms of Gaussian inference, for popular…

Machine Learning · Computer Science 2021-02-23 Filip de Roos , Carl Jidling , Adrian Wills , Thomas Schön , Philipp Hennig

We model the behavioral biases of human decision-making in securing interdependent systems and show that such behavioral decision-making leads to a suboptimal pattern of resource allocation compared to non-behavioral (rational)…

Cryptography and Security · Computer Science 2020-11-25 Mustafa Abdallah , Daniel Woods , Parinaz Naghizadeh , Issa Khalil , Timothy Cason , Shreyas Sundaram , Saurabh Bagchi

Inverse Reinforcement Learning (IRL) techniques deal with the problem of deducing a reward function that explains the behavior of an expert agent who is assumed to act optimally in an underlying unknown task. In several problems of…

Machine Learning · Computer Science 2024-01-09 Riccardo Poiani , Gabriele Curti , Alberto Maria Metelli , Marcello Restelli

Policy gradient methods are among the most effective methods in challenging reinforcement learning problems with large state and/or action spaces. However, little is known about even their most basic theoretical convergence properties,…

Machine Learning · Computer Science 2020-10-16 Alekh Agarwal , Sham M. Kakade , Jason D. Lee , Gaurav Mahajan

Empowerment is an information-theoretic method that can be used to intrinsically motivate learning agents. It attempts to maximize an agent's control over the environment by encouraging visiting states with a large number of reachable next…

Machine Learning · Computer Science 2020-01-09 Felix Leibfried , Sergio Pascual-Diaz , Jordi Grau-Moya

Function approximation has been an indispensable component in modern reinforcement learning algorithms designed to tackle problems with large state spaces in high dimensions. This paper reviews recent results on error analysis for these…

Machine Learning · Computer Science 2024-02-27 Jihao Long , Jiequn Han

The process of meta-learning algorithms from data, instead of relying on manual design, is growing in popularity as a paradigm for improving the performance of machine learning systems. Meta-learning shows particular promise for…

Machine Learning · Computer Science 2025-09-11 Alexander David Goldie , Zilin Wang , Jaron Cohen , Jakob Nicolaus Foerster , Shimon Whiteson

We consider the problem of model multiplicity in downstream decision-making, a setting where two predictive models of equivalent accuracy cannot agree on the best-response action for a downstream loss function. We show that even when the…

Machine Learning · Computer Science 2024-05-31 Ally Yalei Du , Dung Daniel Ngo , Zhiwei Steven Wu

We study reinforcement learning (RL) for decision processes with non-Markovian reward, in which high-level knowledge of the task in the form of reward machines is available to the learner. We consider probabilistic reward machines with…

Machine Learning · Computer Science 2024-12-30 Hippolyte Bourel , Anders Jonsson , Odalric-Ambrym Maillard , Chenxiao Ma , Mohammad Sadegh Talebi

The performance of many machine learning techniques depends on the choice of an appropriate similarity or distance measure on the input space. Similarity learning (or metric learning) aims at building such a measure from training data so…

Machine Learning · Statistics 2019-01-25 Robin Vogel , Aurélien Bellet , Stéphan Clémençon

This effort is focused on examining the behavior of reinforcement learning systems in personalization environments and detailing the differences in policy entropy associated with the type of learning algorithm utilized. We demonstrate that…

Machine Learning · Computer Science 2024-04-30 Anton Dereventsov , Andrew Starnes , Clayton G. Webster

Simplicity is a powerful inductive bias. In reinforcement learning, regularization is used for simpler policies, data augmentation for simpler representations, and sparse reward functions for simpler objectives, all that, with the…

Machine Learning · Computer Science 2025-05-23 Bang You , Puze Liu , Huaping Liu , Jan Peters , Oleg Arenz

In reinforcement learning, a decision needs to be made at some point as to whether it is worthwhile to carry on with the learning process or to terminate it. In many such situations, stochastic elements are often present which govern the…

Machine Learning · Computer Science 2019-02-13 Nikki Lijing Kuang , Clement H. C. Leung

Robust reinforcement learning (RL) aims to find a policy that optimizes the worst-case performance in the face of uncertainties. In this paper, we focus on action robust RL with the probabilistic policy execution uncertainty, in which,…

Machine Learning · Computer Science 2023-07-21 Guanlin Liu , Zhihan Zhou , Han Liu , Lifeng Lai

During the preference optimization of large language models (LLMs), distribution shifts may arise between newly generated model samples and the data used to train the reward model (RM). This shift reduces the efficacy of the RM, which in…

Machine Learning · Computer Science 2025-06-11 Tianyuan Shi , Canbin Huang , Fanqi Wan , Longguang Zhong , Ziyi Yang , Weizhou Shen , Xiaojun Quan , Ming Yan

The tendency of repeating past choices more often than expected from the history of outcomes has been repeatedly empirically observed in reinforcement learning experiments. It can be explained by at least two computational processes:…

Neural and Evolutionary Computing · Computer Science 2024-10-28 Isabelle Hoxha , Leo Sperber , Stefano Palminteri