English
Related papers

Related papers: Beating the Winner's Curse via Inference-Aware Pol…

200 papers

In many reinforcement learning (RL) applications, augmenting the task rewards with heuristic rewards that encode human priors about how a task should be solved is crucial for achieving desirable performance. However, because such heuristics…

Machine Learning · Computer Science 2025-07-09 Chi-Chang Lee , Zhang-Wei Hong , Pulkit Agrawal

What is a good exploration strategy for an agent that interacts with an environment in the absence of external rewards? Ideally, we would like to get a policy driving towards a uniform state-action visitation (highly exploring) in a minimum…

Machine Learning · Computer Science 2019-12-20 Mirco Mutti , Marcello Restelli

Reinforcement learning algorithms describe how an agent can learn an optimal action policy in a sequential decision process, through repeated experience. In a given environment, the agent policy provides him some running and terminal…

Theoretical Economics · Economics 2020-03-24 Arthur Charpentier , Romuald Elie , Carl Remlinger

A fundamental challenge in reinforcement learning is to learn policies that generalize beyond the operating domains experienced during training. In this paper, we approach this challenge through the following invariance principle: an agent…

Machine Learning · Computer Science 2020-11-10 Anoopkumar Sonar , Vincent Pacelli , Anirudha Majumdar

Affine policies (or control) are widely used as a solution approach in dynamic optimization where computing an optimal adjustable solution is usually intractable. While the worst case performance of affine policies can be significantly bad,…

Optimization and Control · Mathematics 2019-10-15 Omar El Housni , Vineet Goyal

Policy learning can be used to extract individualized treatment regimes from observational data in healthcare, civics, e-commerce, and beyond. One big hurdle to policy learning is a commonplace lack of overlap in the data for different…

Machine Learning · Statistics 2020-12-04 Nathan Kallus

Constrained reinforcement learning has achieved promising progress in safety-critical fields where both rewards and constraints are considered. However, constrained reinforcement learning methods face challenges in striking the right…

Machine Learning · Computer Science 2024-10-29 Jianmina Ma , Jingtian Ji , Yue Gao

Fair machine learning works have been focusing on the development of equitable algorithms that address discrimination of certain groups. Yet, many of these fairness-aware approaches aim to obtain a unique solution to the problem, which…

Machine Learning · Computer Science 2021-12-14 Ana Valdivia , Javier Sánchez-Monedero , Jorge Casillas

A reinforcement learning agent that needs to pursue different goals across episodes requires a goal-conditional policy. In addition to their potential to generalize desirable behavior to unseen goals, such policies may also enable…

Machine Learning · Computer Science 2019-02-21 Paulo Rauber , Avinash Ummadisingu , Filipe Mutz , Juergen Schmidhuber

In multi-objective optimization, learning all the policies that reach Pareto-efficient solutions is an expensive process. The set of optimal policies can grow exponentially with the number of objectives, and recovering all solutions…

Machine Learning · Computer Science 2022-04-12 Mathieu Reymond , Eugenio Bargiacchi , Ann Nowé

We study the problem of online learning in adversarial bandit problems under a partial observability model called off-policy feedback. In this sequential decision making problem, the learner cannot directly observe its rewards, but instead…

Machine Learning · Computer Science 2022-07-20 Germano Gabbianelli , Matteo Papini , Gergely Neu

Policy learning utilizing observational data is pivotal across various domains, with the objective of learning the optimal treatment assignment policy while adhering to specific constraints such as fairness, budget, and simplicity. This…

Methodology · Statistics 2023-10-12 Pan Zhao , Antoine Chambaz , Julie Josse , Shu Yang

Path planning plays an essential role in many areas of robotics. Various planning techniques have been presented, either focusing on learning a specific task from demonstrations or retrieving trajectories by optimizing for hand-crafted cost…

Robotics · Computer Science 2018-09-26 Salvatore Virga , Christian Rupprecht , Nassir Navab , Christoph Hennersperger

It is often very challenging to manually design reward functions for complex, real-world tasks. To solve this, one can instead use reward learning to infer a reward function from data. However, there are often multiple reward functions that…

Machine Learning · Computer Science 2023-06-08 Joar Skalse , Matthew Farrugia-Roberts , Stuart Russell , Alessandro Abate , Adam Gleave

Experience replay enables reinforcement learning agents to memorize and reuse past experiences, just as humans replay memories for the situation at hand. Contemporary off-policy algorithms either replay past experiences uniformly or utilize…

Machine Learning · Computer Science 2019-06-21 Daochen Zha , Kwei-Herng Lai , Kaixiong Zhou , Xia Hu

A widely used technique for improving policies is success conditioning, in which one collects trajectories, identifies those that achieve a desired outcome, and updates the policy to imitate the actions taken along successful trajectories.…

Artificial Intelligence · Computer Science 2026-01-27 Daniel Russo

Long-term fairness is an important factor of consideration in designing and deploying learning-based decision systems in high-stake decision-making contexts. Recent work has proposed the use of Markov Decision Processes (MDPs) to formulate…

Machine Learning · Computer Science 2022-10-25 Eric Yang Yu , Zhizhen Qin , Min Kyung Lee , Sicun Gao

When subjected to automated decision-making, decision subjects may strategically modify their observable features in ways they believe will maximize their chances of receiving a favorable decision. In many practical situations, the…

Computer Science and Game Theory · Computer Science 2022-10-10 Keegan Harris , Valerie Chen , Joon Sik Kim , Ameet Talwalkar , Hoda Heidari , Zhiwei Steven Wu

There is growing importance to detecting faults and implementing the best methods in industrial and real-world systems. We are searching for the most trustworthy and practical data-based fault detection methods proposed by artificial…

Systems and Control · Electrical Eng. & Systems 2023-01-11 Mohammad Hossein Modirrousta , Mahdi Aliyari Shoorehdeli , Mostafa Yari , Arash Ghahremani

We address the problem of making a pre-trained reinforcement learning (RL) policy safety-aware by incorporating cost constraints without retraining it from scratch. While costs could be numerically encoded, we assume a more general setting…

Machine Learning · Computer Science 2026-05-21 Richa Verma , Bavish Kulur , Sanjay Chawla , Balaraman Ravindran