English
Related papers

Related papers: Learning in complex action spaces without policy g…

200 papers

Post-deployment machine learning algorithms often influence the environments they act in, and thus shift the underlying dynamics that the standard reinforcement learning (RL) methods ignore. While designing optimal algorithms in this…

Machine Learning · Computer Science 2026-02-03 Debabrota Basu , Udvas Das , Brahim Driss , Uddalak Mukherjee

This article introduces an imitation learning method for learning maximum entropy policies that comply with constraints demonstrated by expert trajectories executing a task. The formulation of the method takes advantage of results…

Machine Learning · Computer Science 2025-07-10 George Papadopoulos , George A. Vouros

Data for face analysis often exhibit highly-skewed class distribution, i.e., most data belong to a few majority classes, while the minority classes only contain a scarce amount of instances. To mitigate this issue, contemporary deep…

Computer Vision and Pattern Recognition · Computer Science 2019-05-01 Chen Huang , Yining Li , Chen Change Loy , Xiaoou Tang

Sequential decision making in the real world often requires finding a good balance of conflicting objectives. In general, there exist a plethora of Pareto-optimal policies that embody different patterns of compromises between objectives,…

Machine Learning · Computer Science 2024-10-08 Takuya Kanazawa , Chetan Gupta

Reinforcement Learning (RL) has made significant strides in complex tasks but struggles in multi-task settings with different embodiments. World model methods offer scalability by learning a simulation of the environment but often rely on…

Machine Learning · Computer Science 2025-02-25 Ignat Georgiev , Varun Giridhar , Nicklas Hansen , Animesh Garg

Complex-valued neural networks are not a new concept, however, the use of real-valued models has often been favoured over complex-valued models due to difficulties in training and performance. When comparing real-valued versus…

Machine Learning · Computer Science 2018-11-30 Nils Mönning , Suresh Manandhar

Medical treatments often involve a sequence of decisions, each informed by previous outcomes. This process closely aligns with reinforcement learning (RL), a framework for optimizing sequential decisions to maximize cumulative rewards under…

Machine Learning · Computer Science 2024-10-15 Ali Shirali , Alexander Schubert , Ahmed Alaa

Reinforcement learning (RL) is about sequential decision making and is traditionally opposed to supervised learning (SL) and unsupervised learning (USL). In RL, given the current state, the agent makes a decision that may influence the next…

Machine Learning · Computer Science 2019-05-03 Eric Benhamou

We study the practical performance of quantum-inspired algorithms for recommendation systems and linear systems of equations. These algorithms were shown to have an exponential asymptotic speedup compared to previously known classical…

Quantum Physics · Physics 2020-08-19 Juan Miguel Arrazola , Alain Delgado , Bhaskar Roy Bardhan , Seth Lloyd

In recent years, various powerful policy gradient algorithms have been proposed in deep reinforcement learning. While all these algorithms build on the Policy Gradient Theorem, the specific design choices differ significantly across…

Machine Learning · Computer Science 2024-03-04 Matthias Lehmann

Action-value estimation is a critical component of many reinforcement learning (RL) methods whereby sample complexity relies heavily on how fast a good estimator for action value can be learned. By viewing this problem through the lens of…

Machine Learning · Computer Science 2021-06-22 Arash Tavakoli , Mehdi Fatemi , Petar Kormushev

A cardinal obstacle to performing quantum-mechanical simulations of strongly-correlated matter is that, with the theoretical tools presently available, sufficiently-accurate computations are often too expensive to be ever feasible. Here we…

Strongly Correlated Electrons · Physics 2021-02-10 John Rogers , Tsung-Han Lee , Sahar Pakdel , Wenhu Xu , Vladimir Dobrosavljević , Yong-Xin Yao , Ove Christiansen , Nicola Lanatà

Off-Policy reinforcement learning (RL) is an important class of methods for many problem domains, such as robotics, where the cost of collecting data is high and on-policy methods are consequently intractable. Standard methods for applying…

Artificial Intelligence · Computer Science 2019-07-03 Riley Simmons-Edler , Ben Eisner , Eric Mitchell , Sebastian Seung , Daniel Lee

We find that across a wide range of robot policy learning scenarios, treating supervised policy learning with an implicit model generally performs better, on average, than commonly used explicit models. We present extensive experiments on…

Value-based methods constitute a fundamental methodology in planning and deep reinforcement learning (RL). In this paper, we propose to exploit the underlying structures of the state-action value function, i.e., Q function, for both…

Machine Learning · Computer Science 2020-07-07 Yuzhe Yang , Guo Zhang , Zhi Xu , Dina Katabi

Adversarial imitation learning (AIL) is a popular method that has recently achieved much success. However, the performance of AIL is still unsatisfactory on the more challenging tasks. We find that one of the major reasons is due to the low…

Machine Learning · Computer Science 2023-07-07 Jialei Huang , Zhaoheng Yin , Yingdong Hu , Yang Gao

The performance of Deep Q-Networks (DQN) is critically dependent on the ability of its underlying neural network to accurately approximate the action-value function. Standard function approximators, such as multi-layer perceptrons, may…

Machine Learning · Computer Science 2025-08-21 Saman Yazdannik , Morteza Tayefi , Shamim Sanisales

LLM-based agents for machine learning engineering (MLE) predominantly rely on tree search, a form of gradient-free optimization that uses scalar validation scores to rank candidates. As LLM reasoning capabilities improve, exhaustive…

Machine Learning · Computer Science 2026-04-14 Yifei Zhang , Xu Yang , Xiao Yang , Bowen Xian , Qizheng Li , Shikai Fang , Jingyuan Li , Jian Wang , Mingrui Xu , Weiqing Liu , Jiang Bian

Reinforcement learning offers the promise of automating the acquisition of complex behavioral skills. However, compared to commonly used and well-understood supervised learning methods, reinforcement learning algorithms can be brittle,…

Machine Learning · Computer Science 2020-01-01 Aviral Kumar , Xue Bin Peng , Sergey Levine

Quantum machine learning (QML) has been identified as one of the key fields that could reap advantages from near-term quantum devices, next to optimization and quantum chemistry. Research in this area has focused primarily on variational…

Quantum Physics · Physics 2022-06-01 Andrea Skolik , Sofiene Jerbi , Vedran Dunjko