English
Related papers

Related papers: Harnessing Distribution Ratio Estimators for Learn…

200 papers

Quality diversity (QD) algorithms have been shown to be very successful when dealing with problems in areas such as robotics, games and combinatorial optimization. They aim to maximize the quality of solutions for different regions of the…

Neural and Evolutionary Computing · Computer Science 2022-07-29 Adel Nikfarjam , Anh Viet Do , Frank Neumann

Compared to on-policy counterparts, off-policy model-free deep reinforcement learning can improve data efficiency by repeatedly using the previously gathered data. However, off-policy learning becomes challenging when the discrepancy…

Machine Learning · Computer Science 2023-09-27 Baturay Saglam , Dogan C. Cicek , Furkan B. Mutlu , Suleyman S. Kozat

The policy gradient theorem gives a convenient form of the policy gradient in terms of three factors: an action value, a gradient of the action likelihood, and a state distribution involving discounting called the \emph{discounted…

Machine Learning · Computer Science 2023-06-26 Fengdi Che , Gautham Vasan , A. Rupam Mahmood

Off-policy evaluation and learning are concerned with assessing a given policy and learning an optimal policy from offline data without direct interaction with the environment. Often, the environment in which the data are collected differs…

Machine Learning · Computer Science 2024-01-18 Yi Shen , Pan Xu , Michael M. Zavlanos

Evolutionary search via the quality-diversity (QD) paradigm can discover highly performing solutions in different behavioural niches, showing considerable potential in complex real-world scenarios such as evolutionary robotics. Yet most QD…

Neural and Evolutionary Computing · Computer Science 2024-04-10 Roberto Gallotta , Antonios Liapis , Georgios N. Yannakakis

Learning a stationary diffusion amounts to estimating the parameters of a stochastic differential equation whose stationary distribution matches a target distribution. We build on the recently introduced kernel deviation from stationarity…

Machine Learning · Statistics 2026-01-30 Fabian Bleile , Sarah Lumpp , Mathias Drton

Dynamic dispatching is one of the core problems for operation optimization in traditional industries such as mining, as it is about how to smartly allocate the right resources to the right place at the right time. Conventionally, the…

Machine Learning · Computer Science 2020-08-26 Chi Zhang , Philip Odonkor , Shuai Zheng , Hamed Khorasgani , Susumu Serita , Chetan Gupta

Without large quantum computers to empirically evaluate performance, theoretical frameworks such as the quantum statistical query (QSQ) are a primary tool to study quantum algorithms for learning classical functions and search for quantum…

Quantum Physics · Physics 2026-02-11 Laura Lewis , Dar Gilboa , Jarrod R. McClean

Using deep neural nets as function approximator for reinforcement learning tasks have recently been shown to be very powerful for solving problems approaching real-world complexity. Using these results as a benchmark, we discuss the role…

Machine Learning · Computer Science 2016-01-21 Vincent François-Lavet , Raphael Fonteneau , Damien Ernst

Reinforcement learning (RL) struggles to scale to large, combinatorial action spaces common in many real-world problems. This paper introduces a novel framework for training discrete diffusion models as highly effective policies in these…

Machine Learning · Computer Science 2026-05-21 Haitong Ma , Ofir Nabati , Aviv Rosenberg , Bo Dai , Oran Lang , Craig Boutilier , Na Li , Shie Mannor , Lior Shani , Guy Tenneholtz

In this article, we propose a novel algorithm for deep reinforcement learning named Expert Q-learning. Expert Q-learning is inspired by Dueling Q-learning and aims at incorporating semi-supervised learning into reinforcement learning…

Machine Learning · Computer Science 2024-06-26 Li Meng , Anis Yazidi , Morten Goodwin , Paal Engelstad

Kernel methods augmented with random features give scalable algorithms for learning from big data. But it has been computationally hard to sample random features according to a probability distribution that is optimized for the data, so as…

Quantum Physics · Physics 2021-11-02 Hayata Yamasaki , Sathyawageeswar Subramanian , Sho Sonoda , Masato Koashi

Safe reinforcement learning (RL) is a popular and versatile paradigm to learn reward-maximizing policies with safety guarantees. Previous works tend to express the safety constraints in an expectation form due to the ease of implementation,…

Machine Learning · Computer Science 2024-12-18 Chenglin Li , Guangchun Ruan , Hua Geng

We introduce Kernel Density Discrimination GAN (KDD GAN), a novel method for generative adversarial learning. KDD GAN formulates the training as a likelihood ratio optimization problem where the data distributions are written explicitly via…

Machine Learning · Computer Science 2021-07-14 Abdelhak Lemkhenter , Adam Bielski , Alp Eren Sari , Paolo Favaro

To date, distributional reinforcement learning (distributional RL) methods have exclusively focused on the discounted setting, where an agent aims to optimize a discounted sum of rewards over time. In this work, we extend distributional RL…

Machine Learning · Computer Science 2026-01-14 Juan Sebastian Rojas , Chi-Guhn Lee

Knowledge distillation (KD) is a widely adopted approach for compressing large neural networks by transferring knowledge from a large teacher model to a smaller student model. In the context of large language models, token level KD,…

Computation and Language · Computer Science 2025-09-19 Yihan Cao , Yanbin Kang , Zhengming Xing , Ruijie Jiang

Offline reinforcement learning (offline RL), which aims to find an optimal policy from a previously collected static dataset, bears algorithmic difficulties due to function approximation errors from out-of-distribution (OOD) data points. To…

Machine Learning · Computer Science 2021-10-06 Gaon An , Seungyong Moon , Jang-Hyun Kim , Hyun Oh Song

In this work we present a new agent architecture, called Reactor, which combines multiple algorithmic and architectural contributions to produce an agent with higher sample-efficiency than Prioritized Dueling DQN (Wang et al., 2016) and…

Artificial Intelligence · Computer Science 2018-06-20 Audrunas Gruslys , Will Dabney , Mohammad Gheshlaghi Azar , Bilal Piot , Marc Bellemare , Remi Munos

Recently, multiagent deep reinforcement learning (DRL) has received increasingly wide attention. Existing multiagent DRL algorithms are inefficient when facing with the non-stationarity due to agents update their policies simultaneously in…

Multiagent Systems · Computer Science 2018-04-17 Yan Zheng , Jianye Hao , Zongzhang Zhang

In this work we examine recently proposed distance-based classification method designed for near-term quantum processing units with limited resources. We further study possibilities to reduce the quantum resources without any efficiency…

Quantum Physics · Physics 2018-03-05 Przemysław Sadowski