中文
相关论文

相关论文: Harnessing Distribution Ratio Estimators for Learn…

200 篇论文

Quantum machine learning has the potential for a transformative impact across industry sectors and in particular in finance. In our work we look at the problem of hedging where deep reinforcement learning offers a powerful framework for…

At the interface of machine learning and quantum computing, an important question is what distributions can be learned provably with optimal sample complexities and with quantum-accelerated time complexities. In the classical case, Klivans…

量子物理 · 物理学 2023-11-08 Siyi Yang , Naixu Guo , Miklos Santha , Patrick Rebentrost

The divergence of the Q-value estimation has been a prominent issue in offline RL, where the agent has no access to real dynamics. Traditional beliefs attribute this instability to querying out-of-distribution actions when bootstrapping…

机器学习 · 计算机科学 2023-11-08 Yang Yue , Rui Lu , Bingyi Kang , Shiji Song , Gao Huang

We study the Non-Stationary Reinforcement Learning (RL) under distribution shifts in both finite-horizon episodic and infinite-horizon discounted Markov Decision Processes (MDPs). In the finite-horizon case, the transition functions may…

机器学习 · 计算机科学 2026-03-31 Ha Manh Bui , Felix Parker , Kimia Ghobadi , Anqi Liu

Q-learning is a regression-based approach that is widely used to formalize the development of an optimal dynamic treatment strategy. Finite dimensional working models are typically used to estimate certain nuisance parameters, and…

统计方法学 · 统计学 2020-03-30 Ashkan Ertefaie , James R. McKay , David Oslin , Robert L. Strawderman

Dealing with distribution shifts is one of the central challenges for modern machine learning. One fundamental situation is the covariate shift, where the input distributions of data change from training to testing stages while the…

机器学习 · 计算机科学 2024-05-28 Yu-Jie Zhang , Zhen-Yu Zhang , Peng Zhao , Masashi Sugiyama

A fundamental challenge in multiagent reinforcement learning is to learn beneficial behaviors in a shared environment with other simultaneously learning agents. In particular, each agent perceives the environment as effectively…

We analyse quantile temporal-difference learning (QTD), a distributional reinforcement learning algorithm that has proven to be a key component in several successful large-scale applications of reinforcement learning. Despite these…

In addition to their undisputed success in solving classical optimization problems, neuroevolutionary and population-based algorithms have become an alternative to standard reinforcement learning methods. However, evolutionary methods often…

神经与进化计算 · 计算机科学 2021-05-18 Jörg Stork , Martin Zaefferer , Nils Eisler , Patrick Tichelmann , Thomas Bartz-Beielstein , A. E. Eiben

In the regression problem, L1 and L2 are the most commonly used loss functions, which produce mean predictions with different biases. However, the predictions are neither robust nor adequate enough since they only capture a few conditional…

机器学习 · 计算机科学 2019-11-14 Faen Zhang , Xinyu Fan , Hui Xu , Pengcheng Zhou , Yujian He , Junlong Liu

The problem of learning functions over spaces of probabilities - or distribution regression - is gaining significant interest in the machine learning community. A key challenge behind this problem is to identify a suitable representation…

机器学习 · 统计学 2022-06-20 Dimitri Meunier , Massimiliano Pontil , Carlo Ciliberto

One central theme in machine learning is function estimation from sparse and noisy data. An example is supervised learning where the elements of the training set are couples, each containing an input location and an output response. In the…

机器学习 · 计算机科学 2023-10-05 Alberto Giaretta , Mauro Bisiacco , Gianluigi Pillonetto

Policy gradient based reinforcement learning algorithms coupled with neural networks have shown success in learning complex policies in the model free continuous action space control setting. However, explicitly parameterized policies are…

机器学习 · 计算机科学 2019-09-30 Oliver Richter , Roger Wattenhofer

Deep Reinforcement Learning (RL) methods rely on experience replay to approximate the minibatched supervised learning setting; however, unlike supervised learning where access to lots of training data is crucial to generalization,…

机器学习 · 计算机科学 2021-02-24 Brett Daley , Cameron Hickert , Christopher Amato

In this paper, we address two practical challenges of distributed learning in multi-agent network systems, namely personalization and resilience. Personalization is the need of heterogeneous agents to learn local models tailored to their…

多智能体系统 · 计算机科学 2026-01-01 Luca Ballotta , Nicola Bastianello , Riccardo M. G. Ferrari , Karl H. Johansson

Knowledge distillation (KD) is an effective model compression method that can transfer the internal capabilities of large language models (LLMs) to smaller ones. However, the multi-modal probability distribution predicted by teacher LLMs…

计算与语言 · 计算机科学 2024-12-19 Tianyu Peng , Jiajun Zhang

In the context of neuroevolution, Quality-Diversity algorithms have proven effective in generating repertoires of diverse and efficient policies by relying on the definition of a behavior space. A natural goal induced by the creation of…

神经与进化计算 · 计算机科学 2023-09-14 Valentin Macé , Raphaël Boige , Felix Chalumeau , Thomas Pierrot , Guillaume Richard , Nicolas Perrin-Gilbert

A key aspect of intelligence is the ability to demonstrate a broad spectrum of behaviors for adapting to unexpected situations. Over the past decade, advancements in deep reinforcement learning have led to groundbreaking achievements to…

机器学习 · 计算机科学 2024-06-04 Luca Grillotti , Maxence Faldor , Borja G. León , Antoine Cully

Distributional reinforcement learning (DRL) enhances the understanding of the effects of the randomness in the environment by letting agents learn the distribution of a random return, rather than its expected value as in standard RL. At the…

最优化与控制 · 数学 2023-03-27 Zifan Wang , Yulong Gao , Siyi Wang , Michael M. Zavlanos , Alessandro Abate , Karl H. Johansson

This paper introduces two learning schemes for distributed agents in Reinforcement Learning (RL) environments, namely Reward-Weighted (R-Weighted) and Loss-Weighted (L-Weighted) gradient merger. The R/L weighted methods replace standard…

机器学习 · 计算机科学 2024-08-20 Martin Holen , Per-Arne Andersen , Kristian Muri Knausgård , Morten Goodwin