中文
相关论文

相关论文: Reward Redistribution via Gaussian Process Likelih…

200 篇论文

This paper presents a new approach to a robust Gaussian process (GP) regression. Most existing approaches replace an outlier-prone Gaussian likelihood with a non-Gaussian likelihood induced from a heavy tail distribution, such as the…

机器学习 · 计算机科学 2020-01-15 Chiwoo Park , David J. Borth , Nicholas S. Wilson , Chad N. Hunter , Fritz J. Friedersdorf

Reward design remains a significant bottleneck in applying reinforcement learning (RL) to real-world problems. A popular alternative is reward learning, where reward functions are inferred from human feedback rather than manually specified.…

机器学习 · 计算机科学 2026-01-16 Chaitanya Kharyal , Calarina Muslimani , Matthew E. Taylor

Gaussian processes (GPs) are a powerful tool for probabilistic inference over functions. They have been applied to both regression and non-linear dimensionality reduction, and offer desirable properties such as uncertainty estimates,…

机器学习 · 统计学 2014-10-01 Yarin Gal , Mark van der Wilk , Carl E. Rasmussen

Self-paced reinforcement learning (RL) aims to improve the data efficiency of learning by automatically creating sequences, namely curricula, of probability distributions over contexts. However, existing techniques for self-paced RL fail in…

机器学习 · 计算机科学 2023-05-29 Cevahir Koprulu , Ufuk Topcu

Gaussian Process (GP) regression models typically assume that residuals are Gaussian and have the same variance for all observations. However, applications with input-dependent noise (heteroscedastic residuals) frequently arise in practice,…

机器学习 · 统计学 2012-12-27 Chunyi Wang , Radford M. Neal

Reinforcement Learning (RL) serves as a potent paradigm for enhancing reasoning capabilities in Large Language Models (LLMs), yet standard outcome-based approaches often suffer from reward sparsity and inefficient credit assignment. In this…

人工智能 · 计算机科学 2026-02-03 Xiangwei Wang , Wei Wang , Ken Chen , Nanduni Nimalsiri , Saman Halgamuge

Gaussian Process (GPs) models are a rich distribution over functions with inductive biases controlled by a kernel function. Learning occurs through the optimisation of kernel hyperparameters using the marginal likelihood as the objective.…

机器学习 · 统计学 2021-11-22 Fergus Simpson , Vidhi Lalchand , Carl Edward Rasmussen

Reinforcement learning with verifiable rewards (RLVR) has emerged as an effective post-training paradigm for improving the reasoning capabilities of large language models. However, existing group-based RLVR methods often suffer from severe…

机器学习 · 计算机科学 2026-05-26 Haechan Kim , Soohyun Ryu , Gyouk Chu , Doohyuk Jang , Eunho Yang

Reinforcement learning has emerged as a powerful paradigm for unlocking reasoning capabilities in language models. However, relying on sparse rewards makes this process highly sample-inefficient, as models must navigate vast search spaces…

机器学习 · 计算机科学 2026-05-11 Ilia Mahrooghi , Aryo Lotfi , Emmanuel Abbe

We present an implementation of model-based online reinforcement learning (RL) for continuous domains with deterministic transitions that is specifically designed to achieve low sample complexity. To achieve low sample complexity, since the…

人工智能 · 计算机科学 2012-02-01 Tobias Jung , Peter Stone

Reinforcement learning (RL) often encounters delayed and sparse feedback in real-world applications, even with only episodic rewards. Previous approaches have made some progress in reward redistribution for credit assignment but still face…

机器学习 · 计算机科学 2025-01-10 Yun Qu , Yuhang Jiang , Boyuan Wang , Yixiu Mao , Cheems Wang , Chang Liu , Xiangyang Ji

One key challenge for multi-task Reinforcement learning (RL) in practice is the absence of task indicators. Robust RL has been applied to deal with task ambiguity, but may result in over-conservative policies. To balance the worst-case…

机器学习 · 计算机科学 2022-10-25 Mengdi Xu , Peide Huang , Yaru Niu , Visak Kumar , Jielin Qiu , Chao Fang , Kuan-Hui Lee , Xuewei Qi , Henry Lam , Bo Li , Ding Zhao

Multi-output regression models must exploit dependencies between outputs to maximise predictive performance. The application of Gaussian processes (GPs) to this setting typically yields models that are computationally demanding and have…

机器学习 · 统计学 2019-02-27 James Requeima , Will Tebbutt , Wessel Bruinsma , Richard E. Turner

Social goods, such as healthcare, smart city, and information networks, often produce ordered event data in continuous time. The generative processes of these event data can be very complex, requiring flexible models to capture their…

机器学习 · 计算机科学 2020-12-29 Shuang Li , Shuai Xiao , Shixiang Zhu , Nan Du , Yao Xie , Le Song

We propose a method to encourage safety in Model Predictive Control (MPC)-based Reinforcement Learning (RL) via Gaussian Process (GP) regression. This framework consists of 1) a parametric MPC scheme that is employed as model-based…

系统与控制 · 电气工程与系统科学 2024-12-13 Filippo Airaldi , Bart De Schutter , Azita Dabiri

Designing reward functions is a challenging problem in AI and robotics. Humans usually have a difficult time directly specifying all the desirable behaviors that a robot needs to optimize. One common approach is to learn reward functions…

机器人学 · 计算机科学 2020-06-05 Erdem Bıyık , Nicolas Huynh , Mykel J. Kochenderfer , Dorsa Sadigh

We develop an automated variational method for inference in models with Gaussian process (GP) priors and general likelihoods. The method supports multiple outputs and multiple latent functions and does not require detailed knowledge of the…

机器学习 · 统计学 2018-11-06 Edwin V. Bonilla , Karl Krauth , Amir Dezfouli

A new algorithm is developed to tackle the issue of sampling non-Gaussian model parameter posterior probability distributions that arise from solutions to Bayesian inverse problems. The algorithm aims to mitigate some of the hurdles faced…

机器学习 · 统计学 2019-11-19 Leen Alawieh , Jonathan Goodman , John B. Bell

We present a two-stage Metropolis-Hastings algorithm for sampling probabilistic models, whose log-likelihood is computationally expensive to evaluate, by using a surrogate Gaussian Process (GP) model. The key feature of the approach, and…

机器学习 · 统计学 2021-09-29 Alessio Benavoli , Jason Wyse , Arthur White

The reward signal plays a central role in defining the desired behaviors of agents in reinforcement learning (RL). Rewards collected from realistic environments could be perturbed, corrupted, or noisy due to an adversary, sensor error, or…

机器学习 · 计算机科学 2025-03-12 Xi Chen , Zhihui Zhu , Andrew Perrault