中文
相关论文

相关论文: Quantifying First-Order Markov Violations in Noisy…

200 篇论文

We consider the problem of training a model under the presence of label noise. Current approaches identify samples with potentially incorrect labels and reduce their influence on the learning process by either assigning lower weights to…

机器学习 · 计算机科学 2019-06-04 Duc Tam Nguyen , Thi-Phuong-Nhung Ngo , Zhongyu Lou , Michael Klar , Laura Beggel , Thomas Brox

Deep Reinforcement Learning is quickly becoming a popular method for training autonomous Unmanned Aerial Vehicles (UAVs). Our work analyzes the effects of measurement uncertainty on the performance of Deep Reinforcement Learning (DRL) based…

机器人学 · 计算机科学 2023-03-14 Bhaskar Joshi , Dhruv Kapur , Harikumar Kandath

Real-world decision-making tasks are usually partially observable Markov decision processes (POMDPs), where the state is not fully observable. Recent progress has demonstrated that recurrent reinforcement learning (RL), which consists of a…

机器学习 · 计算机科学 2024-05-27 Fan-Ming Luo , Zuolin Tu , Zefang Huang , Yang Yu

Robust Markov Decision Processes (RMDPs) have received significant research interest, offering an alternative to standard Markov Decision Processes (MDPs) that often assume fixed transition probabilities. RMDPs address this by optimizing…

机器学习 · 计算机科学 2024-05-06 Xinyi Ni , Lifeng Lai

The challenge of learning with noisy labels is significant in machine learning, as it can severely degrade the performance of prediction models if not addressed properly. This paper introduces a novel framework that conceptualizes noisy…

机器学习 · 计算机科学 2025-11-26 Marzi Heidari , Hanping Zhang , Yuhong Guo

The enormous demand for annotated data brought forth by deep learning techniques has been accompanied by the problem of annotation noise. Although this issue has been widely discussed in machine learning literature, it has been relatively…

机器学习 · 计算机科学 2023-08-10 Soumadeep Saha , Utpal Garain , Arijit Ukil , Arpan Pal , Sundeep Khandelwal

We study the offline reinforcement learning (RL) in the face of unmeasured confounders. Due to the lack of online interaction with the environment, offline RL is facing the following two significant challenges: (i) the agent may be…

机器学习 · 计算机科学 2022-09-20 Zuyue Fu , Zhengling Qi , Zhaoran Wang , Zhuoran Yang , Yanxun Xu , Michael R. Kosorok

Reinforcement learning in non-stationary environments is challenging due to abrupt and unpredictable changes in dynamics, often causing traditional algorithms to fail to converge. However, in many real-world cases, non-stationarity has some…

机器学习 · 计算机科学 2025-03-25 Mohsen Amiri , Sindri Magnússon

In partially observable (PO) environments, deep reinforcement learning (RL) agents often suffer from unsatisfactory performance, since two problems need to be tackled together: how to extract information from the raw observations to solve…

机器学习 · 计算机科学 2019-12-25 Dongqi Han , Kenji Doya , Jun Tani

Motivated by value function estimation in reinforcement learning, we study statistical linear inverse problems, i.e., problems where the coefficients of a linear system to be solved are observed in noise. We consider penalized estimators,…

机器学习 · 计算机科学 2012-07-03 Bernardo Avila Pires , Csaba Szepesvari

Despite recent successes in Reinforcement Learning, value-based methods often suffer from high variance hindering performance. In this paper, we illustrate this in a continuous control setting where state of the art methods perform poorly…

机器学习 · 计算机科学 2019-05-24 Pierre Thodoroff , Nishanth Anand , Lucas Caccia , Doina Precup , Joelle Pineau

Policies for Partially Observable Markov Decision Processes (POMDPs) are often designed using a nominal system model. In practice, this model can deviate from the true system during deployment due to factors such as calibration drift or…

人工智能 · 计算机科学 2026-04-24 Benjamin Kraske , Qi Heng Ho , Federico Rossi , Morteza Lahijanian , Zachary Sunberg

Outstanding claim liabilities are revised repeatedly as claims develop, yet most modern reserving models are trained as one-shot predictors and typically learn only from settled claims. We formulate individual claims reserving as a…

风险管理 · 定量金融 2026-01-13 Benjamin Avanzi , Ronald Richman , Bernard Wong , Mario Wüthrich , Yagebu Xie

Reinforcement learning (RL) offers significant promise for machinery fault detection (MFD). However, most existing RL-based MFD approaches do not fully exploit RL's sequential decision-making strengths, often treating MFD as a simple…

机器学习 · 计算机科学 2026-02-27 Dhiraj Neupane , Richard Dazeley , Mohamed Reda Bouadjenek , Sunil Aryal

The focus of this paper is on stochastic variational inequalities (VI) under Markovian noise. A prominent application of our algorithmic developments is the stochastic policy evaluation problem in reinforcement learning. Prior…

最优化与控制 · 数学 2021-08-17 Georgios Kotsalis , Guanghui Lan , Tianjiao Li

The quantification and characterization of non-Markovian dynamics in quantum systems is an essential endeavor both for the theory of open quantum systems and for a deeper understanding of the effects of non-Markovian noise on quantum…

量子物理 · 物理学 2019-05-28 Namit Anand , Todd A. Brun

A deep neural network trained on noisy labels is known to quickly lose its power to discriminate clean instances from noisy ones. After the early learning phase has ended, the network memorizes the noisy instances, which leads to a…

机器学习 · 计算机科学 2021-09-03 Jason Z. Lin , Jelena Bradic

We present a data-efficient reinforcement learning algorithm resistant to observation noise. Our method extends the highly data-efficient PILCO algorithm (Deisenroth & Rasmussen, 2011) into partially observed Markov decision processes…

机器学习 · 统计学 2016-02-09 Rowan McAllister , Carl Edward Rasmussen

Reinforcement learning (RL) is an important field of research in machine learning that is increasingly being applied to complex optimization problems in physics. In parallel, concepts from physics have contributed to important advances in…

机器学习 · 计算机科学 2023-05-11 Argenis Arriojas , Jacob Adamczyk , Stas Tiomkin , Rahul V. Kulkarni

The integration of physiological computing into mixed-initiative human-robot interaction systems offers valuable advantages in autonomous task allocation by incorporating real-time features as human state observations into the…