中文
相关论文

相关论文: Quantifying First-Order Markov Violations in Noisy…

200 篇论文

Due to recent breakthroughs, reinforcement learning (RL) has demonstrated impressive performance in challenging sequential decision-making problems. However, an open question is how to make RL cope with partial observability which is…

机器学习 · 计算机科学 2021-04-23 Stephan Weigand , Pascal Klink , Jan Peters , Joni Pajarinen

We address the problem of estimating the parameters of a time-homogeneous Markov chain given only noisy, aggregate data. This arises when a population of individuals behave independently according to a Markov chain, but individual sample…

机器学习 · 计算机科学 2016-04-15 Garrett Bernstein , Daniel Sheldon

Reinforcement Learning (RL) has shown promise in improving the reasoning abilities of Large Language Models (LLMs). However, the specific challenges of adapting RL to multimodal data and formats remain relatively unexplored. In this work,…

机器学习 · 计算机科学 2025-05-20 Zirun Guo , Minjie Hong , Tao Jin

Mitigating partial observability is a necessary but challenging task for general reinforcement learning algorithms. To improve an algorithm's ability to mitigate partial observability, researchers need comprehensive benchmarks to gauge…

机器学习 · 计算机科学 2025-08-04 Ruo Yu Tao , Kaicheng Guo , Cameron Allen , George Konidaris

We consider the problem of detecting anomalies among a given set of processes using their noisy binary sensor measurements. The noiseless sensor measurement corresponding to a normal process is 0, and the measurement is 1 if the process is…

信号处理 · 电气工程与系统科学 2020-06-02 Geethu Joseph , M. Cenk Gursoy , Pramod K. Varshney

Deep reinforcement learning (RL) methods generally engage in exploratory behavior through noise injection in the action space. An alternative is to add noise directly to the agent's parameters, which can lead to more consistent exploration…

This paper delves into the problem of safe reinforcement learning (RL) in a partially observable environment with the aim of achieving safe-reachability objectives. In traditional partially observable Markov decision processes (POMDP),…

机器学习 · 计算机科学 2023-12-04 Xiaoyuan Cheng , Boli Chen , Liz Varga , Yukun Hu

Measuring states in reinforcement learning (RL) can be costly in real-world settings and may negatively influence future outcomes. We introduce the Actively Observable Markov Decision Process (AOMDP), where an agent not only selects control…

机器学习 · 计算机科学 2025-10-17 Daiqi Gao , Ziping Xu , Aseel Rawashdeh , Predrag Klasnja , Susan A. Murphy

Reinforcement learning (RL) is a powerful data-driven control method that has been largely explored in autonomous driving tasks. However, conventional RL approaches learn control policies through trial-and-error interactions with the…

机器人学 · 计算机科学 2021-11-03 Tianyu Shi , Dong Chen , Kaian Chen , Zhaojian Li

Pseudo-Labeling has emerged as a simple yet effective technique for semi-supervised object detection (SSOD). However, the inevitable noise problem in pseudo-labels significantly degrades the performance of SSOD methods. Recent advances…

计算机视觉与模式识别 · 计算机科学 2023-03-07 Yulin He , Wei Chen , Ke Liang , Yusong Tan , Zhengfa Liang , Yulan Guo

Recent advances in reinforcement learning (RL) have strengthened the reasoning capabilities of vision-language models (VLMs). However, enhancing policy exploration to better scale test-time compute remains largely underexplored. In…

计算机视觉与模式识别 · 计算机科学 2025-11-03 Xiangyan Liu , Jinjie Ni , Zijian Wu , Chao Du , Longxu Dou , Haonan Wang , Tianyu Pang , Michael Qizhe Shieh

We investigate robustness to strong data corruption in offline sparse reinforcement learning (RL). In our setting, an adversary may arbitrarily perturb a fraction of the collected trajectories from a high-dimensional but sparse Markov…

机器学习 · 统计学 2026-05-13 Nam Phuong Tran , Andi Nika , Goran Radanovic , Long Tran-Thanh , Debmalya Mandal

We study reinforcement learning in infinite-horizon discounted Markov decision processes with continuous state spaces, where data are generated online from a single trajectory under a Markovian behavior policy. To avoid maintaining an…

机器学习 · 计算机科学 2026-03-05 Shengbo Wang

Imitation learning methods are used to infer a policy in a Markov decision process from a dataset of expert demonstrations by minimizing a divergence measure between the empirical state occupancy measures of the expert and the policy. The…

机器学习 · 计算机科学 2023-08-21 Ivan Ovinnikov , Joachim M. Buhmann

We study the reinforcement learning (RL) problem in a constrained Markov decision process (CMDP), where an agent explores the environment to maximize the expected cumulative reward while satisfying a single constraint on the expected total…

This study introduces a novel formulation to enhance Support Vector Machines (SVMs) in handling class imbalance and noise. Unlike the conventional Soft Margin SVM, which penalizes the magnitude of constraint violations, the proposed model…

机器学习 · 计算机科学 2025-03-20 Seyed Mojtaba Mohasel , Hamidreza Koosha

Learned representations in deep reinforcement learning (DRL) have to extract task-relevant information from complex observations, balancing between robustness to distraction and informativeness to the policy. Such stable and rich…

机器学习 · 计算机科学 2021-10-28 Mete Kemertas , Tristan Aumentado-Armstrong

In the context of noisy partial label learning (NPLL), each training sample is associated with a set of candidate labels annotated by multiple noisy annotators. With the emergence of high-performance pre-trained vision-language models…

计算机视觉与模式识别 · 计算机科学 2026-01-30 Qian-Wei Wang , Yaguang Song , Shu-Tao Xia

Constraint-based methods are one of the main approaches for causal structure learning that are particularly valued as they are asymptotically guaranteed to find a structure that is Markov equivalent to the causal graph of the system. On the…

机器学习 · 计算机科学 2021-05-24 Ehsan Mokhtarian , Sina Akbari , AmirEmad Ghassami , Negar Kiyavash

Reliability analysis aims at estimating the failure probability of an engineering system. It often requires multiple runs of a limit-state function, which usually relies on computationally intensive simulations. Traditionally, these…

统计计算 · 统计学 2024-01-22 Anderson V. Pires , Maliki Moustapha , Stefano Marelli , Bruno Sudret