English
Related papers

Related papers: Quantifying First-Order Markov Violations in Noisy…

200 papers

Due to recent breakthroughs, reinforcement learning (RL) has demonstrated impressive performance in challenging sequential decision-making problems. However, an open question is how to make RL cope with partial observability which is…

Machine Learning · Computer Science 2021-04-23 Stephan Weigand , Pascal Klink , Jan Peters , Joni Pajarinen

We address the problem of estimating the parameters of a time-homogeneous Markov chain given only noisy, aggregate data. This arises when a population of individuals behave independently according to a Markov chain, but individual sample…

Machine Learning · Computer Science 2016-04-15 Garrett Bernstein , Daniel Sheldon

Reinforcement Learning (RL) has shown promise in improving the reasoning abilities of Large Language Models (LLMs). However, the specific challenges of adapting RL to multimodal data and formats remain relatively unexplored. In this work,…

Machine Learning · Computer Science 2025-05-20 Zirun Guo , Minjie Hong , Tao Jin

Mitigating partial observability is a necessary but challenging task for general reinforcement learning algorithms. To improve an algorithm's ability to mitigate partial observability, researchers need comprehensive benchmarks to gauge…

Machine Learning · Computer Science 2025-08-04 Ruo Yu Tao , Kaicheng Guo , Cameron Allen , George Konidaris

We consider the problem of detecting anomalies among a given set of processes using their noisy binary sensor measurements. The noiseless sensor measurement corresponding to a normal process is 0, and the measurement is 1 if the process is…

Signal Processing · Electrical Eng. & Systems 2020-06-02 Geethu Joseph , M. Cenk Gursoy , Pramod K. Varshney

Deep reinforcement learning (RL) methods generally engage in exploratory behavior through noise injection in the action space. An alternative is to add noise directly to the agent's parameters, which can lead to more consistent exploration…

This paper delves into the problem of safe reinforcement learning (RL) in a partially observable environment with the aim of achieving safe-reachability objectives. In traditional partially observable Markov decision processes (POMDP),…

Machine Learning · Computer Science 2023-12-04 Xiaoyuan Cheng , Boli Chen , Liz Varga , Yukun Hu

Measuring states in reinforcement learning (RL) can be costly in real-world settings and may negatively influence future outcomes. We introduce the Actively Observable Markov Decision Process (AOMDP), where an agent not only selects control…

Machine Learning · Computer Science 2025-10-17 Daiqi Gao , Ziping Xu , Aseel Rawashdeh , Predrag Klasnja , Susan A. Murphy

Reinforcement learning (RL) is a powerful data-driven control method that has been largely explored in autonomous driving tasks. However, conventional RL approaches learn control policies through trial-and-error interactions with the…

Robotics · Computer Science 2021-11-03 Tianyu Shi , Dong Chen , Kaian Chen , Zhaojian Li

Pseudo-Labeling has emerged as a simple yet effective technique for semi-supervised object detection (SSOD). However, the inevitable noise problem in pseudo-labels significantly degrades the performance of SSOD methods. Recent advances…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Yulin He , Wei Chen , Ke Liang , Yusong Tan , Zhengfa Liang , Yulan Guo

Recent advances in reinforcement learning (RL) have strengthened the reasoning capabilities of vision-language models (VLMs). However, enhancing policy exploration to better scale test-time compute remains largely underexplored. In…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Xiangyan Liu , Jinjie Ni , Zijian Wu , Chao Du , Longxu Dou , Haonan Wang , Tianyu Pang , Michael Qizhe Shieh

We investigate robustness to strong data corruption in offline sparse reinforcement learning (RL). In our setting, an adversary may arbitrarily perturb a fraction of the collected trajectories from a high-dimensional but sparse Markov…

Machine Learning · Statistics 2026-05-13 Nam Phuong Tran , Andi Nika , Goran Radanovic , Long Tran-Thanh , Debmalya Mandal

We study reinforcement learning in infinite-horizon discounted Markov decision processes with continuous state spaces, where data are generated online from a single trajectory under a Markovian behavior policy. To avoid maintaining an…

Machine Learning · Computer Science 2026-03-05 Shengbo Wang

Imitation learning methods are used to infer a policy in a Markov decision process from a dataset of expert demonstrations by minimizing a divergence measure between the empirical state occupancy measures of the expert and the policy. The…

Machine Learning · Computer Science 2023-08-21 Ivan Ovinnikov , Joachim M. Buhmann

We study the reinforcement learning (RL) problem in a constrained Markov decision process (CMDP), where an agent explores the environment to maximize the expected cumulative reward while satisfying a single constraint on the expected total…

This study introduces a novel formulation to enhance Support Vector Machines (SVMs) in handling class imbalance and noise. Unlike the conventional Soft Margin SVM, which penalizes the magnitude of constraint violations, the proposed model…

Machine Learning · Computer Science 2025-03-20 Seyed Mojtaba Mohasel , Hamidreza Koosha

Learned representations in deep reinforcement learning (DRL) have to extract task-relevant information from complex observations, balancing between robustness to distraction and informativeness to the policy. Such stable and rich…

Machine Learning · Computer Science 2021-10-28 Mete Kemertas , Tristan Aumentado-Armstrong

In the context of noisy partial label learning (NPLL), each training sample is associated with a set of candidate labels annotated by multiple noisy annotators. With the emergence of high-performance pre-trained vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Qian-Wei Wang , Yaguang Song , Shu-Tao Xia

Constraint-based methods are one of the main approaches for causal structure learning that are particularly valued as they are asymptotically guaranteed to find a structure that is Markov equivalent to the causal graph of the system. On the…

Machine Learning · Computer Science 2021-05-24 Ehsan Mokhtarian , Sina Akbari , AmirEmad Ghassami , Negar Kiyavash

Reliability analysis aims at estimating the failure probability of an engineering system. It often requires multiple runs of a limit-state function, which usually relies on computationally intensive simulations. Traditionally, these…

Computation · Statistics 2024-01-22 Anderson V. Pires , Maliki Moustapha , Stefano Marelli , Bruno Sudret
‹ Prev 1 4 5 6 7 8 10 Next ›