English
Related papers

Related papers: Pseudo-Quantized Actor-Critic Algorithm for Robust…

200 papers

Solving a reinforcement learning (RL) problem poses two competing challenges: fitting a potentially discontinuous value function, and generalizing well to new observations. In this paper, we analyze the learning dynamics of temporal…

Machine Learning · Computer Science 2022-06-07 Clare Lyle , Mark Rowland , Will Dabney , Marta Kwiatkowska , Yarin Gal

Uncertainty estimation for unlabeled data is crucial to active learning. With a deep neural network employed as the backbone model, the data selection process is highly challenging due to the potential over-confidence of the model…

Machine Learning · Computer Science 2024-02-14 Xingjian Li , Pengkun Yang , Yangcheng Gu , Xueying Zhan , Tianyang Wang , Min Xu , Chengzhong Xu

Robust learning from noisy demonstrations is a practical but highly challenging problem in imitation learning. In this paper, we first theoretically show that robust imitation learning can be achieved by optimizing a classification risk…

Machine Learning · Statistics 2021-02-22 Voot Tangkaratt , Nontawat Charoenphakdee , Masashi Sugiyama

Given a dataset on actions and resulting long-term rewards, a direct estimation approach fits value functions that minimize prediction error on the training data. Temporal difference learning (TD) methods instead fit value functions by…

Machine Learning · Computer Science 2024-02-15 David Cheikhi , Daniel Russo

Learning policy from offline datasets through offline reinforcement learning (RL) holds promise for scaling data-driven decision-making while avoiding unsafe and costly online interactions. However, real-world data collected from sensors or…

Machine Learning · Computer Science 2025-03-04 Jiawei Xu , Rui Yang , Shuang Qiu , Feng Luo , Meng Fang , Baoxiang Wang , Lei Han

Temporal reasoning over long, multi-session dialogues is a critical capability for conversational agents. However, existing works and our pilot study have shown that as dialogue histories grow in length and accumulate noise, current…

Our understanding of reinforcement learning (RL) has been shaped by theoretical and empirical results that were obtained decades ago using tabular representations and linear function approximators. These results suggest that RL methods that…

Machine Learning · Computer Science 2018-06-05 Artemij Amiranashvili , Alexey Dosovitskiy , Vladlen Koltun , Thomas Brox

Robust loss minimization is an important strategy for handling robust learning issue on noisy labels. Current approaches for designing robust losses involve the introduction of noise-robust factors, i.e., hyperparameters, to control the…

Machine Learning · Computer Science 2023-09-06 Kehui Ding , Jun Shu , Deyu Meng , Zongben Xu

For real-world speech recognition applications, noise robustness is still a challenge. In this work, we adopt the teacher-student (T/S) learning technique using a parallel clean and noisy corpus for improving automatic speech recognition…

Audio and Speech Processing · Electrical Eng. & Systems 2019-03-19 Ladislav Mošner , Minhua Wu , Anirudh Raju , Sree Hari Krishnan Parthasarathi , Kenichi Kumatani , Shiva Sundaram , Roland Maas , Björn Hoffmeister

We study the finite-time behaviour of the popular temporal difference (TD) learning algorithm when combined with tail-averaging. We derive finite time bounds on the parameter error of the tail-averaged TD iterate under a step-size choice…

Machine Learning · Computer Science 2024-09-20 Gandharv Patil , Prashanth L. A. , Dheeraj Nagaraj , Doina Precup

While deep reinforcement learning has achieved tremendous successes in various applications, most existing works only focus on maximizing the expected value of total return and thus ignore its inherent stochasticity. Such stochasticity is…

Machine Learning · Computer Science 2023-09-19 Han Zhong , Xun Deng , Ethan X. Fang , Zhuoran Yang , Zhaoran Wang , Runze Li

Temporal difference (TD) learning is a policy evaluation in reinforcement learning whose performance can be enhanced by variance reduction methods. Recently, multiple works have sought to fuse TD learning with Stochastic Variance Reduced…

Machine Learning · Computer Science 2024-08-07 Arsenii Mustafin , Alex Olshevsky , Ioannis Ch. Paschalidis

In this paper, we study the dynamics of temporal difference learning with neural network-based value function approximation over a general state space, namely, \emph{Neural TD learning}. We consider two practically used algorithms,…

Machine Learning · Computer Science 2021-08-09 Semih Cayci , Siddhartha Satpathi , Niao He , R. Srikant

The task of predicting long-term patient outcomes using supervised machine learning is a challenging one, in part because of the high variance of each patient's trajectory, which can result in the model over-fitting to the training data.…

Machine Learning · Computer Science 2026-02-09 Thomas Frost , Kezhi Li , Steve Harris

We investigate robust nonparametric regression in the presence of heavy-tailed noise, where the hypothesis class may contain unbounded functions and robustness is ensured via a robust loss function $\ell_\sigma$. Using Huber regression as a…

Machine Learning · Computer Science 2025-10-14 Yunlong Feng , Qiang Wu

Quality-Diversity (QD) algorithms excel at discovering diverse repertoires of skills, but are hindered by poor sample efficiency and often require tens of millions of environment steps to solve complex locomotion tasks. Recent advances in…

Machine Learning · Computer Science 2026-04-23 Behrad Koohy , Jamie Bayne

Despite strong performance in numerous applications, the fragility of deep learning to input perturbations has raised serious questions about its use in safety-critical domains. While adversarial training can mitigate this issue in…

Machine Learning · Statistics 2021-11-01 Alexander Robey , Luiz F. O. Chamon , George J. Pappas , Hamed Hassani , Alejandro Ribeiro

In recent times, a variety of Reinforcement Learning (RL) algorithms have been proposed for optimal tracking problem of continuous time nonlinear systems with input constraints. Most of these algorithms are based on the notion of uniform…

Systems and Control · Electrical Eng. & Systems 2020-06-16 Amardeep Mishra , Satadal Ghosh

We give the first efficient algorithm for learning halfspaces in the testable learning model recently defined by Rubinfeld and Vasilyan (2023). In this model, a learner certifies that the accuracy of its output hypothesis is near optimal…

Machine Learning · Computer Science 2023-03-14 Aravind Gollakota , Adam R. Klivans , Konstantinos Stavropoulos , Arsen Vasilyan

In this paper time-driven learning refers to the machine learning method that updates parameters in a prediction model continuously as new data arrives. Among existing approximate dynamic programming (ADP) and reinforcement learning (RL)…

Systems and Control · Electrical Eng. & Systems 2020-06-17 Qingtao Zhao , Jennie Si , Jian Sun