中文
相关论文

相关论文: Robust variance-regularized risk minimization with…

200 篇论文

Policy gradient methods are very attractive in reinforcement learning due to their model-free nature and convergence guarantees. These methods, however, suffer from high variance in gradient estimation, resulting in poor sample efficiency.…

机器学习 · 计算机科学 2018-11-16 Sergey Pankov

Most existing distance metric learning methods assume perfect side information that is usually given in pairwise or triplet constraints. Instead, in many real-world applications, the constraints are derived from side information, such as…

机器学习 · 计算机科学 2012-03-19 Kaizhu Huang , Rong Jin , Zenglin Xu , Cheng-Lin Liu

A robust mean value is often a good alternative to the standard mean value when dealing with data containing many outliers. An efficient method for samples of one-dimensional features and the truncated quadratic error norm is presented and…

计算机视觉与模式识别 · 计算机科学 2016-02-01 Erik Jonsson , Michael Felsberg

In safety-critical applications, machine learning models should generalize well under worst-case distribution shifts, that is, have a small robust risk. Invariance-based algorithms can provably take advantage of structural assumptions on…

机器学习 · 统计学 2025-02-06 Julia Kostin , Nicola Gnecco , Fanny Yang

Meta learning is a promising paradigm to enable skill transfer across tasks. Most previous methods employ the empirical risk minimization principle in optimization. However, the resulting worst fast adaptation to a subset of tasks can be…

机器学习 · 计算机科学 2023-10-03 Qi Wang , Yiqin Lv , Yanghe Feng , Zheng Xie , Jincai Huang

Multi-Task Learning (MTL) has achieved success in various fields. However, how to balance different tasks to achieve good performance is a key problem. To achieve the task balancing, there are many works to carefully design dynamical…

机器学习 · 计算机科学 2022-07-28 Baijiong Lin , Feiyang Ye , Yu Zhang , Ivor W. Tsang

Model-Free Reinforcement Learning has achieved meaningful results in stable environments but, to this day, it remains problematic in regime changing environments like financial markets. In contrast, model-based RL is able to capture some…

机器学习 · 计算机科学 2021-04-23 Eric Benhamou , David Saltiel , Serge Tabachnik , Sui Kai Wong , François Chareyron

We present an adaptive approach for robust learning from corrupted training sets. We identify corrupted and non-corrupted samples with latent Bernoulli variables and thus formulate the learning problem as maximization of the likelihood…

机器学习 · 统计学 2024-06-17 Aleksandr Karakulev , Dave Zachariah , Prashant Singh

Adversarially robust learning aims to design algorithms that are robust to small adversarial perturbations on input variables. Beyond the existing studies on the predictive performance to adversarial samples, our goal is to understand…

机器学习 · 统计学 2020-12-21 Yue Xing , Ruizhi Zhang , Guang Cheng

This monograph develops a comprehensive statistical learning framework that is robust to (distributional) perturbations in the data using Distributionally Robust Optimization (DRO) under the Wasserstein metric. Beginning with fundamental…

机器学习 · 统计学 2021-08-23 Ruidi Chen , Ioannis Ch. Paschalidis

We study the problem of selecting limited features to observe such that models trained on them can perform well simultaneously across multiple subpopulations. This problem has applications in settings where collecting each feature is…

机器学习 · 计算机科学 2025-10-27 Maitreyi Swaroop , Tamar Krishnamurti , Bryan Wilder

Designing learning algorithms that are resistant to perturbations of the underlying data distribution is a problem of wide practical and theoretical importance. We present a general approach to this problem focusing on unsupervised…

机器学习 · 计算机科学 2021-02-22 Andreas Maurer , Daniela A. Parletta , Andrea Paudice , Massimiliano Pontil

Dynamic decision-making under distributional shifts is of fundamental interest in theory and applications of reinforcement learning: The distribution of the environment in which the data is collected can differ from that of the environment…

机器学习 · 计算机科学 2024-09-05 Shengbo Wang , Nian Si , Jose Blanchet , Zhengyuan Zhou

Supervised learning with large-scale data usually leads to complex optimization problems, especially for classification tasks with multiple classes. Stochastic subgradient methods can enable efficient learning with a large number of samples…

机器学习 · 计算机科学 2025-11-25 Kartheek Bondugula , Santiago Mazuelas , Aritz Pérez

Options are generally learned by using an inaccurate environment model (or simulator), which contains uncertain model parameters. While there are several methods to learn options that are robust against the uncertainty of model parameters,…

机器学习 · 计算机科学 2019-11-01 Takuya Hiraoka , Takahisa Imagawa , Tatsuya Mori , Takashi Onishi , Yoshimasa Tsuruoka

Ordinary differential equations (ODEs) provide a powerful framework for modeling dynamic systems arising in a wide range of scientific domains. However, most existing ODE methods focus on a single system, and do not adequately address the…

统计方法学 · 统计学 2026-04-08 Shuoxun Xu , Zijian Guo , Brooke R. Staveland , Robert T. Knight , Lexin Li

Dealing with high variance is a significant challenge in model-free reinforcement learning (RL). Existing methods are unreliable, exhibiting high variance in performance from run to run using different initializations/seeds. Focusing on…

机器学习 · 计算机科学 2019-05-15 Richard Cheng , Abhinav Verma , Gabor Orosz , Swarat Chaudhuri , Yisong Yue , Joel W. Burdick

We introduce Harmonic Robustness, a powerful and intuitive method to test the robustness of any machine-learning model either during training or in black-box real-time inference monitoring without ground-truth labels. It is based on…

机器学习 · 计算机科学 2024-04-30 Nicholas S. Kersting , Yi Li , Aman Mohanty , Oyindamola Obisesan , Raphael Okochu

It is well-known that trimmed sample means are robust against heavy tails and data contamination. This paper analyzes the performance of trimmed means and related methods in two novel contexts. The first one consists of estimating…

统计理论 · 数学 2025-12-03 Roberto I. Oliveira , Lucas Resende

Our goal is to build robust optimization problems for making decisions based on complex data from the past. In robust optimization (RO) generally, the goal is to create a policy for decision-making that is robust to our uncertainty about…

最优化与控制 · 数学 2014-07-07 Theja Tulabandhula , Cynthia Rudin