中文
相关论文

相关论文: $\mathscr{H}$-Consistency Estimation Error of Surr…

200 篇论文

This paper is devoted to the estimators of the mean that provide strong non-asymptotic guarantees under minimal assumptions on the underlying distribution. The main ideas behind proposed techniques are based on bridging the notions of…

统计理论 · 数学 2019-05-07 Stanislav Minsker

In classification, the de facto method for aggregating individual losses is the average loss. When the actual metric of interest is 0-1 loss, it is common to minimize the average surrogate loss for some well-behaved (e.g. convex) surrogate.…

机器学习 · 计算机科学 2018-11-06 Bryan He , James Zou

The paper is concerned with guaranteed a posteriori error estimates for a class of evolutionary problems related to poroelastic media governed by the quasi-static linear Biot equations. The system is decoupled employing the fixed-stress…

数值分析 · 数学 2020-01-22 Kundan Kumar , Svetlana Kyas , Jan Nordbotten , Sergey Repin

This article studies the achievable guarantees on the error rates of certain learning algorithms, with particular focus on refining logarithmic factors. Many of the results are based on a general technique for obtaining bounds on the error…

机器学习 · 计算机科学 2016-09-13 Steve Hanneke

The aim of this paper is to provide several novel upper bounds on the excess risk with a primal focus on classification problems. We suggest two approaches and the obtained bounds are represented via the distribution dependent local…

统计理论 · 数学 2018-03-13 Nikita Zhivotovskiy

Analysis of non-asymptotic estimation error and structured statistical recovery based on norm regularized regression, such as Lasso, needs to consider four aspects: the norm, the loss function, the design matrix, and the noise model. This…

机器学习 · 统计学 2015-12-01 Arindam Banerjee , Sheng Chen , Farideh Fazayeli , Vidyashankar Sivakumar

For optimization on large-scale data, exactly calculating its solution may be computationally difficulty because of the large size of the data. In this paper we consider subsampled optimization for fast approximating the exact solution. In…

机器学习 · 统计学 2018-04-11 Rong Zhu , Jiming Jiang

The generalization error of a learning algorithm refers to the discrepancy between the loss of a learning algorithm on training data and that on unseen testing data. Various information-theoretic bounds on the generalization error have been…

信息论 · 计算机科学 2025-06-24 Xuetong Wu , Jonathan H. Manton , Uwe Aickelin , Jingge Zhu

In this paper, we study the problem of consistency in the context of adversarial examples. Specifically, we tackle the following question: can surrogate losses still be used as a proxy for minimizing the $0/1$ loss in the presence of an…

机器学习 · 计算机科学 2022-05-23 Laurent Meunier , Raphaël Ettedgui , Rafael Pinot , Yann Chevaleyre , Jamal Atif

Deep neural networks often fail when deployed in real-world contexts due to distribution shift, a critical barrier to building safe and reliable systems. An emerging approach to address this problem relies on \emph{disagreement discrepancy}…

机器学习 · 计算机科学 2025-12-08 Neil G. Marchant , Andrew C. Cullen , Feng Liu , Sarah M. Erfani

This paper develops a new framework for indirect statistical inference with guaranteed necessity and sufficiency, applicable to continuous random variables. We prove that when comparing exponentially transformed order statistics from an…

统计理论 · 数学 2025-09-25 Z Zhang , X Hu , C Lu , T Liu

The paper is concerned with space-time IgA approximations of parabolic initial-boundary value problems. We deduce guaranteed and fully computable error bounds adapted to special features of IgA approximations and investigate their…

数值分析 · 数学 2018-02-20 Ulrich Langer , Svetlana Matculevich , Sergey Repin

Measurement-constrained datasets, often encountered in semi-supervised learning, arise when data labeling is costly, time-intensive, or hindered by confidentiality or ethical concerns, resulting in a scarcity of labeled data. In certain…

统计方法学 · 统计学 2025-01-15 Yixin Shen , Yang Ning

We prove bounds for the number of solutions to $$a_1 + \dots + a_k = a_1' + \dots + a_k'$$ over $N$-element sets of reals, which are sufficiently convex or near-convex. A near-convex set will be the image of a set with small additive…

数论 · 数学 2021-04-26 Peter J. Bradshaw , Brandon Hanson , Misha Rudnev

Adversarially robust classification seeks a classifier that is insensitive to adversarial perturbations of test patterns. This problem is often formulated via a minimax objective, where the target loss is the worst-case value of the 0-1…

机器学习 · 统计学 2021-05-14 Han Bao , Clayton Scott , Masashi Sugiyama

In many practical and numerical inverse problems, the exact data log-likelihood is not fully accessible, motivating the use of surrogate models. We study heteroscedastic nonparametric nonlinear regression problems with Gaussian errors and…

统计理论 · 数学 2026-03-31 Fanny Seizilles , Maximilian Siebel

We study semi Lagrangian approximation schemes for Hamilton Jacobi Bellman equations arising from finite horizon optimal control problems. Classical error estimates for these schemes include the term $\frac{1}{\Delta t}$ which leads to…

最优化与控制 · 数学 2026-02-18 Alessandro Alla , Filippo Mayer

We study the problem of estimating the diagonal of an implicitly given matrix $A$. For such a matrix we have access to an oracle that allows us to evaluate the matrix vector product $Av$. For random variable $v$ drawn from an appropriate…

数据结构与算法 · 计算机科学 2022-01-27 Robert A. Baston , Yuji Nakatsukasa

Consensus is a well-studied problem in distributed sensing, computation and control, yet deriving useful and easily computable bounds on the rate of convergence to consensus remains a challenge. This paper discusses the use of seminorms for…

系统与控制 · 电气工程与系统科学 2025-08-29 Ron Ofir , Ji Liu , A. Stephen Morse , Brian D. O. Anderson

The $\ell_0$-constrained empirical risk minimization ($\ell_0$-ERM) is a promising tool for high-dimensional statistical estimation. The existing analysis of $\ell_0$-ERM estimator is mostly on parameter estimation and support recovery…

统计理论 · 数学 2020-01-22 Xiao-Tong Yuan , Ping Li