English
Related papers

Related papers: Enhanced Error Estimates for Augmented Subspace Me…

200 papers

This work investigates the impact of data augmentation on confidence calibration and uncertainty estimation in Named Entity Recognition (NER) tasks. For the future advance of NER in safety-critical fields like healthcare and finance, it is…

Computation and Language · Computer Science 2024-10-28 Wataru Hashimoto , Hidetaka Kamigaito , Taro Watanabe

We introduce a proximal version of dual coordinate ascent method. We demonstrate how the derived algorithmic framework can be used for numerous regularized loss minimization problems, including $\ell_1$ regularization and structured output…

Machine Learning · Statistics 2012-11-13 Shai Shalev-Shwartz , Tong Zhang

Two-phase sampling designs are frequently employed in epidemiological studies and large-scale health surveys. In such designs, certain variables are exclusively collected within a second-phase random subsample of the initial first-phase…

Methodology · Statistics 2024-03-25 Lingxiao Wang

We develop a principled approach to obtain exact computer-aided worst-case guarantees on the performance of second-order optimization methods on classes of univariate functions. We first present a generic technique to derive interpolation…

Optimization and Control · Mathematics 2025-07-01 Anne Rubbens , Nizar Bousselmi , Julien M. Hendrickx , François Glineur

The response envelope model provides substantial efficiency gains over the standard multivariate linear regression by identifying the material part of the response to the model and by excluding the immaterial part. In this paper, we propose…

Methodology · Statistics 2024-07-02 Oh-Ran Kwon , Hui Zou

We introduce new multilevel methods for solving large-scale unconstrained optimization problems. Specifically, the philosophy of multilevel methods is applied to Newton-type methods that regularize the Newton sub-problem using second order…

Optimization and Control · Mathematics 2024-07-16 Nick Tsipinakis , Panos Parpas

In this paper we discuss reduced order models for the approximation of parametric eigenvalue problems. In particular, we are interested in the presence of intersections or clusters of eigenvalues. The singularities originating by these…

Numerical Analysis · Mathematics 2024-07-11 Daniele Boffi , Abdul Halim , Gopal Priyadarshi

We introduce a new algorithm, extended regularized dual averaging (XRDA), for solving regularized stochastic optimization problems, which generalizes the regularized dual averaging (RDA) method. The main novelty of the method is that it…

Optimization and Control · Mathematics 2022-07-14 Jonathan W. Siegel , Jinchao Xu

By exploiting double-penalty terms for the primal subproblem, we develop a novel relaxed augmented Lagrangian method for solving a family of convex optimization problems subject to equality or inequality constraints. The method is then…

Numerical Analysis · Mathematics 2025-06-16 Jianchao Bai , Linyuan Jia , Zheng Peng

Neural networks have proven successful at learning from complex data distributions by acting as universal function approximators. However, they are often overconfident in their predictions, which leads to inaccurate and miscalibrated…

Machine Learning · Computer Science 2021-02-23 Jeffrey Willette , Juho Lee , Sung Ju Hwang

Adaptation methods are developed to adapt depth foundation models to endoscopic depth estimation recently. However, such approaches typically under-perform training since they limit the parameter search to a low-rank subspace and alter the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Shuting Zhao , Chenkang Du , Kristin Qi , Xinrong Chen , Xinhan Di

Sample inefficiency is a long-lasting challenge in deep reinforcement learning (DRL). Despite dramatic improvements have been made, the problem is far from being solved and is especially challenging in environments with sparse or delayed…

Machine Learning · Computer Science 2025-06-17 Federico Malato , Ville Hautamaki

Recovery type a posteriori error estimators are popular, particularly in the engineering community, for their computationally inexpensive, easy to implement, and generally asymptotically exactness. Unlike the residual type error estimators,…

Numerical Analysis · Mathematics 2025-03-26 Ying Liu , Jingjing Xiao , Nianyu Yi , Huihui Cao

Second-order optimization methods, such as cubic regularized Newton methods, are known for their rapid convergence rates; nevertheless, they become impractical in high-dimensional problems due to their substantial memory requirements and…

Optimization and Control · Mathematics 2024-01-09 Ruichen Jiang , Parameswaran Raman , Shoham Sabach , Aryan Mokhtari , Mingyi Hong , Volkan Cevher

The requirement to generate robust robotic platforms is a critical enabling step to allow such platforms to permeate safety-critical applications (i.e., the localization of autonomous platforms in urban environments). One of the primary…

Signal Processing · Electrical Eng. & Systems 2019-08-14 Ryan M. Watson , Jason N. Gross , Clark N. Taylor , Robert C. Leishman

Subspace recycling techniques have been used quite successfully for the acceleration of iterative methods for solving large-scale linear systems. These methods often work by augmenting a solution subspace generated iteratively by a known…

Numerical Analysis · Mathematics 2021-05-18 Ronny Ramlau , Kirk M. Soodhalter , Victoria Hutterer

The design and complexity analysis of randomized coordinate descent methods, and in particular of variants which update a random subset (sampling) of coordinates in each iteration, depends on the notion of expected separable…

Optimization and Control · Mathematics 2015-05-29 Zheng Qu , Peter Richtárik

This paper is devoted to study the Arnold-Winther mixed finite element method for two dimensional Stokes eigenvalue problems using the stress-velocity formulation. A priori error estimates for the eigenvalue and eigenfunction errors are…

Numerical Analysis · Mathematics 2017-12-20 Joscha Gedicke , Arbaz Khan

In this paper, we investigate accelerated first-order methods for smooth convex optimization problems under inexact information on the gradient of the objective. The noise in the gradient is considered to be additive with two possibilities:…

Optimization and Control · Mathematics 2023-01-10 Vasin Artem , Alexander Gasnikov , Pavel Dvurechensky , Vladimir Spokoiny

This work develops polynomial-degree-robust (p-robust) equilibrated a posteriori error estimates for $H(\rm curl)$, $H(\rm div)$ and $H(\rm divdiv)$ problems, based on $H^1$ auxiliary space decomposition. The proposed framework employs…

Numerical Analysis · Mathematics 2025-11-14 Yuwen Li