English
Related papers

Related papers: Notes on Exact Boundary Values in Residual Minimis…

200 papers

In this work, we propose and analyze a residual-minimization strategy for the numerical solution of nonlinear PDEs posed in Banach spaces. Given a finite-dimensional trial space and a suitably enriched discrete test space (of higher…

Numerical Analysis · Mathematics 2026-04-02 Ignacio Muga , Jorge Perera , Sergio Rojas , Ricardo Ruiz-Baier

There has been a growing interest in anomaly detection problems recently, whilst their focuses are mostly on anomalies taking place on the time index. In this work, we investigate a new anomaly-in-mean problem in multidimensional spatial…

Methodology · Statistics 2025-10-29 Baiyu Wang , Chao Zheng

We consider linear reaction-diffusion equations posed on unbounded domains, and discretized by adaptive Lagrange finite elements. To obtain finite-dimensional spaces, it is necessary to introduce a truncation boundary, whereby only a…

Numerical Analysis · Mathematics 2025-11-13 Théophile Chaumont-Frelet , Gregor Gantner

We obtain bounds on estimation error rates for regularization procedures of the form \begin{equation*} \hat f \in {\rm argmin}_{f\in F}\left(\frac{1}{N}\sum_{i=1}^N\left(Y_i-f(X_i)\right)^2+\lambda \Psi(f)\right) \end{equation*} when $\Psi$…

Statistics Theory · Mathematics 2017-01-04 Guillaume Lecué , Shahar Mendelson

We consider an optimization problem with strongly convex objective and linear inequalities constraints. To be able to deal with a large number of constraints we provide a penalty reformulation of the problem. As penalty functions we use a…

Optimization and Control · Mathematics 2020-04-29 Angelia Nedich , Tatiana Tatarenko

This paper studies the sparsistency and rates of convergence for estimating sparse covariance and precision matrices based on penalized likelihood with nonconvex penalty functions. Here, sparsistency refers to the property that all…

Statistics Theory · Mathematics 2009-11-20 Clifford Lam , Jianqing Fan

As shown in [15], under some structural assumptions, working on congested traffic problems in general and increasingly dense networks leads, at the limit by {\Gamma}-convergence, to continuous minimization problems posed on measures on…

Optimization and Control · Mathematics 2015-07-07 Roméo Hatchi

Low-rank tensor methods for the approximate solution of second-order elliptic partial differential equations in high dimensions have recently attracted significant attention. A critical issue is to rigorously bound the error of such…

Numerical Analysis · Mathematics 2014-12-15 Markus Bachmayr , Wolfgang Dahmen

People tend to behave inconsistently over time due to an inherent present bias. As this may impair performance, social and economic settings need to be adapted accordingly. Common tools to reduce the impact of time-inconsistent behavior are…

Data Structures and Algorithms · Computer Science 2017-02-07 Susanne Albers , Dennis Kraft

We study two time-scale linear stochastic approximation algorithms, which can be used to model well-known reinforcement learning algorithms such as GTD, GTD2, and TDC. We present finite-time performance bounds for the case where the…

Machine Learning · Computer Science 2019-07-16 Harsh Gupta , R. Srikant , Lei Ying

In a general setting, we study a posteriori estimates used in finite element analysis to measure the error between a solution and its approximation. The latter is not necessarily generated by a finite element method. We show that the error…

Numerical Analysis · Mathematics 2025-07-09 Thomas Führer , Sergio Rojas

The use of machine-learning in neuroimaging offers new perspectives in early diagnosis and prognosis of brain diseases. Although such multivariate methods can capture complex relationships in the data, traditional approaches provide…

A regularized minimization model with $l_1$-norm penalty (RP) is introduced for training the autoencoders that belong to a class of two-layer neural networks. We show that the RP can act as an exact penalty model which shares the same…

Optimization and Control · Mathematics 2022-04-22 Wei Liu , Xin Liu , Xiaojun Chen

Individual treatment effects are not point-identified from data. The Probability of Necessity and Sufficiency (PNS) circumvents this limitation by characterizing individual-level causality through intersection bounds derived from combined…

Machine Learning · Statistics 2026-05-11 Gandharv Patil , Keyi Tang , Raquel Aoki , Leo Guelman

Regularization in the optimization of deep neural networks is often critical to avoid undesirable over-fitting leading to better generalization of model. One of the most popular regularization algorithms is to impose L-2 penalty on the…

Machine Learning · Computer Science 2019-08-09 Kensuke Nakamura , Byung-Woo Hong

AdaBoost sequentially fits so-called weak learners to minimize an exponential loss, which penalizes misclassified data points more severely than other loss functions like cross-entropy. Paradoxically, AdaBoost generalizes well in practice…

Machine Learning · Computer Science 2026-05-13 Klaus-Rudolf Kladny , Bernhard Schölkopf , Michael Muehlebach

We study strong approximation of scalar additive noise driven stochastic differential equations (SDEs) at time point $1$ in the case that the drift coefficient is bounded and has Sobolev regularity $s\in(0,1)$. Recently, it has been shown…

Probability · Mathematics 2024-03-14 Simon Ellinger , Thomas Müller-Gronbach , Larisa Yaroslavtseva

We consider the problem of adversarial bandit convex optimization, that is, online learning over a sequence of arbitrary convex loss functions with only one function evaluation for each of them. While all previous works assume known and…

Machine Learning · Computer Science 2022-02-15 Haipeng Luo , Mengxiao Zhang , Peng Zhao

We study the asymptotics in $L^2$ for complexity penalized least squares regression for the discrete approximation of finite-dimensional signals on continuous domains - e.g. images - by piecewise smooth functions. We introduce a fairly…

Statistics Theory · Mathematics 2013-01-30 Laurent Demaret , Felix Friedrich , Volkmar Liebscher , Gerhard Winkler

Existing approaches typically rely on fixed length penalties, but such penalties are hard to tune and fail to adapt to the evolving reasoning abilities of LLMs, leading to suboptimal trade-offs between accuracy and conciseness. To address…

Artificial Intelligence · Computer Science 2025-12-29 Yanhao Li , Lu Ma , Jiaran Zhang , Lexiang Tang , Wentao Zhang , Guibo Luo