中文
相关论文

相关论文: Optimal adaptation for early stopping in statistic…

200 篇论文

We investigate implicit regularization schemes for gradient descent methods applied to unpenalized least squares regression to solve the problem of reconstructing a sparse signal from an underdetermined system of linear measurements under…

机器学习 · 统计学 2019-09-12 Tomas Vaškevičius , Varun Kanade , Patrick Rebeschini

Increasingly high-dimensional data sets require that estimation methods do not only satisfy statistical guarantees but also remain computationally feasible. In this context, we consider $ L^{2} $-boosting via orthogonal matching pursuit in…

统计理论 · 数学 2022-10-17 Bernhard Stankewitz

In this paper we investigate an adaptive discretization strategy for ill-posed linear prob- lems combined with a regularization from a class of semiiterative methods. We show that such a discretization approach in combination with a…

数值分析 · 数学 2014-07-22 Wolfgang Erb , Evgeniya V. Semenova

In this paper, we aim at recovering an unknown signal x0 from noisy L1measurements y=Phi*x0+w, where Phi is an ill-conditioned or singular linear operator and w accounts for some noise. To regularize such an ill-posed inverse problem, we…

统计理论 · 数学 2013-11-05 Samuel Vaiter , Charles Deledalle , Gabriel Peyré , Charles Dossal , Jalal Fadili

A nonlinear optimization method is proposed for the solution of inverse medium problems with spatially varying properties. To avoid the prohibitively large number of unknown control variables resulting from standard grid-based…

数值分析 · 数学 2023-07-28 Yannik G. Gleichmann , Marcus J. Grote

We consider the problem of learning the optimal policy for Markov decision processes with safety constraints. We formulate the problem in a reach-avoid setup. Our goal is to design online reinforcement learning algorithms that ensure safety…

机器学习 · 计算机科学 2026-01-21 Abhijit Mazumdar , Rafal Wisniewski , Manuela L. Bujorianu

We consider the problem of reconstructing the shape of an impenetrable sound-soft obstacle from scattering measurements. The input data is assumed to be the far-field pattern generated when a plane wave impinges on an unknown obstacle from…

数值分析 · 数学 2015-05-28 Carlos Borges , Leslie Greengard

Blind inverse problems arise in many experimental settings where both the signal of interest and the forward operator are (partially) unknown. In this context, methods developed for the non-blind case cannot be adapted in a straightforward…

机器学习 · 计算机科学 2026-04-21 Nathan Buskulic , Luca Calatroni , Lorenzo Rosasco , Silvia Villa

It is an interesting open problem to achieve adaptive prescribed-time control for strict-feedback systems with unknown and fast or even abrupt time-varying parameters. In this paper we present a solution with the aid of several design and…

系统与控制 · 电气工程与系统科学 2022-10-25 Hefu Ye , Yongduan Song

In this work, we address the solution of both linear and nonlinear ill-posed inverse problems by developing a novel graph-based regularization framework, where the regularization term is formulated through an iteratively updated graph…

数值分析 · 数学 2026-01-21 Harshit Bajpai , Ankik Kumar Giri

We study the problem of adaptively controlling a known discrete-time nonlinear system subject to unmodeled disturbances. We prove the first finite-time regret bounds for adaptive nonlinear control with matched uncertainty in the stochastic…

机器学习 · 计算机科学 2020-11-30 Nicholas M. Boffi , Stephen Tu , Jean-Jacques E. Slotine

This paper explores adaptive variance reduction methods for stochastic optimization based on the STORM technique. Existing adaptive extensions of STORM rely on strong assumptions like bounded gradients and bounded function values, or suffer…

最优化与控制 · 数学 2024-10-24 Wei Jiang , Sifan Yang , Yibo Wang , Lijun Zhang

We investigate an entropy-regularized reinforcement learning (RL) approach to optimal stopping problems motivated by real option models. Classical stopping rules are strict and non-randomized, limiting natural exploration in RL settings. To…

最优化与控制 · 数学 2026-02-18 Jodi Dianetti , Giorgio Ferrari , Renyuan Xu

Finding a sparse representation of a possibly noisy signal can be modeled as a variational minimization with l_q-sparsity constraints for q less than one. Especially for real-time, on-line, or iterative applications, in which problems of…

数值分析 · 数学 2017-09-04 Martin Ehler

Early stopping based on hold-out data is a popular regularization technique designed to mitigate overfitting and increase the predictive accuracy of neural networks. Models trained with early stopping often provide relatively accurate…

机器学习 · 统计学 2023-06-28 Ziyi Liang , Yanfei Zhou , Matteo Sesia

Inverse optimization refers to the inference of unknown parameters of an optimization problem based on knowledge of its optimal solutions. This paper considers inverse optimization in the setting where measurements of the optimal solutions…

最优化与控制 · 数学 2017-12-27 Anil Aswani , Zuo-Jun Max Shen , Auyon Siddiq

In this study, we present and analyze a novel variant of the stochastic gradient descent method, referred as Stochastic data-driven Bouligand Landweber iteration tailored for addressing the system of non-smooth ill-posed inverse problems.…

泛函分析 · 数学 2024-02-08 Harshit Bajpai , Gaurav Mittal , Ankik Kumar Giri

The aim of this paper is to investigate the use of an entropic projection method for the iterative regularization of linear ill-posed problems. We derive a closed form solution for the iterates and analyze their convergence behaviour both…

最优化与控制 · 数学 2020-01-29 Martin Burger , Elena Resmerita , Martin Benning

Various algorithms for reinforcement learning (RL) exhibit dramatic variation in their convergence rates as a function of problem structure. Such problem-dependent behavior is not captured by worst-case analyses and has accordingly inspired…

机器学习 · 统计学 2022-01-24 Koulik Khamaru , Eric Xia , Martin J. Wainwright , Michael I. Jordan

The question of fast convergence in the classical problem of high dimensional linear regression has been extensively studied. Arguably, one of the fastest procedures in practice is Iterative Hard Thresholding (IHT). Still, IHT relies…

统计理论 · 数学 2020-08-28 Mohamed Ndaoud