English
Related papers

Related papers: The quasi-optimality criterion in the linear funct…

200 papers

Estimating linear, mean-square continuous functionals is a pivotal challenge in statistics. In high-dimensional contexts, this estimation is often performed under the assumption of exact model sparsity, meaning that only a small number of…

Statistics Theory · Mathematics 2025-08-04 Jelena Bradic , Victor Chernozhukov , Whitney K. Newey , Yinchu Zhu

In this paper, we consider a static, multi-period newsvendor model under a budget constraint. In the case where the true demand distribution is known, we develop a heuristic algorithm to solve the problem. By comparing this algorithm with…

Optimization and Control · Mathematics 2023-12-04 Ben Black , Trivikram Dokka , Christopher Kirkbride

In this paper, we establish minimax optimal rates of convergence for prediction in a semi-functional linear model that consists of a functional component and a less smooth nonparametric component. Our results reveal that the smoother…

Statistics Theory · Mathematics 2021-11-01 Keli Guo , Jun Fan , Lixing Zhu

The analysis of Tikhonov regularization for nonlinear ill-posed equations with smoothness promoting penalties is an important topic in inverse problem theory. With focus on Hilbert scale models, the case of oversmoothing penalties, i.e.,…

Numerical Analysis · Mathematics 2024-04-18 Bernd Hofmann , Christopher Hofmann , Peter Mathé , Robert Plato

The problem of remotely stabilizing a noisy linear time invariant plant over a Gaussian relay network is addressed. The network is comprised of a sensor node, a group of relay nodes and a remote controller. The sensor and the relay nodes…

Optimization and Control · Mathematics 2013-07-30 Ali A. Zaidi , Tobias J. Oechtering , Serdar Yuksel , Mikael Skoglund

This paper gives two theoretical results on estimating low-rank parameter matrices for linear models with multivariate responses. We first focus on robust parameter estimation of low-rank multi-task learning with heavy-tailed data and…

Statistics Theory · Mathematics 2023-05-24 Kangqiang Li , Yuxuan Wang

This work uses the entropy-regularised relaxed stochastic control perspective as a principled framework for designing reinforcement learning (RL) algorithms. Herein agent interacts with the environment by generating noisy controls…

Machine Learning · Computer Science 2023-09-18 Lukasz Szpruch , Tanut Treetanthiploet , Yufei Zhang

Regularization plays a pivotal role when facing the challenge of solving ill-posed inverse problems, where the number of observations is smaller than the ambient dimension of the object to be estimated. A line of recent work has studied…

Optimization and Control · Mathematics 2014-07-03 Samuel Vaiter , Mohammad Golbabaee , Jalal M. Fadili , Gabriel Peyré

This paper describes a new approach to solving some stochastic optimization problems for linear dynamic system with various parametric uncertainties. Proposed approach is based on application of tensor formalism for creation the…

Artificial Intelligence · Computer Science 2009-09-15 Vadim Yatsenko

Additive regression provides an extension of linear regression by modeling the signal of a response as a sum of functions of covariates of relatively low complexity. We study penalized estimation in high-dimensional nonparametric additive…

Statistics Theory · Mathematics 2017-04-25 Zhiqiang Tan , Cun-Hui Zhang

Most inverse optimization models impute unspecified parameters of an objective function to make an observed solution optimal for a given optimization problem with a fixed feasible set. We propose two approaches to impute unspecified…

Optimization and Control · Mathematics 2019-07-19 Timothy C. Y. Chan , Neal Kaw

We consider the sparse optimization problem with nonlinear constraints and an objective function, which is given by the sum of a general smooth mapping and an additional term defined by the $ \ell_0 $-quasi-norm. This term is used to obtain…

Optimization and Control · Mathematics 2022-10-19 Christian Kanzow , Alexandra Schwarz , Felix Weiß

We develop a family of reformulations of an arbitrary consistent linear system into a stochastic problem. The reformulations are governed by two user-defined parameters: a positive definite matrix defining a norm, and an arbitrary discrete…

Numerical Analysis · Mathematics 2020-01-27 Peter Richtárik , Martin Takáč

We consider optimal sensor placement for a family of linear Bayesian inverse problems characterized by a deterministic hyper-parameter. The hyper-parameter describes distinct configurations in which measurements can be taken of the observed…

Numerical Analysis · Mathematics 2023-01-31 Nicole Aretz , Peng Chen , Denise Degen , Karen Veroy

Regularization is a core component of modern inverse problems, as it helps establish the well-posedness of the solution of interest. Popular regularization approaches include variational regularization and iterative regularization. The…

Optimization and Control · Mathematics 2025-08-08 Jie Gao , Cesare Molinari , Silvia Villa , Jingwei Liang

A number of regularization methods for discrete inverse problems consist in considering weighted versions of the usual least square solution. However, these so-called filter methods are generally restricted to monotonic transformations,…

Statistics Theory · Mathematics 2011-05-05 Paul Rochet

Modern applications require methods that are computationally feasible on large datasets but also preserve statistical efficiency. Frequently, these two concerns are seen as contradictory: approximation methods that enable computation are…

Methodology · Statistics 2021-06-11 Darren Homrighausen , Daniel J. McDonald

In this paper, we establish an initial theory regarding the Second Order Asymptotical Regularization (SOAR) method for the stable approximate solution of ill-posed linear operator equations in Hilbert spaces, which are models for linear…

Numerical Analysis · Mathematics 2018-08-28 Ye Zhang , Bernd Hofmann

Linear programs with quadratic regularization are attracting renewed interest due to their applications in optimal transport: unlike entropic regularization, the squared-norm penalty gives rise to sparse approximations of optimal transport…

Optimization and Control · Mathematics 2025-04-23 Alberto González-Sanz , Marcel Nutz

The Column Subset Selection Problem provides a natural framework for unsupervised feature selection. Despite being a hard combinatorial optimization problem, there exist efficient algorithms that provide good approximations. The drawback of…

Machine Learning · Computer Science 2018-04-13 Bruno Ordozgoiti , Alberto Mozo , Jesús García López de Lacalle