English
Related papers

Related papers: Global polynomial-time estimation in statistical n…

200 papers

Solutions to inverse problems that are ill-conditioned or ill-posed may have significant intrinsic uncertainty. Unfortunately, analysing and quantifying this uncertainty is very challenging, particularly in high-dimensional problems. As a…

Methodology · Statistics 2016-07-12 Marcelo Pereyra

High-dimensional learning problems, where the number of features exceeds the sample size, often require sparse regularization for effective prediction and variable selection. While established for fully supervised data, these techniques…

Machine Learning · Computer Science 2026-01-01 The Tien Mai , Mai Anh Nguyen , Trung Nghia Nguyen

This paper is concerned with solving nonconvex learning problems with folded concave penalty. Despite that their global solutions entail desirable statistical properties, they lack optimization techniques that guarantee global optimality in…

Statistics Theory · Mathematics 2016-03-25 Hongcheng Liu , Tao Yao , Runze Li

This paper has two main goals: (a) establish several statistical properties---consistency, asymptotic distributions, and convergence rates---of stationary solutions and values of a class of coupled nonconvex and nonsmoothempirical risk…

Statistics Theory · Mathematics 2019-10-08 Zhengling Qi , Ying Cui , Yufeng Liu , Jong-Shi Pang

In this paper, we propose and study several inverse problems of identifying/determining unknown coefficients for a class of coupled PDE systems by measuring the average flux data on part of the underlying boundary. In these coupled systems,…

Analysis of PDEs · Mathematics 2023-05-19 Ming-Hui Ding , Hongyu Liu , Guang-Hui Zheng

Estimating high-quality images while also quantifying their uncertainty are two desired features in an image reconstruction algorithm for solving ill-posed inverse problems. In this paper, we propose plug-and-play Monte Carlo (PMC) as a…

Image and Video Processing · Electrical Eng. & Systems 2024-08-29 Yu Sun , Zihui Wu , Yifan Chen , Berthy T. Feng , Katherine L. Bouman

We propose a computationally efficient estimator, formulated as a convex program, for a broad class of non-linear regression problems that involve difference of convex (DC) non-linearities. The proposed method can be viewed as a significant…

Machine Learning · Statistics 2019-04-01 Sohail Bahmani

Schemes with the second-order approximation in time are considered for numerical solving the Cauchy problem for an evolutionary equation of first order with a self-adjoint operator. The implicit two-level scheme based on the Pad\'{e}…

Numerical Analysis · Computer Science 2015-04-17 P. N. Vabishchevich

The sparse inverse covariance estimation problem is commonly solved using an $\ell_{1}$-regularized Gaussian maximum likelihood estimator known as "graphical lasso", but its computational cost becomes prohibitive for large data sets. A…

Machine Learning · Statistics 2018-06-08 Richard Y. Zhang , Salar Fattahi , Somayeh Sojoudi

This article presents a new approach to the real-time solution of inverse problems on embedded systems. The class of problems addressed corresponds to ordinary differential equations (ODEs) with generalized linear constraints, whereby the…

Discrete Mathematics · Computer Science 2014-06-03 Christoph Gugg , Matthew Harker , Paul O'Leary , Gerhard Rath

We develop an efficient, unconditionally stable, variable step second order exponential time differencing scheme for the incompressible Navier Stokes equations in two and three spatial dimensions under periodic boundary conditions, together…

Numerical Analysis · Mathematics 2026-02-24 Haifeng Wang , Xiaoming Wang , Min Zhang

We propose new a posteriori error estimators for non-conforming finite element discretizations of second-order elliptic PDE problems. These estimators are based on novel reformulations of the standard Prager-Synge identity, and enable to…

Numerical Analysis · Mathematics 2026-01-22 T. Chaumont-Frelet

In this work, we show that for all statistical estimation problems, a natural MMSE instability (discontinuity) condition implies the failure of stable algorithms, serving as a version of OGP for estimation tasks. Using this criterion, we…

Statistics Theory · Mathematics 2026-03-24 Xifan Yu , Ilias Zadik

Estimating conditional dependence graphs and precision matrices are some of the most common problems in modern statistics and machine learning. When data are fully observed, penalized maximum likelihood-type estimators have become standard…

Machine Learning · Statistics 2019-04-09 Roger Fan , Byoungwook Jang , Yuekai Sun , Shuheng Zhou

We introduce a new concept of approximation applicable to decision problems and functions, inspired by Bayesian probability. From the perspective of a Bayesian reasoner with limited computational resources, the answer to a problem that…

Computational Complexity · Computer Science 2025-06-27 Vanessa Kosoy , Alexander Appel

We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the…

Methodology · Statistics 2019-09-09 Alexandre Belloni , Abhishek Kaul , Mathieu Rosenbaum

In the field of global optimization, many existing algorithms face challenges posed by non-convex target functions and high computational complexity or unavailability of gradient information. These limitations, exacerbated by sensitivity to…

Optimization and Control · Mathematics 2023-10-16 Xinyu Zhang , Sujit Ghosh

This work develops a class of probabilistic algorithms for the numerical solution of nonlinear, time-dependent partial differential equations (PDEs). Current state-of-the-art PDE solvers treat the space- and time-dimensions separately,…

Numerical Analysis · Mathematics 2022-03-10 Nicholas Krämer , Jonathan Schmidt , Philipp Hennig

Bayesian linear inverse problems aim to recover an unknown signal from noisy observations, incorporating prior knowledge. This paper analyses a data-dependent method to choose the scale parameter of a Gaussian prior. The method we study…

Statistics Theory · Mathematics 2025-10-22 Maia Tienstra , Sebastian Reich

This paper proposes a nonlinear estimator for the robust reconstruction of process and sensor faults for a class of uncertain nonlinear systems. The proposed fault estimation method augments the system dynamics with an ultra-local (in time)…

Systems and Control · Electrical Eng. & Systems 2024-06-11 Farhad Ghanipoor , Carlos Murguia , Peyman Mohajerin Esfahani , Nathan van de Wouw