English
Related papers

Related papers: Revisiting Sampson Approximations for Geometric Es…

200 papers

Approximating a function with a finite series, e.g., involving polynomials or trigonometric functions, is a critical tool in computing and data analysis. The construction of such approximations via now-standard approaches like least squares…

Optimization and Control · Mathematics 2021-08-30 Dihan Dai , Yekaterina Epshteyn , Akil Narayan

We consider the problem of learning high-dimensional Gaussian graphical models. The graphical lasso is one of the most popular methods for estimating Gaussian graphical models. However, it does not achieve the oracle rate of convergence. In…

Machine Learning · Statistics 2017-06-06 Qiang Sun , Kean Ming Tan , Han Liu , Tong Zhang

Detection of a signal under noise is a classical signal processing problem. When monitoring spatial phenomena under a fixed budget, i.e., either physical, economical or computational constraints, the selection of a subset of available…

Signal Processing · Electrical Eng. & Systems 2018-08-01 Mario Coutino , Sundeep Prabhakar Chepuri , Geert Leus

Reconstruction of images from noisy linear measurements is a core problem in image processing, for which convex optimization methods based on total variation (TV) minimization have been the long-standing state-of-the-art. We present an…

Information Theory · Computer Science 2016-08-31 Jean Barbier , Eric W. Tramel , Florent Krzakala

Image restoration problems are often ill-posed, leading to significant uncertainty in reconstructed images. Accurately quantifying this uncertainty is essential for the reliable interpretation of reconstructed images. However, image…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Bernardin Tamo Amougou , Marcelo Pereyra , Barbara Pascal

We study the problem of learning local metrics for nearest neighbor classification. Most previous works on local metric learning learn a number of local unrelated metrics. While this "independence" approach delivers an increased flexibility…

Machine Learning · Computer Science 2012-09-17 Jun Wang , Adam Woznica , Alexandros Kalousis

Linear-parametric optimization, where multiple objectives are combined into a single objective using linear combinations with parameters as coefficients, has numerous links to other fields in optimization and a wide range of application…

Optimization and Control · Mathematics 2025-01-22 Levin Nemesch , Stefan Ruzika , Clemens Thielen , Alina Wittmann

Geometric tempering is a popular approach to sampling from challenging multi-modal probability distributions by instead sampling from a sequence of distributions which interpolate, using the geometric mean, between an easier proposal…

Machine Learning · Statistics 2025-04-09 Omar Chehab , Anna Korba , Austin Stromme , Adrien Vacher

We study entropy-bounded computational geometry, that is, geometric algorithms whose running times depend on a given measure of the input entropy. Specifically, we introduce a measure that we call range-partition entropy, which unifies and…

Computational Geometry · Computer Science 2025-08-29 David Eppstein , Michael T. Goodrich , Abraham M. Illickan , Claire A. To

Estimating linear, mean-square continuous functionals is a pivotal challenge in statistics. In high-dimensional contexts, this estimation is often performed under the assumption of exact model sparsity, meaning that only a small number of…

Statistics Theory · Mathematics 2025-08-04 Jelena Bradic , Victor Chernozhukov , Whitney K. Newey , Yinchu Zhu

We study computational and statistical consequences of problem geometry in stochastic and online optimization. By focusing on constraint set and gradient geometry, we characterize the problem families for which stochastic- and…

Optimization and Control · Mathematics 2025-07-17 Chen Cheng , Daniel Levy , John C. Duchi

Cooperative geolocation has attracted significant research interests in recent years. A large number of localization algorithms rely on the availability of statistical knowledge of measurement errors, which is often difficult to obtain in…

Applications · Statistics 2017-01-05 Xiufang Shi , Guoqiang Mao , Brian. D. O. Anderson , Zaiyue Yang , Jiming Chen

The graph is one of the most widely used mathematical structures in engineering and science because of its representational power and inherent ability to demonstrate the relationship between objects. The objective of this work is to…

Data Structures and Algorithms · Computer Science 2021-01-01 Shri Prakash Dwivedi

The problem of guaranteed parameter estimation (GPE) consists in enclosing the set of all possible parameter values, such that the model predictions match the corresponding measurements within prescribed error bounds. One of the bottlenecks…

Numerical Analysis · Mathematics 2018-10-30 Junyan Su , Yanlin Zha , Kai Wang , Mario E. Villanueva , Radoslav Paulen , Boris Houska

In this paper we consider a problem, called convex projection, of projecting a convex set onto a subspace. We will show that to a convex projection one can assign a particular multi-objective convex optimization problem, such that the…

Optimization and Control · Mathematics 2021-10-18 Gabriela Kováčová , Birgit Rudloff

Richardson extrapolation is a classical technique from numerical analysis that can improve the approximation error of an estimation method by combining linearly several estimates obtained from different values of one of its hyperparameters,…

Machine Learning · Computer Science 2020-07-20 Francis Bach

In this manuscript, we analyze the sparse signal recovery (compressive sensing) problem from the perspective of convex optimization by stochastic proximal gradient descent. This view allows us to significantly simplify the recovery analysis…

Data Structures and Algorithms · Computer Science 2013-04-19 Rong Jin , Tianbao Yang , Shenghuo Zhu

In high-dimensional linear regression, the goal pursued here is to estimate an unknown regression function using linear combinations of a suitable set of covariates. One of the key assumptions for the success of any statistical procedure in…

Statistics Theory · Mathematics 2015-03-13 Philippe Rigollet , Alexandre Tsybakov

Gaussian process (GP) models provide a powerful tool for prediction but are computationally prohibitive using large data sets. In such scenarios, one has to resort to approximate methods. We derive an approximation based on a composite…

Machine Learning · Statistics 2018-02-02 Xiuming Liu , Dave Zachariah , Edith C. H. Ngai

We propose new compressive parameter estimation algorithms that make use of polar interpolation to improve the estimator precision. Our work extends previous approaches involving polar interpolation for compressive parameter estimation in…

Information Theory · Computer Science 2016-11-17 Karsten Fyhn , Marco F. Duarte , Søren Holdt Jensen