English
Related papers

Related papers: Total positivity and least squares problems in the…

200 papers

Complexity bounds for many problems on matrices with univariate polynomial entries have been improved in the last few years. Still, for most related algorithms, efficient implementations are not available, which leaves open the question of…

Symbolic Computation · Computer Science 2019-05-14 Seung Gyu Hyun , Vincent Neiger , Éric Schost

We present the first framework to solve linear inverse problems leveraging pre-trained latent diffusion models. Previously proposed algorithms (such as DPS and DDRM) only apply to pixel-space diffusion models. We theoretically analyze our…

Machine Learning · Computer Science 2023-07-04 Litu Rout , Negin Raoof , Giannis Daras , Constantine Caramanis , Alexandros G. Dimakis , Sanjay Shakkottai

The popular Alternating Least Squares (ALS) algorithm for tensor decomposition is efficient and easy to implement, but often converges to poor local optima---particularly when the weights of the factors are non-uniform. We propose a…

Machine Learning · Computer Science 2017-09-26 Vatsal Sharan , Gregory Valiant

We present a fast algorithm for the total variation regularization of the $3$-D gravity inverse problem. Through imposition of the total variation regularization, subsurface structures presenting with sharp discontinuities are preserved…

Numerical Analysis · Mathematics 2022-08-16 Saeed Vatankhah , Rosemary A. Renaut , Vahid E. Ardestani

Modern control algorithms require tuning of square weight/penalty matrices appearing in quadratic functions/costs to improve performance and/or stability output. Due to simplicity in gain-tuning and enforcing positive-definiteness, diagonal…

Optimization and Control · Mathematics 2025-04-24 Nicholas P. Nurre , Ehsan Taheri

Low-rank matrix approximation is one of the central concepts in machine learning, with applications in dimension reduction, de-noising, multivariate statistical methodology, and many more. A recent extension to LRMA is called low-rank…

Machine Learning · Statistics 2021-09-24 Elena Tuzhilina , Trevor Hastie

This study focuses on addressing the challenge of solving the reduced biquaternion equality constrained least squares (RBLSE) problem. We develop algebraic techniques to derive real and complex solutions for the RBLSE problem by utilizing…

Numerical Analysis · Mathematics 2025-05-05 Sk. Safique Ahmad , Neha Bhadala

A novel algorithm to solve the quadratic programming problem over ellipsoids is proposed. This is achieved by splitting the problem into two optimisation sub-problems, quadratic programming over a sphere and orthogonal projection. Next, an…

Optimization and Control · Mathematics 2017-11-15 Anh-Huy Phan , Masao Yamagishi , Danilo Mandic , Andrzej Cichocki

We consider the solution of full column-rank least squares problems by means of normal equations that are preconditioned, symmetrically or non-symmetrically, with a randomized preconditioner. With an effective preconditioner, the solutions…

Numerical Analysis · Mathematics 2025-12-29 Ilse C. F. Ipsen

We use techniques from (tracial noncommutative) polynomial optimization to formulate hierarchies of semidefinite programming lower bounds on matrix factorization ranks. In particular, we consider the nonnegative rank, the positive…

Optimization and Control · Mathematics 2018-11-06 Sander Gribling , David de Laat , Monique Laurent

The paper concerns the study of criticality of Lagrange multipliers in variational systems that has been recognized in both theoretical and numerical aspects of optimization and variational analysis. In contrast to the previous developments…

Optimization and Control · Mathematics 2018-08-14 Boris Mordukhovich , Ebrahim Sarabi

We analyze the convergence of the Conjugate Gradient (CG) method in exact arithmetic, when the coefficient matrix $A$ is symmetric positive semidefinite and the system is consistent. To do so, we diagonalize $A$ and decompose the algorithm…

Numerical Analysis · Mathematics 2020-05-12 Ken Hayami

A new necessary and sufficient condition for the existence of minor left prime factorizations of multivariate polynomial matrices without full row rank is presented. The key idea is to establish a relationship between a matrix and its full…

Symbolic Computation · Computer Science 2020-10-15 Dong Lu , Dingkang Wang , Fanghui Xiao

Alternating minimization represents a widely applicable and empirically successful approach for finding low-rank matrices that best fit the given data. For example, for the problem of low-rank matrix completion, this method is believed to…

Machine Learning · Statistics 2012-12-04 Prateek Jain , Praneeth Netrapalli , Sujay Sanghavi

We study bihomogeneous systems defining, non-zero dimensional, biprojective varieties for which the projection onto the first group of variables results in a finite set of points. To compute (with) the 0-dimensional projection and the…

Commutative Algebra · Mathematics 2025-07-25 Matías Bender , Laurent Busé , Carles Checa , Elias Tsigaridas

This study presents a generalised least squares based method for fitting polygons and ellipses to data points. The method is based on a trigonometric fitness function that approximates a unit shape accurately, making it applicable to…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Yiming Quan , Shian Chen

We give explicit formulas as well as a quadratic time algorithm to solve (so called) generalized Vandermonde's systems of p linear equations and n variables. It allows in particular to find all (so called Lagrange's) interpolation polynoms…

Numerical Analysis · Mathematics 2007-09-14 Jean-Philippe Preaux , Jacques Raout

The affine inverse eigenvalue problem consists of identifying a real symmetric matrix with a prescribed set of eigenvalues in an affine space. Due to its ubiquity in applications, various instances of the problem have been widely studied in…

Optimization and Control · Mathematics 2019-11-07 Utkan Candogan , Yong Sheng Soh , Venkat Chandrasekaran

Copositive optimization is a special case of convex conic programming, and it consists of optimizing a linear function over the cone of all completely positive matrices under linear constraints. Copositive optimization provides powerful…

Optimization and Control · Mathematics 2022-10-05 Zhijian Lai , Akiko Yoshise

Robust Principal Component Analysis (PCA) (Candes et al., 2011) and low-rank matrix completion (Recht et al., 2010) are extensions of PCA to allow for outliers and missing entries respectively. It is well-known that solving these problems…

Numerical Analysis · Mathematics 2019-07-12 Jared Tanner , Andrew Thompson , Simon Vary