English
Related papers

Related papers: Ground States and Singular Vectors of Convex Varia…

200 papers

Regularization is critical for solving ill-posed geophysical inverse problems. Explicit regularization is often used, but there are opportunities to explore the implicit regularization effects that are inherent in a Neural Network…

Machine Learning · Computer Science 2024-07-10 Anran Xu , Lindsey J. Heagy

Deep convolutional neural networks trained on large datsets have emerged as an intriguing alternative for compressing images and solving inverse problems such as denoising and compressive sensing. However, it has only recently been realized…

Machine Learning · Computer Science 2019-07-09 Reinhard Heckel

Motivated by robust matrix recovery problems such as Robust Principal Component Analysis, we consider a general optimization problem of minimizing a smooth and strongly convex loss function applied to the sum of two blocks of variables,…

Machine Learning · Computer Science 2019-11-19 Dan Garber , Shoham Sabach , Atara Kaplan

In this paper we present a general convex optimization approach for solving high-dimensional multiple response tensor regression problems under low-dimensional structural assumptions. We consider using convex and weakly decomposable…

Statistics Theory · Mathematics 2017-04-17 Garvesh Raskutti , Ming Yuan , Han Chen

We discuss the local behaviour of vector fields in the plane $\R^2$ around a regular singular point, using recently introduced reduced normal forms, i.e. Poincar\'e and Lie renormalized forms [{\it Lett. Math. Phys.} {\bf 42} (1997),…

Mathematical Physics · Physics 2007-05-23 Giuseppe Gaeta

The eigenvalue problem plays a central role in linear algebra and its applications in control and optimization methods. In particular, many matrix decompositions rely upon computation of eigenvalue-eigenvector pairs, such as diagonal or…

Optimization and Control · Mathematics 2016-07-15 Pavel Osinenko , Grigory Devadze , Stefan Streif

The singular value matrix decomposition plays a ubiquitous role throughout statistics and related fields. Myriad applications including clustering, classification, and dimensionality reduction involve studying and exploiting the geometric…

Statistics Theory · Mathematics 2018-10-03 Joshua Cape , Minh Tang , Carey E. Priebe

In this work, we study the dynamics of piecewise smooth systems on a codimension-2 transverse intersection of two codimension-1 discontinuity sets. The Filippov convention can be extended to such intersections, but this approach does not…

Dynamical Systems · Mathematics 2019-09-24 P. Kaklamanos , K. Uldall Kristiansen

A key observation underlying this paper is the fact that the range invariance condition for convergence of regularization methods for nonlinear ill-posed operator equations -- such as coefficient identification in partial differential…

Numerical Analysis · Mathematics 2023-07-26 Barbara Kaltenbacher

Sparse regularization plays a central role in solving inverse problems arising from incomplete or corrupted measurements. Different regularizers correspond to different prior assumptions about the structure of the unknown signal, and…

Machine Learning · Statistics 2026-03-16 Kanghun Lee , Hyungjoon Soh , Junghyo Jo

We introduce a novel class of regularization functions, called Cauchy-Schwarz (CS) regularizers, which can be designed to induce a wide range of properties in solution vectors of optimization problems. To demonstrate the versatility of CS…

Optimization and Control · Mathematics 2025-03-18 Sueda Taner , Ziyi Wang , Christoph Studer

In this paper, we consider the singular values and singular vectors of finite, low rank perturbations of large rectangular random matrices. Specifically, we prove almost sure convergence of the extreme singular values and appropriate…

Probability · Mathematics 2012-01-27 Florent Benaych-Georges , Raj Rao Nadakuditi

In this paper, we propose a unified convergence analysis for a class of generic shuffling-type gradient methods for solving finite-sum optimization problems. Our analysis works with any sampling without replacement strategy and covers many…

Optimization and Control · Mathematics 2021-09-21 Lam M. Nguyen , Quoc Tran-Dinh , Dzung T. Phan , Phuong Ha Nguyen , Marten van Dijk

We derive an efficient stochastic algorithm for inverse problems that present an unknown linear forcing term and a set of nonlinear parameters to be recovered. It is assumed that the data is noisy and that the linear part of the problem is…

Numerical Analysis · Mathematics 2019-09-17 Darko Volkov

Linear models have found widespread use in statistical investigations. For every linear model there exists a matrix representation for which the ReML (Restricted Maximum Likelihood) can be constructed from the elements of the corresponding…

High Energy Physics - Experiment · Physics 2013-07-31 John R. Smith , Milan Nikolic , Stephen P. Smith

We propose an unsupervised approach for learning end-to-end reconstruction operators for ill-posed inverse problems. The proposed method combines the classical variational framework with iterative unrolling, which essentially seeks to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Subhadip Mukherjee , Marcello Carioni , Ozan Öktem , Carola-Bibiane Schönlieb

Concave regularization methods provide natural procedures for sparse recovery. However, they are difficult to analyze in the high dimensional setting. Only recently a few sparse recovery results have been established for some specific local…

Machine Learning · Statistics 2012-02-14 Cun-Hui Zhang , Tong Zhang

Many inverse problems can be described by a PDE model with unknown parameters that need to be calibrated based on measurements related to its solution. This can be seen as a constrained minimization problem where one wishes to minimize the…

Numerical Analysis · Mathematics 2018-09-06 Nick Schenkels , Wim Vanroose

This paper discusses the use of absolutely one-homogeneous regularization functionals in a variational, scale space, and inverse scale space setting to define a nonlinear spectral decomposition of input data. We present several theoretical…

Numerical Analysis · Computer Science 2016-01-13 Martin Burger , Guy Gilboa , Michael Moeller , Lina Eckardt , Daniel Cremers

Stationarity is a very common assumption in time series analysis. A vector autoregressive process is stationary if and only if the roots of its characteristic equation lie outside the unit circle, constraining the autoregressive coefficient…

Methodology · Statistics 2022-05-18 Sarah E. Heaps
‹ Prev 1 8 9 10 Next ›