English
Related papers

Related papers: An $\mathcal{O}(n\log n)$ projection operator for …

200 papers

Given an automorphism and an anti-automorphism of a semigroup of a Geometric Algebra, then for each element of the semigroup a (generalized) projection operator exists that is defined on the entire Geometric Algebra. A single fundamental…

Rings and Algebras · Mathematics 2007-05-23 T. A. Bouma

In this paper, we propose a globally convergent Newton type method to solve $\ell_0$ regularized sparse optimization problem. In fact, a line search strategy is applied to the Newton method to obtain global convergence. The Jacobian matrix…

Optimization and Control · Mathematics 2025-11-26 Yuge Ye , Qingna Li

We propose a linear time and constant space algorithm for computing Euclidean projections onto sets on which a normalized sparseness measure attains a constant value. These non-convex target sets can be characterized as intersections of a…

Computational Geometry · Computer Science 2013-03-22 Markus Thom , Günther Palm

We propose a simple O([n^5/\log n]L) algorithm for linear programming feasibility, that can be considered as a polynomial-time implementation of the relaxation method. Our work draws from Chubanov's "Divide-and-Conquer" algorithm [4], where…

Optimization and Control · Mathematics 2013-12-09 László A. Végh , Giacomo Zambelli

In this paper, we develop a simple yet effective screening rule strategy to improve the computational efficiency in solving structured optimization involving nonconvex $\ell_{q,p}$ regularization. Based on an iteratively reweighted $\ell_1$…

Machine Learning · Computer Science 2022-08-04 Tiange Li , Xiangyu Yang , Hao Wang

We present a new algorithm for solving optimization problems with objective functions that are the sum of a smooth function and a (potentially) nonsmooth regularization function, and nonlinear equality constraints. The algorithm may be…

Optimization and Control · Mathematics 2024-04-12 Yutong Dai , Xiaoyi Qu , Daniel P. Robinson

We give a $O(n)$-time algorithm for determining whether translations of a polyomino with $n$ edges can tile the plane. The algorithm is also a $O(n)$-time algorithm for enumerating all such tilings that are also regular, and we prove that…

Computational Geometry · Computer Science 2015-09-23 Andrew Winslow

The variable projection (VarPro) method is an efficient method to solve separable nonlinear least squares problems. In this paper, we propose a modified VarPro for large-scale separable nonlinear inverse problems that promotes…

Numerical Analysis · Mathematics 2021-06-01 Malena Espanol , Mirjeta Pasha

Tensors serve as a crucial tool in the representation and analysis of complex, multi-dimensional data. As data volumes continue to expand, there is an increasing demand for developing optimization algorithms that can directly operate on…

Optimization and Control · Mathematics 2024-05-15 Katherine Henneberger , Jing Qin

This paper presents a regularization technique incorporating a non-convex and non-smooth term, $\ell_{1}^{2}-\eta\ell_{2}^{2}$, with parameters $0<\eta\leq 1$ designed to address ill-posed linear problems that yield sparse solutions. We…

Optimization and Control · Mathematics 2025-06-16 Long Li , Liang Ding

This paper is concerned with a novel regularisation technique for solving linear ill-posed operator equations in Hilbert spaces from data that is corrupted by white noise. We combine convex penalty functionals with extreme-value statistics…

Statistics Theory · Mathematics 2012-04-03 Klaus Frick , Philipp Marnitz , Axel Munk

In this paper, we investigate regularization of linear inverse problems with irregular noise. In particular, we consider the case that the noise can be preprocessed by certain adjoint embedding operators. By introducing the consequent…

Numerical Analysis · Mathematics 2024-01-30 Xinyan Li , Simon Hubmer , Shuai Lu , Ronny Ramlau

We tackle the problem of building adaptive estimation procedures for ill-posed inverse problems. For general regularization methods depending on tuning parameters, we construct a penalized method that selects the optimal smoothing sequence…

Statistics Theory · Mathematics 2008-07-31 Jean-Michel Loubes , Carenne Ludeña

Motivated by the observation that a given signal $\boldsymbol{x}$ admits sparse representations in multiple dictionaries $\boldsymbol{\Psi}_d$ but with varying levels of sparsity across dictionaries, we propose two new algorithms for the…

Information Theory · Computer Science 2015-09-29 Rizwan Ahmad , Philip Schniter

In this paper, we propose a general class of algorithms for optimizing an extensive variety of nonsmoothly penalized objective functions that satisfy certain regularity conditions. The proposed framework utilizes the…

Computation · Statistics 2011-01-24 Elizabeth D. Schifano , Robert L. Strawderman , Martin T. Wells

This investigation is motivated by PDE-constrained optimization problems arising in connection with electrocardiograms (ECGs) and electroencephalography (EEG). Standard sparsity regularization does not necessarily produce adequate results…

Numerical Analysis · Mathematics 2023-05-25 Ole Løseth Elvetun , Bjørn Fredrik Nielsen

Entropic regularization is quickly emerging as a new standard in optimal transport (OT). It enables to cast the OT computation as a differentiable and unconstrained convex optimization problem, which can be efficiently solved using the…

Machine Learning · Statistics 2018-02-21 Mathieu Blondel , Vivien Seguy , Antoine Rolet

Optimization problems with composite functions consist of an objective function which is the sum of a smooth and a (convex) nonsmooth term. This particular structure is exploited by the class of proximal gradient methods and some of their…

Optimization and Control · Mathematics 2022-10-17 Christian Kanzow , Theresa Lechner

In this paper, the problem of computing the projection, and therefore the minimum distance, from a point onto a Minkowski sum of general convex sets is studied. Our approach is based on the minimum norm duality theorem originally stated by…

Optimization and Control · Mathematics 2018-01-26 Xiaolong Qin , Nguyen Thai An

In this paper, we establish universal approximation theorems for neural networks applied to general nonlinear ill-posed operator equations. In addition to the approximation error, the measurement error is also taken into account in our…

Numerical Analysis · Mathematics 2025-11-21 Lan Wang , Qiao Zhu , Bangti Jin , Ye Zhang