English
Related papers

Related papers: An $\mathcal{O}(n\log n)$ projection operator for …

200 papers

This paper presents a fast algorithm for projecting a given function to the set of shift orthogonal functions (i.e. set containing functions with unit $L^2$ norm that are orthogonal to their prescribed shifts). The algorithm can be…

Numerical Analysis · Mathematics 2014-02-24 Farzin Barekat , Rongjie Lai , Ke Yin , Stanley Osher , Russel Caflisch , Vidvuds Ozolins

Sparse learning has recently received increasing attention in many areas including machine learning, statistics, and applied mathematics. The mixed-norm regularization based on the L1/Lq norm with q > 1 is attractive in many applications of…

Machine Learning · Computer Science 2010-09-27 Jun Liu , Jieping Ye

For high-dimensional sparse parameter estimation problems, Log-Sum Penalty (LSP) regularization effectively reduces the sampling sizes in practice. However, it still lacks theoretical analysis to support the experience from previous…

Information Theory · Computer Science 2014-02-25 Zheng Pan , Guangdong Hou , Changshui Zhang

Motivated by re-weighted $\ell_1$ approaches for sparse recovery, we propose a lifted $\ell_1$ (LL1) regularization which is a generalized form of several popular regularizations in the literature. By exploring such connections, we discover…

Signal Processing · Electrical Eng. & Systems 2022-05-13 Yaghoub Rahimi , Sung Ha Kang , Yifei Lou

We study the Euclidean minimum weight perfect matching problem for $n$ points in the plane. It is known that any deterministic approximation algorithm whose approximation ratio depends only on $n$ requires at least $\Omega(n \log n)$ time.…

Computational Geometry · Computer Science 2026-01-09 Stefan Hougardy , Karolina Tammemaa

Parallel and cyclic projection algorithms are proposed for minimizing the sum of a finite family of convex functions over the intersection of a finite family of closed convex subsets of a Hilbert space. These algorithms are of…

Optimization and Control · Mathematics 2019-01-08 Hong-Kun Xu , Vera Roshchina

This paper presents a regularized Newton method (RNM) with generalized regularization terms for unconstrained convex optimization problems. The generalized regularization includes quadratic, cubic, and elastic net regularizations as special…

Optimization and Control · Mathematics 2024-07-11 Yuya Yamakawa , Nobuo Yamashita

We study the shared processor scheduling problem with a single shared processor where a unit time saving (weight) obtained by processing a job on the shared processor depends on the job. A polynomial-time optimization algorithm has been…

Discrete Mathematics · Computer Science 2021-01-19 Dariusz Dereniowski , Wieslaw Kubiak

Looking for sparsity is nowadays crucial to speed up the training of large-scale neural networks. Projections onto the $\ell_{1,2}$ and $\ell_{1,\infty}$ are among the most efficient techniques to sparsify and reduce the overall cost of…

Machine Learning · Computer Science 2025-02-28 Guillaume Perez , Laurent Condat , Michel Barlaud

We present a new algorithm and the corresponding convergence analysis for the regularization of linear inverse problems with sparsity constraints, applied to a new generalized sparsity promoting functional. The algorithm is based on the…

Numerical Analysis · Mathematics 2016-12-30 Sergey Voronin , Ingrid Daubechies

Projection algorithms are well known for their simplicity and flexibility in solving feasibility problems. They are particularly important in practice due to minimal requirements for software implementation and maintenance. In this work, we…

Optimization and Control · Mathematics 2020-04-14 Minh N. Dao , Hung M. Phan

We use here the results on the influence graph by Boissonnat et al. to adapt them for particular cases where additional information is available. In some cases, it is possible to improve the expected randomized complexity of algorithms from…

Computational Geometry · Computer Science 2009-09-25 Olivier Devillers

We determine the power of the weighted sum scalarization with respect to the computation of approximations for general multiobjective minimization and maximization problems. Additionally, we introduce a new multi-factor notion of…

Data Structures and Algorithms · Computer Science 2021-12-15 Cristina Bazgan , Stefan Ruzika , Clemens Thielen , Daniel Vanderpooten

Discrete regularization methods are often applied for obtaining stable approximate solutions for ill-posed operator equations $Tx=y$, where $T: X\to Y$ is a bounded operator between Hilbert spaces with non-closed range $R(T)$ and $y\in…

Functional Analysis · Mathematics 2016-07-01 M Thamban Nair

A wide class of regularization problems in machine learning and statistics employ a regularization term which is obtained by composing a simple convex function \omega with a linear transformation. This setting includes Group Lasso methods,…

Machine Learning · Computer Science 2011-04-11 Andreas Argyriou , Charles A. Micchelli , Massimiliano Pontil , Lixin Shen , Yuesheng Xu

Resolution and superposition are common techniques which have seen widespread use with propositional and first-order logic in modern theorem provers. In these cases, resolution proof production is a key feature of such tools; however, the…

Logic in Computer Science · Computer Science 2018-04-19 Jan Gorzny , Ezequiel Postan , Bruno Woltzenlogel Paleo

The optimization of the variance supplemented by a budget constraint and an asymmetric $\ell_1$ regularizer is carried out analytically by the replica method borrowed from the theory of disordered systems. The asymmetric regularizer allows…

Portfolio Management · Quantitative Finance 2018-07-16 Imre Kondor , Gábor Papp , Fabio Caccioli

We present a streamlined approach for generalized strong and norm convergence of self-adjoint operators in different Hilbert spaces. In particular, we establish convergence of associated (semi-)groups, (essential) spectra and spectral…

Spectral Theory · Mathematics 2026-01-16 Gerald Teschl , Yifei Wang , Bing Xie , Zhe Zhou

We consider the problem of projecting a probability measure $\pi$ on a set $\mathcal{M}\_N$ of Radon measures. The projection is defined as a solution of the following variational problem:\begin{equation*}\inf\_{\mu\in \mathcal{M}\_N}…

Numerical Analysis · Mathematics 2015-09-02 Nicolas Chauffert , Philippe Ciuciu , Jonas Kahn , Pierre Weiss

In this paper, we presented an efficient algorithm to implement the regularization reconstruction of SPECT. Image reconstruction with priori assumptions is usually modeled as a constrained optimization problem. However, there is no…

Optimization and Control · Mathematics 2013-06-07 Shousheng Luo , Tie Zhou