English
Related papers

Related papers: An $\ell_p$ Variable Projection Method for Large-S…

200 papers

Recovering clear images from blurry ones with an unknown blur kernel is a challenging problem. Deep image prior (DIP) proposes to use the deep network as a regularizer for a single image rather than as a supervised model, which achieves…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Tingting Wu , Zhiyan Du , Zhi Li , Feng-Lei Fan , Tieyong Zeng

We propose a variable smoothing algorithm for solving nonconvexly constrained nonsmooth optimization problems. The target problem has two issues that need to be addressed: (i) the nonconvex constraint and (ii) the nonsmooth term. To handle…

Optimization and Control · Mathematics 2024-04-04 Keita Kume , Isao Yamada

Feature selection with specific multivariate performance measures is the key to the success of many applications, such as image retrieval and text classification. The existing feature selection methods are usually designed for…

Machine Learning · Computer Science 2015-03-19 Qi Mao , Ivor W. Tsang

In this thesis, we offer a thorough investigation of different regularisation terms used in variational imaging problems, together with detailed optimisation processes of these problems. We begin by studying smooth problems and partially…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Joseph Bartlett , Jinming Duan

We propose a unified fractional regularization framework for sparse signal recovery based on the $\ell_1/\ell_p^q$ model. This model generalizes several widely used sparsity-promoting regularizers and provides additional flexibility through…

Information Theory · Computer Science 2026-05-28 Yinhao Zhao , Haoyu He , Chuanqi Ma , Hao Wang

We present a variationally separable splitting technique for the generalized-$\alpha$ method for solving parabolic partial differential equations. We develop a technique for a tensor-product mesh which results in a solver with a linear cost…

Numerical Analysis · Mathematics 2018-11-26 Pouria Behnoudfar , Victor M. Calo , Quanling Deng , Peter D. Minev

Low rank approximation is a commonly occurring problem in many computer vision and machine learning applications. There are two common ways of optimizing the resulting models. Either the set of matrices with a given rank can be explicitly…

Computer Vision and Pattern Recognition · Computer Science 2019-07-24 Marcus Valtonen Örnhag , Carl Olsson , Anders Heyden

We consider the problem of computationally-efficient prediction from high dimensional and highly correlated predictors in challenging settings where accurate variable selection is effectively impossible. Direct application of penalization…

Statistics Theory · Mathematics 2017-12-08 Minerva Mukhopadhyay , David B. Dunson

Owing to the edge preserving ability and low computational cost of the total variation (TV), variational models with the TV regularization have been widely investigated in the field of multiplicative noise removal. The key points of the…

Computer Vision and Pattern Recognition · Computer Science 2015-03-18 Dai-Qiang Chen , Li-Zhi Cheng

We develop a spectral low-mode reduced solver for second-order elliptic boundary value problems with spatially varying diffusion coefficients. The approach projects standard finite difference or finite element discretization onto a global…

Numerical Analysis · Mathematics 2025-12-23 Prosper Torsu

In this paper, we consider Nesterov's Accelerated Gradient method for solving Nonlinear Inverse and Ill-Posed Problems. Known to be a fast gradient-based iterative method for solving well-posed convex optimization problems, this method also…

Numerical Analysis · Mathematics 2020-01-13 Simon Hubmer , Ronny Ramlau

We present a preconditioner based on spectral projection that is combined with a deflated Krylov subspace method for solving ill conditioned linear systems of equations. Our results show that the proposed algorithm requires many fewer…

Numerical Analysis · Mathematics 2016-09-23 Man-Chung Yeung , Craig C. Douglas , Long Lee

Inverse problems and regularization theory is a central theme in contemporary signal processing, where the goal is to reconstruct an unknown signal from partial indirect, and possibly noisy, measurements of it. A now standard method for…

Optimization and Control · Mathematics 2014-12-09 Samuel Vaiter , Gabriel Peyré , Jalal M. Fadili

We present a new numerical technique to solve large-scale eigenvalue problems. It is based on the projection technique, used in strongly correlated quantum many-body systems, where first an effective approximate model of smaller complexity…

Strongly Correlated Electrons · Physics 2015-05-19 Ralf Gamillscheg , Gundolf Haase , Wolfgang von der Linden

Vector extrapolation methods are widely used in large-scale simulation studies, and numerous extrapolation-based acceleration techniques have been developed to enhance the convergence of linear and nonlinear fixed-point iterative methods.…

Numerical Analysis · Mathematics 2026-02-03 Abdellatif Mouhssine

This paper presents an efficient Bayesian framework for solving nonlinear, high-dimensional model calibration problems. It is based on a Variational Bayesian formulation that aims at approximating the exact posterior by means of solving an…

Applications · Statistics 2015-11-02 Isabell M. Franck , P. S. Koutsourelakis

In representation learning and non-linear dimension reduction, there is a huge interest to learn the 'disentangled' latent variables, where each sub-coordinate almost uniquely controls a facet of the observed data. While many regularization…

Machine Learning · Statistics 2019-09-09 Yue Bai , Leo L. Duan

Sparse linear regression -- finding an unknown vector from linear measurements -- is now known to be possible with fewer samples than variables, via methods like the LASSO. We consider the multiple sparse linear regression problem, where…

Machine Learning · Computer Science 2012-02-28 Ali Jalali , Pradeep Ravikumar , Sujay Sanghavi

In this paper we study nonconvex and nonsmooth optimization problems with semi-algebraic data, where the variables vector is split into several blocks of variables. The problem consists of one smooth function of the entire variables vector…

Optimization and Control · Mathematics 2017-02-09 Thomas Pock , Shoham Sabach

This paper derives a new class of adaptive regularization parameter choice strategies that can be effectively and efficiently applied when regularizing large-scale linear inverse problems by combining standard Tikhonov regularization and…

Numerical Analysis · Mathematics 2019-07-15 Silvia Gazzola , Malena Sabate Landman