English
Related papers

Related papers: A structured L-BFGS method with diagonal scaling a…

200 papers

Planes are generally used in 3D reconstruction for depth sensors, such as RGB-D cameras and LiDARs. This paper focuses on the problem of estimating the optimal planes and sensor poses to minimize the point-to-plane distance. The resulting…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Lipu Zhou

In this paper we consider a class of optimization problems with a strongly convex objective function and the feasible set given by an intersection of a simple convex set with a set given by a number of linear equality and inequality…

Optimization and Control · Mathematics 2016-05-11 Alexey Chernov , Pavel Dvurechensky , Alexander Gasnikov

We propose a new randomized algorithm for solving L2-regularized least-squares problems based on sketching. We consider two of the most popular random embeddings, namely, Gaussian embeddings and the Subsampled Randomized Hadamard Transform…

Machine Learning · Computer Science 2020-10-26 Jonathan Lacotte , Mert Pilanci

In this paper, an efficient modified Newton type algorithm is proposed for nonlinear unconstrianed optimization problems. The modified Hessian is a convex combination of the identity matrix (for steepest descent algorithm) and the Hessian…

Optimization and Control · Mathematics 2015-10-09 Yaguang Yang

Fusing hyperspectral images (HSIs) with multispectral images (MSIs) has become a mainstream approach to enhance the spatial resolution of HSIs. Many HSI-MSI fusion methods have achieved impressive results. Nevertheless, certain challenges…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Kunjing Yang , Minru Bai , TingLu

This paper considers distributed optimization problems, where each agent cooperatively minimizes the sum of local objective functions through the communication with its neighbors. The widely adopted distributed gradient method in solving…

Optimization and Control · Mathematics 2025-08-19 Yeming Xu , Ziyuan Guo , Kaihong Lu , Huanshui Zhang

In this paper, we present a global complexity analysis of the classical BFGS method with inexact line search, as applied to minimizing a strongly convex function with Lipschitz continuous gradient and Hessian. We consider a variety of…

Optimization and Control · Mathematics 2024-04-24 Anton Rodomanov

A broad range of inverse problems can be abstracted into the problem of minimizing the sum of several convex functions in a Hilbert space. We propose a proximal decomposition algorithm for solving this problem with an arbitrary number of…

Optimization and Control · Mathematics 2009-11-13 Patrick L. Combettes , Jean-Christophe Pesquet

Detecting boundary of an image based on noisy observations is a fundamental problem of image processing and image segmentation. For a $d$-dimensional image ($d = 2, 3, \ldots$), the boundary can often be described by a closed smooth $(d -…

Statistics Theory · Mathematics 2018-02-16 Meng Li , Subhashis Ghosal

We study bilevel optimization problems where the lower-level problems are strongly convex and have coupled linear constraints. To overcome the potential non-smoothness of the hyper-objective and the computational challenges associated with…

Optimization and Control · Mathematics 2026-02-06 Wei Shen , Jiawei Zhang , Minhui Huang , Cong Shen

Image inverse problems have numerous applications, including image processing, super-resolution, and computer vision, which are important areas in image science. These application models can be seen as a three-function composite…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Yunfei Qu , Deren Han

The low-rank matrix completion problem can be succinctly stated as follows: given a subset of the entries of a matrix, find a low-rank matrix consistent with the observations. While several low-complexity algorithms for matrix completion…

Information Theory · Computer Science 2010-06-11 Wei Dai , Ely Kerman , Olgica Milenkovic

For an overdetermined system $\mathsf{A}\mathsf{x} \approx \mathsf{b}$ with $\mathsf{A}$ and $\mathsf{b}$ given, the least-square (LS) formulation $\min_x \, \|\mathsf{A}\mathsf{x}-\mathsf{b}\|_2$ is often used to find an acceptable…

Numerical Analysis · Mathematics 2020-06-04 Ke Chen , Qin Li , Kit Newton , Steve Wright

The structure tensor method is often used for 2D and 3D analysis of imaged structures, but its results are in many cases very dependent on the user's choice of method parameters. We simplify this parameter choice in first order structure…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Pawel Tomasz Pieta , Anders Bjorholm Dahl , Jeppe Revall Frisvad , Siavash Arjomand Bigdeli , Anders Nymark Christensen

This paper focuses on the minimization of a sum of a twice continuously differentiable function $f$ and a nonsmooth convex function. An inexact regularized proximal Newton method is proposed by an approximation to the Hessian of $f$…

Optimization and Control · Mathematics 2023-11-09 Ruyu Liu , Shaohua Pan , Yuqia Wu , Xiaoqi Yang

Numerical optimization is an important tool in the field of computational physics in general and in nano-optics in specific. It has attracted attention with the increase in complexity of structures that can be realized with nowadays…

Machine learning methods for computational imaging require uncertainty estimation to be reliable in real settings. While Bayesian models offer a computationally tractable way of recovering uncertainty, they need large data volumes to be…

Machine Learning · Computer Science 2020-08-24 Francesco Tonolini , Jack Radford , Alex Turpin , Daniele Faccio , Roderick Murray-Smith

Objective: Deformable image registration is a fundamental problem in medical image analysis, with applications such as longitudinal studies, population modeling, and atlas based image segmentation. Registration is often phrased as an…

Computer Vision and Pattern Recognition · Computer Science 2018-10-22 Simon Ekström , Filip Malmberg , Håkan Ahlström , Joel Kullberg , Robin Strand

Recent advances in 3D Gaussian Splatting (3DGS) have enabled highly efficient and photorealistic novel view synthesis. However, segmenting objects accurately in 3DGS remains challenging due to the discrete nature of Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Yi He , Tao Wang , Yi Jin , Congyan Lang , Yidong Li , Haibin Ling

In this work, we propose Natural Hypergradient Descent (NHGD), a new method for solving bilevel optimization problems. To address the computational bottleneck in hypergradient estimation--namely, the need to compute or approximate Hessian…

Machine Learning · Computer Science 2026-04-02 Deyi Kong , Zaiwei Chen , Shuzhong Zhang , Shancong Mou