English
Related papers

Related papers: A Mini-Batch Quasi-Newton Proximal Method for Cons…

200 papers

We present a randomized maximum a posteriori (rMAP) method for generating approximate samples of posteriors in high dimensional Bayesian inverse problems governed by large-scale forward problems. We derive the rMAP approach by: 1) casting…

Computation · Statistics 2016-02-12 Kainan Wang , Tan Bui-Thanh , Omar Ghattas

We propose new approximate alternating projection methods, based on randomized sketching, for the low-rank nonnegative matrix approximation problem: find a low-rank approximation of a nonnegative matrix that is nonnegative, but whose…

Numerical Analysis · Mathematics 2023-04-25 Sergey A. Matveev , Stanislav Budzinskiy

Non-convex constrained optimizations are ubiquitous in robotic applications such as multi-agent navigation, UAV trajectory optimization, and soft robot simulation. For this problem class, conventional optimizers suffer from small step sizes…

Optimization and Control · Mathematics 2025-10-08 Zherong Pan , Kui Wu

Inexact alternating direction multiplier methods (ADMMs) are developed for solving general separable convex optimization problems with a linear constraint and with an objective that is the sum of smooth and nonsmooth terms. The approach…

Optimization and Control · Mathematics 2016-04-12 William W. Hager , Hongchao Zhang

This paper is concerned with the optimal identification problem of dynamical systems in which only quantized output observations are available under the assumption of fixed thresholds and bounded persistent excitations. Based on a…

Systems and Control · Electrical Eng. & Systems 2023-09-12 Ying Wang , Yanlong Zhao , Ji-Feng Zhang

In computer vision, many problems such as image segmentation, pixel labelling, and scene parsing can be formulated as binary quadratic programs (BQPs). For submodular problems, cuts based methods can be employed to efficiently solve…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Peng Wang , Chunhua Shen , Anton van den Hengel , Philip H. S. Torr

We describe a strategy for solving nonlinear eigenproblems numerically. Our approach is based on the approximation of a vector-valued function, defined as solution of a non-homogeneous version of the eigenproblem. This approximation step is…

Numerical Analysis · Mathematics 2023-12-06 Davide Pradovera

For solving large-scale non-convex problems, we propose inexact variants of trust region and adaptive cubic regularization methods, which, to increase efficiency, incorporate various approximations. In particular, in addition to approximate…

Optimization and Control · Mathematics 2018-02-21 Zhewei Yao , Peng Xu , Farbod Roosta-Khorasani , Michael W. Mahoney

In this paper, we use Proximal Cubic regularized Newton Methods (PCNM) to optimize the sum of a smooth convex function and a non-smooth convex function, where we use inexact gradient and Hessian, and an inexact subsolver for the cubic…

Optimization and Control · Mathematics 2019-02-27 Chaobing Song , Ji Liu , Yong Jiang

Weight pruning methods for deep neural networks (DNNs) have been investigated recently, but prior work in this area is mainly heuristic, iterative pruning, thereby lacking guarantees on the weight reduction ratio and convergence time. To…

Neural and Evolutionary Computing · Computer Science 2018-10-23 Tianyun Zhang , Shaokai Ye , Kaiqi Zhang , Jian Tang , Wujie Wen , Makan Fardad , Yanzhi Wang

This paper presents an efficient Bayesian framework for solving nonlinear, high-dimensional model calibration problems. It is based on a Variational Bayesian formulation that aims at approximating the exact posterior by means of solving an…

Applications · Statistics 2015-11-02 Isabell M. Franck , P. S. Koutsourelakis

We introduce an abstract algorithm that aims to find the Bregman projection onto a closed convex set. As an application, the asymptotic behaviour of an iterative method for finding a fixed point of a quasi Bregman nonexpansive mapping with…

Functional Analysis · Mathematics 2013-09-26 Heinz H. Bauschke , Jiawei Chen , Xianfu Wang

We present in this paper a novel numerical reconstruction method for solving a 3D coefficient inverse problem with scattering data generated by a single direction of the incident plane wave. This inverse problem is well-known to be a highly…

Numerical Analysis · Mathematics 2018-05-22 Michael V. Klibanov , Aleksandr E. Kolesov , Dinh-Liem Nguyen

One of the tasks in color image processing and computer vision is to recover clean data from partial observations corrupted by noise. To this end, robust quaternion matrix completion (QMC) has recently attracted more attention and shown its…

Numerical Analysis · Mathematics 2024-10-22 Baohua Huang , Jiakai Chen , Wen Li

Recent advancements in diffusion models have demonstrated remarkable success in various image generation tasks. Building upon these achievements, diffusion models have also been effectively adapted to image restoration tasks, e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Yu-Shan Tai , An-Yeu , Wu

We present a quasi-Newton method for unconstrained stochastic optimization. Most existing literature on this topic assumes a setting of stochastic optimization in which a finite sum of component functions is a reasonable approximation of an…

Optimization and Control · Mathematics 2024-09-04 Matt Menickelly , Stefan M. Wild , Miaolan Xie

Shape-constrained convex regression problem deals with fitting a convex function to the observed data, where additional constraints are imposed, such as component-wise monotonicity and uniform Lipschitz continuity. This paper provides a…

Optimization and Control · Mathematics 2021-11-23 Meixia Lin , Defeng Sun , Kim-Chuan Toh

The paper presents an image denoising algorithm by combining a method that is based on directional quasi-analytic wavelet packets (qWPs) with the popular BM3D algorithm. The qWPs and its corresponding transforms are designed in [1]. The…

Image and Video Processing · Electrical Eng. & Systems 2022-06-10 Amir Averbuch , Pekka Neittaanmaki , Valery Zheludev , Moshe Salhov , Jonathan Hauser

Low-rank matrix completion (LRMC) has demonstrated remarkable success in a wide range of applications. To address the NP-hard nature of the rank minimization problem, the nuclear norm is commonly used as a convex and computationally…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Zhijie Wang , Liangtian He , Qinghua Zhang , Jifei Miao , Liang-Jian Deng , Jun Liu

We propose a stochastic approximation method for approximating the efficient frontier of chance-constrained nonlinear programs. Our approach is based on a bi-objective viewpoint of chance-constrained programs that seeks solutions on the…

Optimization and Control · Mathematics 2020-05-29 Rohit Kannan , James Luedtke