English
Related papers

Related papers: Revisiting a Fast Newton Solver for a 2-D Spectral…

200 papers

We consider nonsmooth optimization problems under affine constraints, where the objective consists of the average of the component functions of a large number $N$ of agents, and we only assume access to the Fenchel conjugate of the…

Optimization and Control · Mathematics 2026-02-09 Benjamin Dubois-Taine , Laurent Pfeiffer , Nadia Oudjane , Adrien Seguret , Francis Bach

Bilevel optimization, addressing challenges in hierarchical learning tasks, has gained significant interest in machine learning. The practical implementation of the gradient descent method to bilevel optimization encounters computational…

Machine Learning · Computer Science 2025-02-04 Sheng Fang , Yong-Jin Liu , Wei Yao , Chengming Yu , Jin Zhang

Within the well-established optical response function formalism, a new strategy with the central idea of employing the forward-backward stochastic Schr\"{o}dinger equations in a segmented way to accurately obtain the two-dimensional (2D)…

Chemical Physics · Physics 2018-08-08 Yaling Ke , Yi Zhao

High-dimensional hyperspectral imaging (HSI) enables the visualization of ultrafast molecular dynamics and complex, heterogeneous spectra. However, applying this capability to resolve spatially varying vibrational couplings in…

Image and Video Processing · Electrical Eng. & Systems 2026-04-09 Chi-Jui Ho , Harsh Bhakta , Wei Xiong , Nicholas Antipa

Hyperspectral image (HSI) super-resolution is commonly used to overcome the hardware limitations of existing hyperspectral imaging systems on spatial resolution. It fuses a low-resolution (LR) HSI and a high-resolution (HR) conventional…

Image and Video Processing · Electrical Eng. & Systems 2021-04-27 Xiuheng Wang , Jie Chen , Qi Wei , Cédric Richard

Image reconstruction under multiple light scattering is crucial in a number of applications such as diffraction tomography. The reconstruction problem is often formulated as a nonconvex optimization, where a nonlinear measurement model is…

Computer Vision and Pattern Recognition · Computer Science 2018-07-04 Yu Sun , Zhihao Xia , Ulugbek S. Kamilov

We present a fast, high-order accurate and adaptive boundary integral scheme for solving the Stokes equations in complex---possibly nonsmooth---geometries in two dimensions. The key ingredient is a set of panel quadrature rules capable of…

Numerical Analysis · Mathematics 2020-04-22 Bowei Wu , Hai Zhu , Alex Barnett , Shravan Veerapaneni

We propose a randomized second-order method for optimization known as the Newton Sketch: it is based on performing an approximate Newton step using a randomly projected or sub-sampled Hessian. For self-concordant functions, we prove that…

Optimization and Control · Mathematics 2015-05-12 Mert Pilanci , Martin J. Wainwright

This paper concerns a spectral estimation problem in which we want to find a spectral density function that is consistent with estimated second-order statistics. It is an inverse problem admitting multiple solutions, and selection of a…

Optimization and Control · Mathematics 2019-08-08 Bin Zhu

Two optimization algorithms are proposed for solving a stochastic programming problem for which the objective function is given in the form of the expectation of convex functions and the constraint set is defined by the intersection of…

Optimization and Control · Mathematics 2017-10-09 Hideaki Iiduka

We present a new framework for the fast solution of inhomogeneous elliptic boundary value problems in domains with smooth boundaries. High-order solvers based on adaptive box codes or the fast Fourier transform can efficiently treat the…

Numerical Analysis · Mathematics 2025-01-31 Daniel Fortunato , David B. Stein , Alex H. Barnett

We present the optimal design of a spectral method widely used to initialize nonconvex optimization algorithms for solving phase retrieval and other signal recovery problems. Our work leverages recent results that provide an exact…

Information Theory · Computer Science 2019-05-01 Wangyu Luo , Wael Alghamdi , Yue M. Lu

In this paper, we investigate a second-order stochastic algorithm for solving large-scale binary classification problems. We propose to make use of a new hybrid stochastic Newton algorithm that includes two weighted components in the…

Computation · Statistics 2025-12-02 Bernard Bercu , Luis Fredes , Eméric Gbaguidi

Rotation estimation plays a fundamental role in computer vision and robot tasks, and extremely robust rotation estimation is significantly useful for safety-critical applications. Typically, estimating a rotation is considered a non-linear…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Yinlong Liu , Tianyu Huang , Zhi-Xin Yang

In this paper, we discuss the problem of minimizing the sum of two convex functions: a smooth function plus a non-smooth function. Further, the smooth part can be expressed by the average of a large number of smooth component functions, and…

Machine Learning · Computer Science 2016-11-17 Luo Luo , Zihao Chen , Zhihua Zhang , Wu-Jun Li

We consider minimizing a smooth and strongly convex objective function using a stochastic Newton method. At each iteration, the algorithm is given an oracle access to a stochastic estimate of the Hessian matrix. The oracle model includes…

Optimization and Control · Mathematics 2022-11-29 Sen Na , Michał Dereziński , Michael W. Mahoney

To advance hierarchial equations of motion as a standard theory for quantum dissipative dynamics, we put forward a mixed Heisenberg--Schrodinger scheme with block-matrix implementation on efficient evaluation of nonlinear optical response…

Chemical Physics · Physics 2015-05-30 Jian Xu , Rui-Xue Xu , Darius Abramavicius , Houdao Zhang , YiJing Yan

In this paper, we use Proximal Cubic regularized Newton Methods (PCNM) to optimize the sum of a smooth convex function and a non-smooth convex function, where we use inexact gradient and Hessian, and an inexact subsolver for the cubic…

Optimization and Control · Mathematics 2019-02-27 Chaobing Song , Ji Liu , Yong Jiang

Optimization under the symplecticity constraint is an approach for solving various problems in quantum physics and scientific computing. Building on the results that this optimization problem can be transformed into an unconstrained problem…

Optimization and Control · Mathematics 2024-06-21 Bin Gao , Nguyen Thanh Son , Tatjana Stykel

This paper is concerned with the inverse scattering problem which aims to determine the spatially distributed dielectric constant coefficient of the 2D Helmholtz equation from multifrequency backscatter data associated with a single…

Numerical Analysis · Mathematics 2020-02-25 Trung Truong , Dinh-Liem Nguyen , Michael Klibanov