English
Related papers

Related papers: Blended Cured Quasi-Newton for Geometric Optimizat…

200 papers

Over the years, computational imaging with accurate nonlinear physical models has garnered considerable interest due to its ability to achieve high-quality reconstructions. However, using such nonlinear models for reconstruction is…

Optimization and Control · Mathematics 2026-02-24 Tao Hong , Thanh-an Pham , Irad Yavneh , Michael Unser

Geometry optimization is an important part of both computational materials and surface science because it is the path to finding ground state atomic structures and reaction pathways. These properties are used in the estimation of…

Materials Science · Physics 2021-07-07 Yilin Yang , Omar A. Jimenez-Negron , John R. Kitchin

Benson's outer approximation algorithm and its variants are the most frequently used methods for solving linear multiobjective optimization problems. These algorithms have two intertwined components: one-dimensional linear optimization one…

Optimization and Control · Mathematics 2019-03-21 Laszlo Csirmaz

This paper presents key enhancements to our previous work~\cite{naghmouchi2024mixed} on a hybrid Benders decomposition (HBD) framework for solving mixed integer linear programs (MILPs). In our approach, the master problem is reformulated as…

Quantum Physics · Physics 2026-01-23 Anna Joliot , M. Yassine Naghmouchi , Wesley Coelho

We develop a method for optimization in shape spaces, i.e., sets of surfaces modulo re-parametrization. Unlike previously proposed gradient flows, we achieve superlinear convergence rates through a subtle approximation of the shape Hessian,…

Computer Vision and Pattern Recognition · Computer Science 2014-04-15 J. Balzer , S. Soatto

The recently proposed Broximal Point Method (BPM) [Gruntkowska et al., 2025] offers an idealized optimization framework based on iteratively minimizing the objective function over norm balls centered at the current iterate. It enjoys…

Optimization and Control · Mathematics 2025-10-02 Kaja Gruntkowska , Peter Richtárik

We develop multi-step gradient methods for network-constrained optimization of strongly convex functions with Lipschitz-continuous gradients. Given the topology of the underlying network and bounds on the Hessian of the objective function,…

Optimization and Control · Mathematics 2015-06-12 Euhanna Ghadimi , Iman Shames , Mikael Johansson

The main focus in this paper is exact linesearch methods for minimizing a quadratic function whose Hessian is positive definite. We give a class of limited-memory quasi-Newton Hessian approximations which generate search directions parallel…

Optimization and Control · Mathematics 2023-05-04 David Ek , Anders Forsgren

One of the biggest challenges for simulating the Boltzmann equation is the evaluation of fivefold collision integral. Given the recent successes of deep learning and the availability of efficient tools, it is an obvious idea to try to…

Computational Physics · Physics 2021-07-28 Tianbai Xiao , Martin Frank

We study the problem of minimizing the sum of three convex functions: a differentiable, twice-differentiable and a non-smooth term in a high dimensional setting. To this effect we propose and analyze a randomized block cubic Newton (RBCN)…

Optimization and Control · Mathematics 2018-08-09 Nikita Doikov , Peter Richtárik

A numerical study of an optimal control formulation for a shape optimization problem governed by an elliptic variational inequality is performed. The shape optimization problem is reformulated as a boundary control problem in a fixed…

Optimization and Control · Mathematics 2018-01-22 Raino A. E. Mäkinen

Neural networks (NNs) have been extremely successful across many tasks in machine learning. Quantization of NN weights has become an important topic due to its impact on their energy efficiency, inference time and deployment on hardware.…

Machine Learning · Computer Science 2021-05-06 Burak Bartan , Mert Pilanci

Bregman distances (also known as Bregman divergences) are widely used in machine learning, speech recognition and signal processing, and kNN searches with Bregman distances have become increasingly important with the rapid advances of…

Databases · Computer Science 2020-06-02 Yang Song , Yu Gu , Rui Zhang , Ge Yu

It is well-known by now that the BFGS method is an effective method for minimizing nonsmooth functions. However, despite its popularity, theoretical convergence results are almost non-existent. One of the difficulties when analyzing the…

Optimization and Control · Mathematics 2026-05-11 Bennet Gebken

Variational quantum algorithms, optimized using gradient-based methods, often exhibit sub-optimal convergence performance due to their dependence on Euclidean geometry. Quantum natural gradient descent (QNGD) is a more efficient method that…

Quantum Physics · Physics 2025-06-05 Mohammad Aamir Sohail , Mohsen Heidari , S. Sandeep Pradhan

Quantization is a technique for creating efficient Deep Neural Networks (DNNs), which involves performing computations and storing tensors at lower bit-widths than f32 floating point precision. Quantization reduces model size and inference…

Machine Learning · Computer Science 2023-10-02 Eliska Kloberdanz , Wei Le

This paper deals with regularized Newton methods, a flexible class of unconstrained optimization algorithms that is competitive with line search and trust region methods and potentially combines attractive elements of both. The particular…

Optimization and Control · Mathematics 2022-07-13 Daniel Steck , Christian Kanzow

Quantum computing is emerging as a new computing resource that could be superior to conventional computing for certain classes of optimization problems. However, in principle, most existing approaches to quantum optimization are intended to…

Optimization and Control · Mathematics 2022-01-21 Chin-Yao Chang , Eric Jones , Yiyun Yao , Peter Graf , Rishabh Jain

Computational materials discovery is limited by the high cost of first-principles calculations. Machine learning (ML) potentials that predict energies from crystal structures are promising, but existing methods face computational…

Batch Bayesian optimisation and Bayesian quadrature have been shown to be sample-efficient methods of performing optimisation and quadrature where expensive-to-evaluate objective functions can be queried in parallel. However, current…

Machine Learning · Computer Science 2023-07-06 Masaki Adachi , Satoshi Hayakawa , Saad Hamid , Martin Jørgensen , Harald Oberhauser , Micheal A. Osborne