English
Related papers

Related papers: Accelerated Newton-Raphson GRAPE methods for optim…

200 papers

In this paper, further extensions of the result of the paper "A successive approximation method in functional spaces for hierarchical optimal control problems and its application to learning, arXiv:2410.20617 [math.OC], 2024" concerning a…

Optimization and Control · Mathematics 2024-11-26 Getachew K. Befekadu

Quantum control optimization algorithms are routinely used to generate optimal quantum gates or efficient quantum state transfers. However, there are two main challenges in designing efficient optimization algorithms, namely overcoming the…

Quantum Physics · Physics 2022-02-02 Priya Batra , M. Harshanth Ram , T. S. Mahesh

The recent promises of Model Predictive Control in robotics have motivated the development of tailored second-order methods to solve optimal control problems efficiently. While those methods benefit from strong convergence properties,…

Robotics · Computer Science 2024-09-30 Jianghan Zhang , Armand Jordana , Ludovic Righetti

The purpose of this work is the development of space-time discretization schemes for phase-field optimal control problems. Specifically in the optimal control minimization problem, a tracking-type cost functional is minimized to steer the…

Optimization and Control · Mathematics 2022-09-14 Denis Khimin , Marc C. Steinbach , Thomas Wick

In this paper we present a new steepest-descent type algorithm for convex optimization problems. Our algorithm pieces the unknown into sub-blocs of unknowns and considers a partial optimization over each sub-bloc. In quadratic optimization,…

Optimization and Control · Mathematics 2015-01-15 Mohamed Kamel Riahi

A finite horizon linear quadratic(LQ) optimal control problem is studied for a class of discrete-time linear fractional systems (LFSs) affected by multiplicative, independent random perturbations. Based on the dynamic programming technique,…

Optimization and Control · Mathematics 2016-07-01 J. J. Trujillo , V. M. Ungureanu

Standard optimal control methods perform optimization in the time domain. However, many experimental settings demand the expression of the control signal as a superposition of given waveforms, a case that cannot easily be accommodated using…

Optimization and Control · Mathematics 2015-06-22 Selina Meister , Jürgen T. Stockburger , Rebecca Schmidt , Joachim Ankerhold

For over a century, extrapolation methods have provided a powerful tool to improve the convergence order of a numerical method. However, these tools are not well-suited to modern computer codes, where multiple continua are discretised and…

3D Gaussian Splatting (3DGS) is widely used for novel view synthesis due to its high rendering quality and fast inference time. However, 3DGS predominantly relies on first-order optimizers such as Adam, which leads to long training times.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Hamza Pehlivan , Andrea Boscolo Camiletto , Lin Geng Foo , Marc Habermann , Christian Theobalt

We consider variants of a recently-developed Newton-CG algorithm for nonconvex problems \citep{royer2018newton} in which inexact estimates of the gradient and the Hessian information are used for various steps. Under certain conditions on…

Optimization and Control · Mathematics 2022-04-12 Zhewei Yao , Peng Xu , Fred Roosta , Stephen J. Wright , Michael W. Mahoney

This paper introduces a generalization of the well-known Riccati recursion for solving the discrete-time equality-constrained linear quadratic optimal control problem. The recursion can be used to compute the solutions as well as optimal…

Optimization and Control · Mathematics 2024-12-31 Lander Vanroye , Joris De Schutter , Wilm Decré

We introduce the MAGICARP algorithm, a numerical optimization method for quantum optimal control problems that combines the structure provided by Pontryagin's Maximum Principle (PMP) and the robustness of gradient ascent techniques, such as…

A new fast algebraic method for obtaining an $\mathcal{H}^2$-approximation of a matrix from its entries is presented. The main idea behind the method is based on the nested representation and the maximum-volume principle to select…

Numerical Analysis · Mathematics 2015-11-17 A. Yu Mikhalev , I. V. Oseledets

Robotic systems must be able to quickly and robustly make decisions when operating in uncertain and dynamic environments. While Reinforcement Learning (RL) can be used to compute optimal policies with little prior knowledge about the…

Robotics · Computer Science 2016-09-13 Yunpeng Pan , Xinyan Yan , Evangelos Theodorou , Byron Boots

Accelerated gradient methods play a central role in optimization, achieving optimal rates in many settings. While many generalizations and extensions of Nesterov's original acceleration method have been proposed, it is not yet clear what is…

Optimization and Control · Mathematics 2022-06-08 Andre Wibisono , Ashia C. Wilson , Michael I. Jordan

This article proposes new perspectives for developing derivative based numerical algorithms, supported by the introduction of a generalized derivative operators. It demonstrates that these operators have the potential to enhance and extend…

General Mathematics · Mathematics 2026-01-13 Flavio Barbosa , Fernando Nogueira

We present a kernel-independent method that applies hierarchical matrices to the problem of maximum likelihood estimation for Gaussian processes. The proposed approximation provides natural and scalable stochastic estimators for its…

Computation · Statistics 2019-03-26 Christopher J. Geoga , Mihai Anitescu , Michael L. Stein

We propose the generalized Newton's method (GeN) -- a Hessian-informed approach that applies to any optimizer such as SGD and Adam, and covers the Newton-Raphson method as a sub-case. Our method automatically and dynamically selects the…

Machine Learning · Computer Science 2025-05-20 Zhiqi Bu , Shiyun Xu

We consider large scale empirical risk minimization (ERM) problems, where both the problem dimension and variable size is large. In these cases, most second order methods are infeasible due to the high cost in both computing the Hessian…

Optimization and Control · Mathematics 2017-05-24 Mark Eisen , Aryan Mokhtari , Alejandro Ribeiro

We describe a new method to accelerate neighbor searches on GRAPE, i.e. a special purpose hardware that efficiently calculates gravitational forces and potentials in $N$-body simulations. In addition to the gravitational calculations, GRAPE…

Astrophysics · Physics 2015-06-24 T. R. Saitoh , J. Koda