English
Related papers

Related papers: Consistent Computation of First- and Second-Order …

200 papers

Accelerating the convergence of second-order optimization, particularly Newton-type methods, remains a pivotal challenge in algorithmic research. In this paper, we extend previous work on the \textbf{Quadratic Gradient (QG)} and rigorously…

Optimization and Control · Mathematics 2026-04-01 John Chiang

We establish integral formulas and sharp two-sided bounds for the Ricci curvature, mean curvature and second fundamental form on a Riemannian manifold with boundary. As applications, sharp gradient and Hessian estimates are derived for the…

Differential Geometry · Mathematics 2018-07-10 Feng-Yu Wang

We construct examples of twice differentiable functions in $\mathbb{R}^n$ with continuous Laplacian and bounded Hessian. The same construction is also applicable to higher order differentiability, the Monge-Amp\`ere equation, and mean…

Analysis of PDEs · Mathematics 2023-09-12 Yifei Pan , Yu Yan

Several quantities important in condensed matter physics, quantum information, and quantum chemistry, as well as quantities required in meta-optimization of machine learning algorithms, can be expressed as gradients of implicitly defined…

Quantum Physics · Physics 2022-11-28 Shahnawaz Ahmed , Nathan Killoran , Juan Felipe Carrasquilla Álvarez

This paper introduces a novel method for the efficient second-order accurate computation of normal fields from volume fractions on unstructured polyhedral meshes. Locally, i.e. in each mesh cell, an averaged normal is reconstructed by…

Numerical Analysis · Mathematics 2023-08-16 Johannes Kromer , Fabio Leotta , Dieter Bothe

In the past few years, following the differentiable programming paradigm, there has been a growing interest in computing the gradient information of physical processes (e.g., physical simulation, image rendering). However, such processes…

Robotics · Computer Science 2022-06-24 Quentin Le Lidec , Louis Montaut , Cordelia Schmid , Ivan Laptev , Justin Carpentier

In this work, we develop new optimization algorithms that use approximate second-order information combined with the gradient regularization technique to achieve fast global convergence rates for both convex and non-convex objectives. The…

Optimization and Control · Mathematics 2025-06-17 Andrei Semenov , Martin Jaggi , Nikita Doikov

Natural gradient descent is an optimization method traditionally motivated from the perspective of information geometry, and works well for many applications as an alternative to stochastic gradient descent. In this paper we critically…

Machine Learning · Computer Science 2020-09-22 James Martens

Estimation of surface curvature from range data is important for a range of tasks in computer vision and robotics, object segmentation, object recognition and robotic grasping estimation. This work presents a fast method of robustly…

Computer Vision and Pattern Recognition · Computer Science 2017-07-17 Andrew Spek , Wai Ho Li , Tom Drummond

The diffuse-domain, or smoothed boundary, method is an attractive approach for solving partial differential equations in complex geometries because of its simplicity and flexibility. In this method the complex geometry is embedded into a…

Numerical Analysis · Mathematics 2019-12-02 Fei Yu , Zhenlin Guo , John Lowengrub

A novel high-order numerical scheme is proposed to compute the covariant derivative, particularly for divergence and curl, on any curved surface. The proposed scheme does not require the construction of a curved axis or metric tensor, which…

Numerical Analysis · Mathematics 2020-04-30 Sehun Chun

We introduce new results about the shape derivatives of scalar- and vector-valued functions, extending the results from (Dogan-Nochetto 2012) to more general surface energies. They consider surface energies defined as integrals over…

Optimization and Control · Mathematics 2017-08-25 Aníbal Chicco-Ruiz , Pedro Morin , M. Sebastian Pauletti

In multi-phase fluid flow, fluid-structure interaction, and other applications, partial differential equations (PDEs) often arise with discontinuous coefficients and singular sources (e.g., Dirac delta functions). These complexities arise…

Numerical Analysis · Mathematics 2019-07-24 Chung-Nan Tzou , Samuel Stechmann

We introduce meshfree finite difference methods for approximating nonlinear elliptic operators that depend on second directional derivatives or the eigenvalues of the Hessian. Approximations are defined on unstructured point clouds, which…

Numerical Analysis · Mathematics 2017-05-03 Brittany D. Froese

The curvature regularities are well-known for providing strong priors in the continuity of edges, which have been applied to a wide range of applications in image processing and computer vision. However, these models are usually non-convex,…

Numerical Analysis · Mathematics 2019-12-03 Qiuxiang Zhong , Ke Yin , Yuping Duan

Weighted Gaussian Curvature is an important measurement for images. However, its conventional computation scheme has low performance, low accuracy and requires that the input image must be second order differentiable. To tackle these three…

Computer Vision and Pattern Recognition · Computer Science 2021-01-21 Yuanhao Gong , Wenming Tang , Lebin Zhou , Lantao Yu , Guoping Qiu

This paper considers optimization of smooth nonconvex functionals in smooth infinite dimensional spaces. A H\"older gradient descent algorithm is first proposed for finding approximate first-order points of regularized polynomial…

Optimization and Control · Mathematics 2021-04-07 Serge Gratton , Sadok Jerad , Philippe L. Toint

A method is presented to calculate from first principles the higher-order elastic constants of a solid material. The method relies on finite strain deformations, a density functional theory approach to calculate the Cauchy stress tensor,…

Materials Science · Physics 2025-10-08 Ruvini Attanayake , Umesh C. Roy , Abhiyan Pandit , Angelo Bongiorno

Differentiable optimization layers enable learning systems to make decisions by solving embedded optimization problems. However, computing gradients via implicit differentiation requires solving a linear system with Hessian terms, which is…

Machine Learning · Computer Science 2025-12-03 Zihao Zhao , Kai-Chia Mo , Shing-Hei Ho , Brandon Amos , Kai Wang

We give curvature-dependant convergence rates for the optimization of weakly convex functions defined on a manifold of 1-bounded geometry via Riemannian gradient descent and via the dynamic trivialization algorithm. In order to do this, we…

Optimization and Control · Mathematics 2020-08-07 Mario Lezcano-Casado