English
Related papers

Related papers: A generalized formulation for gradient schemes in …

200 papers

Multilevel optimization has gained renewed interest in machine learning due to its promise in applications such as hyperparameter tuning and continual learning. However, existing methods struggle with the inherent difficulty of efficiently…

Machine Learning · Computer Science 2024-10-16 Yuntian Gu , Xuzheng Chen

The conjugate gradient method is a widely used algorithm for the numerical solution of a system of linear equations. It is particularly attractive because it allows one to take advantage of sparse matrices and produces (in case of infinite…

Numerical Analysis · Mathematics 2017-11-27 Sergey Voronin , Christophe Zaroli , Naresh P. Cuntoor

Neural implicit shape representations are an emerging paradigm that offers many potential benefits over conventional discrete representations, including memory efficiency at a high spatial resolution. Generalizing across shapes with such…

Computer Vision and Pattern Recognition · Computer Science 2020-06-18 Vincent Sitzmann , Eric R. Chan , Richard Tucker , Noah Snavely , Gordon Wetzstein

In this paper, a globally convergent Newton-type proximal gradient method is developed for composite multi-objective optimization problems where each objective function can be represented as the sum of a smooth function and a nonsmooth…

Optimization and Control · Mathematics 2024-10-25 Md Abu Talhamainuddin Ansary

This paper presents a fully multidimensional kernel-based reconstruction scheme for finite volume methods applied to systems of hyperbolic conservation laws, with a particular emphasis on the compressible Euler equations. Non-oscillatory…

Numerical Analysis · Mathematics 2024-01-31 Ian May , Dongwook Lee

Recent research has indicated a substantial rise in interest in understanding Nesterov's accelerated gradient methods via their continuous-time models. However, most existing studies focus on specific classes of Nesterov's methods, which…

Optimization and Control · Mathematics 2026-03-23 Chanwoong Park , Youngchae Cho , Insoon Yang

Finite volume methods (FVMs) constitute a popular class of methods for the numerical simulation of fluid flows. Among the various components of these methods, the discretisation of the gradient operator has received less attention despite…

Numerical Analysis · Computer Science 2018-01-03 Alexandros Syrakos , Stylianos Varchanis , Yannis Dimakopoulos , Apostolos Goulas , John Tsamopoulos

Discrete gradient methods are a powerful tool for the time discretization of dynamical systems, since they are structure-preserving regardless of the form of the total energy. In this work, we discuss the application of discrete gradient…

Numerical Analysis · Mathematics 2026-01-06 Philipp L. Kinon , Riccardo Morandin , Philipp Schulze

We present a general dyadic vector circuit formalism, applicable for uniaxial magneto-dielectric slabs, with strong spatial dispersion explicitly taken into account. This formalism extends the vector circuit theory, previously introduced…

Classical Physics · Physics 2007-05-23 Pekka Ikonen , Mikhail Lapine , Igor Nefedov , Sergei Tretyakov

A large class of machine learning techniques requires the solution of optimization problems involving spectral functions of parametric matrices, e.g. log-determinant and nuclear norm. Unfortunately, computing the gradient of a spectral…

Machine Learning · Computer Science 2018-10-31 Insu Han , Haim Avron , Jinwoo Shin

We propose a novel formulation for the second-order total generalized variation (TGV) of the normal vector on an oriented, triangular mesh embedded in $\R^3$. The normal vector is considered as a manifold-valued function, taking values on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Lukas Baumgärtner , Ronny Bergmann , Roland Herzog , Stephan Schmidt , Manuel Weiß

We address composite optimization problems, which consist in minimizing the sum of a smooth and a merely lower semicontinuous function, without any convexity assumptions. Numerical solutions of these problems can be obtained by proximal…

Optimization and Control · Mathematics 2024-02-14 Alberto De Marchi

A general method for analytic inversion of geometric integral transforms is proposed

Differential Geometry · Mathematics 2011-09-27 Victor Palamodov

Combining the signed distance function (SDF) and differentiable volume rendering has emerged as a powerful paradigm for surface reconstruction from multi-view images without 3D supervision. However, current methods are impeded by requiring…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Rui Peng , Xiaodong Gu , Luyang Tang , Shihe Shen , Fanqi Yu , Ronggang Wang

We investigate the connections between several recent methods for the discretization of anisotropic heterogeneous diffusion operators on general grids. We prove that the Mimetic Finite Difference scheme, the Hybrid Finite Volume scheme and…

Numerical Analysis · Mathematics 2010-11-01 Jerome Droniou , Robert Eymard , Thierry Gallouët , Raphaele Herbin

The inverse problem of supervised reconstruction of depth-variable (time-dependent) parameters in a neural ordinary differential equation (NODE) is considered, that means finding the weights of a residual network with time continuous…

Machine Learning · Computer Science 2022-02-14 George Baravdish , Gabriel Eilertsen , Rym Jaroudi , B. Tomas Johansson , Lukáš Malý , Jonas Unger

Spectral clustering is one of the most popular unsupervised machine learning methods. Constructing similarity matrix is crucial to this type of method. In most existing works, the similarity matrix is computed once for all or is updated…

Machine Learning · Computer Science 2023-06-30 Yongyan Guo , Gang Wu

A generalized prefactorization of compact schemes aimed at reducing the stencil and improving the computational efficiency is proposed here in the framework of transport equations. By the prefactorization introduced here, the computational…

Numerical Analysis · Mathematics 2019-02-13 Adrian Sescu

3D volumetric reconstruction from incomplete or noisy measurements is a fundamental problem in medical imaging and computational tomography. Deep image prior (DIP)-based methods have recently shown strong capability for solving inverse…

Computational Engineering, Finance, and Science · Computer Science 2026-05-29 Haijie Yuan , Chaoyan Huang , Srijita Bandopadhyay , Liyue Shen , Saiprasad Ravishankar

High-order partial differential equations (PDEs) require derivative regularity that standard $C^0$ finite element infrastructures do not directly provide on unstructured meshes. We propose a mesh-intrinsic generalized finite element method…

Numerical Analysis · Mathematics 2026-04-28 Rong Tian