English
Related papers

Related papers: Adjoint Multi-Start Based Estimation of Cardiac Hy…

200 papers

Gradient-based solvers risk convergence to local optima, leading to incorrect researcher inference. Heuristic-based algorithms are able to ``break free" of these local optima to eventually converge to the true global optimum. However, given…

Econometrics · Economics 2024-01-17 Zachary Porreca

We propose a first-order method for convex optimization, where instead of being restricted to the gradient from a single parameter, gradients from multiple parameters can be used during each step of gradient descent. This setup is…

Machine Learning · Computer Science 2023-02-08 Yash Chandak , Shiv Shankar , Venkata Gandikota , Philip S. Thomas , Arya Mazumdar

The grade of membership model is a flexible latent variable model for analyzing multivariate categorical data through individual-level mixed membership scores. In many modern applications, auxiliary covariates are collected alongside…

Methodology · Statistics 2026-01-27 Zhiyu Xu , Yuqi Gu

Patient-specific modeling of cardiovascular flows with high-fidelity is challenging due to its dependence on accurately estimated velocity boundary profiles, which are essential for precise simulations and directly influence wall shear…

Numerical Analysis · Mathematics 2024-11-28 Kabir Bakhshaei , Sajad Salavatidezfouli , Giovanni Stabile , Gianluigi Rozza

We introduce a novel algorithm for gradient-based optimization of stochastic objective functions. The method may be seen as a variant of SGD with momentum equipped with an adaptive learning rate automatically adjusted by an 'energy'…

Optimization and Control · Mathematics 2022-03-24 Hailiang Liu , Xuping Tian

Materials design can be cast as an optimization problem with the goal of achieving desired properties, by varying material composition, microstructure morphology, and processing conditions. Existence of both qualitative and quantitative…

Computational Physics · Physics 2019-07-08 Akshay Iyer , Yichi Zhang , Aditya Prasad , Siyu Tao , Yixing Wang , Linda Schadler , L Catherine Brinson , Wei Chen

This paper introduces an iterative algorithm for training nonparametric additive models that enjoys favorable memory storage and computational requirements. The algorithm can be viewed as the functional counterpart of stochastic gradient…

Machine Learning · Statistics 2026-01-01 Xin Chen , Jason M. Klusowski

Hyperparameter tuning is one of the essential steps to guarantee the convergence of machine learning models. We argue that intuition about the optimal choice of hyperparameters for stochastic gradient descent can be obtained by studying a…

Disordered Systems and Neural Networks · Physics 2025-12-12 Chanju Park , Biagio Lucini , Gert Aarts

To accurately reproduce measurements from the real world, simulators need to have an adequate model of the physical system and require the parameters of the model be identified. We address the latter problem of estimating parameters through…

Robotics · Computer Science 2022-03-01 Eric Heiden , Christopher E. Denniston , David Millard , Fabio Ramos , Gaurav S. Sukhatme

For a given {\it misfit function}, a specified optimality measure of a model, its gradient describes the manner in which one may alter properties of the system to march towards a stationary point. The adjoint method, arising from…

Solar and Stellar Astrophysics · Physics 2015-05-28 Shravan Hanasoge , Aaron Birch , Laurent Gizon , Jeroen Tromp

Bilevel optimization is a central tool in machine learning for high-dimensional hyperparameter tuning. Its applications are vast; for instance, in imaging it can be used for learning data-adaptive regularizers and optimizing forward…

Optimization and Control · Mathematics 2025-11-11 Mohammad Sadegh Salehi , Subhadip Mukherjee , Lindon Roberts , Matthias J. Ehrhardt

In the optimization of turbomachinery components, shape sensitivities for fluid dynamical objective functions have been used for a long time. As peak stress is not a differential func- tional of the shape, such highly efficient procedures…

Numerical Analysis · Mathematics 2018-02-15 Hanno Gottschalk , Mohamed Saadi , Onur Tanil Doganay , Kathrin Klamroth , Sebastian Schmitz

The calibration of CALPHAD (CALculation of PHAse Diagrams) models involves the solution of a very challenging high-dimensional multiobjective optimization problem. Traditional approaches to parameter fitting predominantly rely on…

Materials Science · Physics 2025-05-06 Courtney Kunselman , Brandon Bocklund , Richard Otis , Raymundo Arroyave

The Heston model is a well-known two-dimensional financial model. Because the Heston model contains implicit parameters that cannot be determined directly from real market data, calibrating the parameters to real market data is challenging.…

Optimization and Control · Mathematics 2023-10-16 Anna Clevenhaus , Claudia Totzeck , Matthias Ehrhardt

A number of optimization approaches have been proposed for optimizing nonconvex objectives (e.g. deep learning models), such as batch gradient descent, stochastic gradient descent and stochastic variance reduced gradient descent. Theory…

Machine Learning · Computer Science 2019-05-15 Jia Bi , Steve R. Gunn

The use of mathematical models to make predictions about tumor growth and response to treatment has become increasingly more prevalent in the clinical setting. The level of complexity within these models ranges broadly, and the calibration…

Quantitative Methods · Quantitative Biology 2021-12-28 Allison L. Lewis , Kathleen M. Storey , Heyrim Cho , Anna C. Zittle

Modelling of mechanical behaviour of pre-stressed fibre-reinforced composites is considered in a geometrically exact setting. A general approach which includes two different reference configurations is employed: one configuration…

Computational Engineering, Finance, and Science · Computer Science 2021-03-15 I. I. Tagiltsev , A. V. Shutov

Surface matching usually provides significant deformations that can lead to structural failure due to the lack of physical policy. In this context, partial surface matching of non-linear deformable bodies is crucial in engineering to govern…

Artificial Intelligence · Computer Science 2023-03-17 Alban Odot , Guillaume Mestdagh , Yannick Privat , Stéphane Cotin

Many problems encountered in science and engineering can be formulated as estimating a low-rank object (e.g., matrices and tensors) from incomplete, and possibly corrupted, linear measurements. Through the lens of matrix and tensor…

Machine Learning · Computer Science 2023-10-11 Cong Ma , Xingyu Xu , Tian Tong , Yuejie Chi

In this work, a higher-order irrotational strain gradient plasticity theory is studied in the small strain regime. A detailed numerical study is based on the problem of simple shear of a non-homogeneous block comprising an elastic-plastic…

Materials Science · Physics 2019-06-26 Nothando Mhlongo , B Daya Reddy