English
Related papers

Related papers: Adjoint-based gradient estimation from gray-box so…

200 papers

Meta-optics promises compact, high-performance imaging and color routing. However, designing high-performance structures is a high-dimensional optimization problem: mapping a desired optical output back to a physical 3D structure requires…

Machine Learning · Computer Science 2026-04-21 Chanik Kang , Hyewon Suk , Haejun Chung

Low-rank matrix estimation is a canonical problem that finds numerous applications in signal processing, machine learning and imaging science. A popular approach in practice is to factorize the matrix into two compact low-rank factors, and…

Machine Learning · Computer Science 2021-06-16 Tian Tong , Cong Ma , Yuejie Chi

We study estimation problems in safety-critical applications with streaming data. Since estimation problems can be posed as optimization problems in the probability space, we devise a stochastic projected Wasserstein gradient flow that…

Systems and Control · Electrical Eng. & Systems 2023-04-07 Nicolas Lanzetti , Efe C. Balta , Dominic Liao-McPherson , Florian Dörfler

The equation governing the streaming of a quantity down its gradient superficially looks similar to the simple constant velocity advection equation. In fact, it is the same as an advection equation if there are no local extrema in the…

High Energy Astrophysical Phenomena · Physics 2015-03-13 Prateek Sharma , Phillip Colella , Daniel F. Martin

Flow matching has become a leading framework for generative modeling, but quantifying the uncertainty of its samples remains an open problem. Existing approaches retrain the model with auxiliary variance heads, maintain costly ensembles, or…

Machine Learning · Computer Science 2026-05-22 Jiarui Xing , Song Wang , Jian Wang

Recently proposed gradient estimators enable gradient descent over stochastic programs with discrete jumps in the response surface, which are not covered by automatic differentiation (AD) alone. Although these estimators' capability to…

Machine Learning · Computer Science 2024-04-09 Philipp Andelfinger , Justin N. Kreikemeyer

Optimization and control of complex unsteady flows remains an important challenge due to the large cost of performing a function evaluation, i.e. a full computational fluid dynamics (CFD) simulation. Reducing the number of required function…

Fluid Dynamics · Physics 2023-01-31 A. Quirós Rodríguez , M. Fosas de Pando , T. Sayadi

This paper presents a special type of distributed optimization problems, where the summation of agents' local cost functions (i.e., global cost function) is convex, but each individual can be non-convex. Unlike most distributed optimization…

Optimization and Control · Mathematics 2021-08-16 Yipeng Pang , Guoqiang Hu

Gradient-based techniques are becoming increasingly critical in quantitative fields, notably in statistics and computer science. The utility of these techniques, however, ultimately depends on how efficiently we can evaluate the derivatives…

Computation · Statistics 2020-02-04 Michael Betancourt , Charles C. Margossian , Vianey Leos-Barajas

Gaussian Process (GP) models are a powerful tool in probabilistic machine learning with a solid theoretical foundation. Thanks to current advances, modeling complex data with GPs is becoming increasingly feasible, which makes them an…

Machine Learning · Computer Science 2025-03-04 Sarem Seitz

The paper is devoted to the group analysis of equations of motion of two-dimensional uniformly stratified rotating fluids used as a basic model in geophysical fluid dynamics. It is shown that the nonlinear equations in question have a…

Mathematical Physics · Physics 2011-08-10 Nail H. Ibragimov , Ranis N. Ibragimov

Purpose: This study aims to assess the accuracy of degree adaptive strategies in the context of incompressible Navier-Stokes flows using the high order hybridisable discontinuous Galerkin (HDG) method. Design/methodology/approach: The work…

Fluid Dynamics · Physics 2024-11-12 Agustina Felipe , Ruben Sevilla , Oubay Hassan

Many real-world optimization problems contain parameters that are unknown before deployment time, either due to stochasticity or to lack of information (e.g., demand or travel times in delivery problems). A common strategy in such cases is…

We introduce a gradient flow formulation of linear Boltzmann equations. Under a diffusive scaling we derive a diffusion equation by using the machinery of gradient flows.

Mathematical Physics · Physics 2020-09-03 Giada Basile , Dario Benedetto , Lorenzo Bertini

Groundwater flow in Washington DC greatly influences the surface water quality in urban areas. The current methods of flow estimation, based on Darcy's Law and the groundwater flow equation, can be described by the diffusion equation (the…

Numerical Analysis · Mathematics 2010-01-20 Li Chen

In this work we develop implicit Active Flux schemes for the scalar advection equation. At every cell interface we approximate the solution by a polynomial in time. This allows to evolve the point values using characteristics and to update…

Numerical Analysis · Mathematics 2023-12-12 Wasilij Barsukow , Raul Borsche

We show for a variety of classes of conservative PDEs that discrete gradient methods designed to have a conserved quantity (here called energy) also have a time-discrete conservation law. The discrete conservation law has the same conserved…

Numerical Analysis · Mathematics 2013-02-20 Robert I McLachlan , G R W Quispel

Variational inference is a technique that approximates a target distribution by optimizing within the parameter space of variational families. On the other hand, Wasserstein gradient flows describe optimization within the space of…

Machine Learning · Statistics 2023-11-01 Mingxuan Yi , Song Liu

Adjoint based shape optimization is a powerful technique in fluid-dynamics optimization, capable of identifying an optimal shape within only dozens of design iterations. However, when extended to rarefied gas flows, the computational cost…

Computational Physics · Physics 2025-11-25 Yanbing Zhang , Ruifeng Yuan , Lei Wu

We present a novel deep learning approach to approximate the solution of large, sparse, symmetric, positive-definite linear systems of equations. These systems arise from many problems in applied science, e.g., in numerical methods for…

Machine Learning · Computer Science 2022-10-04 Ayano Kaneda , Osman Akar , Jingyu Chen , Victoria Kala , David Hyde , Joseph Teran