English
Related papers

Related papers: Score Operator Newton transport

200 papers

A new variant of Newton's method for empirical risk minimization is studied, where at each iteration of the optimization algorithm, the gradient and Hessian of the objective function are replaced by robust estimators taken from existing…

Machine Learning · Statistics 2023-07-18 Eirini Ioannou , Muni Sreenivas Pydi , Po-Ling Loh

Neural Operators offer a powerful, data-driven tool for solving parametric PDEs as they can represent maps between infinite-dimensional function spaces. In this work, we employ physics-informed Neural Operators in the context of…

Machine Learning · Statistics 2023-03-08 Sebastian Kaltenbach , Paris Perdikaris , Phaedon-Stelios Koutsourelakis

Optimal transport is widely used to learn distributions, enforce distributional constraints, and model uncertainty. In applications, transport losses are often computed from samples through tractable representations, such as one-dimensional…

Optimization and Control · Mathematics 2026-05-28 Tam Le

Clustering is a fundamental task in the computer vision and machine learning community. Although various methods have been proposed, the performance of existing approaches drops dramatically when handling incomplete high-dimensional data…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Mingjie Luo , Siwei Wang , Xinwang Liu , Wenxuan Tu , Yi Zhang , Xifeng Guo , Sihang Zhou , En Zhu

For several combinatorial optimization problems over random structures, the theory of local weak convergence from probability and the cavity method from statistical physics can be used to deduce a recursive equation for the distribution of…

Probability · Mathematics 2014-05-07 Mustafa Khandwawala

The task of sampling from a probability density can be approached as transporting a tractable density function to the target, known as dynamical measure transport. In this work, we tackle it through a principled unified framework using…

In this paper, we propose new methods to efficiently solve convex optimization problems encountered in sparse estimation, which include a new quasi-Newton method that avoids computing the Hessian matrix and improves efficiency, and we prove…

Optimization and Control · Mathematics 2023-09-06 Ryosuke Shimmura , Joe Suzuki

Saddle point optimization is a critical problem employed in numerous real-world applications, including portfolio optimization, generative adversarial networks, and robotics. It has been extensively studied in cases where the objective…

Machine Learning · Computer Science 2025-03-25 Shubhankar Agarwal , Hamzah I. Khan , Sandeep P. Chinchali , David Fridovich-Keil

We consider infinite-dimensional Bayesian linear inverse problems governed by time-dependent partial differential equations (PDEs) and develop a mathematical and computational framework for optimal design of mobile sensor paths in this…

Optimization and Control · Mathematics 2026-01-22 J. Nicholas Neuberger , Alen Alexanderian , Bart van Bloemen Waanders , Ahmed Attia

Destination prediction is an essential task in a variety of mobile applications. In this paper, we optimize the matrix operation and adapt a semi-lazy framework to improve the prediction accuracy and efficiency of a state-of-the-art…

Databases · Computer Science 2018-07-11 Zhou Yang , Heli Sun , Jianbin Huang , Xiaolin Jia , Ziyu Guan , Zhongmeng Zhao

Optimal transport (OT) provides effective tools for comparing and mapping probability measures. We propose to leverage the flexibility of neural networks to learn an approximate optimal transport map. More precisely, we present a new and…

Machine Learning · Computer Science 2022-07-06 Florentin Coeurdoux , Nicolas Dobigeon , Pierre Chainais

Transportation maps between probability measures are critical objects in numerous areas of mathematics and applications such as PDE, fluid mechanics, geometry, machine learning, computer science, and economics. Given a pair of source and…

Optimization and Control · Mathematics 2020-04-07 Levon Nurbekyan , Alexander Iannantuono , Adam M. Oberman

Objective prior distributions represent an important tool that allows one to have the advantages of using the Bayesian framework even when information about the parameters of a model is not available. The usual objective approaches work off…

Methodology · Statistics 2018-09-25 Fabrizio Leisen , Cristiano Villa , Stephen G. Walker

We introduce a novel framework for efficient sampling from complex, unnormalised target distributions by exploiting multiscale dynamics. Traditional score-based sampling methods either rely on learned approximations of the score function or…

Computation · Statistics 2025-11-04 Paula Cordero-Encinar , Andrew B. Duncan , Sebastian Reich , O. Deniz Akyildiz

In this paper, we study a spline collocation method for a numerical solution to the optimal transport problem We mainly solve the \MAE with the second boundary condition numerically by proposing a center matching algorithm. We prove a…

Numerical Analysis · Mathematics 2023-10-27 Ming-Jun Lai , Jinsil Lee

Optimal transport (OT) has an important role in transforming data distributions in a manner which engenders fairness. Typically, the OT operators are learnt from the unfair attribute-labelled data, and then used for their repair. Two…

Machine Learning · Computer Science 2026-03-11 Abigail Langbridge , Anthony Quinn , Robert Shorten

We propose the Block Coordinate Descent Network Simplex (BCDNS) method for solving large-scale discrete Optimal Transport (OT) problems. BCDNS integrates the Network Simplex (NS) algorithm with a block coordinate descent (BCD) strategy,…

Optimization and Control · Mathematics 2026-01-08 Lingrui Li , Nobuo Yamashita

We address the problem of static OD matrix estimation from a formal statistical viewpoint. We adopt a novel Bayesian framework to develop a class of models that explicitly cast trip configurations in the study region as random variables. As…

Applications · Statistics 2015-03-17 Luis Carvalho

For distributed computing environment, we consider the empirical risk minimization problem and propose a distributed and communication-efficient Newton-type optimization method. At every iteration, each worker locally finds an Approximate…

Machine Learning · Computer Science 2018-09-12 Shusen Wang , Farbod Roosta-Khorasani , Peng Xu , Michael W. Mahoney

We study the slice-matching scheme, an efficient iterative method for distribution matching based on sliced optimal transport. We investigate convergence to the target distribution and derive quantitative non-asymptotic rates. To this end,…

Machine Learning · Statistics 2026-02-12 Gauthier Thurin , Claire Boyer , Kimia Nadjahi