English
Related papers

Related papers: Global Optimization via Schr{\"o}dinger-F{\"o}llme…

200 papers

In this paper we study the problem of minimizing a submodular function $f : 2^V \rightarrow \mathbb{R}$ that is guaranteed to have a $k$-sparse minimizer. We give a deterministic algorithm that computes an additive $\epsilon$-approximate…

Data Structures and Algorithms · Computer Science 2024-07-09 Andrei Graur , Haotian Jiang , Aaron Sidford

We address the problem of Schr\"odinger potential estimation, which plays a crucial role in modern generative modelling approaches based on Schr\"odinger bridges and stochastic optimal control for SDEs. Given a simple prior diffusion…

Machine Learning · Computer Science 2025-06-04 Nikita Puchkin , Iurii Pustovalov , Yuri Sapronov , Denis Suchkov , Alexey Naumov , Denis Belomestny

Error bounds are derived for sampling and estimation using a discretization of an intrinsically defined Langevin diffusion with invariant measure $\text{d}\mu_\phi \propto e^{-\phi} \mathrm{dvol}_g $ on a compact Riemannian manifold. Two…

Statistics Theory · Mathematics 2025-12-10 Karthik Bharath , Alexander Lewis , Akash Sharma , Michael V Tretyakov

Global optimization, particularly for non-convex functions with multiple local minima, poses significant challenges for traditional gradient-based methods. While metaheuristic approaches offer empirical effectiveness, they often lack…

Machine Learning · Computer Science 2026-05-12 Andrea Agazzi , Vittorio Carlei , Marco Romito , Samuele Saviozzi

We propose a novel Bregman descent algorithm for minimizing a convex function that is expressed as the sum of a differentiable part (defined over an open set) and a possibly nonsmooth term. The approach, referred to as the Variable Bregman…

Machine Learning · Computer Science 2025-02-06 Ségolène Martin , Jean-Christophe Pesquet , Gabriele Steidl , Ismail Ben Ayed

We investigate the implementation of a new stochastic Kuramoto-Vicsek-type model for global optimization of nonconvex functions on the sphere. This model belongs to the class of Consensus-Based Optimization. In fact, particles move on the…

Machine Learning · Computer Science 2021-07-29 Massimo Fornasier , Hui Huang , Lorenzo Pareschi , Philippe Sünnen

SDE-based methods such as denoising diffusion probabilistic models (DDPMs) have shown remarkable success in real-world sample generation tasks. Prior analyses of DDPMs have been focused on the exponential Euler discretization, showing…

Machine Learning · Computer Science 2025-11-10 Matthew S. Zhang , Stephen Huan , Jerry Huang , Nicholas M. Boffi , Sitan Chen , Sinho Chewi

This paper investigates a category of constrained fractional optimization problems that emerge in various practical applications. The objective function for this category is characterized by the ratio of a numerator and denominator, both…

Optimization and Control · Mathematics 2026-05-28 Yizun Lin , Jian-Feng Cai , Zhao-Rong Lai , Cheng Li

The paper considers the problem of network-based computation of global minima in smooth nonconvex optimization problems. It is known that distributed gradient-descent-type algorithms can achieve convergence to the set of global minima by…

Optimization and Control · Mathematics 2019-10-24 Brian Swenson , Anirudh Sridhar , H. Vincent Poor

A fundamental problem in statistics is estimating the shape matrix of an Elliptical distribution. This generalizes the familiar problem of Gaussian covariance estimation, for which the sample covariance achieves optimal estimation error.…

Statistics Theory · Mathematics 2025-10-16 Lap Chi Lau , Akshay Ramachandran

In stochastic optimization, the population risk is generally approximated by the empirical risk. However, in the large-scale setting, minimization of the empirical risk may be computationally restrictive. In this paper, we design an…

Machine Learning · Statistics 2016-11-22 Murat A. Erdogdu , Mohsen Bayati , Lee H. Dicker

We propose a novel deterministic sampling method to approximate a target distribution $\rho^*$ by minimizing the kernel discrepancy, also known as the Maximum Mean Discrepancy (MMD). By employing the general \emph{energetic variational…

Machine Learning · Statistics 2025-03-12 Yindong Chen , Yiwei Wang , Lulu Kang , Chun Liu

Diffusion Probabilistic Models (DPMs) have demonstrated exceptional capability of generating high-quality and diverse images, but their practical application is hindered by the intensive computational cost during inference. The DPM…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Jen-Yuan Huang

We propose a new approach to quantize the marginals of the discrete Euler diffusion process. The method is built recursively and involves the conditional distribution of the marginals of the discrete Euler process. Analytically, the method…

Probability · Mathematics 2015-05-25 Gilles Pagès , Abass Sagna

We develop a distributed algorithm for convex Empirical Risk Minimization, the problem of minimizing large but finite sum of convex functions over networks. The proposed algorithm is derived from directly discretizing the second-order…

Optimization and Control · Mathematics 2018-11-07 Jingzhao Zhang , César A. Uribe , Aryan Mokhtari , Ali Jadbabaie

This paper proposes a stochastic gradient descent method with an adaptive Gaussian noise term for the global minimization of nearly convex functions, which are nonconvex and possess multiple strict local minimizers. The noise term,…

Optimization and Control · Mathematics 2025-08-05 Chenglong Bao , Liang Chen , Weizhi Shao

Recently there is a rising interest in the research of mean field optimization, in particular because of its role in analyzing the training of neural networks. In this paper by adding the Fisher Information as the regularizer, we relate the…

Probability · Mathematics 2023-07-25 Julien Claisse , Giovanni Conforti , Zhenjie Ren , Songbo Wang

This paper proposes a novel method to estimate the rate parameter of the Poisson distribution. The proposed method employs the Cramer-von Mises type optimization which has been commonly used in estimating parameters of continuous…

Computation · Statistics 2026-05-22 Jiwoong Kim

We consider distributed estimation of the inverse covariance matrix, also called the concentration or precision matrix, in Gaussian graphical models. Traditional centralized estimation often requires global inference of the covariance…

Machine Learning · Statistics 2015-06-15 Zhaoshi Meng , Dennis Wei , Ami Wiesel , Alfred O. Hero

We prove the existence of non-trivial global minimizers of a class of free energies related to aggregation equations with degenerate diffusion on $\Real^d$. Such equations arise in mathematical biology as models for organism group dynamics…

Analysis of PDEs · Mathematics 2010-09-28 Jacob Bedrossian