English
Related papers

Related papers: Kinetic variable-sample methods for stochastic opt…

200 papers

A widely used heuristic for solving stochastic optimization problems is to use a deterministic rolling horizon procedure, which has been modified to handle uncertainty (e.g. buffer stocks, schedule slack). This approach has been criticized…

Optimization and Control · Mathematics 2017-03-16 Raymond T. Perkins , Warren B. Powell

We initiate a systematic study of utilizing predictions to improve over approximation guarantees of classic algorithms, without increasing the running time. We propose a systematic method for a wide class of optimization problems that ask…

Data Structures and Algorithms · Computer Science 2024-11-26 Antonios Antoniadis , Marek Eliáš , Adam Polak , Moritz Venzin

We propose a hierarchy of multi-level kinetic Monte Carlo methods for sampling high-dimensional, stochastic lattice particle dynamics with complex interactions. The method is based on the efficient coupling of different spatial resolution…

Numerical Analysis · Mathematics 2012-08-06 Evangelia Kalligiannaki , Markos A. Katsoulakis , Petr Plechac

Kinetic approaches are routinely employed to simulate the dynamics of systems that are too rarified to be described by the Navier-Stokes equations. However, generally they are far too computationally expensive to be applied for systems that…

Fluid Dynamics · Physics 2014-04-18 Irina Sagert , Dirk Colbry , Terrance Strother , Rodney Pickett , Wolfgang Bauer

We propose a new method to obtain kinetic properties of infrequent events from molecular dynamics simulation. The procedure employs a recently introduced variational approach [Valsson and Parrinello, Phys. Rev. Lett. 113, 090601 (2014)] to…

Statistical Mechanics · Physics 2015-08-19 James McCarty , Omar Valsson , Pratyush Tiwary , Michele Parrinello

Many stochastic optimization problems include chance constraints that enforce constraint satisfaction with a specific probability; however, solving an optimization problem with chance constraints assumes that the solver has access to the…

Optimization and Control · Mathematics 2021-09-21 Joshua Comden , Ahmed S. Zamzam , Andrey Bernstein

This paper considers the stochastic convex composite optimization problem and presents multi-cut stochastic approximation (SA) methods for solving it, whose models in expectation overestimate its objective function. The multi-cut model…

Optimization and Control · Mathematics 2026-03-03 Jiaming Liang , Renato D. C. Monteiro , Honghao Zhang

We consider stochastic optimization problems involving an expected value of a nonlinear function of a base random vector and a conditional expectation of another function depending on the base random vector, a dependent random vector, and…

Optimization and Control · Mathematics 2024-05-20 Andrzej Ruszczyński , Shangzhe Yang

Consensus maximization is one of the most widely used robust fitting paradigms in computer vision, and the development of algorithms for consensus maximization is an active research topic. In this paper, we propose an efficient…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Zhipeng Cai , Tat-Jun Chin , Huu Le , David Suter

Maximum consensus estimation plays a critically important role in robust fitting problems in computer vision. Currently, the most prevalent algorithms for consensus maximization draw from the class of randomized hypothesize-and-verify…

Computer Vision and Pattern Recognition · Computer Science 2018-10-24 Huu Le , Tat-Jun Chin , Anders Eriksson , Thanh-Toan Do , David Suter

Majorization-minimization algorithms consist of iteratively minimizing a majorizing surrogate of an objective function. Because of its simplicity and its wide applicability, this principle has been very popular in statistics and in signal…

Machine Learning · Statistics 2013-09-11 Julien Mairal

We focus on solving constrained convex optimization problems using mini-batch stochastic gradient descent. Dynamic sample size rules are presented which ensure a descent direction with high probability. Empirical results from two…

Optimization and Control · Mathematics 2017-08-03 Michael R. Metel

We consider the problem of supply and demand balancing that is stated as a minimization problem for the total expected revenue function describing the behavior of both consumers and suppliers. In the considered market model we assume that…

Optimization and Control · Mathematics 2021-06-29 Dmitry Pasechnyuk , Pavel Dvurechensky , Sergey Omelchenko , Alexander Gasnikov

This paper proposes a novel technique called "successive stochastic smoothing" that optimizes nonsmooth and discontinuous functions while considering various constraints. Our methodology enables local and global optimization, making it a…

Optimization and Control · Mathematics 2023-08-17 Vladimir Norkin , Alois Pichler , Anton Kozyriev

In this paper we propose stochastic gradient-free methods and accelerated methods with momentum for solving stochastic optimization problems. All these methods rely on stochastic directions rather than stochastic gradients. We analyze the…

Optimization and Control · Mathematics 2020-01-15 Xiaopeng Luo , Xin Xu

This paper considers the problem of minimizing a convex expectation function with a set of inequality convex expectation constraints. We present a computable stochastic approximation type algorithm, namely the stochastic linearized proximal…

Optimization and Control · Mathematics 2022-06-16 Liwei Zhang , Yule Zhang , Jia Wu , Xiantao Xiao

Chance constraints are frequently used to limit the probability of constraint violations in real-world optimization problems where the constraints involve stochastic components. We study chance-constrained submodular optimization problems,…

Optimization and Control · Mathematics 2023-09-27 Xiankun Yan , Anh Viet Do , Feng Shi , Xiaoyu Qin , Frank Neumann

This article presents a new method for computing guaranteed convex and concave relaxations of nonlinear stochastic optimal control problems with final-time expected-value cost functions. This method is motivated by similar methods for…

Optimization and Control · Mathematics 2017-11-27 Yuanxun Shao , Dillard Robertson , Joseph Kirk Scott

We propose a simple, scalable algorithm for using stochastic interpolants to sample from unnormalized densities and for fine-tuning generative models. The approach, Tilt Matching, arises from a dynamical equation relating the flow matching…

Machine Learning · Statistics 2025-12-29 Peter Potaptchik , Cheuk-Kit Lee , Michael S. Albergo

A novel hybrid computational method based on the discrete-velocity (DV) approximation, including the lattice-Boltzmann (LB) technique, is proposed. Numerical schemes for the kinetic equations are used in regions of rarefied flows, and LB…

Computational Physics · Physics 2019-10-14 V. V. Aristov , O. V. Ilyin , O. A. Rogozin