English
Related papers

Related papers: Markov Chain Analysis of Evolution Strategies on a…

200 papers

Many systems across the sciences evolve through a combination of multiplicative growth and diffusive transport. In the presence of disorder, these systems tend to form localized structures which alternate between long periods of relative…

Statistical Mechanics · Physics 2022-12-19 Matteo Smerlak

Robust iterative methods for solving large sparse systems of linear algebraic equations often suffer from the problem of optimizing the corresponding tuning parameters. To improve the performance of the problem of interest, specific…

Numerical Analysis · Mathematics 2023-10-18 Andrey Petrushov , Boris Krasnopolsky

The problem of estimating an unknown discrete distribution from its samples is a fundamental tenet of statistical learning. Over the past decade, it attracted significant research effort and has been solved for a variety of divergence…

Machine Learning · Computer Science 2018-10-30 Yi Hao , Alon Orlitsky , Venkatadheeraj Pichapati

We consider chance-constrained problems with discrete random distribution. We aim for problems with a large number of scenarios. We propose a novel method based on the stochastic gradient descent method which performs updates of the…

Optimization and Control · Mathematics 2019-05-28 Lukáš Adam , Martin Branda

We consider an assortment optimization problem where a customer chooses a single item from a sequence of sets shown to her, while limited inventories constrain the items offered to customers over time. In the special case where all of the…

Data Structures and Algorithms · Computer Science 2020-07-28 Elaheh Fata , Will Ma , David Simchi-Levi

Many real-world optimisation problems involve dynamic and stochastic components. While problems with multiple interacting components are omnipresent in inherently dynamic domains like supply-chain optimisation and logistics, most research…

Neural and Evolutionary Computing · Computer Science 2020-09-16 Ragav Sachdeva , Frank Neumann , Markus Wagner

Markov chain Monte Carlo algorithms are invaluable tools for exploring stationary properties of physical systems, especially in situations where direct sampling is unfeasible. Common implementations of Monte Carlo algorithms employ…

Statistical Mechanics · Physics 2016-04-27 Marija Vucelja

The Makespan Scheduling problem is an extensively studied NP-hard problem, and its simplest version looks for an allocation approach for a set of jobs with deterministic processing times to two identical machines such that the makespan is…

Neural and Evolutionary Computing · Computer Science 2025-04-25 Feng Shi , Daoyu Huang , Xiankun Yan , Frank Neumann

We present two adaptive schemes for dynamically choosing the number of parallel instances in parallel evolutionary algorithms. This includes the choice of the offspring population size in a (1+$\lambda$) EA as a special case. Our schemes…

Data Structures and Algorithms · Computer Science 2011-03-03 Jörg Lässig , Dirk Sudholt

Gradient descent and stochastic gradient descent are central to modern machine learning, yet their behavior under large step sizes remains theoretically unclear. Recent work suggests that acceleration often arises near the edge of…

Machine Learning · Computer Science 2026-03-02 Sacchit Kale , Piyushi Manupriya , Pierre Marion , Francis Bach , Anant Raj

In this paper we deal with stochastic optimization problems where the data distributions change in response to the decision variables. Traditionally, the study of optimization problems with decision-dependent distributions has assumed…

Optimization and Control · Mathematics 2023-10-05 Zifan Wang , Changxin Liu , Thomas Parisini , Michael M. Zavlanos , Karl H. Johansson

We develop a stochastic approximation-type algorithm to solve finite state/action, infinite-horizon, risk-aware Markov decision processes. Our algorithm has two loops. The inner loop computes the risk by solving a stochastic saddle-point…

Optimization and Control · Mathematics 2019-12-05 Wenjie Huang , William B. Haskell

Sampling from a high-dimensional distribution is a fundamental task in statistics, engineering, and the sciences. A canonical approach is the Langevin Algorithm, i.e., the Markov chain for the discretized Langevin Diffusion. This is the…

Statistics Theory · Mathematics 2022-11-01 Jason M. Altschuler , Kunal Talwar

Mini-batch stochastic gradient descent and variants thereof have become standard for large-scale empirical risk minimization like the training of neural networks. These methods are usually used with a constant batch size chosen by simple…

Machine Learning · Computer Science 2017-06-29 Lukas Balles , Javier Romero , Philipp Hennig

For solving a broad class of nonconvex programming problems on an unbounded constraint set, we provide a self-adaptive step-size strategy that does not include line-search techniques and establishes the convergence of a generic approach…

Optimization and Control · Mathematics 2022-12-14 Thang Tran Ngoc , Hai Trinh Ngoc

To approximate convolutions which occur in evolution equations with memory terms, a variable-stepsize algorithm is presented for which advancing N steps requires only O(N log(N)) operations and O(log(N)) active memory, in place of O(N^2)…

Numerical Analysis · Mathematics 2007-05-23 María López-Fernández , Christian Lubich , Achim Schädle

Markov chains are a common framework for individual-based state and time discrete models in ecology and evolution. Their use, however, is largely limited to systems with a low number of states, since the transition matrices involved pose…

Quantitative Methods · Quantitative Biology 2014-07-10 Katja Reichel , Valentin Bahier , Cédric Midoux , Jean-Pierre Masson , Solenn Stoeckel

This paper proposes a new sampling scheme based on Langevin dynamics that is applicable within pseudo-marginal and particle Markov chain Monte Carlo algorithms. We investigate this algorithm's theoretical properties under standard…

Methodology · Statistics 2016-05-30 Christopher Nemeth , Chris Sherlock , Paul Fearnhead

In this paper, a general framework for the analysis of a connection between the training of artificial neural networks via the dynamics of Markov chains and the approximation of conservation law equations is proposed. This framework allows…

Computational Engineering, Finance, and Science · Computer Science 2025-10-20 Roderick V. N. Melnik

This paper considers the optimal scaling problem for high-dimensional random walk Metropolis algorithms for densities which are differentiable in Lp mean but which may be irregular at some points (like the Laplace density for example)…

Probability · Mathematics 2016-04-25 Alain Durmus , Sylvain Le Corff , Eric Moulines , Gareth O. Roberts