English
Related papers

Related papers: Statistical behavior of adaptive multilevel splitt…

200 papers

The performance of standard stochastic approximation implementations can vary significantly based on the choice of the steplength sequence, and in general, little guidance is provided about good choices. Motivated by this gap, in the first…

Optimization and Control · Mathematics 2015-03-19 Farzad Yousefian , Angelia Nedić , Uday V. Shanbhag

In regression modelling approach, the main step is to fit the regression line as close as possible to the target variable. In this process most algorithms try to fit all of the data in a single line and hence fitting all parts of target…

Machine Learning · Statistics 2018-05-07 Kumarjit Pathak , Jitin Kapila , Aasheesh Barvey , Nikit Gawande

The purpose of this paper is to introduce a new Markov chain Monte Carlo method and exhibit its efficiency by simulation and high-dimensional asymptotic theory. Key fact is that our algorithm has a reversible proposal transition kernel,…

Methodology · Statistics 2014-12-22 Kengo Kamatani

This paper studies distributed resource allocation problem in multi-agent systems, where all the agents cooperatively minimize the sum of their cost functions with global resource constraints over stochastic communication networks. This…

Optimization and Control · Mathematics 2021-04-27 Tie Ding , Shanying Zhu , Cailian Chen , Xinping Guan

Policy gradient methods are among the most effective methods in challenging reinforcement learning problems with large state and/or action spaces. However, little is known about even their most basic theoretical convergence properties,…

Machine Learning · Computer Science 2020-10-16 Alekh Agarwal , Sham M. Kakade , Jason D. Lee , Gaurav Mahajan

Transition Path Theory (TPT) provides a rigorous statistical characterization of the ensemble of trajectories connecting directly, i.e., without detours, two disconnected (sets of) states in a Markov chain, a stochastic process that…

Statistical Mechanics · Physics 2023-06-28 G. Bonner , F. J. Beron-Vera , M. J. Olascoaga

State aggregation is a popular model reduction method rooted in optimal control. It reduces the complexity of engineering systems by mapping the system's states into a small number of meta-states. The choice of aggregation map often depends…

Machine Learning · Computer Science 2019-10-17 Yaqi Duan , Zheng Tracy Ke , Mengdi Wang

Stochastic reaction networks governed by Chemical Langevin Equations (CLE) exhibit pronounced multiscale dynamics spanning fast molecular reactions, intermediate transport, and slow cellular regulation, posing significant challenges for…

Numerical Analysis · Mathematics 2026-04-02 Yuming Zeng , Wei Xie , Keqi Wang

We consider a Markov jump process on a general state space to which we apply a time-dependent weak perturbation over a finite time interval. By martingale-based stochastic calculus, under a suitable exponential moment bound for the…

Probability · Mathematics 2024-05-14 Alessandra Faggionato , Vittoria Silvestri

A compound tunneling mechanism from one integrable region to another mediated by a delocalized state in an intermediate chaotic region of phase space was recently introduced to explain peculiar features of tunneling in certain…

chao-dyn · Physics 2016-08-16 F. Leyvraz , D. Ullmo

Biochemical reaction networks are often modelled using discrete-state, continuous-time Markov chains. System statistics of these Markov chains usually cannot be calculated analytically and therefore estimates must be generated via…

Quantitative Methods · Quantitative Biology 2016-04-19 Daniel Wilson , Ruth E. Baker

One of the most widely used samplers in practice is the component-wise Metropolis-Hastings (CMH) sampler that updates in turn the components of a vector valued Markov chain using accept-reject moves generated from a proposal distribution.…

Computation · Statistics 2017-03-22 Jinyoung Yang , Evgeny Levi , Radu V. Craiu , Jeffrey S. Rosenthal

Trajectory optimization methods have achieved an exceptional level of performance on real-world robots in recent years. These methods heavily rely on accurate analytical models of the dynamics, yet some aspects of the physical world can…

We analyze a stochastic approximation algorithm for decision-dependent problems, wherein the data distribution used by the algorithm evolves along the iterate sequence. The primary examples of such problems appear in performative prediction…

Optimization and Control · Mathematics 2024-05-15 Joshua Cutler , Mateo Díaz , Dmitriy Drusvyatskiy

The problem of designing adaptive stepsize sequences for the gradient descent method applied to convex and locally smooth functions is studied. We take an adaptive control perspective and design update rules for the stepsize that make use…

Optimization and Control · Mathematics 2025-08-27 Andrea Iannelli

In a physical system, changing parameters such as temperature can induce a phase transition: an abrupt change from one state of matter to another. Analogous phenomena have recently been observed in large language models. Typically, the task…

Machine Learning · Computer Science 2024-05-28 Julian Arnold , Flemming Holtorf , Frank Schäfer , Niels Lörch

We study distributed algorithms for solving global optimization problems in which the objective function is the sum of local objective functions of agents and the constraint set is given by the intersection of local constraint sets of…

Optimization and Control · Mathematics 2015-03-14 Ilan Lobel , Asuman Ozdaglar , Diego Feijer

Physically motivated stochastic dynamics are often used to sample from high-dimensional distributions. However such dynamics often get stuck in specific regions of their state space and mix very slowly to the desired stationary state. This…

Machine Learning · Statistics 2025-05-13 Abhijith Jayakumar , Andrey Y. Lokhov , Sidhant Misra , Marc Vuffray

Markov processes with stochastic resetting towards the origin generically converge towards non-equilibrium steady-states. Long dynamical trajectories can be thus analyzed via the large deviations at Level 2.5 for the joint probability of…

Statistical Mechanics · Physics 2021-05-07 Cecile Monthus

The treatment assignment mechanism in a randomized clinical trial can be optimized for statistical efficiency within a specified class of randomization mechanisms. Optimal designs of this type have been characterized in terms of the…

Methodology · Statistics 2025-09-03 Wei Zhang , Zhiwei Zhang , Aiyi Liu