English
Related papers

Related papers: $S$-Leaping: An adaptive, accelerated stochastic s…

200 papers

This paper considers a cross-layer optimization problem driven by multi-timescale stochastic exogenous processes in wireless communication networks. Due to the hierarchical information structure in a wireless network, a mixed timescale…

Systems and Control · Computer Science 2013-05-02 Junting Chen , Vincent K. N. Lau

The use of stochastic models, in effect piecewise deterministic Markov processes (PDMP), has become increasingly popular especially for the modeling of chemical reactions and cell biophysics. Yet, exact simulation methods, for the…

Numerical Analysis · Mathematics 2015-04-28 Romain Veltz

This paper discusses new simulation algorithms for stochastic chemical kinetics that exploit the linearity of the chemical master equation and its matrix exponential exact solution. These algorithms make use of various approximations of the…

Numerical Analysis · Computer Science 2016-09-08 Azam S. Zavar Moosavi , Adrian Sandu

One of the most common methods to train machine learning algorithms today is the stochastic gradient descent (SGD). In a distributed setting, SGD-based algorithms have been shown to converge theoretically under specific circumstances. A…

Machine Learning · Computer Science 2025-08-22 Soumya Sarkar , Shweta Jain

Since their introduction, anchoring methods in extragradient-type saddlepoint problems have inspired a flurry of research due to their ability to provide order-optimal rates of accelerated convergence in very general problem settings. Such…

Optimization and Control · Mathematics 2025-06-10 James Alcala , Yat Tin Chow , Mahesh Sunkula

Safety and trustworthiness are indispensable requirements for real-world applications of AI systems using large language models (LLMs). This paper formulates human value alignment as an optimization problem of the language model policy to…

Machine Learning · Computer Science 2024-10-22 Akifumi Wachi , Thien Q. Tran , Rei Sato , Takumi Tanabe , Youhei Akimoto

We propose a new formulation of optimal motion planning (OMP) algorithm for robots operating in a hazardous environment, called adaptive Gaussian-process based stochastic trajectory optimization (AGP-STO). It first restarts the accelerated…

Robotics · Computer Science 2022-01-03 Feng Yichang , Zhang Haiyun , Wang Jin , Lu Guodong

Model parameter inference is a universal problem across science. This challenge is particularly pronounced in developmental biology, where faithful mechanistic descriptions require spatial-stochastic models with numerous parameters, yet…

Biological Physics · Physics 2024-07-16 Michael A. Ramirez-Sierra , Thomas R. Sokolowski

We consider a class of stochastic smooth convex optimization problems under rather general assumptions on the noise in the stochastic gradient observation. As opposed to the classical problem setting in which the variance of noise is…

Optimization and Control · Mathematics 2024-08-23 Sasila Ilandarideva , Anatoli Juditsky , Guanghui Lan , Tianjiao Li

We propose new continuous-time formulations for first-order stochastic optimization algorithms such as mini-batch gradient descent and variance-reduced methods. We exploit these continuous-time models, together with simple Lyapunov analysis…

Optimization and Control · Mathematics 2020-03-12 Antonio Orvieto , Aurelien Lucchi

Algorithm selection (AS) deals with the automatic selection of an algorithm from a fixed set of candidate algorithms most suitable for a specific instance of an algorithmic problem class, where "suitability" often refers to an algorithm's…

Machine Learning · Computer Science 2020-07-13 Alexander Tornede , Marcel Wever , Stefan Werner , Felix Mohr , Eyke Hüllermeier

We propose an algorithm for optimizations in which the gradients contain stochastic noise. This arises, for example, in structural optimizations when computations of forces and stresses rely on methods involving Monte Carlo sampling, such…

Materials Science · Physics 2022-11-30 Siyuan Chen , Shiwei Zhang

Gradient descent, and coordinate descent in particular, are core tools in machine learning and elsewhere. Large problem instances are common. To help solve them, two orthogonal approaches are known: acceleration and parallelism. In this…

Optimization and Control · Mathematics 2018-08-16 Richard Cole , Yixin Tao

Stochastic kinetic models are ubiquitous in physics, yet inferring their parameters from experimental data remains challenging. In deterministic models, parameter inference often relies on gradients, as they can be obtained efficiently…

Computational Physics · Physics 2026-04-03 Ludwig Burger , Annalena Kofler , Lukas Heinrich , Ulrich Gerland

We consider checkpointing strategies that minimize the number of recomputations needed when performing discrete adjoint computations using multistage time-stepping schemes, which requires computing several substeps within one complete time…

Mathematical Software · Computer Science 2022-04-29 Hong Zhang , Emil Constantinescu

We discuss through multiple numerical examples the accuracy and efficiency of a micro-macro acceleration method for stiff stochastic differential equations (SDEs) with a time-scale separation between the fast microscopic dynamics and the…

Numerical Analysis · Mathematics 2019-02-22 Hannes Vandecasteele , Przemysław Zieliński , Giovanni Samaey

The presence of erratic or unstable paths in standard kinetic Monte Carlo simulations significantly undermines the accurate simulation and sampling of transition pathways. While typically reliable methods, such as the Gillespie algorithm,…

Statistical Mechanics · Physics 2024-12-03 Elad Korngut , Ohad Vilk , Michael Assaf

Langevin simulation provides an effective way to study collisional effects in beams by reducing the six-dimensional Fokker-Planck equation to a group of stochastic ordinary differential equations. These resulting equations usually have…

Accelerator Physics · Physics 2007-05-23 Ji Qiang , Salman Habib

One of the key limitations of Molecular Dynamics simulations is the computational intractability of sampling protein conformational landscapes associated with either large system size or long timescales. To overcome this bottleneck, we…

Biomolecules · Quantitative Biology 2018-07-09 Zahra Shamsi , Kevin J. Cheng , Diwakar Shukla

Signal Temporal Logic (STL) enables formal specification of complex spatiotemporal constraints for robotic task planning. However, synthesizing long-horizon continuous control trajectories from complex STL specifications is fundamentally…

Robotics · Computer Science 2026-03-17 Hongrui Zheng , Zirui Zang , Ahmad Amine , Cristian Ioan Vasile , Rahul Mangharam