English
Related papers

Related papers: Lectures on stochastic sewing with applications

200 papers

We consider the problem of minimizing a convex function that is evolving according to unknown and possibly stochastic dynamics, which may depend jointly on time and on the decision variable itself. Such problems abound in the machine…

Optimization and Control · Mathematics 2023-05-30 Joshua Cutler , Dmitriy Drusvyatskiy , Zaid Harchaoui

It has been found that stochastic algorithms often find good solutions much more rapidly than inherently-batch approaches. Indeed, a very useful rule of thumb is that often, when solving a machine learning problem, an iterative technique…

Machine Learning · Computer Science 2013-08-19 Andrew Cotter

Stochastic optimisation algorithms are the de facto standard for machine learning with large amounts of data. Handling only a subset of available data in each optimisation step dramatically reduces the per-iteration computational costs,…

Numerical Analysis · Mathematics 2024-12-19 Matthias J. Ehrhardt , Zeljko Kereta , Jingwei Liang , Junqi Tang

When optimizing problems with uncertain parameter values in a linear objective, decision-focused learning enables end-to-end learning of these values. We are interested in a stochastic scheduling problem, in which processing times are…

Machine Learning · Computer Science 2024-08-16 Kim van den Houten , David M. J. Tax , Esteban Freydell , Mathijs de Weerdt

Stochastic integration \textit{wrt} Gaussian processes has raised strong interest in recent years, motivated in particular by its applications in Internet traffic modeling, biomedicine and finance. The aim of this work is to define and…

Probability · Mathematics 2018-02-15 Joachim Lebovits

The main goal of these notes is to give an introduction to the mathematics of quantum noise and some of its applications in non-equilibrium statistical mechanics. We start with some reminders from the theory of classical stochastic…

Mathematical Physics · Physics 2024-07-08 Soon Hoe Lim

For stochastic models with intractable likelihood functions, approximate Bayesian computation offers a way of approximating the true posterior through repeated comparisons of observations with simulated model outputs in terms of a small set…

Machine Learning · Computer Science 2022-05-24 Carlo Albert , Simone Ulzega , Firat Ozdemir , Fernando Perez-Cruz , Antonietta Mira

Our first result is a stochastic sewing lemma with quantitative estimates for mild incremental processes, with which we study SPDEs driven by fractional Brownian motions in a random environment. We obtain uniform $L^p$-bounds. Our second…

Probability · Mathematics 2023-03-07 Xue-Mei Li , Julian Sieber

We propose a new approach to apply the chaining technique in conjunction with information-theoretic measures to bound the generalization error of machine learning algorithms. Different from the deterministic chaining approach based on…

Information Theory · Computer Science 2022-01-31 Ruida Zhou , Chao Tian , Tie Liu

In this Topical Review we consider stochastic processes under resetting, which have attracted a lot of attention in recent years. We begin with the simple example of a diffusive particle whose position is reset randomly in time with a…

Statistical Mechanics · Physics 2020-06-24 Martin R. Evans , Satya N. Majumdar , Gregory Schehr

The recent progresses in Machine Learning opened the door to actual applications of learning algorithms but also to new research directions both in the field of Machine Learning directly and, at the edges with other disciplines. The case…

Disordered Systems and Neural Networks · Physics 2023-07-17 Aurélien Decelle

Transport phenomena are ubiquitous in nature and known to be important for various scientific domains. Examples can be found in physics, electrochemistry, heterogeneous catalysis, physiology, etc. To obtain new information about diffusive…

Probability · Mathematics 2007-05-23 Denis S. Grebenkov

We present a method for incorporating a stochastic point of view into physics exercises of mathematics education. The core of our method is the randomization of some inputs, the system model used does not differ from what we would use in…

Physics Education · Physics 2025-09-16 Matyas Barczy , Imre Kocsis , Csaba Gábor Kézi

The execution time of programs is a key element in many areas of computer science, mainly those where achieving good performance (e.g., scheduling in cloud computing) or a predictable one (e.g., meeting deadlines in embedded systems) is the…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-13 Matheus Henrique Junqueira Saldanha

We present a theoretical analysis of some popular adaptive Stochastic Gradient Descent (SGD) methods in the small learning rate regime. Using the stochastic modified equations framework introduced by Li et al., we derive effective…

Machine Learning · Statistics 2025-09-29 Luca Callisti , Marco Romito , Francesco Triggiano

Can noise be beneficial to machine-learning prediction of chaotic systems? Utilizing reservoir computers as a paradigm, we find that injecting noise to the training data can induce a stochastic resonance with significant benefits to both…

Machine Learning · Computer Science 2022-11-21 Zheng-Meng Zhai , Ling-Wei Kong , Ying-Cheng Lai

Stochastic processes offer a flexible mathematical formalism to model and reason about systems. Most analysis tools, however, start from the premises that models are fully specified, so that any parameters controlling the system's dynamics…

Systems and Control · Computer Science 2017-01-11 Luca Bortolussi , Guido Sanguinetti

This primer explains how continuous-time stochastic processes (precisely, Brownian motion and other Ito diffusions) can be defined and studied on manifolds. No knowledge is assumed of either differential geometry or continuous-time…

History and Overview · Mathematics 2014-08-06 Jonathan H. Manton

The semiconductor and IC industry is facing the issue of high energy consumption. In modern days computers and processing systems are designed based on the Turing machine and Von Neumann's architecture. This architecture mainly focused on…

Emerging Technologies · Computer Science 2020-11-11 S. Rahimi Kari

Stochastic processes have found numerous applications in science, as they are broadly used to model a variety of natural phenomena. Due to their intrinsic randomness and uncertainty, they are, however, difficult to characterize. Here, we…