English
Related papers

Related papers: Diffusion Approximations in the Online Increasing …

200 papers

We suggest a novel procedure for online change point detection. Our approach expands an idea of maximizing a discrepancy measure between points from pre-change and post-change distributions. This leads to flexible algorithms suitable for…

Machine Learning · Statistics 2026-03-24 Nikita Puchkin , Artur Goldman , Konstantin Yakovlev , Valeriia Dzis , Uliana Vinogradova

We propose information-directed sampling -- a new approach to online optimization problems in which a decision-maker must balance between exploration and exploitation while learning from partial feedback. Each action is sampled in a manner…

Machine Learning · Computer Science 2017-07-10 Daniel Russo , Benjamin Van Roy

We resolve the fundamental problem of online decoding with general $n^{th}$ order ergodic Markov chain models. Specifically, we provide deterministic and randomized algorithms whose performance is close to that of the optimal offline…

Machine Learning · Computer Science 2019-05-31 Vikas K. Garg , Tamar Pichkhadze

This paper investigates online algorithms for smooth time-varying optimization problems, focusing first on methods with constant step-size, momentum, and extrapolation-length. Assuming strong convexity, precise results for the tracking…

Optimization and Control · Mathematics 2024-07-16 Liam Madden , Stephen Becker , Emiliano Dall'Anese

Stochastic processes play a key role for modeling a huge variety of transport problems out of equilibrium, with manifold applications throughout the natural and social sciences. To formulate models of stochastic dynamics the conventional…

Statistical Mechanics · Physics 2022-07-25 Massimiliano Giona , Andrea Cairoli , Rainer Klages

We study distributed methods for online prediction and stochastic optimization. Our approach is iterative: in each round nodes first perform local computations and then communicate in order to aggregate information and synchronize their…

Information Theory · Computer Science 2014-03-06 Konstantinos I. Tsianos , Michael G. Rabbat

This paper considers a class of real-time stochastic optimization problems dependent on an unknown probability distribution. In the considered scenario, data is streaming frequently while trying to reach a decision. Thus, we aim to devise a…

Optimization and Control · Mathematics 2020-09-08 Dan Li , Sonia Martinez

In this paper, we solve explicitly the optimal stopping problem with random discounting and an additive functional as cost of observations for a regular linear diffusion. We also extend the results to the class of one-sided regular Feller…

Probability · Mathematics 2012-11-06 Mamadou Cissé , Pierre Patie , Etienne Tanré

Finding the reduced-dimensional structure is critical to understanding complex networks. Existing approaches such as spectral clustering are applicable only when the full network is explicitly observed. In this paper, we focus on the online…

Machine Learning · Computer Science 2017-12-13 Lin F. Yang , Vladimir Braverman , Tuo Zhao , Mengdi Wang

The problem of online learning and optimization of unknown Markov jump affine models is considered. An online learning policy, referred to as Markovian simultaneous perturbations stochastic approximation (MSPSA), is proposed for two…

Information Theory · Computer Science 2016-05-10 Sevi Baltaoglu , Lang Tong , Qing Zhao

Real world networks are often subject to severe uncertainties which need to be addressed by any reliable prescriptive model. In the context of the maximum flow problem subject to arc failure, robust models have gained particular attention.…

Discrete Mathematics · Computer Science 2017-05-24 Fabian Mies , Britta Peis , Andreas Wierz

We introduce a resetting Brownian bridge as a simple model to study search processes where the total search time $t_f$ is finite and the searcher returns to its starting point at $t_f$. This is simply a Brownian motion with a Poissonian…

Statistical Mechanics · Physics 2022-05-23 Benjamin De Bruyne , Satya N. Majumdar , Gregory Schehr

In statistical learning for real-world large-scale data problems, one must often resort to "streaming" algorithms which operate sequentially on small batches of data. In this work, we present an analysis of the information-theoretic limits…

Machine Learning · Statistics 2018-01-22 Andre Manoel , Florent Krzakala , Eric W. Tramel , Lenka Zdeborová

The paper studies a class of multidimensional optimal stopping problems with infinite horizon for linear switching diffusions. There are two main novelties in the optimal problems considered: the underlying stochastic process has…

Probability · Mathematics 2021-08-02 Philip Ernst , Hongwei Mei

This paper considers the problem of minimizing the time average of a controlled stochastic process subject to multiple time average constraints on other related processes. The probability distribution of the random events in the system is…

Optimization and Control · Mathematics 2016-12-20 Xiaohan Wei , Hao Yu , Michael J. Neely

In order to approximate the exit time of a one-dimensional diffusion process, we propose an algorithm based on a random walk. Such an algorithm was already introduced in both the Brownian context and in the Ornstein-Uhlenbeck context. Here…

Probability · Mathematics 2019-12-12 Samuel Herrmann , Nicolas Massin

We consider the boundary crossing problem for time-homogeneous diffusions and general curvilinear boundaries. Bounds are derived for the approximation error of the one-sided (upper) boundary crossing probability when replacing the original…

Probability · Mathematics 2007-08-28 A. N. Downes , K. Borovkov

Web crawling is the problem of keeping a cache of webpages fresh, i.e., having the most recent copy available when a page is requested. This problem is usually coupled with the natural restriction that the bandwidth available to the web…

Machine Learning · Computer Science 2019-11-26 Utkarsh Upadhyay , Robert Busa-Fekete , Wojciech Kotlowski , David Pal , Balazs Szorenyi

A novel distributed algorithm is proposed for finite-time converging to a feasible consensus solution satisfying global optimality to a certain accuracy of the distributed robust convex optimization problem (DRCO) subject to bounded…

Optimization and Control · Mathematics 2023-09-06 Xunhao Wu , Jun Fu

We study sublinear algorithms for two fundamental graph problems, MAXCUT and correlation clustering. Our focus is on constructing core-sets as well as developing streaming algorithms for these problems. Constant space algorithms are known…

Data Structures and Algorithms · Computer Science 2018-02-21 Aditya Bhaskara , Samira Daruki , Suresh Venkatasubramanian