English
Related papers

Related papers: Randomized sliding window algorithms for regular l…

200 papers

Stochastic optimization problems often involve data distributions that change in reaction to the decision variables. This is the case for example when members of the population respond to a deployed classifier by manipulating their features…

Optimization and Control · Mathematics 2020-12-15 Dmitriy Drusvyatskiy , Lin Xiao

We present a comparative study of several algorithms for an in-plane random walk with a variable step. The goal is to check the efficiency of the algorithm in the case where the random walk terminates at some boundary. We recently found…

Statistical Mechanics · Physics 2019-04-17 Olga Klimenkova , Anton Yu. Menshutin , Lev N. Shchur

In this paper, we develop efficient randomized algorithms for estimating probabilistic robustness margin and constructing robustness degradation curve for uncertain dynamic systems. One remarkable feature of these algorithms is their…

Optimization and Control · Mathematics 2008-05-13 Xinjia Chen , Kemin Zhou , Jorge L. Aravena

Despite some empirical success at correcting exposure bias in machine translation, scheduled sampling algorithms suffer from a major drawback: they incorrectly assume that words in the reference translations and in sampled sequences are…

Computation and Language · Computer Science 2019-05-07 Weijia Xu , Xing Niu , Marine Carpuat

Choosing the optimization algorithm that performs best on a given machine learning problem is often delicate, and there is no guarantee that current state-of-the-art algorithms will perform well across all tasks. Consequently, the more…

Optimization and Control · Mathematics 2024-06-25 Måns Williamson , Monika Eisenmann , Tony Stillfjord

The correctness of most randomized distributed algorithms is expressed by a statement of the form ``some predicate of the executions holds with high probability, regardless of the order in which actions are scheduled''. In this paper, we…

Combinatorics · Mathematics 2008-11-23 Isaac Saias

Traditional SLAM algorithms are typically based on artificial features, which lack high-level information. By introducing semantic information, SLAM can own higher stability and robustness rather than purely hand-crafted features. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Xianwei Meng , Bonian Li

The Lov\'{a}sz Local Lemma (LLL) is a keystone principle in probability theory, guaranteeing the existence of configurations which avoid a collection $\mathcal B$ of "bad" events which are mostly independent and have low probability. In its…

Data Structures and Algorithms · Computer Science 2023-10-13 David G. Harris

The conventional rounding error analysis provides worst-case bounds with an associated failure probability and ignores the statistical property of the rounding errors. In this paper, we develop a new statistical rounding error analysis for…

Numerical Analysis · Mathematics 2025-11-04 Yiming Fang , Li Chen

Randomness supports many critical functions in the field of machine learning (ML) including optimisation, data selection, privacy, and security. ML systems outsource the task of generating or harvesting randomness to the compiler, the cloud…

Machine Learning · Computer Science 2024-02-13 Pranav Dahiya , Ilia Shumailov , Ross Anderson

Many machine learning algorithms minimize a regularized risk, and stochastic optimization is widely used for this task. When working with massive data, it is desirable to perform stochastic optimization in parallel. Unfortunately, many…

Machine Learning · Statistics 2023-11-27 Shin Matsushima , Hyokun Yun , Xinhua Zhang , S. V. N. Vishwanathan

We use the martingale-theoretic approach of game-theoretic probability to incorporate imprecision into the study of randomness. In particular, we define several notions of randomness associated with interval, rather than precise,…

Probability · Mathematics 2021-06-24 Gert de Cooman , Jasper De Bock

During recent years the interest of optimization and machine learning communities in high-probability convergence of stochastic optimization methods has been growing. One of the main reasons for this is that high-probability complexity…

In this paper, we introduce a family of sequential decision-making problems, collectively termed the Keychain Problem, that involve exploring a set of actions to maximize expected payoff when only a subset of actions are available in each…

Computer Science and Game Theory · Computer Science 2026-02-13 Ramiro N. Deo-Campo Vuong , Robert Kleinberg , Aditya Prasad , Eric Xiao , Haifeng Xu

We show that a very simple randomised algorithm for numerical integration can produce a near optimal rate of convergence for integrals of functions in the $d$-dimensional weighted Korobov space. This algorithm uses a lattice rule with a…

Numerical Analysis · Mathematics 2023-04-21 Frances Y. Kuo , Dirk Nuyens , Laurence Wilkes

We introduce the concept of an \ff-maximal error-detecting block code, for some parameter \ff{} between 0 and 1, in order to formalize the situation where a block code is close to maximal with respect to being error-detecting. Our…

Information Theory · Computer Science 2016-08-01 Stavros Konstantinidis , Nelma Moreira , Rogerio Reis

This paper revisits the well known single machine scheduling problem to minimize total weighted completion times. The twist is that job sizes are stochastic from unknown distributions, and the scheduler has access to only a single sample…

Data Structures and Algorithms · Computer Science 2023-08-23 Puck te Rietmole , Marc Uetz

We analyze two classical algorithms for solving additively composite convex optimization problems where the objective is the sum of a smooth term and a nonsmooth regularizer: proximal stochastic gradient method for a single regularizer; and…

Optimization and Control · Mathematics 2026-02-06 Kevin Kurian Thomas Vaidyan , Michael P. Friedlander , Ahmet Alacaoglu

In this work we focus on the problem of finding the heaviest-k and lightest-k hitters in a sliding window data stream. The most recent research endeavours have yielded an epsilon-approximate algorithm with update operations in constant time…

Data Structures and Algorithms · Computer Science 2011-03-02 Remous-Aris Koutsiamanis , Pavlos S. Efraimidis

Continuous prompt search offers a computationally efficient alternative to conventional parameter tuning in natural language processing tasks. Nevertheless, its practical effectiveness can be significantly hindered by the black-box nature…

Computation and Language · Computer Science 2026-03-17 Yu Cai , Canxi Huang , Xiaoyu He