English
Related papers

Related papers: Diversity of Sharp Restart

200 papers

Sharpness is an almost generic assumption in continuous optimization that bounds the distance from minima by objective function suboptimality. It facilitates the acceleration of first-order methods through restarts. However, sharpness…

Optimization and Control · Mathematics 2024-07-24 Ben Adcock , Matthew J. Colbrook , Maksym Neyra-Nesterenko

We study how the Shannon entropy of sequences produced by an information source converges to the source's entropy rate. We synthesize several phenomenological approaches to applying information theoretic measures of randomness and memory to…

Statistical Mechanics · Physics 2007-05-23 James P. Crutchfield , David P. Feldman

We study how stochastic resetting affects first-passage processes in systems of many interacting particles. While resetting is well understood for single-particle dynamics, its consequences for collective behavior remain less clear. We…

Statistical Mechanics · Physics 2026-04-28 Juhee Lee , Seong-Gyu Yang , Ludvig Lizana

Randomized controlled trials are susceptible to imbalance on covariates predictive of the outcome. Rerandomization and deterministic treatment assignment are two proposed solutions. This paper explores the relationship between…

Methodology · Statistics 2023-10-03 Connor T. Jerzak , Rebecca Goldstein

Rerandomization is a modern experimental design technique that repeatedly randomizes treatment assignments until covariates are deemed balanced between treatment groups. This enhances the precision and coherence of causal effect estimators,…

Methodology · Statistics 2025-12-08 Antônio Carlos Herling Ribeiro Junior , Zach Branson

Many tasks are subject to failure before completion. Two of the most common failure recovery strategies are restart and checkpointing. Under restart, once a failure occurs, it is restarted from the beginning. Under checkpointing, the task…

Probability · Mathematics 2018-05-15 Antonio Sodre

Stochastic resetting, a diffusive process whose amplitude is "reset" to the origin at random times, is a vividly studied strategy to optimize encounter dynamics, e.g., in chemical reactions. We here generalize the resetting step by…

Statistical Mechanics · Physics 2021-05-26 M. Dahlenburg , A. V. Chechkin , R. Schumer , R. Metzler

We propose a universal framework to compute record age statistics of a stochastic time-series that undergoes random restarts. The proposed framework makes minimal assumptions on the underlying process and is furthermore suited to treat…

Statistical Mechanics · Physics 2023-04-28 Aanjaneya Kumar , Arnab Pal

A device-independent randomness expansion protocol aims to take an initial random string and generate a longer one, where the security of the protocol does not rely on knowing the inner workings of the devices used to run it. In order to do…

Quantum Physics · Physics 2026-01-06 Rutvij Bhavsar , Sammy Ragy , Roger Colbeck

We study group fairness in the context of feedback loops induced by meritocratic selection into programs that themselves confer additional advantage, like college admissions. We introduce a stylized, yet novel inter-generational model for…

Computers and Society · Computer Science 2026-05-27 Gaurab Pokharel , Diptangshu Sen , Sanmay Das , Juba Ziani

Several theoretical frameworks have been proposed to explain observed biodiversity patterns, ranging from the classical niche-based theories, mainly employing a continuous formalism, to neutral theories, based on statistical mechanics of…

Quantitative Methods · Quantitative Biology 2019-11-01 Xue Feng , Sara Bonetti , Amilcare Porporato

Entropy measures have become increasingly popular as an evaluation metric for complexity in the analysis of time series data, especially in physiology and medicine. Entropy measures the rate of information gain, or degree of regularity in a…

Methodology · Statistics 2015-12-03 Chee Chun Gan , Gerard Learmonth

By driving models to converge to flat minima, sharpness-aware learning algorithms (such as SAM) have shown the power to achieve state-of-the-art performances. However, these algorithms will generally incur one extra forward-backward…

Machine Learning · Computer Science 2023-04-11 Yang Zhao , Hao Zhang , Xiuyuan Hu

In covariate-adaptive or response-adaptive randomization, the treatment assignment and outcome can be correlated. Under this situation, re-randomization tests are a straightforward and attractive method to provide valid statistical…

Methodology · Statistics 2023-03-14 Yilong Zhang , Yujie Zhao , Yiwen Luo

Extropy, a complementary dual of entropy, (proposed by Lad et al. \cite{lad2015extropy} in 2015) has attracted considerable interest from the research community. In this study, we focus on discrete random variables and define conditional…

Information Theory · Computer Science 2025-07-16 Naveen Kumar , Vivek Vijay

The authors present evidence for universality in numerical computations with random data. Given a (possibly stochastic) numerical algorithm with random input data, the time (or number of iterations) to convergence (within a given tolerance)…

Numerical Analysis · Mathematics 2015-06-22 Percy Deift , Govind Menon , Sheehan Olver , Thomas Trogdon

Motivated by applications in telecommunications, computer scienceand physics, we consider a discrete-time Markov process withrestart. At each step the process eitherwith a positive probability restarts from a given distribution, orwith the…

Performance · Computer Science 2017-03-13 Konstantin Avrachenkov , Alexey Piunovskiy , Yi Zhang

The cost of stochastic resetting is considered within the context of a discrete random walk model. In addition to standard stochastic resetting, for which a reset occurs with a certain probability after \emph{each} step, we introduce a…

Statistical Mechanics · Physics 2024-10-30 Deepak Gupta , Bart Cleuren

The research described herewith is to re-visit the classical doubly robust estimation of average treatment effect by conducting a systematic study on the comparisons, in the sense of asymptotic efficiency, among all possible combinations of…

Statistics Theory · Mathematics 2020-06-01 Keli Guo , Chuyun Ye , Jun Fan , Lixing Zhu

Multi-user diversity is considered when the number of users in the system is random. The complete monotonicity of the error rate as a function of the (deterministic) number of users is established and it is proved that randomization of the…

Information Theory · Computer Science 2012-01-24 Adarsh B. Narasimhamurthy , Cihan Tepedelenlioglu , Yuan Zhang