English
Related papers

Related papers: Coupling rare event algorithms with data-based lea…

200 papers

Data-carving methods perform selective inference by conditioning the distribution of data on the observed selection event. However, existing data-carving approaches typically require an analytically tractable characterization of the…

Methodology · Statistics 2025-06-03 Sifan Liu , Snigdha Panigrahi

In many sequential decision-making problems we may want to manage risk by minimizing some measure of variability in rewards in addition to maximizing a standard criterion. Variance related risk measures are among the most common…

Machine Learning · Computer Science 2015-03-19 Prashanth L. A. , Mohammad Ghavamzadeh

We study weak convergence of empirical processes of dependent data $(X_i)_{i\geq0}$, indexed by classes of functions. Our results are especially suitable for data arising from dynamical systems and Markov chains, where the central limit…

Probability · Mathematics 2014-07-07 Herold Dehling , Olivier Durieu , Marco Tusche

Dynamic adaptation has become an essential technique in accelerating distributed machine learning (ML) training. Recent studies have shown that dynamically adjusting model structure (e.g., lottery ticket hypothesis) or hyperparameters…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-04 Pengfei Zheng , Rui Pan , Tarannum Khan , Shivaram Venkataraman , Aditya Akella

This study introduces a novel approach for learning mixtures of Markov chains, a critical process applicable to various fields, including healthcare and the analysis of web users. Existing research has identified a clear divide in…

Machine Learning · Computer Science 2024-05-27 Fabian Spaeh , Konstantinos Sotiropoulos , Charalampos E. Tsourakakis

Spiking neural networks (SNNs), central to computational neuroscience and neuromorphic machine learning (ML), require efficient simulation and gradient-based training. While AI accelerators offer promising speedups, gradient-based SNNs…

Neural and Evolutionary Computing · Computer Science 2025-12-08 Lennart P. L. Landsmeer , Amirreza Movahedin , Said Hamdioui , Christos Strydis

Accurate and efficient estimation of rare events probabilities is of significant importance, since often the occurrences of such events have widespread impacts. The focus in this work is on precisely quantifying these probabilities, often…

Computation · Statistics 2019-09-11 Hamed Nikbakht , Konstantinos G. Papakonstantinou

We develop rare-event simulation methodology for the analysis of loss events in a many-server loss system under quality-driven regime, focusing on the steady-state loss probability (i.e. fraction of lost customers over arrivals) and the…

Probability · Mathematics 2012-01-18 Jose Blanchet , Henry Lam

Mass violence, almost no matter how defined, is (thankfully) rare. Rare events are very difficult to study in a systematic manner. Standard statistical procedures can fail badly and usefully accurate forecasts of rare events often are…

Applications · Statistics 2019-03-05 Richard A. Berk , Susan B. Sorenson

Dynamical systems with high intrinsic dimensionality are often characterized by extreme events having the form of rare transitions several standard deviations away from the mean. For such systems, order-reduction methods through projection…

Chaotic Dynamics · Physics 2018-07-04 Zhong Yi Wan , Pantelis R. Vlachas , Petros Koumoutsakos , Themistoklis P. Sapsis

As data-driven methods are deployed in real-world settings, the processes that generate the observed data will often react to the decisions of the learner. For example, a data source may have some incentive for the algorithm to provide a…

Machine Learning · Computer Science 2023-04-26 Roy Dong , Heling Zhang , Lillian J. Ratliff

Flow Matching (FM) policies have emerged as an efficient backbone for robotic control, offering fast and expressive action generation that underpins recent large-scale embodied AI systems. However, FM policies trained via imitation learning…

Robotics · Computer Science 2026-04-14 Xiaotian Qiu , Lukai Chen , Jinhao Li , Qi Sun , Cheng Zhuo , Guohao Dai

In distributed optimization problems, a technique called gradient coding, which involves replicating data points, has been used to mitigate the effect of straggling machines. Recent work has studied approximate gradient coding, which…

Machine Learning · Statistics 2021-08-09 Margalit Glasgow , Mary Wootters

We propose a novel method to directly learn a stochastic transition operator whose repeated application provides generated samples. Traditional undirected graphical models approach this problem indirectly by learning a Markov chain model…

Machine Learning · Statistics 2017-11-08 Anirudh Goyal , Nan Rosemary Ke , Surya Ganguli , Yoshua Bengio

Event-driven molecular dynamics is a valuable tool in condensed and soft matter physics when particles can be modeled as hard objects or more generally if their interaction potential can be modeled in a stepwise fashion. Hard spheres model…

Computational Physics · Physics 2015-05-19 Cristiano De Michele

Suppose an online platform wants to compare a treatment and control policy, e.g., two different matching algorithms in a ridesharing system, or two different inventory management algorithms in an online retail site. Standard randomized…

Methodology · Statistics 2022-12-27 Peter Glynn , Ramesh Johari , Mohammad Rasouli

Incorporating novelties into deep learning systems remains a challenging problem. Introducing new information to a machine learning system can interfere with previously stored data and potentially alter the global model paradigm, especially…

Machine Learning · Computer Science 2024-12-09 Alessandro Londei , Matteo Benati , Denise Lanzieri , Vittorio Loreto

The time to converge to the steady state of a finite Markov chain can be greatly reduced by a lifting operation, which creates a new Markov chain on an expanded state space. For a class of quadratic objectives, we show an analogous behavior…

Machine Learning · Statistics 2017-03-14 Guilherme França , José Bento

In this paper we study the effect of stochastic errors on two constrained incremental sub-gradient algorithms. We view the incremental sub-gradient algorithms as decentralized network optimization algorithms as applied to minimize a sum of…

Optimization and Control · Mathematics 2008-06-09 S Sundhar Ram , A Nedich , V. V. Veeravalli

Autoregressive models use chain rule to define a joint probability distribution as a product of conditionals. These conditionals need to be normalized, imposing constraints on the functional families that can be used. To increase…

Machine Learning · Computer Science 2020-10-27 Chenlin Meng , Lantao Yu , Yang Song , Jiaming Song , Stefano Ermon