English
Related papers

Related papers: Coupling rare event algorithms with data-based lea…

200 papers

Stochastic optimization methods such as mirror descent have wide applications due to low computational cost. Those methods have been well studied under assumption of the independent and identical distribution, and usually achieve sublinear…

Machine Learning · Computer Science 2023-09-27 Yawei Zhao

This paper introduces an algorithm for discovering implicit and delayed causal relations between events observed by a robot at arbitrary times, with the objective of improving data-efficiency and interpretability of model-based…

Machine Learning · Computer Science 2020-08-05 Junchi Liang , Abdeslam Boularias

We study a family of distributed stochastic optimization algorithms where gradients are sampled by a token traversing a network of agents in random-walk fashion. Typically, these random-walks are chosen to be Markov chains that…

Probability · Mathematics 2024-01-19 Jie Hu , Vishwaraj Doshi , Do Young Eun

This paper proposes niching importance sampling, a framework that combines concepts from reliability analysis, e.g. Markov chains, importance sampling, and relative cross entropy minimisation, with niching techniques from evolutionary…

Computation · Statistics 2026-04-09 Hugh J. Kinnear , F. A. DiazDelaO

Stochastic gradient methods are the workhorse (algorithms) of large-scale optimization problems in machine learning, signal processing, and other computational sciences and engineering. This paper studies Markov chain gradient descent, a…

Optimization and Control · Mathematics 2018-09-13 Tao Sun , Yuejiao Sun , Wotao Yin

Continuous-time Markov chains are used to model stochastic systems where transitions can occur at irregular times, e.g., birth-death processes, chemical reaction networks, population dynamics, and gene regulatory networks. We develop a…

Machine Learning · Statistics 2022-12-13 Majerle Reeves , Harish S. Bhat

Interactive reinforcement learning has shown promise in learning complex robotic tasks. However, the process can be human-intensive due to the requirement of a large amount of interactive feedback. This paper presents a new method that uses…

Robotics · Computer Science 2023-08-08 Shukai Liu , Chenming Wu , Ying Li , Liangjun Zhang

Many machine learning models, such as logistic regression~(LR) and support vector machine~(SVM), can be formulated as composite optimization problems. Recently, many distributed stochastic optimization~(DSO) methods have been proposed to…

Machine Learning · Statistics 2016-12-13 Shen-Yi Zhao , Ru Xiang , Ying-Hao Shi , Peng Gao , Wu-Jun Li

In domains such as biomedical, expert insights are crucial for selecting the most informative modalities for artificial intelligence (AI) methodologies. However, using all available modalities poses challenges, particularly in determining…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Payal Kamboj , Ayan Banerjee , Sandeep K. S. Gupta

Learning in games provides a powerful framework to design control policies for self-interested agents that may be coupled through their dynamics, costs, or constraints. We consider the case where the dynamics of the coupled system can be…

Systems and Control · Electrical Eng. & Systems 2024-09-18 Mostafa M. Shibl , Vijay Gupta

Differential-algebraic equations (DAEs) with state-dependent events arise in systems whose continuous dynamics are constrained by algebraic equations and interrupted by mode changes, switching logic, impacts, or state reinitializations.…

Machine Learning · Computer Science 2026-05-08 Ion Matei , Maksym Zhenirovskyy , Anthony Wong

Most single-molecule transport experiments produce large and stochastic datasets containing a wide range of behaviors, presenting both a challenge to their analysis, but also an opportunity for discovering new physical insights. Recently,…

Mesoscale and Nanoscale Physics · Physics 2021-08-19 Nathan D. Bamberger , Dylan Dyer , Keshaba N. Parida , Dominic V. McGrath , Oliver L. A. Monti

A leading goal for climate science and weather risk management is to accurately model both the physics and statistics of extreme events. These two goals are fundamentally at odds: the higher a computational model's resolution, the more…

Atmospheric and Oceanic Physics · Physics 2024-02-06 Justin Finkel , Paul A. O'Gorman

Many networks used in machine learning and as models of biological neural networks make use of stochastic neurons or neuron-like units. We show that stochastic artificial neurons can be realized on silicon chips by exploiting the…

Neural and Evolutionary Computing · Computer Science 2015-12-10 Hesham Mostafa , Giacomo Indiveri

We present an efficient finite difference method for the computation of parameter sensitivities that is applicable to a wide class of continuous time Markov chain models. The estimator for the method is constructed by coupling the perturbed…

Numerical Analysis · Mathematics 2012-05-14 David F. Anderson

Studying extreme events and how they evolve in a changing climate is one of the most important current scientific challenges. Starting from complex climate models, a key difficulty is to be able to run long enough simulations in order to…

Atmospheric and Oceanic Physics · Physics 2017-12-27 Francesco Ragone , Jeroen Wouters , Freddy Bouchet

The ability to detect and classify rare occurrences in images has important applications - for example, counting rare and endangered species when studying biodiversity, or detecting infrequent traffic scenarios that pose a danger to…

Computer Vision and Pattern Recognition · Computer Science 2019-05-15 Sara Beery , Yang Liu , Dan Morris , Jim Piavis , Ashish Kapoor , Markus Meister , Neel Joshi , Pietro Perona

Markov Chain Monte Carlo (MCMC) algorithms are often used for approximate inference inside learning, but their slow mixing can be difficult to diagnose and the approximations can seriously degrade learning. To alleviate these issues, we…

Machine Learning · Computer Science 2015-02-25 Jacob Steinhardt , Percy Liang

We study the problem of learning the transition matrices of a set of Markov chains from a single stream of observations on each chain. We assume that the Markov chains are ergodic but otherwise unknown. The learner can sample Markov chains…

Machine Learning · Computer Science 2019-11-14 Mohammad Sadegh Talebi , Odalric-Ambrym Maillard

We can directly sample from the conditional distribution of any log-affine model. The algorithm is a Markov chain on a bounded integer lattice, and its transition probability is the ratio of the UMVUE (uniformly minimum variance unbiased…

Statistics Theory · Mathematics 2025-11-26 Shuhei Mano